2026-04-16 06:23:15.155164 | Job console starting 2026-04-16 06:23:15.169982 | Updating git repos 2026-04-16 06:23:15.230611 | Cloning repos into workspace 2026-04-16 06:23:44.797627 | Restoring repo states 2026-04-16 06:23:45.394140 | Merging changes 2026-04-16 06:23:47.910321 | Checking out repos 2026-04-16 06:23:55.704529 | Preparing playbooks 2026-04-16 06:25:51.174348 | Running Ansible setup 2026-04-16 06:25:54.619332 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-16 06:25:55.252330 | 2026-04-16 06:25:55.252468 | PLAY [localhost] 2026-04-16 06:25:55.260608 | 2026-04-16 06:25:55.260701 | TASK [Gathering Facts] 2026-04-16 06:25:57.398148 | localhost | ok 2026-04-16 06:25:57.409799 | 2026-04-16 06:25:57.409896 | TASK [Setup log path fact] 2026-04-16 06:25:57.426890 | localhost | ok 2026-04-16 06:25:57.442373 | 2026-04-16 06:25:57.442472 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-16 06:25:57.470676 | localhost | ok 2026-04-16 06:25:57.476727 | 2026-04-16 06:25:57.476794 | TASK [emit-job-header : Print job information] 2026-04-16 06:25:57.519242 | # Job Information 2026-04-16 06:25:57.519462 | Ansible Version: 2.16.16 2026-04-16 06:25:57.519505 | Job: atmosphere-molecule-aio-ovn 2026-04-16 06:25:57.519536 | Pipeline: check 2026-04-16 06:25:57.519564 | Executor: 0a8996d2b663 2026-04-16 06:25:57.519591 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3838 2026-04-16 06:25:57.519624 | Event ID: a55ebd60-395c-11f1-9553-b6e2be3189ba 2026-04-16 06:25:57.523688 | 2026-04-16 06:25:57.523783 | LOOP [emit-job-header : Print node information] 2026-04-16 06:25:57.629013 | localhost | ok: 2026-04-16 06:25:57.629313 | localhost | # Node Information 2026-04-16 06:25:57.629373 | localhost | Inventory Hostname: instance 2026-04-16 06:25:57.629432 | localhost | Hostname: np0000166624 2026-04-16 06:25:57.629503 | localhost | Username: zuul 2026-04-16 06:25:57.629568 | localhost | Distro: Ubuntu 22.04 2026-04-16 06:25:57.629615 | localhost | Provider: yul1 2026-04-16 06:25:57.629657 | localhost | Region: ca-ymq-1 2026-04-16 06:25:57.629699 | localhost | Label: ubuntu-jammy-16 2026-04-16 06:25:57.629741 | localhost | Product Name: OpenStack Nova 2026-04-16 06:25:57.629781 | localhost | Interface IP: 199.204.45.205 2026-04-16 06:25:57.644491 | 2026-04-16 06:25:57.644697 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-16 06:25:58.034861 | localhost -> localhost | changed 2026-04-16 06:25:58.043301 | 2026-04-16 06:25:58.043405 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-16 06:25:58.910162 | localhost -> localhost | changed 2026-04-16 06:25:58.918403 | 2026-04-16 06:25:58.918479 | PLAY [all] 2026-04-16 06:25:58.928174 | 2026-04-16 06:25:58.928248 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-16 06:25:59.179982 | instance -> localhost | ok 2026-04-16 06:25:59.191761 | 2026-04-16 06:25:59.191859 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-16 06:25:59.225934 | instance | ok 2026-04-16 06:25:59.243025 | instance | included: /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-16 06:25:59.248868 | 2026-04-16 06:25:59.248932 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-16 06:26:01.693034 | instance -> localhost | Generating public/private rsa key pair. 2026-04-16 06:26:01.693294 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/7fc62a7811be4a82aaa56d425cb58e63_id_rsa 2026-04-16 06:26:01.693331 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/7fc62a7811be4a82aaa56d425cb58e63_id_rsa.pub 2026-04-16 06:26:01.693360 | instance -> localhost | The key fingerprint is: 2026-04-16 06:26:01.693387 | instance -> localhost | SHA256:OOO2dS15J6DZLkjkijBksfnBOtK2eu3c9/ov/flGCkU zuul-build-sshkey 2026-04-16 06:26:01.693435 | instance -> localhost | The key's randomart image is: 2026-04-16 06:26:01.693463 | instance -> localhost | +---[RSA 3072]----+ 2026-04-16 06:26:01.693495 | instance -> localhost | | | 2026-04-16 06:26:01.693525 | instance -> localhost | | . E | 2026-04-16 06:26:01.693551 | instance -> localhost | | = . | 2026-04-16 06:26:01.693576 | instance -> localhost | | = o .. . | 2026-04-16 06:26:01.693600 | instance -> localhost | |o.o .o+ S . . | 2026-04-16 06:26:01.693624 | instance -> localhost | |+oo. .oo + +. .| 2026-04-16 06:26:01.693648 | instance -> localhost | |.+.+ oo.+ =.+..o | 2026-04-16 06:26:01.693672 | instance -> localhost | | +.oo.ooo.o.o...| 2026-04-16 06:26:01.693700 | instance -> localhost | |.o .o o..=+o..oo.| 2026-04-16 06:26:01.693725 | instance -> localhost | +----[SHA256]-----+ 2026-04-16 06:26:01.693787 | instance -> localhost | ok: Runtime: 0:00:02.030684 2026-04-16 06:26:01.700939 | 2026-04-16 06:26:01.701043 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-16 06:26:01.737905 | instance | ok 2026-04-16 06:26:01.747036 | instance | included: /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-16 06:26:01.754871 | 2026-04-16 06:26:01.754942 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-16 06:26:01.780230 | instance | skipping: Conditional result was False 2026-04-16 06:26:01.790946 | 2026-04-16 06:26:01.791111 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-16 06:26:02.386824 | instance | changed 2026-04-16 06:26:02.400819 | 2026-04-16 06:26:02.400897 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-16 06:26:02.600773 | instance | ok 2026-04-16 06:26:02.606592 | 2026-04-16 06:26:02.606660 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-16 06:26:03.079220 | instance | changed 2026-04-16 06:26:03.086128 | 2026-04-16 06:26:03.086216 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-16 06:26:03.598600 | instance | changed 2026-04-16 06:26:03.606085 | 2026-04-16 06:26:03.606183 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-16 06:26:03.631246 | instance | skipping: Conditional result was False 2026-04-16 06:26:03.639827 | 2026-04-16 06:26:03.639907 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-16 06:26:04.073659 | instance -> localhost | changed 2026-04-16 06:26:04.131521 | 2026-04-16 06:26:04.131680 | TASK [add-build-sshkey : Add back temp key] 2026-04-16 06:26:04.449667 | instance -> localhost | Identity added: /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/7fc62a7811be4a82aaa56d425cb58e63_id_rsa (zuul-build-sshkey) 2026-04-16 06:26:04.449951 | instance -> localhost | ok: Runtime: 0:00:00.015107 2026-04-16 06:26:04.457360 | 2026-04-16 06:26:04.457423 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-16 06:26:04.734859 | instance | ok 2026-04-16 06:26:04.741477 | 2026-04-16 06:26:04.741569 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-16 06:26:04.766909 | instance | skipping: Conditional result was False 2026-04-16 06:26:04.783462 | 2026-04-16 06:26:04.783526 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-16 06:26:05.066335 | instance | ok 2026-04-16 06:26:05.072011 | 2026-04-16 06:26:05.072074 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-16 06:26:07.131516 | instance | Output suppressed because no_log was given 2026-04-16 06:26:07.144060 | 2026-04-16 06:26:07.144208 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-16 06:26:07.345162 | instance | ok: "logs" 2026-04-16 06:26:07.345423 | instance | ok: All items complete 2026-04-16 06:26:07.345453 | 2026-04-16 06:26:07.508237 | instance | ok: "artifacts" 2026-04-16 06:26:07.672846 | instance | ok: "docs" 2026-04-16 06:26:07.686841 | 2026-04-16 06:26:07.687044 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-16 06:26:07.874652 | instance | changed: "logs" 2026-04-16 06:26:08.034323 | instance | changed: "artifacts" 2026-04-16 06:26:08.185048 | instance | changed: "docs" 2026-04-16 06:26:08.201186 | 2026-04-16 06:26:08.201309 | PLAY RECAP 2026-04-16 06:26:08.201365 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-16 06:26:08.201395 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-16 06:26:08.201418 | 2026-04-16 06:26:08.365319 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-16 06:26:08.378786 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-16 06:26:09.017428 | 2026-04-16 06:26:09.017570 | PLAY [all] 2026-04-16 06:26:09.029857 | 2026-04-16 06:26:09.029944 | TASK [setup-uv : Extract archive] 2026-04-16 06:26:11.308013 | instance | changed 2026-04-16 06:26:11.314135 | 2026-04-16 06:26:11.314221 | TASK [setup-uv : Print version] 2026-04-16 06:26:11.664528 | instance | uv 0.8.13 2026-04-16 06:26:11.854967 | instance | ok: Runtime: 0:00:00.015579 2026-04-16 06:26:11.861513 | 2026-04-16 06:26:11.861561 | PLAY RECAP 2026-04-16 06:26:11.861609 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-16 06:26:11.861633 | 2026-04-16 06:26:11.979406 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-16 06:26:11.990389 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-16 06:26:12.575139 | 2026-04-16 06:26:12.575261 | PLAY [all] 2026-04-16 06:26:12.586611 | 2026-04-16 06:26:12.586688 | TASK [Install "jq" for log collection] 2026-04-16 06:34:21.707214 | instance | changed 2026-04-16 06:34:21.709199 | 2026-04-16 06:34:21.709261 | PLAY RECAP 2026-04-16 06:34:21.709314 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-16 06:34:21.709364 | 2026-04-16 06:34:21.827051 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-16 06:34:21.837597 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-16 06:34:22.454516 | 2026-04-16 06:34:22.454744 | PLAY [all] 2026-04-16 06:34:22.469223 | 2026-04-16 06:34:22.469413 | TASK [Copy inventory file for Zuul] 2026-04-16 06:34:23.315910 | instance | changed 2026-04-16 06:34:23.321151 | 2026-04-16 06:34:23.321228 | TASK [Switch "ansible_host" to private IP] 2026-04-16 06:34:23.645383 | instance | changed: 1 replacements made 2026-04-16 06:34:23.650844 | 2026-04-16 06:34:23.650912 | TASK [Run Molecule scenario] 2026-04-16 06:34:24.037013 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-16 06:34:24.037180 | instance | Creating virtual environment at: .venv 2026-04-16 06:34:24.061814 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-16 06:34:24.084296 | instance | Downloading rjsonnet (1.2MiB) 2026-04-16 06:34:24.084934 | instance | Downloading netaddr (2.2MiB) 2026-04-16 06:34:24.085108 | instance | Downloading pydantic-core (2.0MiB) 2026-04-16 06:34:24.085647 | instance | Downloading pygments (1.2MiB) 2026-04-16 06:34:24.087133 | instance | Downloading kubernetes (1.9MiB) 2026-04-16 06:34:24.087463 | instance | Downloading setuptools (1.1MiB) 2026-04-16 06:34:24.089951 | instance | Downloading ansible-core (2.1MiB) 2026-04-16 06:34:24.090151 | instance | Downloading cryptography (4.2MiB) 2026-04-16 06:34:24.090587 | instance | Downloading openstacksdk (1.7MiB) 2026-04-16 06:34:24.393939 | instance | Building pyperclip==1.9.0 2026-04-16 06:34:24.394322 | instance | Downloading rjsonnet 2026-04-16 06:34:24.496599 | instance | Downloading pydantic-core 2026-04-16 06:34:24.543946 | instance | Downloading netaddr 2026-04-16 06:34:24.560172 | instance | Downloading pygments 2026-04-16 06:34:24.570369 | instance | Downloading cryptography 2026-04-16 06:34:24.605511 | instance | Downloading setuptools 2026-04-16 06:34:24.666386 | instance | Downloading kubernetes 2026-04-16 06:34:24.701737 | instance | Downloading ansible-core 2026-04-16 06:34:24.740789 | instance | Downloading openstacksdk 2026-04-16 06:34:25.115144 | instance | Built pyperclip==1.9.0 2026-04-16 06:34:25.258111 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-16 06:34:25.301247 | instance | Installed 83 packages in 41ms 2026-04-16 06:34:25.915889 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-16 06:34:26.499235 | instance | INFO [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-16 06:34:26.499379 | instance | INFO [aio > prerun] Performing prerun with role_name_check=0... 2026-04-16 06:35:11.675503 | instance | INFO [aio > dependency] Executing 2026-04-16 06:35:11.675821 | instance | WARNING [aio > dependency] Missing roles requirements file: requirements.yml 2026-04-16 06:35:11.676064 | instance | WARNING [aio > dependency] Missing collections requirements file: collections.yml 2026-04-16 06:35:11.676214 | instance | WARNING [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-16 06:35:11.684036 | instance | INFO [aio > cleanup] Executing 2026-04-16 06:35:11.684409 | instance | WARNING [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-16 06:35:11.692839 | instance | INFO [aio > destroy] Executing 2026-04-16 06:35:11.692995 | instance | WARNING [aio > destroy] Skipping, '--destroy=never' requested. 2026-04-16 06:35:11.693136 | instance | INFO [aio > destroy] Executed: Successful 2026-04-16 06:35:11.703481 | instance | INFO [aio > syntax] Executing 2026-04-16 06:35:14.637196 | instance | 2026-04-16 06:35:14.637677 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-16 06:35:14.772440 | instance | INFO [aio > syntax] Executed: Successful 2026-04-16 06:35:14.785475 | instance | INFO [aio > create] Executing 2026-04-16 06:35:14.792378 | instance | WARNING [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-16 06:35:14.801311 | instance | INFO [aio > prepare] Executing 2026-04-16 06:35:15.616044 | instance | 2026-04-16 06:35:15.616457 | instance | PLAY [Prepare] ***************************************************************** 2026-04-16 06:35:15.616873 | instance | 2026-04-16 06:35:15.617222 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:35:15.617559 | instance | Thursday 16 April 2026 06:35:15 +0000 (0:00:00.025) 0:00:00.025 ******** 2026-04-16 06:35:16.736945 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-16 06:35:16.737245 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-16 06:35:16.737464 | instance | interpreter could change the meaning of that path. See 2026-04-16 06:35:16.737676 | instance | https://docs.ansible.com/ansible- 2026-04-16 06:35:16.737888 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-16 06:35:16.746345 | instance | ok: [instance] 2026-04-16 06:35:16.746560 | instance | 2026-04-16 06:35:16.746773 | instance | TASK [Configure short hostname] ************************************************ 2026-04-16 06:35:16.746981 | instance | Thursday 16 April 2026 06:35:16 +0000 (0:00:01.130) 0:00:01.156 ******** 2026-04-16 06:35:17.431478 | instance | changed: [instance] 2026-04-16 06:35:17.431943 | instance | 2026-04-16 06:35:17.432315 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-16 06:35:17.432666 | instance | Thursday 16 April 2026 06:35:17 +0000 (0:00:00.684) 0:00:01.840 ******** 2026-04-16 06:35:17.673065 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-16 06:35:17.673487 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-16 06:35:17.673876 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-16 06:35:17.680574 | instance | changed: [instance] 2026-04-16 06:35:17.680869 | instance | 2026-04-16 06:35:17.681160 | instance | TASK [Install "dirmngr" for GPG keyserver operations] ************************** 2026-04-16 06:35:17.681444 | instance | Thursday 16 April 2026 06:35:17 +0000 (0:00:00.249) 0:00:02.090 ******** 2026-04-16 06:35:18.708243 | instance | ok: [instance] 2026-04-16 06:35:18.708485 | instance | 2026-04-16 06:35:18.708691 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-16 06:35:18.708893 | instance | Thursday 16 April 2026 06:35:18 +0000 (0:00:01.027) 0:00:03.117 ******** 2026-04-16 06:35:19.347145 | instance | ok: [instance] 2026-04-16 06:35:19.347558 | instance | 2026-04-16 06:35:19.347906 | instance | PLAY [Generate workspace for Atmosphere] *************************************** 2026-04-16 06:35:19.348224 | instance | 2026-04-16 06:35:19.348554 | instance | TASK [Create folders for workspace] ******************************************** 2026-04-16 06:35:19.348881 | instance | Thursday 16 April 2026 06:35:19 +0000 (0:00:00.638) 0:00:03.756 ******** 2026-04-16 06:35:20.359002 | instance | changed: [localhost] => (item=group_vars) 2026-04-16 06:35:20.359094 | instance | changed: [localhost] => (item=group_vars/all) 2026-04-16 06:35:20.359102 | instance | changed: [localhost] => (item=group_vars/controllers) 2026-04-16 06:35:20.359107 | instance | changed: [localhost] => (item=group_vars/cephs) 2026-04-16 06:35:20.359112 | instance | changed: [localhost] => (item=group_vars/computes) 2026-04-16 06:35:20.359117 | instance | changed: [localhost] => (item=host_vars) 2026-04-16 06:35:20.359122 | instance | 2026-04-16 06:35:20.359127 | instance | PLAY [Generate Ceph control plane configuration for workspace] ***************** 2026-04-16 06:35:20.359133 | instance | 2026-04-16 06:35:20.359143 | instance | TASK [Ensure the Ceph control plane configuration file exists] ***************** 2026-04-16 06:35:20.359414 | instance | Thursday 16 April 2026 06:35:20 +0000 (0:00:01.009) 0:00:04.765 ******** 2026-04-16 06:35:20.536835 | instance | changed: [localhost] 2026-04-16 06:35:20.537099 | instance | 2026-04-16 06:35:20.537412 | instance | TASK [Load the current Ceph control plane configuration into a variable] ******* 2026-04-16 06:35:20.537714 | instance | Thursday 16 April 2026 06:35:20 +0000 (0:00:00.179) 0:00:04.945 ******** 2026-04-16 06:35:20.563955 | instance | ok: [localhost] 2026-04-16 06:35:20.564237 | instance | 2026-04-16 06:35:20.564549 | instance | TASK [Generate Ceph control plane values for missing variables] **************** 2026-04-16 06:35:20.564831 | instance | Thursday 16 April 2026 06:35:20 +0000 (0:00:00.026) 0:00:04.972 ******** 2026-04-16 06:35:20.613842 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': 'e75d8469-fa56-548d-aaa0-ac4b92869698'}) 2026-04-16 06:35:20.614125 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'}) 2026-04-16 06:35:20.614381 | instance | 2026-04-16 06:35:20.614739 | instance | TASK [Write new Ceph control plane configuration file to disk] ***************** 2026-04-16 06:35:20.615104 | instance | Thursday 16 April 2026 06:35:20 +0000 (0:00:00.051) 0:00:05.023 ******** 2026-04-16 06:35:21.184439 | instance | changed: [localhost] 2026-04-16 06:35:21.184740 | instance | 2026-04-16 06:35:21.185094 | instance | PLAY [Generate Ceph OSD configuration for workspace] *************************** 2026-04-16 06:35:21.185383 | instance | 2026-04-16 06:35:21.185684 | instance | TASK [Ensure the Ceph OSDs configuration file exists] ************************** 2026-04-16 06:35:21.186023 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.569) 0:00:05.593 ******** 2026-04-16 06:35:21.362861 | instance | changed: [localhost] 2026-04-16 06:35:21.363177 | instance | 2026-04-16 06:35:21.363600 | instance | TASK [Load the current Ceph OSDs configuration into a variable] **************** 2026-04-16 06:35:21.363905 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.178) 0:00:05.771 ******** 2026-04-16 06:35:21.390086 | instance | ok: [localhost] 2026-04-16 06:35:21.390346 | instance | 2026-04-16 06:35:21.390627 | instance | TASK [Generate Ceph OSDs values for missing variables] ************************* 2026-04-16 06:35:21.390903 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.027) 0:00:05.799 ******** 2026-04-16 06:35:21.423004 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']}) 2026-04-16 06:35:21.423176 | instance | 2026-04-16 06:35:21.423351 | instance | TASK [Write new Ceph OSDs configuration file to disk] ************************** 2026-04-16 06:35:21.423591 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.032) 0:00:05.831 ******** 2026-04-16 06:35:21.767553 | instance | changed: [localhost] 2026-04-16 06:35:21.767840 | instance | 2026-04-16 06:35:21.768161 | instance | PLAY [Generate Kubernetes configuration for workspace] ************************* 2026-04-16 06:35:21.768449 | instance | 2026-04-16 06:35:21.768758 | instance | TASK [Ensure the Kubernetes configuration file exists] ************************* 2026-04-16 06:35:21.769115 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.344) 0:00:06.176 ******** 2026-04-16 06:35:21.944810 | instance | changed: [localhost] 2026-04-16 06:35:21.944904 | instance | 2026-04-16 06:35:21.945029 | instance | TASK [Load the current Kubernetes configuration into a variable] *************** 2026-04-16 06:35:21.945153 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.177) 0:00:06.354 ******** 2026-04-16 06:35:21.972728 | instance | ok: [localhost] 2026-04-16 06:35:21.973008 | instance | 2026-04-16 06:35:21.973311 | instance | TASK [Generate Kubernetes values for missing variables] ************************ 2026-04-16 06:35:21.973603 | instance | Thursday 16 April 2026 06:35:21 +0000 (0:00:00.027) 0:00:06.382 ******** 2026-04-16 06:35:22.019450 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'}) 2026-04-16 06:35:22.019719 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42}) 2026-04-16 06:35:22.020004 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'}) 2026-04-16 06:35:22.020251 | instance | 2026-04-16 06:35:22.020524 | instance | TASK [Write new Kubernetes configuration file to disk] ************************* 2026-04-16 06:35:22.020787 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.046) 0:00:06.428 ******** 2026-04-16 06:35:22.379514 | instance | changed: [localhost] 2026-04-16 06:35:22.379758 | instance | 2026-04-16 06:35:22.380038 | instance | PLAY [Generate Keepalived configuration for workspace] ************************* 2026-04-16 06:35:22.380287 | instance | 2026-04-16 06:35:22.380558 | instance | TASK [Ensure the Keeaplived configuration file exists] ************************* 2026-04-16 06:35:22.380826 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.360) 0:00:06.788 ******** 2026-04-16 06:35:22.553675 | instance | changed: [localhost] 2026-04-16 06:35:22.553826 | instance | 2026-04-16 06:35:22.554012 | instance | TASK [Load the current Keepalived configuration into a variable] *************** 2026-04-16 06:35:22.554200 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.174) 0:00:06.963 ******** 2026-04-16 06:35:22.577336 | instance | ok: [localhost] 2026-04-16 06:35:22.577445 | instance | 2026-04-16 06:35:22.577620 | instance | TASK [Generate Keepalived values for missing variables] ************************ 2026-04-16 06:35:22.577800 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.023) 0:00:06.986 ******** 2026-04-16 06:35:22.617370 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'}) 2026-04-16 06:35:22.617521 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'}) 2026-04-16 06:35:22.617692 | instance | 2026-04-16 06:35:22.617844 | instance | TASK [Write new Keepalived configuration file to disk] ************************* 2026-04-16 06:35:22.618016 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.039) 0:00:07.026 ******** 2026-04-16 06:35:22.969621 | instance | changed: [localhost] 2026-04-16 06:35:22.969868 | instance | 2026-04-16 06:35:22.970155 | instance | PLAY [Generate endpoints for workspace] **************************************** 2026-04-16 06:35:22.970416 | instance | 2026-04-16 06:35:22.970685 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:35:22.970975 | instance | Thursday 16 April 2026 06:35:22 +0000 (0:00:00.352) 0:00:07.378 ******** 2026-04-16 06:35:23.672148 | instance | ok: [localhost] 2026-04-16 06:35:23.672400 | instance | 2026-04-16 06:35:23.672794 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-16 06:35:23.673191 | instance | Thursday 16 April 2026 06:35:23 +0000 (0:00:00.702) 0:00:08.081 ******** 2026-04-16 06:35:23.879876 | instance | changed: [localhost] 2026-04-16 06:35:23.880127 | instance | 2026-04-16 06:35:23.880411 | instance | TASK [Load the current endpoints into a variable] ****************************** 2026-04-16 06:35:23.880699 | instance | Thursday 16 April 2026 06:35:23 +0000 (0:00:00.207) 0:00:08.288 ******** 2026-04-16 06:35:23.911937 | instance | ok: [localhost] 2026-04-16 06:35:23.912281 | instance | 2026-04-16 06:35:23.912611 | instance | TASK [Generate endpoint skeleton for missing variables] ************************ 2026-04-16 06:35:23.912892 | instance | Thursday 16 April 2026 06:35:23 +0000 (0:00:00.032) 0:00:08.321 ******** 2026-04-16 06:35:24.736227 | instance | ok: [localhost] => (item=keycloak_host) 2026-04-16 06:35:24.736502 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host) 2026-04-16 06:35:24.736838 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host) 2026-04-16 06:35:24.737103 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host) 2026-04-16 06:35:24.737372 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name) 2026-04-16 06:35:24.737651 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host) 2026-04-16 06:35:24.737918 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host) 2026-04-16 06:35:24.738186 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host) 2026-04-16 06:35:24.738456 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host) 2026-04-16 06:35:24.738730 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host) 2026-04-16 06:35:24.738996 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host) 2026-04-16 06:35:24.739342 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host) 2026-04-16 06:35:24.739612 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host) 2026-04-16 06:35:24.739885 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host) 2026-04-16 06:35:24.740150 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host) 2026-04-16 06:35:24.740422 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host) 2026-04-16 06:35:24.740731 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host) 2026-04-16 06:35:24.740994 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host) 2026-04-16 06:35:24.741260 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host) 2026-04-16 06:35:24.741545 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host) 2026-04-16 06:35:24.741818 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host) 2026-04-16 06:35:24.742077 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host) 2026-04-16 06:35:24.742338 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host) 2026-04-16 06:35:24.742592 | instance | 2026-04-16 06:35:24.742868 | instance | TASK [Write new endpoints file to disk] **************************************** 2026-04-16 06:35:24.743176 | instance | Thursday 16 April 2026 06:35:24 +0000 (0:00:00.824) 0:00:09.145 ******** 2026-04-16 06:35:25.079475 | instance | changed: [localhost] 2026-04-16 06:35:25.079723 | instance | 2026-04-16 06:35:25.080001 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-16 06:35:25.080281 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.343) 0:00:09.488 ******** 2026-04-16 06:35:25.271977 | instance | changed: [localhost] 2026-04-16 06:35:25.272236 | instance | 2026-04-16 06:35:25.272522 | instance | PLAY [Generate Neutron configuration for workspace] **************************** 2026-04-16 06:35:25.272782 | instance | 2026-04-16 06:35:25.273063 | instance | TASK [Ensure the Neutron configuration file exists] **************************** 2026-04-16 06:35:25.273524 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.192) 0:00:09.680 ******** 2026-04-16 06:35:25.458774 | instance | changed: [localhost] 2026-04-16 06:35:25.459008 | instance | 2026-04-16 06:35:25.459319 | instance | TASK [Load the current Neutron configuration into a variable] ****************** 2026-04-16 06:35:25.459614 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.186) 0:00:09.867 ******** 2026-04-16 06:35:25.489874 | instance | ok: [localhost] 2026-04-16 06:35:25.490116 | instance | 2026-04-16 06:35:25.490390 | instance | TASK [Generate Neutron values for missing variables] *************************** 2026-04-16 06:35:25.490663 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.031) 0:00:09.899 ******** 2026-04-16 06:35:25.532135 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]}) 2026-04-16 06:35:25.532377 | instance | 2026-04-16 06:35:25.532663 | instance | TASK [Write new Neutron configuration file to disk] **************************** 2026-04-16 06:35:25.532932 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.041) 0:00:09.941 ******** 2026-04-16 06:35:25.898100 | instance | changed: [localhost] 2026-04-16 06:35:25.898343 | instance | 2026-04-16 06:35:25.898625 | instance | PLAY [Generate Nova configuration for workspace] ******************************* 2026-04-16 06:35:25.898871 | instance | 2026-04-16 06:35:25.899177 | instance | TASK [Ensure the Nova configuration file exists] ******************************* 2026-04-16 06:35:25.899450 | instance | Thursday 16 April 2026 06:35:25 +0000 (0:00:00.365) 0:00:10.306 ******** 2026-04-16 06:35:26.076073 | instance | changed: [localhost] 2026-04-16 06:35:26.076263 | instance | 2026-04-16 06:35:26.076540 | instance | TASK [Load the current Nova configuration into a variable] ********************* 2026-04-16 06:35:26.076812 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.178) 0:00:10.485 ******** 2026-04-16 06:35:26.108520 | instance | ok: [localhost] 2026-04-16 06:35:26.108681 | instance | 2026-04-16 06:35:26.108979 | instance | TASK [Generate Nova values for missing variables] ****************************** 2026-04-16 06:35:26.109250 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.032) 0:00:10.517 ******** 2026-04-16 06:35:26.152243 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]}) 2026-04-16 06:35:26.152472 | instance | 2026-04-16 06:35:26.152761 | instance | TASK [Write new Nova configuration file to disk] ******************************* 2026-04-16 06:35:26.153123 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.043) 0:00:10.561 ******** 2026-04-16 06:35:26.510727 | instance | changed: [localhost] 2026-04-16 06:35:26.510919 | instance | 2026-04-16 06:35:26.511249 | instance | PLAY [Generate secrets for workspace] ****************************************** 2026-04-16 06:35:26.511642 | instance | 2026-04-16 06:35:26.511998 | instance | TASK [Ensure the secrets file exists] ****************************************** 2026-04-16 06:35:26.512366 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.357) 0:00:10.919 ******** 2026-04-16 06:35:26.685315 | instance | changed: [localhost] 2026-04-16 06:35:26.685486 | instance | 2026-04-16 06:35:26.685757 | instance | TASK [Load the current secrets into a variable] ******************************** 2026-04-16 06:35:26.686018 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.175) 0:00:11.094 ******** 2026-04-16 06:35:26.711701 | instance | ok: [localhost] 2026-04-16 06:35:26.711874 | instance | 2026-04-16 06:35:26.712209 | instance | TASK [Generate secrets for missing variables] ********************************** 2026-04-16 06:35:26.712468 | instance | Thursday 16 April 2026 06:35:26 +0000 (0:00:00.026) 0:00:11.121 ******** 2026-04-16 06:35:27.136895 | instance | ok: [localhost] => (item=heat_auth_encryption_key) 2026-04-16 06:35:27.137147 | instance | ok: [localhost] => (item=keepalived_password) 2026-04-16 06:35:27.137459 | instance | ok: [localhost] => (item=keycloak_admin_password) 2026-04-16 06:35:27.137723 | instance | ok: [localhost] => (item=keycloak_database_password) 2026-04-16 06:35:27.138003 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret) 2026-04-16 06:35:27.138265 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase) 2026-04-16 06:35:27.138608 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password) 2026-04-16 06:35:27.138821 | instance | ok: [localhost] => (item=octavia_heartbeat_key) 2026-04-16 06:35:27.139168 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password) 2026-04-16 06:35:27.139437 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key) 2026-04-16 06:35:27.139705 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password) 2026-04-16 06:35:27.139968 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password) 2026-04-16 06:35:27.140235 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password) 2026-04-16 06:35:27.140752 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password) 2026-04-16 06:35:27.141084 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password) 2026-04-16 06:35:27.141385 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password) 2026-04-16 06:35:27.141651 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password) 2026-04-16 06:35:27.141921 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password) 2026-04-16 06:35:27.142195 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password) 2026-04-16 06:35:27.142459 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password) 2026-04-16 06:35:27.142750 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password) 2026-04-16 06:35:27.143020 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password) 2026-04-16 06:35:27.143331 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password) 2026-04-16 06:35:27.143592 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password) 2026-04-16 06:35:27.143859 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password) 2026-04-16 06:35:27.144169 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password) 2026-04-16 06:35:27.144443 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret) 2026-04-16 06:35:27.144753 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password) 2026-04-16 06:35:27.145059 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password) 2026-04-16 06:35:27.145369 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password) 2026-04-16 06:35:27.145694 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password) 2026-04-16 06:35:27.145966 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password) 2026-04-16 06:35:27.146234 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password) 2026-04-16 06:35:27.146361 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password) 2026-04-16 06:35:27.146503 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password) 2026-04-16 06:35:27.146623 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password) 2026-04-16 06:35:27.146755 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password) 2026-04-16 06:35:27.146876 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password) 2026-04-16 06:35:27.147017 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password) 2026-04-16 06:35:27.147161 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password) 2026-04-16 06:35:27.147281 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password) 2026-04-16 06:35:27.147403 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password) 2026-04-16 06:35:27.147534 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password) 2026-04-16 06:35:27.147681 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password) 2026-04-16 06:35:27.147804 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password) 2026-04-16 06:35:27.147926 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password) 2026-04-16 06:35:27.148048 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password) 2026-04-16 06:35:27.148174 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password) 2026-04-16 06:35:27.148300 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password) 2026-04-16 06:35:27.148430 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password) 2026-04-16 06:35:27.148558 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password) 2026-04-16 06:35:27.148685 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password) 2026-04-16 06:35:27.148811 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password) 2026-04-16 06:35:27.148944 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password) 2026-04-16 06:35:27.149061 | instance | 2026-04-16 06:35:27.149188 | instance | TASK [Generate base64 encoded secrets] ***************************************** 2026-04-16 06:35:27.149323 | instance | Thursday 16 April 2026 06:35:27 +0000 (0:00:00.424) 0:00:11.545 ******** 2026-04-16 06:35:27.194482 | instance | ok: [localhost] => (item=barbican_kek) 2026-04-16 06:35:27.194680 | instance | 2026-04-16 06:35:27.194962 | instance | TASK [Generate temporary files for generating keys for missing variables] ****** 2026-04-16 06:35:27.195263 | instance | Thursday 16 April 2026 06:35:27 +0000 (0:00:00.057) 0:00:11.603 ******** 2026-04-16 06:35:27.598161 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-16 06:35:27.598381 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-16 06:35:27.598634 | instance | 2026-04-16 06:35:27.598970 | instance | TASK [Generate SSH keys for missing variables] ********************************* 2026-04-16 06:35:27.599309 | instance | Thursday 16 April 2026 06:35:27 +0000 (0:00:00.403) 0:00:12.006 ******** 2026-04-16 06:35:31.883481 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-16 06:35:31.883929 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-16 06:35:31.884292 | instance | 2026-04-16 06:35:31.884665 | instance | TASK [Set values for SSH keys] ************************************************* 2026-04-16 06:35:31.885032 | instance | Thursday 16 April 2026 06:35:31 +0000 (0:00:04.285) 0:00:16.292 ******** 2026-04-16 06:35:31.936268 | instance | ok: [localhost] => (item=manila_ssh_key) 2026-04-16 06:35:31.936604 | instance | ok: [localhost] => (item=nova_ssh_key) 2026-04-16 06:35:31.936826 | instance | 2026-04-16 06:35:31.937057 | instance | TASK [Delete the temporary files generated for SSH keys] *********************** 2026-04-16 06:35:31.937319 | instance | Thursday 16 April 2026 06:35:31 +0000 (0:00:00.052) 0:00:16.344 ******** 2026-04-16 06:35:32.308051 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-16 06:35:32.308486 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-16 06:35:32.308819 | instance | 2026-04-16 06:35:32.309160 | instance | TASK [Write new secrets file to disk] ****************************************** 2026-04-16 06:35:32.309498 | instance | Thursday 16 April 2026 06:35:32 +0000 (0:00:00.370) 0:00:16.715 ******** 2026-04-16 06:35:32.679875 | instance | changed: [localhost] 2026-04-16 06:35:32.680190 | instance | 2026-04-16 06:35:32.680490 | instance | TASK [Encrypt secrets file with Vault password] ******************************** 2026-04-16 06:35:32.680786 | instance | Thursday 16 April 2026 06:35:32 +0000 (0:00:00.373) 0:00:17.089 ******** 2026-04-16 06:35:32.718701 | instance | skipping: [localhost] 2026-04-16 06:35:32.718884 | instance | 2026-04-16 06:35:32.719042 | instance | PLAY [Setup networking] ******************************************************** 2026-04-16 06:35:32.719217 | instance | 2026-04-16 06:35:32.719385 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:35:32.719540 | instance | Thursday 16 April 2026 06:35:32 +0000 (0:00:00.037) 0:00:17.126 ******** 2026-04-16 06:35:33.429136 | instance | ok: [instance] 2026-04-16 06:35:33.429165 | instance | 2026-04-16 06:35:33.429170 | instance | TASK [Create bridge for management network] ************************************ 2026-04-16 06:35:33.429175 | instance | Thursday 16 April 2026 06:35:33 +0000 (0:00:00.712) 0:00:17.838 ******** 2026-04-16 06:35:33.791214 | instance | ok: [instance] 2026-04-16 06:35:33.791287 | instance | 2026-04-16 06:35:33.791481 | instance | TASK [Create fake interface for management bridge] ***************************** 2026-04-16 06:35:33.791657 | instance | Thursday 16 April 2026 06:35:33 +0000 (0:00:00.362) 0:00:18.200 ******** 2026-04-16 06:35:34.009511 | instance | ok: [instance] 2026-04-16 06:35:34.009791 | instance | 2026-04-16 06:35:34.010101 | instance | TASK [Assign dummy interface to management bridge] ***************************** 2026-04-16 06:35:34.010391 | instance | Thursday 16 April 2026 06:35:34 +0000 (0:00:00.218) 0:00:18.418 ******** 2026-04-16 06:35:34.212269 | instance | ok: [instance] 2026-04-16 06:35:34.212471 | instance | 2026-04-16 06:35:34.212760 | instance | TASK [Assign IP address for management bridge] ********************************* 2026-04-16 06:35:34.213106 | instance | Thursday 16 April 2026 06:35:34 +0000 (0:00:00.202) 0:00:18.621 ******** 2026-04-16 06:35:34.401344 | instance | ok: [instance] 2026-04-16 06:35:34.401717 | instance | 2026-04-16 06:35:34.402033 | instance | TASK [Bring up interfaces] ***************************************************** 2026-04-16 06:35:34.402382 | instance | Thursday 16 April 2026 06:35:34 +0000 (0:00:00.188) 0:00:18.810 ******** 2026-04-16 06:35:34.776487 | instance | ok: [instance] => (item=br-mgmt) 2026-04-16 06:35:34.776927 | instance | ok: [instance] => (item=dummy0) 2026-04-16 06:35:34.777286 | instance | 2026-04-16 06:35:34.777642 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-16 06:35:34.777968 | instance | 2026-04-16 06:35:34.778417 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:35:34.778848 | instance | Thursday 16 April 2026 06:35:34 +0000 (0:00:00.374) 0:00:19.185 ******** 2026-04-16 06:35:35.515141 | instance | ok: [instance] 2026-04-16 06:35:35.515343 | instance | 2026-04-16 06:35:35.515510 | instance | TASK [Install depedencies] ***************************************************** 2026-04-16 06:35:35.515668 | instance | Thursday 16 April 2026 06:35:35 +0000 (0:00:00.737) 0:00:19.923 ******** 2026-04-16 06:36:15.092889 | instance | changed: [instance] 2026-04-16 06:36:15.092943 | instance | 2026-04-16 06:36:15.092954 | instance | TASK [Start up service] ******************************************************** 2026-04-16 06:36:15.092964 | instance | Thursday 16 April 2026 06:36:15 +0000 (0:00:39.577) 0:00:59.501 ******** 2026-04-16 06:36:15.658100 | instance | ok: [instance] 2026-04-16 06:36:15.658169 | instance | 2026-04-16 06:36:15.658185 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-16 06:36:15.658200 | instance | Thursday 16 April 2026 06:36:15 +0000 (0:00:00.564) 0:01:00.065 ******** 2026-04-16 06:36:15.897540 | instance | ok: [instance] 2026-04-16 06:36:15.898000 | instance | 2026-04-16 06:36:15.898384 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-16 06:36:15.898742 | instance | Thursday 16 April 2026 06:36:15 +0000 (0:00:00.240) 0:01:00.306 ******** 2026-04-16 06:36:16.374522 | instance | changed: [instance] 2026-04-16 06:36:16.374924 | instance | 2026-04-16 06:36:16.375342 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-16 06:36:16.375781 | instance | Thursday 16 April 2026 06:36:16 +0000 (0:00:00.476) 0:01:00.783 ******** 2026-04-16 06:36:16.571778 | instance | ok: [instance] 2026-04-16 06:36:16.572143 | instance | 2026-04-16 06:36:16.572491 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-16 06:36:16.572831 | instance | Thursday 16 April 2026 06:36:16 +0000 (0:00:00.197) 0:01:00.981 ******** 2026-04-16 06:36:16.598712 | instance | skipping: [instance] 2026-04-16 06:36:16.599085 | instance | 2026-04-16 06:36:16.599524 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-16 06:36:16.599864 | instance | Thursday 16 April 2026 06:36:16 +0000 (0:00:00.027) 0:01:01.008 ******** 2026-04-16 06:36:17.135014 | instance | changed: [instance] => (item=osd0) 2026-04-16 06:36:17.135564 | instance | changed: [instance] => (item=osd1) 2026-04-16 06:36:17.136005 | instance | changed: [instance] => (item=osd2) 2026-04-16 06:36:17.136431 | instance | 2026-04-16 06:36:17.136874 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-16 06:36:17.137228 | instance | Thursday 16 April 2026 06:36:17 +0000 (0:00:00.535) 0:01:01.544 ******** 2026-04-16 06:36:17.656436 | instance | changed: [instance] => (item=osd0) 2026-04-16 06:36:17.656843 | instance | changed: [instance] => (item=osd1) 2026-04-16 06:36:17.657192 | instance | changed: [instance] => (item=osd2) 2026-04-16 06:36:17.657529 | instance | 2026-04-16 06:36:17.657959 | instance | TASK [Start loop devices] ****************************************************** 2026-04-16 06:36:17.658314 | instance | Thursday 16 April 2026 06:36:17 +0000 (0:00:00.521) 0:01:02.065 ******** 2026-04-16 06:36:18.395956 | instance | changed: [instance] => (item=osd0) 2026-04-16 06:36:18.396347 | instance | changed: [instance] => (item=osd1) 2026-04-16 06:36:18.396740 | instance | changed: [instance] => (item=osd2) 2026-04-16 06:36:18.397059 | instance | 2026-04-16 06:36:18.397393 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-16 06:36:18.397719 | instance | Thursday 16 April 2026 06:36:18 +0000 (0:00:00.739) 0:01:02.805 ******** 2026-04-16 06:36:21.523889 | instance | changed: [instance] => (item=osd0) 2026-04-16 06:36:21.524508 | instance | changed: [instance] => (item=osd1) 2026-04-16 06:36:21.524851 | instance | changed: [instance] => (item=osd2) 2026-04-16 06:36:21.525171 | instance | 2026-04-16 06:36:21.525509 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-16 06:36:21.525845 | instance | Thursday 16 April 2026 06:36:21 +0000 (0:00:03.126) 0:01:05.931 ******** 2026-04-16 06:36:23.387736 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-16 06:36:23.387937 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-16 06:36:23.388090 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-16 06:36:23.388232 | instance | 2026-04-16 06:36:23.388383 | instance | PLAY [controllers] ************************************************************* 2026-04-16 06:36:23.388522 | instance | 2026-04-16 06:36:23.388669 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:36:23.388852 | instance | Thursday 16 April 2026 06:36:23 +0000 (0:00:01.864) 0:01:07.796 ******** 2026-04-16 06:36:24.295153 | instance | ok: [instance] 2026-04-16 06:36:24.295337 | instance | 2026-04-16 06:36:24.295489 | instance | TASK [Set masquerade rule] ***************************************************** 2026-04-16 06:36:24.295639 | instance | Thursday 16 April 2026 06:36:24 +0000 (0:00:00.906) 0:01:08.702 ******** 2026-04-16 06:36:24.747152 | instance | changed: [instance] 2026-04-16 06:36:24.747215 | instance | 2026-04-16 06:36:24.747224 | instance | PLAY RECAP ********************************************************************* 2026-04-16 06:36:24.747232 | instance | instance : ok=24 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-16 06:36:24.747239 | instance | localhost : ok=40 changed=21 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-16 06:36:24.747245 | instance | 2026-04-16 06:36:24.747251 | instance | Thursday 16 April 2026 06:36:24 +0000 (0:00:00.451) 0:01:09.154 ******** 2026-04-16 06:36:24.747265 | instance | =============================================================================== 2026-04-16 06:36:24.752317 | instance | Install depedencies ---------------------------------------------------- 39.58s 2026-04-16 06:36:24.752372 | instance | Generate SSH keys for missing variables --------------------------------- 4.29s 2026-04-16 06:36:24.752377 | instance | Create a volume group for each loop device ------------------------------ 3.13s 2026-04-16 06:36:24.752381 | instance | Create a logical volume for each loop device ---------------------------- 1.86s 2026-04-16 06:36:24.752386 | instance | Gathering Facts --------------------------------------------------------- 1.13s 2026-04-16 06:36:24.752389 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.03s 2026-04-16 06:36:24.752394 | instance | Create folders for workspace -------------------------------------------- 1.01s 2026-04-16 06:36:24.752398 | instance | Gathering Facts --------------------------------------------------------- 0.91s 2026-04-16 06:36:24.752402 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.82s 2026-04-16 06:36:24.752406 | instance | Start loop devices ------------------------------------------------------ 0.74s 2026-04-16 06:36:24.752410 | instance | Gathering Facts --------------------------------------------------------- 0.74s 2026-04-16 06:36:24.752414 | instance | Gathering Facts --------------------------------------------------------- 0.71s 2026-04-16 06:36:24.752417 | instance | Gathering Facts --------------------------------------------------------- 0.70s 2026-04-16 06:36:24.752421 | instance | Configure short hostname ------------------------------------------------ 0.68s 2026-04-16 06:36:24.752425 | instance | Purge "snapd" package --------------------------------------------------- 0.64s 2026-04-16 06:36:24.752429 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.57s 2026-04-16 06:36:24.752433 | instance | Start up service -------------------------------------------------------- 0.56s 2026-04-16 06:36:24.752437 | instance | Create devices for Ceph ------------------------------------------------- 0.54s 2026-04-16 06:36:24.752440 | instance | Set permissions on loopback devices ------------------------------------- 0.52s 2026-04-16 06:36:24.752444 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.48s 2026-04-16 06:36:24.828279 | instance | INFO [aio > prepare] Executed: Successful 2026-04-16 06:36:24.840441 | instance | INFO [aio > converge] Executing 2026-04-16 06:36:27.689714 | instance | 2026-04-16 06:36:27.690188 | instance | PLAY [all] ********************************************************************* 2026-04-16 06:36:27.690559 | instance | 2026-04-16 06:36:27.690895 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:36:27.691267 | instance | Thursday 16 April 2026 06:36:27 +0000 (0:00:00.016) 0:00:00.016 ******** 2026-04-16 06:36:28.912937 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-16 06:36:28.913217 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-16 06:36:28.913447 | instance | interpreter could change the meaning of that path. See 2026-04-16 06:36:28.913669 | instance | https://docs.ansible.com/ansible- 2026-04-16 06:36:28.913890 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-16 06:36:28.923323 | instance | ok: [instance] 2026-04-16 06:36:28.923417 | instance | 2026-04-16 06:36:28.923539 | instance | TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-04-16 06:36:28.923656 | instance | Thursday 16 April 2026 06:36:28 +0000 (0:00:01.233) 0:00:01.250 ******** 2026-04-16 06:36:28.961206 | instance | skipping: [instance] 2026-04-16 06:36:28.961312 | instance | 2026-04-16 06:36:28.961412 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-16 06:36:28.961535 | instance | Thursday 16 April 2026 06:36:28 +0000 (0:00:00.038) 0:00:01.289 ******** 2026-04-16 06:36:29.142513 | instance | ok: [instance] 2026-04-16 06:36:29.143256 | instance | 2026-04-16 06:36:29.143276 | instance | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-16 06:36:29.143283 | instance | 2026-04-16 06:36:29.143290 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:36:29.143333 | instance | Thursday 16 April 2026 06:36:29 +0000 (0:00:00.181) 0:00:01.470 ******** 2026-04-16 06:36:30.026586 | instance | ok: [instance] 2026-04-16 06:36:30.026718 | instance | 2026-04-16 06:36:30.026970 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:36:30.027286 | instance | Thursday 16 April 2026 06:36:30 +0000 (0:00:00.883) 0:00:02.353 ******** 2026-04-16 06:36:30.319120 | instance | ok: [instance] 2026-04-16 06:36:30.319199 | instance | 2026-04-16 06:36:30.319512 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:36:30.319555 | instance | Thursday 16 April 2026 06:36:30 +0000 (0:00:00.292) 0:00:02.646 ******** 2026-04-16 06:36:30.368417 | instance | skipping: [instance] 2026-04-16 06:36:30.368498 | instance | 2026-04-16 06:36:30.368771 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-16 06:36:30.368815 | instance | Thursday 16 April 2026 06:36:30 +0000 (0:00:00.049) 0:00:02.695 ******** 2026-04-16 06:36:30.669860 | instance | changed: [instance] 2026-04-16 06:36:30.669935 | instance | 2026-04-16 06:36:30.670175 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:36:30.670209 | instance | Thursday 16 April 2026 06:36:30 +0000 (0:00:00.301) 0:00:02.997 ******** 2026-04-16 06:36:30.742944 | instance | ok: [instance] => { 2026-04-16 06:36:30.743075 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-16 06:36:30.743285 | instance | } 2026-04-16 06:36:30.743430 | instance | 2026-04-16 06:36:30.743584 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:36:30.743735 | instance | Thursday 16 April 2026 06:36:30 +0000 (0:00:00.073) 0:00:03.070 ******** 2026-04-16 06:36:31.538344 | instance | changed: [instance] 2026-04-16 06:36:31.538432 | instance | 2026-04-16 06:36:31.538571 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:36:31.538753 | instance | Thursday 16 April 2026 06:36:31 +0000 (0:00:00.795) 0:00:03.865 ******** 2026-04-16 06:36:31.590245 | instance | skipping: [instance] 2026-04-16 06:36:31.590325 | instance | 2026-04-16 06:36:31.590436 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:36:31.590756 | instance | Thursday 16 April 2026 06:36:31 +0000 (0:00:00.051) 0:00:03.917 ******** 2026-04-16 06:36:31.643671 | instance | skipping: [instance] 2026-04-16 06:36:31.643772 | instance | 2026-04-16 06:36:31.643959 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:36:31.644129 | instance | Thursday 16 April 2026 06:36:31 +0000 (0:00:00.053) 0:00:03.971 ******** 2026-04-16 06:36:31.855922 | instance | ok: [instance] 2026-04-16 06:36:31.856296 | instance | 2026-04-16 06:36:31.856636 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:36:31.856968 | instance | Thursday 16 April 2026 06:36:31 +0000 (0:00:00.210) 0:00:04.182 ******** 2026-04-16 06:36:33.291635 | instance | ok: [instance] 2026-04-16 06:36:33.291707 | instance | 2026-04-16 06:36:33.291826 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:36:33.292162 | instance | Thursday 16 April 2026 06:36:33 +0000 (0:00:01.434) 0:00:05.616 ******** 2026-04-16 06:36:33.359662 | instance | ok: [instance] => { 2026-04-16 06:36:33.359812 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-16 06:36:33.360020 | instance | } 2026-04-16 06:36:33.360187 | instance | 2026-04-16 06:36:33.360409 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:36:33.360571 | instance | Thursday 16 April 2026 06:36:33 +0000 (0:00:00.066) 0:00:05.683 ******** 2026-04-16 06:36:34.136040 | instance | changed: [instance] 2026-04-16 06:36:34.136422 | instance | 2026-04-16 06:36:34.136763 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:36:34.137099 | instance | Thursday 16 April 2026 06:36:34 +0000 (0:00:00.777) 0:00:06.460 ******** 2026-04-16 06:36:38.055727 | instance | changed: [instance] 2026-04-16 06:36:38.055806 | instance | 2026-04-16 06:36:38.055897 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-16 06:36:38.056222 | instance | Thursday 16 April 2026 06:36:38 +0000 (0:00:03.919) 0:00:10.379 ******** 2026-04-16 06:36:38.095665 | instance | skipping: [instance] 2026-04-16 06:36:38.095850 | instance | 2026-04-16 06:36:38.096007 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-16 06:36:38.096160 | instance | Thursday 16 April 2026 06:36:38 +0000 (0:00:00.040) 0:00:10.420 ******** 2026-04-16 06:36:38.131617 | instance | skipping: [instance] 2026-04-16 06:36:38.131735 | instance | 2026-04-16 06:36:38.131831 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-16 06:36:38.132009 | instance | Thursday 16 April 2026 06:36:38 +0000 (0:00:00.036) 0:00:10.457 ******** 2026-04-16 06:36:38.167744 | instance | skipping: [instance] 2026-04-16 06:36:38.167995 | instance | 2026-04-16 06:36:38.168160 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-16 06:36:38.168314 | instance | Thursday 16 April 2026 06:36:38 +0000 (0:00:00.034) 0:00:10.492 ******** 2026-04-16 06:36:47.911897 | instance | changed: [instance] 2026-04-16 06:36:47.912267 | instance | 2026-04-16 06:36:47.912613 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-16 06:36:47.912940 | instance | Thursday 16 April 2026 06:36:47 +0000 (0:00:09.746) 0:00:20.239 ******** 2026-04-16 06:36:48.567859 | instance | changed: [instance] 2026-04-16 06:36:48.568287 | instance | 2026-04-16 06:36:48.568649 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-16 06:36:48.568989 | instance | Thursday 16 April 2026 06:36:48 +0000 (0:00:00.652) 0:00:20.891 ******** 2026-04-16 06:36:49.475868 | instance | changed: [instance] => (item={'path': '/etc/containerd'}) 2026-04-16 06:36:49.476461 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-16 06:36:49.476811 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-16 06:36:49.477156 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-16 06:36:49.477494 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-16 06:36:49.477799 | instance | 2026-04-16 06:36:49.478125 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-16 06:36:49.478450 | instance | Thursday 16 April 2026 06:36:49 +0000 (0:00:00.908) 0:00:21.800 ******** 2026-04-16 06:36:50.044157 | instance | changed: [instance] 2026-04-16 06:36:50.045054 | instance | 2026-04-16 06:36:50.045094 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-16 06:36:50.045101 | instance | Thursday 16 April 2026 06:36:50 +0000 (0:00:00.562) 0:00:22.363 ******** 2026-04-16 06:36:50.045105 | instance | 2026-04-16 06:36:50.045110 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-16 06:36:50.045115 | instance | Thursday 16 April 2026 06:36:50 +0000 (0:00:00.008) 0:00:22.371 ******** 2026-04-16 06:36:50.987451 | instance | ok: [instance] 2026-04-16 06:36:50.987530 | instance | 2026-04-16 06:36:50.987758 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-16 06:36:50.987809 | instance | Thursday 16 April 2026 06:36:50 +0000 (0:00:00.943) 0:00:23.315 ******** 2026-04-16 06:36:51.464488 | instance | changed: [instance] 2026-04-16 06:36:51.464623 | instance | 2026-04-16 06:36:51.464892 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-16 06:36:51.464931 | instance | Thursday 16 April 2026 06:36:51 +0000 (0:00:00.476) 0:00:23.791 ******** 2026-04-16 06:36:52.015384 | instance | changed: [instance] 2026-04-16 06:36:52.015451 | instance | 2026-04-16 06:36:52.015721 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:36:52.015758 | instance | Thursday 16 April 2026 06:36:52 +0000 (0:00:00.551) 0:00:24.342 ******** 2026-04-16 06:36:52.231078 | instance | ok: [instance] 2026-04-16 06:36:52.231139 | instance | 2026-04-16 06:36:52.231412 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:36:52.231497 | instance | Thursday 16 April 2026 06:36:52 +0000 (0:00:00.215) 0:00:24.558 ******** 2026-04-16 06:36:52.288684 | instance | ok: [instance] => { 2026-04-16 06:36:52.289305 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-16 06:36:52.289347 | instance | } 2026-04-16 06:36:52.289353 | instance | 2026-04-16 06:36:52.289358 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:36:52.289362 | instance | Thursday 16 April 2026 06:36:52 +0000 (0:00:00.057) 0:00:24.616 ******** 2026-04-16 06:36:53.085938 | instance | changed: [instance] 2026-04-16 06:36:53.085998 | instance | 2026-04-16 06:36:53.086287 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:36:53.086327 | instance | Thursday 16 April 2026 06:36:53 +0000 (0:00:00.797) 0:00:25.413 ******** 2026-04-16 06:36:57.409596 | instance | changed: [instance] 2026-04-16 06:36:57.409667 | instance | 2026-04-16 06:36:57.409942 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-16 06:36:57.409981 | instance | Thursday 16 April 2026 06:36:57 +0000 (0:00:04.323) 0:00:29.737 ******** 2026-04-16 06:36:58.361296 | instance | ok: [instance] 2026-04-16 06:36:58.361387 | instance | 2026-04-16 06:36:58.361673 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-16 06:36:58.361713 | instance | Thursday 16 April 2026 06:36:58 +0000 (0:00:00.951) 0:00:30.688 ******** 2026-04-16 06:36:58.798232 | instance | changed: [instance] 2026-04-16 06:36:58.798315 | instance | 2026-04-16 06:36:58.798696 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-16 06:36:58.798745 | instance | Thursday 16 April 2026 06:36:58 +0000 (0:00:00.436) 0:00:31.125 ******** 2026-04-16 06:36:59.283884 | instance | changed: [instance] 2026-04-16 06:36:59.283966 | instance | 2026-04-16 06:36:59.284027 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-16 06:36:59.284191 | instance | Thursday 16 April 2026 06:36:59 +0000 (0:00:00.485) 0:00:31.611 ******** 2026-04-16 06:36:59.857545 | instance | changed: [instance] => (item={'path': '/etc/docker'}) 2026-04-16 06:36:59.857612 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-16 06:36:59.858092 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-16 06:36:59.858130 | instance | 2026-04-16 06:36:59.858137 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-16 06:36:59.858142 | instance | Thursday 16 April 2026 06:36:59 +0000 (0:00:00.573) 0:00:32.184 ******** 2026-04-16 06:37:00.322659 | instance | changed: [instance] 2026-04-16 06:37:00.322740 | instance | 2026-04-16 06:37:00.323024 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-16 06:37:00.323077 | instance | Thursday 16 April 2026 06:37:00 +0000 (0:00:00.465) 0:00:32.650 ******** 2026-04-16 06:37:00.798052 | instance | changed: [instance] 2026-04-16 06:37:00.798120 | instance | 2026-04-16 06:37:00.798773 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-16 06:37:00.798813 | instance | Thursday 16 April 2026 06:37:00 +0000 (0:00:00.467) 0:00:33.117 ******** 2026-04-16 06:37:00.798819 | instance | 2026-04-16 06:37:00.798824 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-16 06:37:00.798828 | instance | Thursday 16 April 2026 06:37:00 +0000 (0:00:00.008) 0:00:33.125 ******** 2026-04-16 06:37:01.493684 | instance | ok: [instance] 2026-04-16 06:37:01.493752 | instance | 2026-04-16 06:37:01.494028 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-16 06:37:01.494111 | instance | Thursday 16 April 2026 06:37:01 +0000 (0:00:00.695) 0:00:33.821 ******** 2026-04-16 06:37:02.473397 | instance | changed: [instance] 2026-04-16 06:37:02.473487 | instance | 2026-04-16 06:37:02.473558 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-16 06:37:02.473769 | instance | Thursday 16 April 2026 06:37:02 +0000 (0:00:00.979) 0:00:34.800 ******** 2026-04-16 06:37:03.043120 | instance | changed: [instance] 2026-04-16 06:37:03.043465 | instance | 2026-04-16 06:37:03.043502 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-16 06:37:03.043508 | instance | Thursday 16 April 2026 06:37:03 +0000 (0:00:00.569) 0:00:35.370 ******** 2026-04-16 06:37:03.107309 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-16 06:37:03.107672 | instance | 2026-04-16 06:37:03.107716 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-16 06:37:03.107722 | instance | Thursday 16 April 2026 06:37:03 +0000 (0:00:00.063) 0:00:35.434 ******** 2026-04-16 06:37:08.105506 | instance | changed: [instance] 2026-04-16 06:37:08.105575 | instance | 2026-04-16 06:37:08.105966 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-16 06:37:08.106012 | instance | Thursday 16 April 2026 06:37:08 +0000 (0:00:04.998) 0:00:40.432 ******** 2026-04-16 06:37:08.776004 | instance | ok: [instance] => (item=chronyd) 2026-04-16 06:37:08.776095 | instance | ok: [instance] => (item=sshd) 2026-04-16 06:37:08.776172 | instance | 2026-04-16 06:37:08.776426 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-16 06:37:08.776458 | instance | Thursday 16 April 2026 06:37:08 +0000 (0:00:00.670) 0:00:41.103 ******** 2026-04-16 06:37:09.091600 | instance | changed: [instance] 2026-04-16 06:37:09.091662 | instance | 2026-04-16 06:37:09.091943 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-16 06:37:09.091981 | instance | Thursday 16 April 2026 06:37:09 +0000 (0:00:00.315) 0:00:41.419 ******** 2026-04-16 06:37:09.288759 | instance | ok: [instance] 2026-04-16 06:37:09.288839 | instance | 2026-04-16 06:37:09.289064 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-16 06:37:09.289102 | instance | Thursday 16 April 2026 06:37:09 +0000 (0:00:00.196) 0:00:41.616 ******** 2026-04-16 06:37:09.754667 | instance | changed: [instance] 2026-04-16 06:37:09.755037 | instance | 2026-04-16 06:37:09.755089 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-16 06:37:09.755096 | instance | Thursday 16 April 2026 06:37:09 +0000 (0:00:00.466) 0:00:42.082 ******** 2026-04-16 06:37:10.143405 | instance | changed: [instance] 2026-04-16 06:37:10.143472 | instance | 2026-04-16 06:37:10.143764 | instance | TASK [vexxhost.ceph.mon : Get `cephadm ls` status] ***************************** 2026-04-16 06:37:10.143801 | instance | Thursday 16 April 2026 06:37:10 +0000 (0:00:00.388) 0:00:42.471 ******** 2026-04-16 06:37:11.828117 | instance | ok: [instance] 2026-04-16 06:37:11.828192 | instance | 2026-04-16 06:37:11.828516 | instance | TASK [vexxhost.ceph.mon : Parse the `cephadm ls` output] *********************** 2026-04-16 06:37:11.828755 | instance | Thursday 16 April 2026 06:37:11 +0000 (0:00:01.684) 0:00:44.155 ******** 2026-04-16 06:37:11.886903 | instance | ok: [instance] 2026-04-16 06:37:11.886954 | instance | 2026-04-16 06:37:11.887258 | instance | TASK [vexxhost.ceph.mon : Assimilate existing configs in `ceph.conf`] ********** 2026-04-16 06:37:11.887293 | instance | Thursday 16 April 2026 06:37:11 +0000 (0:00:00.058) 0:00:44.214 ******** 2026-04-16 06:37:11.927648 | instance | skipping: [instance] 2026-04-16 06:37:11.927995 | instance | 2026-04-16 06:37:11.928023 | instance | TASK [vexxhost.ceph.mon : Adopt monitor to cluster] **************************** 2026-04-16 06:37:11.928029 | instance | Thursday 16 April 2026 06:37:11 +0000 (0:00:00.040) 0:00:44.255 ******** 2026-04-16 06:37:11.962569 | instance | skipping: [instance] 2026-04-16 06:37:11.962678 | instance | 2026-04-16 06:37:11.962954 | instance | TASK [vexxhost.ceph.mon : Adopt manager to cluster] **************************** 2026-04-16 06:37:11.962994 | instance | Thursday 16 April 2026 06:37:11 +0000 (0:00:00.035) 0:00:44.290 ******** 2026-04-16 06:37:12.001632 | instance | skipping: [instance] 2026-04-16 06:37:12.001738 | instance | 2026-04-16 06:37:12.002037 | instance | TASK [vexxhost.ceph.mon : Enable "cephadm" mgr module] ************************* 2026-04-16 06:37:12.002103 | instance | Thursday 16 April 2026 06:37:11 +0000 (0:00:00.038) 0:00:44.328 ******** 2026-04-16 06:37:12.047146 | instance | skipping: [instance] 2026-04-16 06:37:12.047263 | instance | 2026-04-16 06:37:12.047476 | instance | TASK [vexxhost.ceph.mon : Set orchestrator backend to "cephadm"] *************** 2026-04-16 06:37:12.047645 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.045) 0:00:44.374 ******** 2026-04-16 06:37:12.083481 | instance | skipping: [instance] 2026-04-16 06:37:12.083633 | instance | 2026-04-16 06:37:12.083847 | instance | TASK [vexxhost.ceph.mon : Use `cephadm` user for cephadm] ********************** 2026-04-16 06:37:12.084007 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.036) 0:00:44.410 ******** 2026-04-16 06:37:12.125806 | instance | skipping: [instance] 2026-04-16 06:37:12.125905 | instance | 2026-04-16 06:37:12.126032 | instance | TASK [vexxhost.ceph.mon : Generate "cephadm" key] ****************************** 2026-04-16 06:37:12.126204 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.042) 0:00:44.453 ******** 2026-04-16 06:37:12.161778 | instance | skipping: [instance] 2026-04-16 06:37:12.161920 | instance | 2026-04-16 06:37:12.162135 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-16 06:37:12.162297 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.035) 0:00:44.489 ******** 2026-04-16 06:37:12.283583 | instance | ok: [instance] 2026-04-16 06:37:12.283763 | instance | 2026-04-16 06:37:12.283918 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-16 06:37:12.284069 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.119) 0:00:44.608 ******** 2026-04-16 06:37:12.527493 | instance | ok: [instance] => (item=instance) 2026-04-16 06:37:12.527582 | instance | 2026-04-16 06:37:12.527885 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-16 06:37:12.527939 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.246) 0:00:44.854 ******** 2026-04-16 06:37:12.579932 | instance | ok: [instance] 2026-04-16 06:37:12.580023 | instance | 2026-04-16 06:37:12.580263 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-16 06:37:12.580303 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.052) 0:00:44.907 ******** 2026-04-16 06:37:12.654036 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance 2026-04-16 06:37:12.654122 | instance | 2026-04-16 06:37:12.654137 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-16 06:37:12.654297 | instance | Thursday 16 April 2026 06:37:12 +0000 (0:00:00.074) 0:00:44.981 ******** 2026-04-16 06:37:13.050202 | instance | changed: [instance] 2026-04-16 06:37:13.050278 | instance | 2026-04-16 06:37:13.050608 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-16 06:37:13.050679 | instance | Thursday 16 April 2026 06:37:13 +0000 (0:00:00.395) 0:00:45.377 ******** 2026-04-16 06:37:13.774231 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True}) 2026-04-16 06:37:13.774321 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-04-16 06:37:13.774808 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-04-16 06:37:13.774862 | instance | 2026-04-16 06:37:13.774869 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap coomand] ******************************* 2026-04-16 06:37:13.774874 | instance | Thursday 16 April 2026 06:37:13 +0000 (0:00:00.724) 0:00:46.101 ******** 2026-04-16 06:39:20.818443 | instance | ok: [instance] 2026-04-16 06:39:20.818527 | instance | 2026-04-16 06:39:20.818752 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-16 06:39:20.818793 | instance | Thursday 16 April 2026 06:39:20 +0000 (0:02:07.043) 0:02:53.145 ******** 2026-04-16 06:39:21.038719 | instance | changed: [instance] 2026-04-16 06:39:21.038798 | instance | 2026-04-16 06:39:21.039080 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-16 06:39:21.039100 | instance | Thursday 16 April 2026 06:39:21 +0000 (0:00:00.220) 0:02:53.366 ******** 2026-04-16 06:39:21.081567 | instance | ok: [instance] 2026-04-16 06:39:21.081666 | instance | 2026-04-16 06:39:21.081928 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-16 06:39:21.082091 | instance | Thursday 16 April 2026 06:39:21 +0000 (0:00:00.042) 0:02:53.409 ******** 2026-04-16 06:39:21.170959 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-16 06:39:21.171504 | instance | 2026-04-16 06:39:21.171556 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-16 06:39:21.171566 | instance | Thursday 16 April 2026 06:39:21 +0000 (0:00:00.088) 0:02:53.498 ******** 2026-04-16 06:39:22.693099 | instance | ok: [instance] 2026-04-16 06:39:22.693161 | instance | 2026-04-16 06:39:22.693431 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-16 06:39:22.693451 | instance | Thursday 16 April 2026 06:39:22 +0000 (0:00:01.522) 0:02:55.020 ******** 2026-04-16 06:39:22.751140 | instance | ok: [instance] => (item=instance) 2026-04-16 06:39:22.751211 | instance | 2026-04-16 06:39:22.751489 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-16 06:39:22.751531 | instance | Thursday 16 April 2026 06:39:22 +0000 (0:00:00.058) 0:02:55.078 ******** 2026-04-16 06:39:23.153810 | instance | ok: [instance] 2026-04-16 06:39:23.153887 | instance | 2026-04-16 06:39:23.154112 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-16 06:39:23.154153 | instance | Thursday 16 April 2026 06:39:23 +0000 (0:00:00.402) 0:02:55.481 ******** 2026-04-16 06:39:25.155355 | instance | ok: [instance] 2026-04-16 06:39:25.155459 | instance | 2026-04-16 06:39:25.155669 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-16 06:39:25.155848 | instance | Thursday 16 April 2026 06:39:25 +0000 (0:00:02.000) 0:02:57.482 ******** 2026-04-16 06:39:26.813686 | instance | ok: [instance] 2026-04-16 06:39:26.813761 | instance | 2026-04-16 06:39:26.814045 | instance | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-16 06:39:26.814085 | instance | Thursday 16 April 2026 06:39:26 +0000 (0:00:01.658) 0:02:59.141 ******** 2026-04-16 06:39:37.985187 | instance | ok: [instance] 2026-04-16 06:39:37.985286 | instance | 2026-04-16 06:39:37.985361 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-16 06:39:37.985507 | instance | Thursday 16 April 2026 06:39:37 +0000 (0:00:11.171) 0:03:10.312 ******** 2026-04-16 06:39:38.062724 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-16 06:39:38.062766 | instance | 2026-04-16 06:39:38.062771 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-16 06:39:38.062776 | instance | Thursday 16 April 2026 06:39:38 +0000 (0:00:00.077) 0:03:10.389 ******** 2026-04-16 06:39:38.120566 | instance | skipping: [instance] 2026-04-16 06:39:38.120604 | instance | 2026-04-16 06:39:38.120610 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-16 06:39:38.120615 | instance | Thursday 16 April 2026 06:39:38 +0000 (0:00:00.057) 0:03:10.447 ******** 2026-04-16 06:39:38.170558 | instance | skipping: [instance] => (item=instance) 2026-04-16 06:39:38.170591 | instance | skipping: [instance] 2026-04-16 06:39:38.170596 | instance | 2026-04-16 06:39:38.170601 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-16 06:39:38.170606 | instance | Thursday 16 April 2026 06:39:38 +0000 (0:00:00.049) 0:03:10.497 ******** 2026-04-16 06:39:38.433944 | instance | ok: [instance] 2026-04-16 06:39:38.433992 | instance | 2026-04-16 06:39:38.434000 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-16 06:39:38.434006 | instance | Thursday 16 April 2026 06:39:38 +0000 (0:00:00.263) 0:03:10.761 ******** 2026-04-16 06:39:40.395805 | instance | ok: [instance] 2026-04-16 06:39:40.395876 | instance | 2026-04-16 06:39:40.396132 | instance | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-16 06:39:40.396172 | instance | Thursday 16 April 2026 06:39:40 +0000 (0:00:01.962) 0:03:12.723 ******** 2026-04-16 06:39:41.976482 | instance | ok: [instance] 2026-04-16 06:39:41.976578 | instance | 2026-04-16 06:39:41.976824 | instance | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-16 06:39:41.976864 | instance | Thursday 16 April 2026 06:39:41 +0000 (0:00:01.580) 0:03:14.304 ******** 2026-04-16 06:39:43.561385 | instance | ok: [instance] 2026-04-16 06:39:43.561454 | instance | 2026-04-16 06:39:43.561702 | instance | TASK [vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module] *********** 2026-04-16 06:39:43.561754 | instance | Thursday 16 April 2026 06:39:43 +0000 (0:00:01.584) 0:03:15.888 ******** 2026-04-16 06:39:46.099783 | instance | ok: [instance] 2026-04-16 06:39:46.099876 | instance | 2026-04-16 06:39:46.099934 | instance | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-16 06:39:46.100073 | instance | 2026-04-16 06:39:46.100195 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:39:46.100315 | instance | Thursday 16 April 2026 06:39:46 +0000 (0:00:02.539) 0:03:18.427 ******** 2026-04-16 06:39:46.987801 | instance | ok: [instance] 2026-04-16 06:39:46.987969 | instance | 2026-04-16 06:39:46.988187 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:39:46.988400 | instance | Thursday 16 April 2026 06:39:46 +0000 (0:00:00.887) 0:03:19.315 ******** 2026-04-16 06:39:47.190859 | instance | ok: [instance] 2026-04-16 06:39:47.190921 | instance | 2026-04-16 06:39:47.191118 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:39:47.191266 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.203) 0:03:19.518 ******** 2026-04-16 06:39:47.234703 | instance | skipping: [instance] 2026-04-16 06:39:47.234828 | instance | 2026-04-16 06:39:47.235017 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-16 06:39:47.235221 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.043) 0:03:19.562 ******** 2026-04-16 06:39:47.476880 | instance | ok: [instance] 2026-04-16 06:39:47.477003 | instance | 2026-04-16 06:39:47.477165 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:39:47.477984 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.242) 0:03:19.804 ******** 2026-04-16 06:39:47.539181 | instance | ok: [instance] => { 2026-04-16 06:39:47.539277 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-16 06:39:47.539343 | instance | } 2026-04-16 06:39:47.539493 | instance | 2026-04-16 06:39:47.539607 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:39:47.539721 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.061) 0:03:19.866 ******** 2026-04-16 06:39:47.845418 | instance | ok: [instance] 2026-04-16 06:39:47.845494 | instance | 2026-04-16 06:39:47.845639 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:39:47.845738 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.305) 0:03:20.172 ******** 2026-04-16 06:39:47.900543 | instance | skipping: [instance] 2026-04-16 06:39:47.900621 | instance | 2026-04-16 06:39:47.900753 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:39:47.900846 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.055) 0:03:20.227 ******** 2026-04-16 06:39:47.949310 | instance | skipping: [instance] 2026-04-16 06:39:47.949373 | instance | 2026-04-16 06:39:47.949479 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:39:47.949663 | instance | Thursday 16 April 2026 06:39:47 +0000 (0:00:00.049) 0:03:20.276 ******** 2026-04-16 06:39:48.153384 | instance | ok: [instance] 2026-04-16 06:39:48.153470 | instance | 2026-04-16 06:39:48.153538 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:39:48.153673 | instance | Thursday 16 April 2026 06:39:48 +0000 (0:00:00.203) 0:03:20.480 ******** 2026-04-16 06:39:49.194989 | instance | ok: [instance] 2026-04-16 06:39:49.195080 | instance | 2026-04-16 06:39:49.195212 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:39:49.195332 | instance | Thursday 16 April 2026 06:39:49 +0000 (0:00:01.041) 0:03:21.522 ******** 2026-04-16 06:39:49.271420 | instance | ok: [instance] => { 2026-04-16 06:39:49.271569 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-16 06:39:49.271771 | instance | } 2026-04-16 06:39:49.271896 | instance | 2026-04-16 06:39:49.272111 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:39:49.272258 | instance | Thursday 16 April 2026 06:39:49 +0000 (0:00:00.077) 0:03:21.599 ******** 2026-04-16 06:39:49.617153 | instance | ok: [instance] 2026-04-16 06:39:49.617284 | instance | 2026-04-16 06:39:49.617466 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:39:49.617622 | instance | Thursday 16 April 2026 06:39:49 +0000 (0:00:00.345) 0:03:21.944 ******** 2026-04-16 06:39:51.574920 | instance | ok: [instance] 2026-04-16 06:39:51.575005 | instance | 2026-04-16 06:39:51.575129 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-16 06:39:51.575245 | instance | Thursday 16 April 2026 06:39:51 +0000 (0:00:01.958) 0:03:23.902 ******** 2026-04-16 06:39:51.601456 | instance | skipping: [instance] 2026-04-16 06:39:51.601566 | instance | 2026-04-16 06:39:51.601743 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-16 06:39:51.601914 | instance | Thursday 16 April 2026 06:39:51 +0000 (0:00:00.026) 0:03:23.928 ******** 2026-04-16 06:39:51.634884 | instance | skipping: [instance] 2026-04-16 06:39:51.635001 | instance | 2026-04-16 06:39:51.635194 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-16 06:39:51.635369 | instance | Thursday 16 April 2026 06:39:51 +0000 (0:00:00.033) 0:03:23.962 ******** 2026-04-16 06:39:51.665716 | instance | skipping: [instance] 2026-04-16 06:39:51.665868 | instance | 2026-04-16 06:39:51.666030 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-16 06:39:51.666214 | instance | Thursday 16 April 2026 06:39:51 +0000 (0:00:00.030) 0:03:23.993 ******** 2026-04-16 06:39:52.645893 | instance | ok: [instance] 2026-04-16 06:39:52.645959 | instance | 2026-04-16 06:39:52.646073 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-16 06:39:52.646197 | instance | Thursday 16 April 2026 06:39:52 +0000 (0:00:00.980) 0:03:24.973 ******** 2026-04-16 06:39:53.080559 | instance | ok: [instance] 2026-04-16 06:39:53.080694 | instance | 2026-04-16 06:39:53.080861 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-16 06:39:53.081035 | instance | Thursday 16 April 2026 06:39:53 +0000 (0:00:00.434) 0:03:25.408 ******** 2026-04-16 06:39:54.000227 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-16 06:39:54.000375 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-16 06:39:54.000532 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-16 06:39:54.000711 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-16 06:39:54.000898 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-16 06:39:54.001057 | instance | 2026-04-16 06:39:54.001222 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-16 06:39:54.001423 | instance | Thursday 16 April 2026 06:39:53 +0000 (0:00:00.919) 0:03:26.327 ******** 2026-04-16 06:39:54.509226 | instance | ok: [instance] 2026-04-16 06:39:54.509298 | instance | 2026-04-16 06:39:54.509426 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-16 06:39:54.509545 | instance | Thursday 16 April 2026 06:39:54 +0000 (0:00:00.501) 0:03:26.829 ******** 2026-04-16 06:39:54.509660 | instance | 2026-04-16 06:39:54.509791 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-16 06:39:54.509907 | instance | Thursday 16 April 2026 06:39:54 +0000 (0:00:00.007) 0:03:26.836 ******** 2026-04-16 06:39:54.868795 | instance | ok: [instance] 2026-04-16 06:39:54.868968 | instance | 2026-04-16 06:39:54.869092 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:39:54.869235 | instance | Thursday 16 April 2026 06:39:54 +0000 (0:00:00.359) 0:03:27.196 ******** 2026-04-16 06:39:55.069121 | instance | ok: [instance] 2026-04-16 06:39:55.069191 | instance | 2026-04-16 06:39:55.069311 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:39:55.069431 | instance | Thursday 16 April 2026 06:39:55 +0000 (0:00:00.200) 0:03:27.396 ******** 2026-04-16 06:39:55.122071 | instance | ok: [instance] => { 2026-04-16 06:39:55.122145 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-16 06:39:55.122234 | instance | } 2026-04-16 06:39:55.122398 | instance | 2026-04-16 06:39:55.122462 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:39:55.122642 | instance | Thursday 16 April 2026 06:39:55 +0000 (0:00:00.053) 0:03:27.449 ******** 2026-04-16 06:39:55.497145 | instance | ok: [instance] 2026-04-16 06:39:55.497257 | instance | 2026-04-16 06:39:55.497487 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:39:55.497631 | instance | Thursday 16 April 2026 06:39:55 +0000 (0:00:00.374) 0:03:27.824 ******** 2026-04-16 06:39:58.528402 | instance | ok: [instance] 2026-04-16 06:39:58.528509 | instance | 2026-04-16 06:39:58.528523 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-16 06:39:58.528721 | instance | Thursday 16 April 2026 06:39:58 +0000 (0:00:03.030) 0:03:30.855 ******** 2026-04-16 06:39:59.509610 | instance | ok: [instance] 2026-04-16 06:39:59.509698 | instance | 2026-04-16 06:39:59.509823 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-16 06:39:59.509947 | instance | Thursday 16 April 2026 06:39:59 +0000 (0:00:00.981) 0:03:31.836 ******** 2026-04-16 06:39:59.713878 | instance | ok: [instance] 2026-04-16 06:39:59.713945 | instance | 2026-04-16 06:39:59.714080 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-16 06:39:59.714196 | instance | Thursday 16 April 2026 06:39:59 +0000 (0:00:00.204) 0:03:32.041 ******** 2026-04-16 06:40:00.139818 | instance | ok: [instance] 2026-04-16 06:40:00.140001 | instance | 2026-04-16 06:40:00.140271 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-16 06:40:00.140512 | instance | Thursday 16 April 2026 06:40:00 +0000 (0:00:00.425) 0:03:32.466 ******** 2026-04-16 06:40:00.701287 | instance | ok: [instance] => (item={'path': '/etc/docker'}) 2026-04-16 06:40:00.701360 | instance | ok: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-16 06:40:00.701513 | instance | ok: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-16 06:40:00.701624 | instance | 2026-04-16 06:40:00.701757 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-16 06:40:00.701888 | instance | Thursday 16 April 2026 06:40:00 +0000 (0:00:00.561) 0:03:33.028 ******** 2026-04-16 06:40:01.143914 | instance | ok: [instance] 2026-04-16 06:40:01.144026 | instance | 2026-04-16 06:40:01.144298 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-16 06:40:01.144471 | instance | Thursday 16 April 2026 06:40:01 +0000 (0:00:00.442) 0:03:33.471 ******** 2026-04-16 06:40:01.576202 | instance | ok: [instance] 2026-04-16 06:40:01.576285 | instance | 2026-04-16 06:40:01.576461 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-16 06:40:01.576632 | instance | Thursday 16 April 2026 06:40:01 +0000 (0:00:00.425) 0:03:33.896 ******** 2026-04-16 06:40:01.576765 | instance | 2026-04-16 06:40:01.576920 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-16 06:40:01.577085 | instance | Thursday 16 April 2026 06:40:01 +0000 (0:00:00.006) 0:03:33.903 ******** 2026-04-16 06:40:01.935974 | instance | ok: [instance] 2026-04-16 06:40:01.936042 | instance | 2026-04-16 06:40:01.936173 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-16 06:40:01.936331 | instance | Thursday 16 April 2026 06:40:01 +0000 (0:00:00.359) 0:03:34.263 ******** 2026-04-16 06:40:01.995240 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-16 06:40:01.995343 | instance | 2026-04-16 06:40:01.995495 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-16 06:40:01.995621 | instance | Thursday 16 April 2026 06:40:01 +0000 (0:00:00.059) 0:03:34.322 ******** 2026-04-16 06:40:02.961174 | instance | ok: [instance] 2026-04-16 06:40:02.961266 | instance | 2026-04-16 06:40:02.961321 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-16 06:40:02.961441 | instance | Thursday 16 April 2026 06:40:02 +0000 (0:00:00.966) 0:03:35.288 ******** 2026-04-16 06:40:03.637078 | instance | ok: [instance] => (item=chronyd) 2026-04-16 06:40:03.637140 | instance | ok: [instance] => (item=sshd) 2026-04-16 06:40:03.637278 | instance | 2026-04-16 06:40:03.637398 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-16 06:40:03.637523 | instance | Thursday 16 April 2026 06:40:03 +0000 (0:00:00.676) 0:03:35.964 ******** 2026-04-16 06:40:04.264803 | instance | ok: [instance] 2026-04-16 06:40:04.264840 | instance | 2026-04-16 06:40:04.264845 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-16 06:40:04.264855 | instance | Thursday 16 April 2026 06:40:04 +0000 (0:00:00.627) 0:03:36.592 ******** 2026-04-16 06:40:04.479373 | instance | ok: [instance] 2026-04-16 06:40:04.479505 | instance | 2026-04-16 06:40:04.479650 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-16 06:40:04.479792 | instance | Thursday 16 April 2026 06:40:04 +0000 (0:00:00.214) 0:03:36.806 ******** 2026-04-16 06:40:04.725981 | instance | ok: [instance] 2026-04-16 06:40:04.726230 | instance | 2026-04-16 06:40:04.726513 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-16 06:40:04.726789 | instance | Thursday 16 April 2026 06:40:04 +0000 (0:00:00.245) 0:03:37.052 ******** 2026-04-16 06:40:04.925119 | instance | ok: [instance] 2026-04-16 06:40:04.925240 | instance | 2026-04-16 06:40:04.925373 | instance | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-16 06:40:04.925533 | instance | Thursday 16 April 2026 06:40:04 +0000 (0:00:00.200) 0:03:37.252 ******** 2026-04-16 06:40:05.159104 | instance | ok: [instance] => (item=instance) 2026-04-16 06:40:05.159146 | instance | 2026-04-16 06:40:05.159153 | instance | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-16 06:40:05.159243 | instance | Thursday 16 April 2026 06:40:05 +0000 (0:00:00.233) 0:03:37.486 ******** 2026-04-16 06:40:05.209367 | instance | ok: [instance] 2026-04-16 06:40:05.209402 | instance | 2026-04-16 06:40:05.209408 | instance | TASK [vexxhost.ceph.osd : Get `cephadm ls` status] ***************************** 2026-04-16 06:40:05.209413 | instance | Thursday 16 April 2026 06:40:05 +0000 (0:00:00.050) 0:03:37.536 ******** 2026-04-16 06:40:09.830981 | instance | ok: [instance] 2026-04-16 06:40:09.831032 | instance | 2026-04-16 06:40:09.831081 | instance | TASK [vexxhost.ceph.osd : Parse the `cephadm ls` output] *********************** 2026-04-16 06:40:09.831090 | instance | Thursday 16 April 2026 06:40:09 +0000 (0:00:04.621) 0:03:42.158 ******** 2026-04-16 06:40:09.882339 | instance | ok: [instance] 2026-04-16 06:40:09.882375 | instance | 2026-04-16 06:40:09.882386 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-16 06:40:09.882397 | instance | Thursday 16 April 2026 06:40:09 +0000 (0:00:00.051) 0:03:42.209 ******** 2026-04-16 06:40:09.946793 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-16 06:40:09.946846 | instance | 2026-04-16 06:40:09.946857 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-16 06:40:09.946874 | instance | Thursday 16 April 2026 06:40:09 +0000 (0:00:00.063) 0:03:42.272 ******** 2026-04-16 06:40:09.988892 | instance | skipping: [instance] 2026-04-16 06:40:09.989150 | instance | 2026-04-16 06:40:09.989465 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-16 06:40:09.989735 | instance | Thursday 16 April 2026 06:40:09 +0000 (0:00:00.043) 0:03:42.316 ******** 2026-04-16 06:40:10.038840 | instance | skipping: [instance] => (item=instance) 2026-04-16 06:40:10.039070 | instance | skipping: [instance] 2026-04-16 06:40:10.039370 | instance | 2026-04-16 06:40:10.039622 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-16 06:40:10.039945 | instance | Thursday 16 April 2026 06:40:10 +0000 (0:00:00.049) 0:03:42.366 ******** 2026-04-16 06:40:10.291027 | instance | ok: [instance] 2026-04-16 06:40:10.291183 | instance | 2026-04-16 06:40:10.291484 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-16 06:40:10.291836 | instance | Thursday 16 April 2026 06:40:10 +0000 (0:00:00.251) 0:03:42.618 ******** 2026-04-16 06:40:12.205514 | instance | ok: [instance] 2026-04-16 06:40:12.205589 | instance | 2026-04-16 06:40:12.205839 | instance | TASK [vexxhost.ceph.osd : Adopt OSDs to cluster] ******************************* 2026-04-16 06:40:12.205880 | instance | Thursday 16 April 2026 06:40:12 +0000 (0:00:01.914) 0:03:44.533 ******** 2026-04-16 06:40:12.231879 | instance | skipping: [instance] 2026-04-16 06:40:12.232006 | instance | 2026-04-16 06:40:12.232370 | instance | TASK [vexxhost.ceph.osd : Wait until OSD added to cephadm] ********************* 2026-04-16 06:40:12.232392 | instance | Thursday 16 April 2026 06:40:12 +0000 (0:00:00.026) 0:03:44.559 ******** 2026-04-16 06:40:12.260845 | instance | skipping: [instance] 2026-04-16 06:40:12.261234 | instance | 2026-04-16 06:40:12.261274 | instance | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-16 06:40:12.261280 | instance | Thursday 16 April 2026 06:40:12 +0000 (0:00:00.028) 0:03:44.588 ******** 2026-04-16 06:40:17.579959 | instance | ok: [instance] 2026-04-16 06:40:17.580036 | instance | 2026-04-16 06:40:17.580347 | instance | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-16 06:40:17.580411 | instance | Thursday 16 April 2026 06:40:17 +0000 (0:00:05.318) 0:03:49.907 ******** 2026-04-16 06:40:27.942617 | instance | ok: [instance] 2026-04-16 06:40:27.942696 | instance | 2026-04-16 06:40:27.942970 | instance | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-16 06:40:27.942995 | instance | Thursday 16 April 2026 06:40:27 +0000 (0:00:10.363) 0:04:00.270 ******** 2026-04-16 06:41:52.722328 | instance | ok: [instance] => (item=/dev/ceph-instance-osd0/data) 2026-04-16 06:41:52.722427 | instance | ok: [instance] => (item=/dev/ceph-instance-osd1/data) 2026-04-16 06:41:52.722439 | instance | ok: [instance] => (item=/dev/ceph-instance-osd2/data) 2026-04-16 06:41:52.722507 | instance | 2026-04-16 06:41:52.722629 | instance | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-16 06:41:52.722750 | instance | Thursday 16 April 2026 06:41:52 +0000 (0:01:24.779) 0:05:25.049 ******** 2026-04-16 06:41:54.310798 | instance | ok: [instance] 2026-04-16 06:41:54.310864 | instance | 2026-04-16 06:41:54.311168 | instance | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-16 06:41:54.311235 | instance | Thursday 16 April 2026 06:41:54 +0000 (0:00:01.588) 0:05:26.638 ******** 2026-04-16 06:41:55.860435 | instance | ok: [instance] 2026-04-16 06:41:55.860502 | instance | 2026-04-16 06:41:55.860797 | instance | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-16 06:41:55.860827 | instance | Thursday 16 April 2026 06:41:55 +0000 (0:00:01.549) 0:05:28.188 ******** 2026-04-16 06:41:55.922315 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for instance 2026-04-16 06:41:55.922378 | instance | 2026-04-16 06:41:55.922694 | instance | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-16 06:41:55.922734 | instance | Thursday 16 April 2026 06:41:55 +0000 (0:00:00.061) 0:05:28.249 ******** 2026-04-16 06:41:56.113362 | instance | ok: [instance] 2026-04-16 06:41:56.113440 | instance | 2026-04-16 06:41:56.113664 | instance | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-16 06:41:56.113734 | instance | Thursday 16 April 2026 06:41:56 +0000 (0:00:00.191) 0:05:28.441 ******** 2026-04-16 06:41:57.647076 | instance | ok: [instance] 2026-04-16 06:41:57.647365 | instance | 2026-04-16 06:41:57.647377 | instance | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-16 06:41:57.647479 | instance | Thursday 16 April 2026 06:41:57 +0000 (0:00:01.533) 0:05:29.974 ******** 2026-04-16 06:41:57.695499 | instance | ok: [instance] 2026-04-16 06:41:57.695579 | instance | 2026-04-16 06:41:57.695846 | instance | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-16 06:41:57.695878 | instance | Thursday 16 April 2026 06:41:57 +0000 (0:00:00.048) 0:05:30.023 ******** 2026-04-16 06:41:57.739736 | instance | skipping: [instance] => (item=1) 2026-04-16 06:41:57.739832 | instance | skipping: [instance] => (item=1) 2026-04-16 06:41:57.740480 | instance | skipping: [instance] => (item=1) 2026-04-16 06:41:57.740519 | instance | skipping: [instance] 2026-04-16 06:41:57.740525 | instance | 2026-04-16 06:41:57.740529 | instance | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-16 06:41:57.740534 | instance | Thursday 16 April 2026 06:41:57 +0000 (0:00:00.044) 0:05:30.067 ******** 2026-04-16 06:41:57.795922 | instance | skipping: [instance] 2026-04-16 06:41:57.796017 | instance | 2026-04-16 06:41:57.796559 | instance | PLAY [all] ********************************************************************* 2026-04-16 06:41:57.796604 | instance | 2026-04-16 06:41:57.796609 | instance | TASK [Ensure RBD kernel module is loaded] ************************************** 2026-04-16 06:41:57.796620 | instance | Thursday 16 April 2026 06:41:57 +0000 (0:00:00.056) 0:05:30.123 ******** 2026-04-16 06:41:58.092599 | instance | changed: [instance] 2026-04-16 06:41:58.092735 | instance | 2026-04-16 06:41:58.092908 | instance | PLAY [all] ********************************************************************* 2026-04-16 06:41:58.093042 | instance | 2026-04-16 06:41:58.093190 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:41:58.093352 | instance | Thursday 16 April 2026 06:41:58 +0000 (0:00:00.296) 0:05:30.420 ******** 2026-04-16 06:41:59.005324 | instance | ok: [instance] 2026-04-16 06:41:59.005394 | instance | 2026-04-16 06:41:59.005670 | instance | TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ******************** 2026-04-16 06:41:59.005717 | instance | Thursday 16 April 2026 06:41:59 +0000 (0:00:00.912) 0:05:31.332 ******** 2026-04-16 06:42:03.626215 | instance | changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576}) 2026-04-16 06:42:03.627232 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0}) 2026-04-16 06:42:03.627300 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1}) 2026-04-16 06:42:03.627312 | instance | changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000}) 2026-04-16 06:42:03.627321 | instance | changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000}) 2026-04-16 06:42:03.627331 | instance | changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304}) 2026-04-16 06:42:03.627340 | instance | changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304}) 2026-04-16 06:42:03.627357 | instance | changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304}) 2026-04-16 06:42:03.627367 | instance | changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304}) 2026-04-16 06:42:03.629073 | instance | changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304}) 2026-04-16 06:42:03.629348 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'}) 2026-04-16 06:42:03.629354 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'}) 2026-04-16 06:42:03.629359 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1}) 2026-04-16 06:42:03.629363 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1}) 2026-04-16 06:42:03.629367 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128}) 2026-04-16 06:42:03.629371 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-16 06:42:03.629375 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-16 06:42:03.629379 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128}) 2026-04-16 06:42:03.629383 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-16 06:42:03.629387 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-16 06:42:03.629391 | instance | 2026-04-16 06:42:03.629395 | instance | TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] *** 2026-04-16 06:42:03.629399 | instance | Thursday 16 April 2026 06:42:03 +0000 (0:00:04.621) 0:05:35.953 ******** 2026-04-16 06:42:03.819560 | instance | changed: [instance] 2026-04-16 06:42:03.819670 | instance | 2026-04-16 06:42:03.819850 | instance | TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] ******* 2026-04-16 06:42:03.820017 | instance | Thursday 16 April 2026 06:42:03 +0000 (0:00:00.192) 0:05:36.146 ******** 2026-04-16 06:42:04.267540 | instance | changed: [instance] 2026-04-16 06:42:04.267813 | instance | 2026-04-16 06:42:04.268178 | instance | TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] ********************** 2026-04-16 06:42:04.268455 | instance | Thursday 16 April 2026 06:42:04 +0000 (0:00:00.447) 0:05:36.594 ******** 2026-04-16 06:42:04.506355 | instance | ok: [instance] 2026-04-16 06:42:04.506584 | instance | 2026-04-16 06:42:04.506852 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-16 06:42:04.507161 | instance | Thursday 16 April 2026 06:42:04 +0000 (0:00:00.239) 0:05:36.833 ******** 2026-04-16 06:42:04.552724 | instance | ok: [instance] 2026-04-16 06:42:04.552939 | instance | 2026-04-16 06:42:04.553199 | instance | PLAY [Configure Kubernetes VIP] ************************************************ 2026-04-16 06:42:04.553439 | instance | 2026-04-16 06:42:04.553700 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:42:04.553956 | instance | Thursday 16 April 2026 06:42:04 +0000 (0:00:00.046) 0:05:36.880 ******** 2026-04-16 06:42:05.421874 | instance | ok: [instance] 2026-04-16 06:42:05.422103 | instance | 2026-04-16 06:42:05.422387 | instance | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] *** 2026-04-16 06:42:05.422691 | instance | Thursday 16 April 2026 06:42:05 +0000 (0:00:00.868) 0:05:37.749 ******** 2026-04-16 06:42:05.620336 | instance | changed: [instance] 2026-04-16 06:42:05.621185 | instance | 2026-04-16 06:42:05.621347 | instance | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] **************** 2026-04-16 06:42:05.621553 | instance | Thursday 16 April 2026 06:42:05 +0000 (0:00:00.197) 0:05:37.946 ******** 2026-04-16 06:42:06.471283 | instance | ok: [instance] => (item=/etc/keepalived/keepalived.conf) 2026-04-16 06:42:06.471547 | instance | ok: [instance] => (item=/etc/keepalived/check_apiserver.sh) 2026-04-16 06:42:06.471817 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-04-16 06:42:06.472086 | instance | ok: [instance] => (item=/etc/haproxy/haproxy.cfg) 2026-04-16 06:42:06.472354 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-04-16 06:42:06.472601 | instance | 2026-04-16 06:42:06.472868 | instance | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] **** 2026-04-16 06:42:06.473160 | instance | Thursday 16 April 2026 06:42:06 +0000 (0:00:00.852) 0:05:38.798 ******** 2026-04-16 06:42:06.644656 | instance | failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-04-16 06:42:06.802306 | instance | failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-04-16 06:42:06.956503 | instance | failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-04-16 06:42:06.968982 | instance | ...ignoring 2026-04-16 06:42:06.969121 | instance | 2026-04-16 06:42:06.969300 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] ********* 2026-04-16 06:42:06.969500 | instance | Thursday 16 April 2026 06:42:06 +0000 (0:00:00.498) 0:05:39.296 ******** 2026-04-16 06:42:07.155831 | instance | ok: [instance] 2026-04-16 06:42:07.156065 | instance | 2026-04-16 06:42:07.156342 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] ********* 2026-04-16 06:42:07.156610 | instance | Thursday 16 April 2026 06:42:07 +0000 (0:00:00.186) 0:05:39.483 ******** 2026-04-16 06:42:07.340610 | instance | ok: [instance] 2026-04-16 06:42:07.340882 | instance | 2026-04-16 06:42:07.341200 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************ 2026-04-16 06:42:07.341509 | instance | Thursday 16 April 2026 06:42:07 +0000 (0:00:00.184) 0:05:39.667 ******** 2026-04-16 06:42:07.366718 | instance | ok: [instance] 2026-04-16 06:42:07.367095 | instance | 2026-04-16 06:42:07.367479 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] *** 2026-04-16 06:42:07.367786 | instance | Thursday 16 April 2026 06:42:07 +0000 (0:00:00.026) 0:05:39.694 ******** 2026-04-16 06:42:07.401952 | instance | ok: [instance] 2026-04-16 06:42:07.402297 | instance | 2026-04-16 06:42:07.402652 | instance | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] *************** 2026-04-16 06:42:07.402979 | instance | Thursday 16 April 2026 06:42:07 +0000 (0:00:00.034) 0:05:39.728 ******** 2026-04-16 06:42:07.929873 | instance | ok: [instance] 2026-04-16 06:42:07.930128 | instance | 2026-04-16 06:42:07.930400 | instance | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] ******* 2026-04-16 06:42:07.930663 | instance | Thursday 16 April 2026 06:42:07 +0000 (0:00:00.528) 0:05:40.257 ******** 2026-04-16 06:42:08.181756 | instance | ok: [instance] 2026-04-16 06:42:08.181982 | instance | 2026-04-16 06:42:08.182310 | instance | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-04-16 06:42:08.182581 | instance | Thursday 16 April 2026 06:42:08 +0000 (0:00:00.191) 0:05:40.449 ******** 2026-04-16 06:42:08.182814 | instance | 2026-04-16 06:42:08.183112 | instance | PLAY [Install Kubernetes] ****************************************************** 2026-04-16 06:42:08.183355 | instance | 2026-04-16 06:42:08.183611 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-16 06:42:08.183867 | instance | Thursday 16 April 2026 06:42:08 +0000 (0:00:00.060) 0:05:40.509 ******** 2026-04-16 06:42:09.104322 | instance | ok: [instance] 2026-04-16 06:42:09.104380 | instance | 2026-04-16 06:42:09.104393 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:09.104404 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.921) 0:05:41.430 ******** 2026-04-16 06:42:09.301327 | instance | ok: [instance] 2026-04-16 06:42:09.301396 | instance | 2026-04-16 06:42:09.301653 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:42:09.301694 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.198) 0:05:41.629 ******** 2026-04-16 06:42:09.340412 | instance | skipping: [instance] 2026-04-16 06:42:09.340516 | instance | 2026-04-16 06:42:09.340772 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-16 06:42:09.340811 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.039) 0:05:41.668 ******** 2026-04-16 06:42:09.548259 | instance | ok: [instance] 2026-04-16 06:42:09.548329 | instance | 2026-04-16 06:42:09.548608 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:09.548645 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.207) 0:05:41.875 ******** 2026-04-16 06:42:09.603789 | instance | ok: [instance] => { 2026-04-16 06:42:09.604618 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-16 06:42:09.604653 | instance | } 2026-04-16 06:42:09.604661 | instance | 2026-04-16 06:42:09.604667 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:09.604673 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.055) 0:05:41.931 ******** 2026-04-16 06:42:09.895845 | instance | ok: [instance] 2026-04-16 06:42:09.895922 | instance | 2026-04-16 06:42:09.896029 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:09.896217 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.292) 0:05:42.223 ******** 2026-04-16 06:42:09.942071 | instance | skipping: [instance] 2026-04-16 06:42:09.942180 | instance | 2026-04-16 06:42:09.942375 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:09.942528 | instance | Thursday 16 April 2026 06:42:09 +0000 (0:00:00.046) 0:05:42.269 ******** 2026-04-16 06:42:10.157891 | instance | ok: [instance] 2026-04-16 06:42:10.157985 | instance | 2026-04-16 06:42:10.158140 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-16 06:42:10.158386 | instance | Thursday 16 April 2026 06:42:10 +0000 (0:00:00.215) 0:05:42.485 ******** 2026-04-16 06:42:11.103681 | instance | ok: [instance] 2026-04-16 06:42:11.103751 | instance | 2026-04-16 06:42:11.103865 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:11.104049 | instance | Thursday 16 April 2026 06:42:11 +0000 (0:00:00.945) 0:05:43.430 ******** 2026-04-16 06:42:11.167578 | instance | ok: [instance] => { 2026-04-16 06:42:11.167703 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-16 06:42:11.167768 | instance | } 2026-04-16 06:42:11.167876 | instance | 2026-04-16 06:42:11.168054 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:11.168202 | instance | Thursday 16 April 2026 06:42:11 +0000 (0:00:00.063) 0:05:43.493 ******** 2026-04-16 06:42:11.495967 | instance | ok: [instance] 2026-04-16 06:42:11.496333 | instance | 2026-04-16 06:42:11.496734 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:11.497136 | instance | Thursday 16 April 2026 06:42:11 +0000 (0:00:00.327) 0:05:43.821 ******** 2026-04-16 06:42:13.415202 | instance | ok: [instance] 2026-04-16 06:42:13.415363 | instance | 2026-04-16 06:42:13.415653 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-16 06:42:13.416048 | instance | Thursday 16 April 2026 06:42:13 +0000 (0:00:01.920) 0:05:45.742 ******** 2026-04-16 06:42:13.446843 | instance | skipping: [instance] 2026-04-16 06:42:13.447104 | instance | 2026-04-16 06:42:13.447380 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-16 06:42:13.447640 | instance | Thursday 16 April 2026 06:42:13 +0000 (0:00:00.032) 0:05:45.774 ******** 2026-04-16 06:42:13.475329 | instance | skipping: [instance] 2026-04-16 06:42:13.475575 | instance | 2026-04-16 06:42:13.475835 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-16 06:42:13.476092 | instance | Thursday 16 April 2026 06:42:13 +0000 (0:00:00.028) 0:05:45.802 ******** 2026-04-16 06:42:13.504984 | instance | skipping: [instance] 2026-04-16 06:42:13.505226 | instance | 2026-04-16 06:42:13.505502 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-16 06:42:13.505750 | instance | Thursday 16 April 2026 06:42:13 +0000 (0:00:00.029) 0:05:45.832 ******** 2026-04-16 06:42:14.473005 | instance | ok: [instance] 2026-04-16 06:42:14.473402 | instance | 2026-04-16 06:42:14.473750 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-16 06:42:14.474079 | instance | Thursday 16 April 2026 06:42:14 +0000 (0:00:00.967) 0:05:46.800 ******** 2026-04-16 06:42:14.898334 | instance | ok: [instance] 2026-04-16 06:42:14.898408 | instance | 2026-04-16 06:42:14.898653 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-16 06:42:14.898691 | instance | Thursday 16 April 2026 06:42:14 +0000 (0:00:00.425) 0:05:47.226 ******** 2026-04-16 06:42:15.809410 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-16 06:42:15.810701 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-16 06:42:15.810741 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-16 06:42:15.810746 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-16 06:42:15.810751 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-16 06:42:15.810756 | instance | 2026-04-16 06:42:15.810760 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-16 06:42:15.810764 | instance | Thursday 16 April 2026 06:42:15 +0000 (0:00:00.910) 0:05:48.136 ******** 2026-04-16 06:42:16.315007 | instance | ok: [instance] 2026-04-16 06:42:16.315103 | instance | 2026-04-16 06:42:16.315795 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-16 06:42:16.315845 | instance | Thursday 16 April 2026 06:42:16 +0000 (0:00:00.499) 0:05:48.636 ******** 2026-04-16 06:42:16.315851 | instance | 2026-04-16 06:42:16.315855 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-16 06:42:16.315859 | instance | Thursday 16 April 2026 06:42:16 +0000 (0:00:00.006) 0:05:48.642 ******** 2026-04-16 06:42:16.672982 | instance | ok: [instance] 2026-04-16 06:42:16.673056 | instance | 2026-04-16 06:42:16.673315 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] *** 2026-04-16 06:42:16.673347 | instance | Thursday 16 April 2026 06:42:16 +0000 (0:00:00.357) 0:05:49.000 ******** 2026-04-16 06:42:17.223224 | instance | fatal: [instance]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on instance's Python /usr/bin/python3.10. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"} 2026-04-16 06:42:17.238066 | instance | ...ignoring 2026-04-16 06:42:17.238594 | instance | 2026-04-16 06:42:17.238638 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] *** 2026-04-16 06:42:17.238646 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.564) 0:05:49.565 ******** 2026-04-16 06:42:17.270324 | instance | skipping: [instance] 2026-04-16 06:42:17.270696 | instance | 2026-04-16 06:42:17.270740 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] *** 2026-04-16 06:42:17.270747 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.032) 0:05:49.597 ******** 2026-04-16 06:42:17.301560 | instance | skipping: [instance] 2026-04-16 06:42:17.301927 | instance | 2026-04-16 06:42:17.301966 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] *** 2026-04-16 06:42:17.301972 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.031) 0:05:49.629 ******** 2026-04-16 06:42:17.342945 | instance | skipping: [instance] 2026-04-16 06:42:17.343117 | instance | 2026-04-16 06:42:17.343303 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] *** 2026-04-16 06:42:17.343478 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.041) 0:05:49.670 ******** 2026-04-16 06:42:17.372139 | instance | skipping: [instance] 2026-04-16 06:42:17.372387 | instance | 2026-04-16 06:42:17.372659 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] *** 2026-04-16 06:42:17.372916 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.029) 0:05:49.699 ******** 2026-04-16 06:42:17.411830 | instance | skipping: [instance] 2026-04-16 06:42:17.412078 | instance | 2026-04-16 06:42:17.412344 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:17.412608 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.039) 0:05:49.739 ******** 2026-04-16 06:42:17.603788 | instance | ok: [instance] 2026-04-16 06:42:17.604034 | instance | 2026-04-16 06:42:17.604317 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:17.604614 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.191) 0:05:49.931 ******** 2026-04-16 06:42:17.642481 | instance | ok: [instance] => { 2026-04-16 06:42:17.642757 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm" 2026-04-16 06:42:17.643152 | instance | } 2026-04-16 06:42:17.643486 | instance | 2026-04-16 06:42:17.643777 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:17.644061 | instance | Thursday 16 April 2026 06:42:17 +0000 (0:00:00.038) 0:05:49.970 ******** 2026-04-16 06:42:18.234892 | instance | changed: [instance] 2026-04-16 06:42:18.234962 | instance | 2026-04-16 06:42:18.235185 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:18.235418 | instance | Thursday 16 April 2026 06:42:18 +0000 (0:00:00.592) 0:05:50.562 ******** 2026-04-16 06:42:18.280314 | instance | skipping: [instance] 2026-04-16 06:42:18.280541 | instance | 2026-04-16 06:42:18.280955 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:18.281234 | instance | Thursday 16 April 2026 06:42:18 +0000 (0:00:00.045) 0:05:50.607 ******** 2026-04-16 06:42:18.470947 | instance | ok: [instance] 2026-04-16 06:42:18.471195 | instance | 2026-04-16 06:42:18.471529 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:18.471805 | instance | Thursday 16 April 2026 06:42:18 +0000 (0:00:00.190) 0:05:50.798 ******** 2026-04-16 06:42:18.506653 | instance | ok: [instance] => { 2026-04-16 06:42:18.506908 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl" 2026-04-16 06:42:18.507191 | instance | } 2026-04-16 06:42:18.507490 | instance | 2026-04-16 06:42:18.507746 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:18.508004 | instance | Thursday 16 April 2026 06:42:18 +0000 (0:00:00.035) 0:05:50.834 ******** 2026-04-16 06:42:19.095262 | instance | changed: [instance] 2026-04-16 06:42:19.095463 | instance | 2026-04-16 06:42:19.095738 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:19.096062 | instance | Thursday 16 April 2026 06:42:19 +0000 (0:00:00.588) 0:05:51.422 ******** 2026-04-16 06:42:19.148282 | instance | skipping: [instance] 2026-04-16 06:42:19.148543 | instance | 2026-04-16 06:42:19.148844 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-16 06:42:19.149130 | instance | Thursday 16 April 2026 06:42:19 +0000 (0:00:00.052) 0:05:51.475 ******** 2026-04-16 06:42:19.179401 | instance | skipping: [instance] 2026-04-16 06:42:19.179663 | instance | 2026-04-16 06:42:19.180004 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-16 06:42:19.180315 | instance | Thursday 16 April 2026 06:42:19 +0000 (0:00:00.031) 0:05:51.506 ******** 2026-04-16 06:42:19.210816 | instance | skipping: [instance] 2026-04-16 06:42:19.211101 | instance | 2026-04-16 06:42:19.211406 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-16 06:42:19.211694 | instance | Thursday 16 April 2026 06:42:19 +0000 (0:00:00.031) 0:05:51.538 ******** 2026-04-16 06:42:19.245133 | instance | skipping: [instance] 2026-04-16 06:42:19.245520 | instance | 2026-04-16 06:42:19.245875 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-16 06:42:19.246217 | instance | Thursday 16 April 2026 06:42:19 +0000 (0:00:00.034) 0:05:51.572 ******** 2026-04-16 06:42:20.215709 | instance | ok: [instance] 2026-04-16 06:42:20.215829 | instance | 2026-04-16 06:42:20.216193 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-16 06:42:20.216234 | instance | Thursday 16 April 2026 06:42:20 +0000 (0:00:00.970) 0:05:52.543 ******** 2026-04-16 06:42:20.629712 | instance | ok: [instance] 2026-04-16 06:42:20.629794 | instance | 2026-04-16 06:42:20.630059 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-16 06:42:20.630094 | instance | Thursday 16 April 2026 06:42:20 +0000 (0:00:00.413) 0:05:52.957 ******** 2026-04-16 06:42:21.532527 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-16 06:42:21.533540 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-16 06:42:21.533587 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-16 06:42:21.533593 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-16 06:42:21.533599 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-16 06:42:21.533605 | instance | 2026-04-16 06:42:21.533611 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-16 06:42:21.533616 | instance | Thursday 16 April 2026 06:42:21 +0000 (0:00:00.902) 0:05:53.860 ******** 2026-04-16 06:42:22.022014 | instance | ok: [instance] 2026-04-16 06:42:22.022082 | instance | 2026-04-16 06:42:22.022695 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-16 06:42:22.022944 | instance | Thursday 16 April 2026 06:42:22 +0000 (0:00:00.480) 0:05:54.340 ******** 2026-04-16 06:42:22.022950 | instance | 2026-04-16 06:42:22.022964 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-16 06:42:22.022971 | instance | Thursday 16 April 2026 06:42:22 +0000 (0:00:00.008) 0:05:54.349 ******** 2026-04-16 06:42:22.365882 | instance | ok: [instance] 2026-04-16 06:42:22.365957 | instance | 2026-04-16 06:42:22.366208 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:22.366250 | instance | Thursday 16 April 2026 06:42:22 +0000 (0:00:00.343) 0:05:54.693 ******** 2026-04-16 06:42:22.564885 | instance | ok: [instance] 2026-04-16 06:42:22.564957 | instance | 2026-04-16 06:42:22.565169 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:22.565208 | instance | Thursday 16 April 2026 06:42:22 +0000 (0:00:00.199) 0:05:54.892 ******** 2026-04-16 06:42:22.620431 | instance | ok: [instance] => { 2026-04-16 06:42:22.621055 | instance | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz" 2026-04-16 06:42:22.621093 | instance | } 2026-04-16 06:42:22.621098 | instance | 2026-04-16 06:42:22.621103 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:22.621108 | instance | Thursday 16 April 2026 06:42:22 +0000 (0:00:00.055) 0:05:54.948 ******** 2026-04-16 06:42:23.229739 | instance | changed: [instance] 2026-04-16 06:42:23.229814 | instance | 2026-04-16 06:42:23.230086 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:23.230120 | instance | Thursday 16 April 2026 06:42:23 +0000 (0:00:00.609) 0:05:55.557 ******** 2026-04-16 06:42:25.580394 | instance | changed: [instance] 2026-04-16 06:42:25.580474 | instance | 2026-04-16 06:42:25.580733 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:25.580770 | instance | Thursday 16 April 2026 06:42:25 +0000 (0:00:02.350) 0:05:57.907 ******** 2026-04-16 06:42:25.636858 | instance | ok: [instance] => { 2026-04-16 06:42:25.637685 | instance | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/critest-v1.35.0-linux-amd64.tar.gz" 2026-04-16 06:42:25.637722 | instance | } 2026-04-16 06:42:25.637730 | instance | 2026-04-16 06:42:25.637736 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:25.637742 | instance | Thursday 16 April 2026 06:42:25 +0000 (0:00:00.056) 0:05:57.964 ******** 2026-04-16 06:42:26.280553 | instance | changed: [instance] 2026-04-16 06:42:26.280610 | instance | 2026-04-16 06:42:26.280877 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:26.280911 | instance | Thursday 16 April 2026 06:42:26 +0000 (0:00:00.643) 0:05:58.608 ******** 2026-04-16 06:42:27.625959 | instance | changed: [instance] 2026-04-16 06:42:27.626578 | instance | 2026-04-16 06:42:27.626629 | instance | TASK [vexxhost.containers.cri_tools : Create crictl config] ******************** 2026-04-16 06:42:27.626639 | instance | Thursday 16 April 2026 06:42:27 +0000 (0:00:01.344) 0:05:59.953 ******** 2026-04-16 06:42:28.076959 | instance | changed: [instance] 2026-04-16 06:42:28.077028 | instance | 2026-04-16 06:42:28.077299 | instance | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] ********* 2026-04-16 06:42:28.077334 | instance | Thursday 16 April 2026 06:42:28 +0000 (0:00:00.451) 0:06:00.404 ******** 2026-04-16 06:42:28.290659 | instance | changed: [instance] 2026-04-16 06:42:28.290714 | instance | 2026-04-16 06:42:28.290978 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:28.291019 | instance | Thursday 16 April 2026 06:42:28 +0000 (0:00:00.213) 0:06:00.618 ******** 2026-04-16 06:42:28.495559 | instance | ok: [instance] 2026-04-16 06:42:28.495625 | instance | 2026-04-16 06:42:28.495891 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:28.495928 | instance | Thursday 16 April 2026 06:42:28 +0000 (0:00:00.204) 0:06:00.823 ******** 2026-04-16 06:42:28.549114 | instance | ok: [instance] => { 2026-04-16 06:42:28.549717 | instance | "msg": "https://github.com/containernetworking/plugins/releases/download/v1.9.0/cni-plugins-linux-amd64-v1.9.0.tgz" 2026-04-16 06:42:28.549755 | instance | } 2026-04-16 06:42:28.549760 | instance | 2026-04-16 06:42:28.549805 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:28.549811 | instance | Thursday 16 April 2026 06:42:28 +0000 (0:00:00.053) 0:06:00.876 ******** 2026-04-16 06:42:29.351133 | instance | changed: [instance] 2026-04-16 06:42:29.351189 | instance | 2026-04-16 06:42:29.351446 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:29.351460 | instance | Thursday 16 April 2026 06:42:29 +0000 (0:00:00.802) 0:06:01.678 ******** 2026-04-16 06:42:31.948096 | instance | changed: [instance] 2026-04-16 06:42:31.948164 | instance | 2026-04-16 06:42:31.948448 | instance | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] *** 2026-04-16 06:42:31.948728 | instance | Thursday 16 April 2026 06:42:31 +0000 (0:00:02.596) 0:06:04.275 ******** 2026-04-16 06:42:31.998014 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-04-16 06:42:31.998090 | instance | 2026-04-16 06:42:31.998342 | instance | TASK [vexxhost.containers.cni_plugins : Install additional packages] *********** 2026-04-16 06:42:31.998379 | instance | Thursday 16 April 2026 06:42:31 +0000 (0:00:00.049) 0:06:04.325 ******** 2026-04-16 06:42:32.960786 | instance | ok: [instance] 2026-04-16 06:42:32.960887 | instance | 2026-04-16 06:42:32.961139 | instance | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] **************** 2026-04-16 06:42:32.961155 | instance | Thursday 16 April 2026 06:42:32 +0000 (0:00:00.962) 0:06:05.288 ******** 2026-04-16 06:42:33.153367 | instance | changed: [instance] 2026-04-16 06:42:33.153449 | instance | 2026-04-16 06:42:33.153674 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] ********* 2026-04-16 06:42:33.153708 | instance | Thursday 16 April 2026 06:42:33 +0000 (0:00:00.192) 0:06:05.481 ******** 2026-04-16 06:42:33.601107 | instance | changed: [instance] 2026-04-16 06:42:33.601161 | instance | 2026-04-16 06:42:33.601424 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ****** 2026-04-16 06:42:33.601462 | instance | Thursday 16 April 2026 06:42:33 +0000 (0:00:00.447) 0:06:05.928 ******** 2026-04-16 06:42:34.302615 | instance | changed: [instance] => (item=br_netfilter) 2026-04-16 06:42:34.302722 | instance | ok: [instance] => (item=ip_tables) 2026-04-16 06:42:34.303147 | instance | changed: [instance] => (item=ip6_tables) 2026-04-16 06:42:34.303210 | instance | ok: [instance] => (item=nf_conntrack) 2026-04-16 06:42:34.303221 | instance | 2026-04-16 06:42:34.303238 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-16 06:42:34.303362 | instance | Thursday 16 April 2026 06:42:34 +0000 (0:00:00.701) 0:06:06.630 ******** 2026-04-16 06:42:34.498597 | instance | ok: [instance] 2026-04-16 06:42:34.498668 | instance | 2026-04-16 06:42:34.498930 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-16 06:42:34.498971 | instance | Thursday 16 April 2026 06:42:34 +0000 (0:00:00.195) 0:06:06.826 ******** 2026-04-16 06:42:34.542529 | instance | ok: [instance] => { 2026-04-16 06:42:34.542603 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubelet" 2026-04-16 06:42:34.543088 | instance | } 2026-04-16 06:42:34.543125 | instance | 2026-04-16 06:42:34.543130 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-16 06:42:34.543135 | instance | Thursday 16 April 2026 06:42:34 +0000 (0:00:00.043) 0:06:06.870 ******** 2026-04-16 06:42:35.626474 | instance | changed: [instance] 2026-04-16 06:42:35.626550 | instance | 2026-04-16 06:42:35.626784 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-16 06:42:35.626821 | instance | Thursday 16 April 2026 06:42:35 +0000 (0:00:01.083) 0:06:07.954 ******** 2026-04-16 06:42:35.665869 | instance | skipping: [instance] 2026-04-16 06:42:35.665967 | instance | 2026-04-16 06:42:35.666230 | instance | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] *** 2026-04-16 06:42:35.666257 | instance | Thursday 16 April 2026 06:42:35 +0000 (0:00:00.039) 0:06:07.993 ******** 2026-04-16 06:42:35.721614 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-04-16 06:42:35.721682 | instance | 2026-04-16 06:42:35.721939 | instance | TASK [vexxhost.kubernetes.kubelet : Install coreutils] ************************* 2026-04-16 06:42:35.721970 | instance | Thursday 16 April 2026 06:42:35 +0000 (0:00:00.055) 0:06:08.048 ******** 2026-04-16 06:42:35.761938 | instance | skipping: [instance] 2026-04-16 06:42:35.762102 | instance | 2026-04-16 06:42:35.762366 | instance | TASK [vexxhost.kubernetes.kubelet : Install additional packages] *************** 2026-04-16 06:42:35.762591 | instance | Thursday 16 April 2026 06:42:35 +0000 (0:00:00.040) 0:06:08.089 ******** 2026-04-16 06:43:04.094539 | instance | fatal: [instance]: FAILED! => {"cache_update_time": 1776321257, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\" install 'conntrack=1:1.4.6-2build2' 'ebtables=2.0.11-4build2' 'ethtool=1:5.16-1ubuntu0.2' 'socat=1.7.4.1-3ubuntu4'' failed: E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/c/conntrack-tools/conntrack_1.4.6-2build2_amd64.deb 503 Service Unavailable [IP: 2620:2d:4000:1::93 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", "rc": 100, "stderr": "E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/c/conntrack-tools/conntrack_1.4.6-2build2_amd64.deb 503 Service Unavailable [IP: 2620:2d:4000:1::93 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", "stderr_lines": ["E: Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/c/conntrack-tools/conntrack_1.4.6-2build2_amd64.deb 503 Service Unavailable [IP: 2620:2d:4000:1::93 80]", "E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?"], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n nftables\nThe following NEW packages will be installed:\n conntrack ebtables ethtool socat\n0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 676 kB of archives.\nAfter this operation, 2397 kB of additional disk space will be used.\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2\nGet:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 ebtables amd64 2.0.11-4build2 [84.9 kB]\nGet:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 ethtool amd64 1:5.16-1ubuntu0.2 [208 kB]\nGet:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB]\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2\nIgn:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2\nErr:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2\n 503 Service Unavailable [IP: 2620:2d:4000:1::93 80]\nFetched 642 kB in 27s (24.0 kB/s)\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " nftables", "The following NEW packages will be installed:", " conntrack ebtables ethtool socat", "0 upgraded, 4 newly installed, 0 to remove and 0 not upgraded.", "Need to get 676 kB of archives.", "After this operation, 2397 kB of additional disk space will be used.", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2", "Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 ebtables amd64 2.0.11-4build2 [84.9 kB]", "Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu jammy-updates/main amd64 ethtool amd64 1:5.16-1ubuntu0.2 [208 kB]", "Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB]", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2", "Ign:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2", "Err:1 http://nova.clouds.archive.ubuntu.com/ubuntu jammy/main amd64 conntrack amd64 1:1.4.6-2build2", " 503 Service Unavailable [IP: 2620:2d:4000:1::93 80]", "Fetched 642 kB in 27s (24.0 kB/s)"]} 2026-04-16 06:43:04.097671 | instance | 2026-04-16 06:43:04.097834 | instance | PLAY RECAP ********************************************************************* 2026-04-16 06:43:04.098548 | instance | instance : ok=178 changed=45 unreachable=0 failed=1 skipped=45 rescued=0 ignored=2 2026-04-16 06:43:04.098582 | instance | 2026-04-16 06:43:04.098595 | instance | Thursday 16 April 2026 06:43:04 +0000 (0:00:28.335) 0:06:36.425 ******** 2026-04-16 06:43:04.098604 | instance | =============================================================================== 2026-04-16 06:43:04.099085 | instance | vexxhost.ceph.mon : Run Bootstrap coomand ----------------------------- 127.04s 2026-04-16 06:43:04.099101 | instance | vexxhost.ceph.osd : Install OSDs --------------------------------------- 84.78s 2026-04-16 06:43:04.099110 | instance | vexxhost.kubernetes.kubelet : Install additional packages -------------- 28.34s 2026-04-16 06:43:04.101985 | instance | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 11.17s 2026-04-16 06:43:04.102060 | instance | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 10.36s 2026-04-16 06:43:04.102068 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.75s 2026-04-16 06:43:04.102074 | instance | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.32s 2026-04-16 06:43:04.102080 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.00s 2026-04-16 06:43:04.102086 | instance | vexxhost.ceph.osd : Get `cephadm ls` status ----------------------------- 4.62s 2026-04-16 06:43:04.102092 | instance | vexxhost.atmosphere.sysctl : Configure sysctl values -------------------- 4.62s 2026-04-16 06:43:04.102098 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.32s 2026-04-16 06:43:04.102104 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 3.92s 2026-04-16 06:43:04.102110 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-04-16 06:43:04.102116 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.60s 2026-04-16 06:43:04.102122 | instance | vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module ----------- 2.54s 2026-04-16 06:43:04.102128 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.35s 2026-04-16 06:43:04.102134 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.00s 2026-04-16 06:43:04.102140 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 1.96s 2026-04-16 06:43:04.102146 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 1.96s 2026-04-16 06:43:04.102152 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 1.92s 2026-04-16 06:43:04.360094 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-16 06:43:04.360625 | instance | ERROR [aio > converge] Executed: Failed 2026-04-16 06:43:04.360838 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-16 06:43:04.568294 | instance | ERROR 2026-04-16 06:43:04.568564 | instance | { 2026-04-16 06:43:04.568618 | instance | "delta": "0:08:40.488389", 2026-04-16 06:43:04.568651 | instance | "end": "2026-04-16 06:43:04.461153", 2026-04-16 06:43:04.568681 | instance | "msg": "non-zero return code", 2026-04-16 06:43:04.568708 | instance | "rc": 2, 2026-04-16 06:43:04.568739 | instance | "start": "2026-04-16 06:34:23.972764" 2026-04-16 06:43:04.568767 | instance | } failure 2026-04-16 06:43:04.584242 | 2026-04-16 06:43:04.584339 | PLAY RECAP 2026-04-16 06:43:04.584392 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-16 06:43:04.584416 | 2026-04-16 06:43:04.716087 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-16 06:43:04.726764 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-16 06:43:05.349737 | 2026-04-16 06:43:05.349870 | PLAY [all] 2026-04-16 06:43:05.364549 | 2026-04-16 06:43:05.364671 | TASK [gather-host-logs : creating directory for system status] 2026-04-16 06:43:05.704054 | instance | changed 2026-04-16 06:43:05.711699 | 2026-04-16 06:43:05.711815 | TASK [gather-host-logs : Get logs for each host] 2026-04-16 06:43:06.067946 | instance | + systemd-cgls --full --all --no-pager 2026-04-16 06:43:06.088622 | instance | + ip addr 2026-04-16 06:43:06.091664 | instance | + ip route 2026-04-16 06:43:06.094498 | instance | + lsblk 2026-04-16 06:43:06.100047 | instance | + mount 2026-04-16 06:43:06.102105 | instance | + docker images 2026-04-16 06:43:06.122032 | instance | + brctl show 2026-04-16 06:43:06.122735 | instance | /bin/bash: line 8: brctl: command not found 2026-04-16 06:43:06.123018 | instance | + ps aux --sort=-%mem 2026-04-16 06:43:06.142955 | instance | + dpkg -l 2026-04-16 06:43:06.152743 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-16 06:43:06.153221 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-16 06:43:06.167636 | instance | + '[' '!' -z '' ']' 2026-04-16 06:43:06.247941 | instance | ok: Runtime: 0:00:00.105593 2026-04-16 06:43:06.256456 | 2026-04-16 06:43:06.256622 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-16 06:43:06.904356 | instance | changed: 2026-04-16 06:43:06.904577 | instance | created directory /var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/logs/instance 2026-04-16 06:43:06.904606 | instance | cd+++++++++ system/ 2026-04-16 06:43:06.904629 | instance | >f+++++++++ system/brctl-show.txt 2026-04-16 06:43:06.904650 | instance | >f+++++++++ system/docker-images.txt 2026-04-16 06:43:06.904670 | instance | >f+++++++++ system/ip-addr.txt 2026-04-16 06:43:06.904693 | instance | >f+++++++++ system/ip-route.txt 2026-04-16 06:43:06.904714 | instance | >f+++++++++ system/lsblk.txt 2026-04-16 06:43:06.904734 | instance | >f+++++++++ system/mount.txt 2026-04-16 06:43:06.904753 | instance | >f+++++++++ system/packages.txt 2026-04-16 06:43:06.904771 | instance | >f+++++++++ system/ps.txt 2026-04-16 06:43:06.904792 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-16 06:43:06.914760 | 2026-04-16 06:43:06.914912 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-16 06:43:07.114275 | instance | changed: "values" 2026-04-16 06:43:07.276191 | instance | changed: "releases" 2026-04-16 06:43:07.290647 | 2026-04-16 06:43:07.290830 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-16 06:43:07.541899 | instance | E0416 06:43:07.541729 38744 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:07.542626 | instance | E0416 06:43:07.542579 38744 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:07.544591 | instance | E0416 06:43:07.544525 38744 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:07.545437 | instance | E0416 06:43:07.545391 38744 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:07.547352 | instance | E0416 06:43:07.547308 38744 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:07.547377 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:07.830813 | instance | ok: Runtime: 0:00:00.062802 2026-04-16 06:43:07.838778 | 2026-04-16 06:43:07.838934 | TASK [helm-release-status : Downloads logs to executor] 2026-04-16 06:43:08.341165 | instance | changed: 2026-04-16 06:43:08.341360 | instance | cd+++++++++ helm/ 2026-04-16 06:43:08.341397 | instance | cd+++++++++ helm/releases/ 2026-04-16 06:43:08.341423 | instance | cd+++++++++ helm/values/ 2026-04-16 06:43:08.352942 | 2026-04-16 06:43:08.353073 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-16 06:43:08.549436 | instance | changed 2026-04-16 06:43:08.586912 | 2026-04-16 06:43:08.587052 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-16 06:43:08.796517 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-16 06:43:08.796609 | instance | 2026-04-16 06:43:08.802925 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-16 06:43:08.805986 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-16 06:43:08.850889 | instance | E0416 06:43:08.850782 38796 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.851710 | instance | E0416 06:43:08.851682 38796 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.852417 | instance | E0416 06:43:08.852352 38803 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.853126 | instance | E0416 06:43:08.853085 38803 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.853554 | instance | E0416 06:43:08.853520 38796 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.855464 | instance | E0416 06:43:08.855426 38796 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.855859 | instance | E0416 06:43:08.855804 38803 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.856103 | instance | E0416 06:43:08.856070 38796 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.857284 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:08.857359 | instance | E0416 06:43:08.857322 38803 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.858004 | instance | E0416 06:43:08.857977 38803 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.859234 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:08.863487 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-16 06:43:08.867774 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-16 06:43:08.910707 | instance | E0416 06:43:08.910571 38837 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.913118 | instance | E0416 06:43:08.912065 38837 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.913871 | instance | E0416 06:43:08.913827 38837 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.914606 | instance | E0416 06:43:08.914558 38837 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.915355 | instance | E0416 06:43:08.915292 38844 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.916005 | instance | E0416 06:43:08.915966 38844 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.916308 | instance | E0416 06:43:08.916218 38837 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.916357 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:08.917544 | instance | E0416 06:43:08.917501 38844 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.917990 | instance | E0416 06:43:08.917962 38844 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.919584 | instance | E0416 06:43:08.919538 38844 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.919622 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:08.923777 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-16 06:43:08.968851 | instance | E0416 06:43:08.968747 38869 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.969699 | instance | E0416 06:43:08.969651 38869 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.971133 | instance | E0416 06:43:08.971087 38869 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.972871 | instance | E0416 06:43:08.972796 38869 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.973538 | instance | E0416 06:43:08.973493 38869 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:08.974700 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:09.123812 | instance | ok: Runtime: 0:00:00.190199 2026-04-16 06:43:09.130952 | 2026-04-16 06:43:09.131074 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-16 06:43:09.326683 | instance | changed 2026-04-16 06:43:09.333738 | 2026-04-16 06:43:09.333889 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-16 06:43:09.545418 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-16 06:43:09.545746 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-16 06:43:09.545860 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-16 06:43:09.592629 | instance | E0416 06:43:09.592413 38906 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:09.592989 | instance | E0416 06:43:09.592945 38906 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:09.594366 | instance | E0416 06:43:09.594319 38906 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:09.594901 | instance | E0416 06:43:09.594840 38906 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:09.596238 | instance | E0416 06:43:09.596204 38906 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:09.596278 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:09.875533 | instance | ok: Runtime: 0:00:00.062750 2026-04-16 06:43:09.883876 | 2026-04-16 06:43:09.884092 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-16 06:43:10.366650 | instance | changed: 2026-04-16 06:43:10.366846 | instance | cd+++++++++ objects/ 2026-04-16 06:43:10.366874 | instance | cd+++++++++ objects/cluster/ 2026-04-16 06:43:10.366895 | instance | cd+++++++++ objects/namespaced/ 2026-04-16 06:43:10.376520 | 2026-04-16 06:43:10.376610 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-16 06:43:10.568095 | instance | changed 2026-04-16 06:43:10.573613 | 2026-04-16 06:43:10.573697 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-16 06:43:10.768883 | instance | changed 2026-04-16 06:43:10.775757 | 2026-04-16 06:43:10.775856 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-16 06:43:11.049194 | instance | E0416 06:43:11.049056 38964 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:11.049917 | instance | E0416 06:43:11.049879 38964 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:11.051595 | instance | E0416 06:43:11.051563 38964 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:11.052347 | instance | E0416 06:43:11.052314 38964 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:11.053703 | instance | E0416 06:43:11.053663 38964 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:11.053749 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:11.318248 | instance | ok: Runtime: 0:00:00.070086 2026-04-16 06:43:11.325546 | 2026-04-16 06:43:11.325701 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-16 06:43:11.821511 | instance | changed: 2026-04-16 06:43:11.821756 | instance | cd+++++++++ pod-logs/ 2026-04-16 06:43:11.821785 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-16 06:43:11.831244 | 2026-04-16 06:43:11.831308 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-16 06:43:12.036579 | instance | changed 2026-04-16 06:43:12.043254 | 2026-04-16 06:43:12.043328 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-16 06:43:12.307713 | instance | E0416 06:43:12.307576 39012 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.308732 | instance | E0416 06:43:12.308609 39012 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.309628 | instance | E0416 06:43:12.309576 39012 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.311549 | instance | E0416 06:43:12.311503 39012 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.312221 | instance | E0416 06:43:12.312179 39012 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.313505 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:12.581240 | instance | ok: Runtime: 0:00:00.069536 2026-04-16 06:43:12.587624 | 2026-04-16 06:43:12.587693 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-16 06:43:12.839262 | instance | E0416 06:43:12.839099 39040 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.839829 | instance | E0416 06:43:12.839783 39040 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.841871 | instance | E0416 06:43:12.841815 39040 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.842856 | instance | E0416 06:43:12.842813 39040 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.843415 | instance | E0416 06:43:12.843366 39040 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:12.844589 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:12.848604 | instance | ceph-mgr endpoints: 2026-04-16 06:43:13.125440 | instance | ok: Runtime: 0:00:00.068182 2026-04-16 06:43:13.133159 | 2026-04-16 06:43:13.133252 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-16 06:43:13.391462 | instance | E0416 06:43:13.391322 39067 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:13.392148 | instance | E0416 06:43:13.392118 39067 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:13.393928 | instance | E0416 06:43:13.393888 39067 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:13.394578 | instance | E0416 06:43:13.394547 39067 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:13.396327 | instance | E0416 06:43:13.396288 39067 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-16 06:43:13.396353 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-16 06:43:13.668232 | instance | ok: Runtime: 0:00:00.066675 2026-04-16 06:43:13.676657 | 2026-04-16 06:43:13.676803 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-16 06:43:14.179312 | instance | changed: cd+++++++++ prometheus/ 2026-04-16 06:43:14.190963 | 2026-04-16 06:43:14.191083 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-16 06:43:14.437941 | instance | changed 2026-04-16 06:43:14.443067 | 2026-04-16 06:43:14.443134 | TASK [gather-selenium-data : Get selenium data] 2026-04-16 06:43:14.647342 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-16 06:43:14.648810 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-16 06:43:14.979861 | instance | ERROR 2026-04-16 06:43:14.980231 | instance | { 2026-04-16 06:43:14.980311 | instance | "delta": "0:00:00.006319", 2026-04-16 06:43:14.980361 | instance | "end": "2026-04-16 06:43:14.649231", 2026-04-16 06:43:14.980404 | instance | "msg": "non-zero return code", 2026-04-16 06:43:14.980444 | instance | "rc": 1, 2026-04-16 06:43:14.980485 | instance | "start": "2026-04-16 06:43:14.642912" 2026-04-16 06:43:14.980524 | instance | } 2026-04-16 06:43:14.980578 | instance | ERROR: Ignoring Errors 2026-04-16 06:43:14.986703 | 2026-04-16 06:43:14.986778 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-16 06:43:15.488387 | instance | changed: cd+++++++++ selenium/ 2026-04-16 06:43:15.495268 | 2026-04-16 06:43:15.495408 | PLAY RECAP 2026-04-16 06:43:15.495463 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-16 06:43:15.495488 | 2026-04-16 06:43:15.660742 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-16 06:43:15.673888 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-16 06:43:16.310213 | 2026-04-16 06:43:16.310372 | PLAY [all] 2026-04-16 06:43:16.322305 | 2026-04-16 06:43:16.322416 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-16 06:43:16.368472 | instance | skipping: Conditional result was False 2026-04-16 06:43:16.379078 | 2026-04-16 06:43:16.379209 | TASK [fetch-output : Set log path for single node] 2026-04-16 06:43:16.424872 | instance | ok 2026-04-16 06:43:16.432090 | 2026-04-16 06:43:16.432179 | LOOP [fetch-output : Ensure local output dirs] 2026-04-16 06:43:16.821012 | instance -> localhost | ok: "/var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/logs" 2026-04-16 06:43:17.032506 | instance -> localhost | changed: "/var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/artifacts" 2026-04-16 06:43:17.245147 | instance -> localhost | changed: "/var/lib/zuul/builds/7fc62a7811be4a82aaa56d425cb58e63/work/docs" 2026-04-16 06:43:17.259710 | 2026-04-16 06:43:17.259907 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-16 06:43:17.901901 | instance | changed: .d..t...... ./ 2026-04-16 06:43:17.902161 | instance | changed: All items complete 2026-04-16 06:43:17.902200 | 2026-04-16 06:43:18.350874 | instance | changed: .d..t...... ./ 2026-04-16 06:43:18.822700 | instance | changed: .d..t...... ./ 2026-04-16 06:43:18.848515 | 2026-04-16 06:43:18.848745 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-16 06:43:19.286154 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007564 2026-04-16 06:43:19.519332 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007640 2026-04-16 06:43:19.541852 | 2026-04-16 06:43:19.541983 | PLAY [all] 2026-04-16 06:43:19.549098 | 2026-04-16 06:43:19.549171 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-16 06:43:19.968994 | instance | changed 2026-04-16 06:43:19.976121 | 2026-04-16 06:43:19.976201 | PLAY RECAP 2026-04-16 06:43:19.976248 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-16 06:43:19.976280 | 2026-04-16 06:43:20.118925 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-16 06:43:20.133225 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-16 06:43:20.773533 | 2026-04-16 06:43:20.774192 | PLAY [localhost] 2026-04-16 06:43:20.784500 | 2026-04-16 06:43:20.784574 | TASK [Generate Zuul manifest] 2026-04-16 06:43:20.807135 | localhost | ok 2026-04-16 06:43:20.822920 | 2026-04-16 06:43:20.823005 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-16 06:43:21.202643 | localhost | changed 2026-04-16 06:43:21.212943 | 2026-04-16 06:43:21.213053 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-16 06:43:21.244922 | localhost | ok 2026-04-16 06:43:21.252425 | 2026-04-16 06:43:21.252494 | TASK [Upload logs] 2026-04-16 06:43:21.274674 | localhost | ok 2026-04-16 06:43:21.385824 | 2026-04-16 06:43:21.386014 | TASK [Set zuul-log-path fact] 2026-04-16 06:43:21.406352 | localhost | ok 2026-04-16 06:43:21.419432 | 2026-04-16 06:43:21.419506 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-16 06:43:21.451399 | localhost | ok 2026-04-16 06:43:21.461552 | 2026-04-16 06:43:21.461649 | TASK [upload-logs : Create log directories] 2026-04-16 06:43:21.859525 | localhost | changed 2026-04-16 06:43:21.866120 | 2026-04-16 06:43:21.866258 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-16 06:43:22.291708 | localhost -> localhost | ok: Runtime: 0:00:00.006294 2026-04-16 06:43:22.300833 | 2026-04-16 06:43:22.300930 | TASK [upload-logs : Upload logs to log server] 2026-04-16 06:43:22.739638 | localhost | Output suppressed because no_log was given 2026-04-16 06:43:22.744935 | 2026-04-16 06:43:22.745019 | LOOP [upload-logs : Compress console log and json output] 2026-04-16 06:43:22.795919 | localhost | skipping: Conditional result was False 2026-04-16 06:43:22.804394 | localhost | skipping: Conditional result was False 2026-04-16 06:43:22.819002 | 2026-04-16 06:43:22.819142 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-16 06:43:22.861182 | localhost | skipping: Conditional result was False 2026-04-16 06:43:22.861507 | 2026-04-16 06:43:22.866074 | localhost | skipping: Conditional result was False 2026-04-16 06:43:22.883536 | 2026-04-16 06:43:22.883694 | LOOP [upload-logs : Upload console log and json output]