2026-04-07 08:59:03.382744 | Job console starting 2026-04-07 08:59:03.393425 | Updating git repos 2026-04-07 08:59:03.463655 | Cloning repos into workspace 2026-04-07 08:59:04.490392 | Restoring repo states 2026-04-07 08:59:04.509432 | Merging changes 2026-04-07 08:59:05.664667 | Checking out repos 2026-04-07 08:59:05.769148 | Preparing playbooks 2026-04-07 08:59:09.119768 | Running Ansible setup 2026-04-07 08:59:12.886380 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-07 08:59:13.532966 | 2026-04-07 08:59:13.533119 | PLAY [localhost] 2026-04-07 08:59:13.541379 | 2026-04-07 08:59:13.541464 | TASK [Gathering Facts] 2026-04-07 08:59:14.552278 | localhost | ok 2026-04-07 08:59:14.563952 | 2026-04-07 08:59:14.564082 | TASK [Setup log path fact] 2026-04-07 08:59:14.587623 | localhost | ok 2026-04-07 08:59:14.601725 | 2026-04-07 08:59:14.601805 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-07 08:59:14.633242 | localhost | ok 2026-04-07 08:59:14.642887 | 2026-04-07 08:59:14.643076 | TASK [emit-job-header : Print job information] 2026-04-07 08:59:14.684630 | # Job Information 2026-04-07 08:59:14.684890 | Ansible Version: 2.16.16 2026-04-07 08:59:14.684939 | Job: atmosphere-molecule-aio-openvswitch 2026-04-07 08:59:14.685012 | Pipeline: check 2026-04-07 08:59:14.685045 | Executor: 0a8996d2b663 2026-04-07 08:59:14.685070 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3809 2026-04-07 08:59:14.685102 | Event ID: f203c010-325f-11f1-8ab8-427e3704333c 2026-04-07 08:59:14.689133 | 2026-04-07 08:59:14.689217 | LOOP [emit-job-header : Print node information] 2026-04-07 08:59:14.792905 | localhost | ok: 2026-04-07 08:59:14.793160 | localhost | # Node Information 2026-04-07 08:59:14.793201 | localhost | Inventory Hostname: instance 2026-04-07 08:59:14.793232 | localhost | Hostname: np0000163897 2026-04-07 08:59:14.793259 | localhost | Username: zuul 2026-04-07 08:59:14.793290 | localhost | Distro: Ubuntu 22.04 2026-04-07 08:59:14.793317 | localhost | Provider: yul1 2026-04-07 08:59:14.793343 | localhost | Region: ca-ymq-1 2026-04-07 08:59:14.793369 | localhost | Label: ubuntu-jammy-16 2026-04-07 08:59:14.793395 | localhost | Product Name: OpenStack Nova 2026-04-07 08:59:14.793420 | localhost | Interface IP: 199.204.45.140 2026-04-07 08:59:14.812455 | 2026-04-07 08:59:14.812646 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-07 08:59:15.213680 | localhost -> localhost | changed 2026-04-07 08:59:15.220123 | 2026-04-07 08:59:15.220204 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-07 08:59:16.045776 | localhost -> localhost | changed 2026-04-07 08:59:16.055371 | 2026-04-07 08:59:16.055450 | PLAY [all] 2026-04-07 08:59:16.064225 | 2026-04-07 08:59:16.064298 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-07 08:59:16.310363 | instance -> localhost | ok 2026-04-07 08:59:16.320260 | 2026-04-07 08:59:16.320367 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-07 08:59:16.354820 | instance | ok 2026-04-07 08:59:16.371252 | instance | included: /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-07 08:59:16.377435 | 2026-04-07 08:59:16.377497 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-07 08:59:17.066019 | instance -> localhost | Generating public/private rsa key pair. 2026-04-07 08:59:17.066196 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/83796d888f8e42aeb3f93002b9d02ee7_id_rsa 2026-04-07 08:59:17.066225 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/83796d888f8e42aeb3f93002b9d02ee7_id_rsa.pub 2026-04-07 08:59:17.066247 | instance -> localhost | The key fingerprint is: 2026-04-07 08:59:17.066268 | instance -> localhost | SHA256:3aWoSBj/3Ek8jxbVwmO/ysJJHrjvE4wmC1L7GsHhYgY zuul-build-sshkey 2026-04-07 08:59:17.066304 | instance -> localhost | The key's randomart image is: 2026-04-07 08:59:17.066325 | instance -> localhost | +---[RSA 3072]----+ 2026-04-07 08:59:17.066349 | instance -> localhost | | | 2026-04-07 08:59:17.066370 | instance -> localhost | | . . | 2026-04-07 08:59:17.066390 | instance -> localhost | |E o * o | 2026-04-07 08:59:17.066410 | instance -> localhost | | . o.= o = * | 2026-04-07 08:59:17.066429 | instance -> localhost | | +.=.o S+B o . | 2026-04-07 08:59:17.066448 | instance -> localhost | | o..oo.+++=* . | 2026-04-07 08:59:17.066467 | instance -> localhost | | ..o.++==+. . | 2026-04-07 08:59:17.066486 | instance -> localhost | | .o ..*. . | 2026-04-07 08:59:17.066507 | instance -> localhost | | .. oooo | 2026-04-07 08:59:17.066527 | instance -> localhost | +----[SHA256]-----+ 2026-04-07 08:59:17.066577 | instance -> localhost | ok: Runtime: 0:00:00.256974 2026-04-07 08:59:17.071662 | 2026-04-07 08:59:17.071731 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-07 08:59:17.105312 | instance | ok 2026-04-07 08:59:17.116350 | instance | included: /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-07 08:59:17.123892 | 2026-04-07 08:59:17.123955 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-07 08:59:17.147843 | instance | skipping: Conditional result was False 2026-04-07 08:59:17.156477 | 2026-04-07 08:59:17.156561 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-07 08:59:17.612841 | instance | changed 2026-04-07 08:59:17.633288 | 2026-04-07 08:59:17.633413 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-07 08:59:17.829381 | instance | ok 2026-04-07 08:59:17.836521 | 2026-04-07 08:59:17.836624 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-07 08:59:18.277673 | instance | changed 2026-04-07 08:59:18.283770 | 2026-04-07 08:59:18.283834 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-07 08:59:18.746245 | instance | changed 2026-04-07 08:59:18.753318 | 2026-04-07 08:59:18.753404 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-07 08:59:18.778080 | instance | skipping: Conditional result was False 2026-04-07 08:59:18.791690 | 2026-04-07 08:59:18.791826 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-07 08:59:19.283195 | instance -> localhost | changed 2026-04-07 08:59:19.327334 | 2026-04-07 08:59:19.327457 | TASK [add-build-sshkey : Add back temp key] 2026-04-07 08:59:19.583332 | instance -> localhost | Identity added: /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/83796d888f8e42aeb3f93002b9d02ee7_id_rsa (zuul-build-sshkey) 2026-04-07 08:59:19.583558 | instance -> localhost | ok: Runtime: 0:00:00.011078 2026-04-07 08:59:19.605941 | 2026-04-07 08:59:19.606046 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-07 08:59:19.884355 | instance | ok 2026-04-07 08:59:19.889521 | 2026-04-07 08:59:19.889589 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-07 08:59:19.913759 | instance | skipping: Conditional result was False 2026-04-07 08:59:19.931688 | 2026-04-07 08:59:19.931799 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-07 08:59:20.274415 | instance | ok 2026-04-07 08:59:20.282110 | 2026-04-07 08:59:20.282196 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-07 08:59:21.904706 | instance | Output suppressed because no_log was given 2026-04-07 08:59:21.919948 | 2026-04-07 08:59:21.920042 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-07 08:59:22.134683 | instance | ok: "logs" 2026-04-07 08:59:22.134959 | instance | ok: All items complete 2026-04-07 08:59:22.134989 | 2026-04-07 08:59:22.283313 | instance | ok: "artifacts" 2026-04-07 08:59:22.450433 | instance | ok: "docs" 2026-04-07 08:59:22.462290 | 2026-04-07 08:59:22.462394 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-07 08:59:22.651441 | instance | changed: "logs" 2026-04-07 08:59:22.804539 | instance | changed: "artifacts" 2026-04-07 08:59:22.969194 | instance | changed: "docs" 2026-04-07 08:59:22.980272 | 2026-04-07 08:59:22.980337 | PLAY RECAP 2026-04-07 08:59:22.980399 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-07 08:59:22.980438 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-07 08:59:22.980465 | 2026-04-07 08:59:23.095527 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-07 08:59:23.105249 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-07 08:59:23.690551 | 2026-04-07 08:59:23.690670 | PLAY [all] 2026-04-07 08:59:23.702188 | 2026-04-07 08:59:23.702264 | TASK [setup-uv : Extract archive] 2026-04-07 08:59:26.347082 | instance | changed 2026-04-07 08:59:26.353846 | 2026-04-07 08:59:26.353934 | TASK [setup-uv : Print version] 2026-04-07 08:59:26.680909 | instance | uv 0.8.13 2026-04-07 08:59:26.895811 | instance | ok: Runtime: 0:00:00.013033 2026-04-07 08:59:26.906848 | 2026-04-07 08:59:26.906907 | PLAY RECAP 2026-04-07 08:59:26.906951 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-07 08:59:26.906975 | 2026-04-07 08:59:27.053064 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-07 08:59:27.116112 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-07 08:59:27.733292 | 2026-04-07 08:59:27.733454 | PLAY [all] 2026-04-07 08:59:27.746157 | 2026-04-07 08:59:27.746307 | TASK [Install "jq" for log collection] 2026-04-07 08:59:45.920756 | instance | changed 2026-04-07 08:59:45.923633 | 2026-04-07 08:59:45.923714 | PLAY RECAP 2026-04-07 08:59:45.923785 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-07 08:59:45.923853 | 2026-04-07 08:59:46.069040 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-07 08:59:46.079980 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-07 08:59:46.679478 | 2026-04-07 08:59:46.679627 | PLAY [all] 2026-04-07 08:59:46.691358 | 2026-04-07 08:59:46.691438 | TASK [Copy inventory file for Zuul] 2026-04-07 08:59:47.520416 | instance | changed 2026-04-07 08:59:47.527623 | 2026-04-07 08:59:47.527726 | TASK [Switch "ansible_host" to private IP] 2026-04-07 08:59:47.845454 | instance | changed: 1 replacements made 2026-04-07 08:59:47.856836 | 2026-04-07 08:59:47.856945 | TASK [Run Molecule scenario] 2026-04-07 08:59:48.246649 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-07 08:59:48.246935 | instance | Creating virtual environment at: .venv 2026-04-07 08:59:48.270622 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-07 08:59:48.293068 | instance | Downloading pydantic-core (2.0MiB) 2026-04-07 08:59:48.293252 | instance | Downloading setuptools (1.1MiB) 2026-04-07 08:59:48.293464 | instance | Downloading netaddr (2.2MiB) 2026-04-07 08:59:48.293694 | instance | Downloading ansible-core (2.1MiB) 2026-04-07 08:59:48.293943 | instance | Downloading openstacksdk (1.7MiB) 2026-04-07 08:59:48.294173 | instance | Downloading pygments (1.2MiB) 2026-04-07 08:59:48.294654 | instance | Downloading cryptography (4.2MiB) 2026-04-07 08:59:48.294897 | instance | Downloading kubernetes (1.9MiB) 2026-04-07 08:59:48.295151 | instance | Downloading rjsonnet (1.2MiB) 2026-04-07 08:59:48.625966 | instance | Building pyperclip==1.9.0 2026-04-07 08:59:48.645859 | instance | Downloading rjsonnet 2026-04-07 08:59:48.747030 | instance | Downloading pydantic-core 2026-04-07 08:59:48.806900 | instance | Downloading netaddr 2026-04-07 08:59:48.819187 | instance | Downloading pygments 2026-04-07 08:59:48.833114 | instance | Downloading cryptography 2026-04-07 08:59:48.884834 | instance | Downloading setuptools 2026-04-07 08:59:48.947282 | instance | Downloading kubernetes 2026-04-07 08:59:48.982958 | instance | Downloading ansible-core 2026-04-07 08:59:49.042093 | instance | Downloading openstacksdk 2026-04-07 08:59:49.387971 | instance | Built pyperclip==1.9.0 2026-04-07 08:59:49.580345 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-07 08:59:49.624698 | instance | Installed 83 packages in 42ms 2026-04-07 08:59:50.337418 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-07 08:59:50.980484 | instance | INFO [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-07 08:59:50.980620 | instance | INFO [aio > prerun] Performing prerun with role_name_check=0... 2026-04-07 09:01:28.310414 | instance | INFO [aio > dependency] Executing 2026-04-07 09:01:28.310613 | instance | WARNING [aio > dependency] Missing roles requirements file: requirements.yml 2026-04-07 09:01:28.310859 | instance | WARNING [aio > dependency] Missing collections requirements file: collections.yml 2026-04-07 09:01:28.311019 | instance | WARNING [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-07 09:01:28.320725 | instance | INFO [aio > cleanup] Executing 2026-04-07 09:01:28.321082 | instance | WARNING [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-07 09:01:28.330749 | instance | INFO [aio > destroy] Executing 2026-04-07 09:01:28.330841 | instance | WARNING [aio > destroy] Skipping, '--destroy=never' requested. 2026-04-07 09:01:28.330932 | instance | INFO [aio > destroy] Executed: Successful 2026-04-07 09:01:28.340551 | instance | INFO [aio > syntax] Executing 2026-04-07 09:01:31.153994 | instance | 2026-04-07 09:01:31.154356 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-07 09:01:31.271962 | instance | INFO [aio > syntax] Executed: Successful 2026-04-07 09:01:31.282525 | instance | INFO [aio > create] Executing 2026-04-07 09:01:31.284321 | instance | WARNING [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-07 09:01:31.293946 | instance | INFO [aio > prepare] Executing 2026-04-07 09:01:32.138223 | instance | 2026-04-07 09:01:32.138387 | instance | PLAY [Prepare] ***************************************************************** 2026-04-07 09:01:32.138593 | instance | 2026-04-07 09:01:32.138781 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:01:32.138970 | instance | Tuesday 07 April 2026 09:01:32 +0000 (0:00:00.034) 0:00:00.034 ********* 2026-04-07 09:01:33.099895 | instance | ok: [instance] 2026-04-07 09:01:33.100023 | instance | 2026-04-07 09:01:33.100382 | instance | TASK [Configure short hostname] ************************************************ 2026-04-07 09:01:33.100759 | instance | Tuesday 07 April 2026 09:01:33 +0000 (0:00:00.961) 0:00:00.995 ********* 2026-04-07 09:01:33.927066 | instance | changed: [instance] 2026-04-07 09:01:33.927333 | instance | 2026-04-07 09:01:33.927606 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-07 09:01:33.927882 | instance | Tuesday 07 April 2026 09:01:33 +0000 (0:00:00.826) 0:00:01.822 ********* 2026-04-07 09:01:34.322428 | instance | changed: [instance] 2026-04-07 09:01:34.322711 | instance | 2026-04-07 09:01:34.323010 | instance | TASK [Install "dirmngr" for GPG keyserver operations] ************************** 2026-04-07 09:01:34.323291 | instance | Tuesday 07 April 2026 09:01:34 +0000 (0:00:00.395) 0:00:02.218 ********* 2026-04-07 09:01:36.012250 | instance | ok: [instance] 2026-04-07 09:01:36.012457 | instance | 2026-04-07 09:01:36.012757 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-07 09:01:36.013059 | instance | Tuesday 07 April 2026 09:01:36 +0000 (0:00:01.689) 0:00:03.907 ********* 2026-04-07 09:01:37.104563 | instance | ok: [instance] 2026-04-07 09:01:37.104980 | instance | 2026-04-07 09:01:37.105379 | instance | PLAY [Generate workspace for Atmosphere] *************************************** 2026-04-07 09:01:37.105975 | instance | 2026-04-07 09:01:37.106453 | instance | TASK [Create folders for workspace] ******************************************** 2026-04-07 09:01:37.106869 | instance | Tuesday 07 April 2026 09:01:37 +0000 (0:00:01.092) 0:00:05.000 ********* 2026-04-07 09:01:38.311211 | instance | ok: [localhost] => (item=group_vars) 2026-04-07 09:01:38.311412 | instance | ok: [localhost] => (item=group_vars/all) 2026-04-07 09:01:38.311699 | instance | changed: [localhost] => (item=group_vars/controllers) 2026-04-07 09:01:38.311909 | instance | changed: [localhost] => (item=group_vars/cephs) 2026-04-07 09:01:38.312148 | instance | changed: [localhost] => (item=group_vars/computes) 2026-04-07 09:01:38.312388 | instance | ok: [localhost] => (item=host_vars) 2026-04-07 09:01:38.312616 | instance | 2026-04-07 09:01:38.312918 | instance | PLAY [Generate Ceph control plane configuration for workspace] ***************** 2026-04-07 09:01:38.313143 | instance | 2026-04-07 09:01:38.313380 | instance | TASK [Ensure the Ceph control plane configuration file exists] ***************** 2026-04-07 09:01:38.313622 | instance | Tuesday 07 April 2026 09:01:38 +0000 (0:00:01.207) 0:00:06.207 ********* 2026-04-07 09:01:38.570866 | instance | changed: [localhost] 2026-04-07 09:01:38.571099 | instance | 2026-04-07 09:01:38.571379 | instance | TASK [Load the current Ceph control plane configuration into a variable] ******* 2026-04-07 09:01:38.571657 | instance | Tuesday 07 April 2026 09:01:38 +0000 (0:00:00.258) 0:00:06.466 ********* 2026-04-07 09:01:38.628528 | instance | ok: [localhost] 2026-04-07 09:01:38.628826 | instance | 2026-04-07 09:01:38.629338 | instance | TASK [Generate Ceph control plane values for missing variables] **************** 2026-04-07 09:01:38.629675 | instance | Tuesday 07 April 2026 09:01:38 +0000 (0:00:00.058) 0:00:06.524 ********* 2026-04-07 09:01:38.700126 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': '33558cd0-98d1-564f-b5dd-cb79d49705d6'}) 2026-04-07 09:01:38.700244 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'}) 2026-04-07 09:01:38.700370 | instance | 2026-04-07 09:01:38.700545 | instance | TASK [Write new Ceph control plane configuration file to disk] ***************** 2026-04-07 09:01:38.700717 | instance | Tuesday 07 April 2026 09:01:38 +0000 (0:00:00.071) 0:00:06.596 ********* 2026-04-07 09:01:39.307137 | instance | changed: [localhost] 2026-04-07 09:01:39.307376 | instance | 2026-04-07 09:01:39.307660 | instance | PLAY [Generate Ceph OSD configuration for workspace] *************************** 2026-04-07 09:01:39.307912 | instance | 2026-04-07 09:01:39.308187 | instance | TASK [Ensure the Ceph OSDs configuration file exists] ************************** 2026-04-07 09:01:39.308460 | instance | Tuesday 07 April 2026 09:01:39 +0000 (0:00:00.606) 0:00:07.202 ********* 2026-04-07 09:01:39.550032 | instance | changed: [localhost] 2026-04-07 09:01:39.550249 | instance | 2026-04-07 09:01:39.550569 | instance | TASK [Load the current Ceph OSDs configuration into a variable] **************** 2026-04-07 09:01:39.550861 | instance | Tuesday 07 April 2026 09:01:39 +0000 (0:00:00.242) 0:00:07.445 ********* 2026-04-07 09:01:39.582865 | instance | ok: [localhost] 2026-04-07 09:01:39.583112 | instance | 2026-04-07 09:01:39.583413 | instance | TASK [Generate Ceph OSDs values for missing variables] ************************* 2026-04-07 09:01:39.583711 | instance | Tuesday 07 April 2026 09:01:39 +0000 (0:00:00.033) 0:00:07.478 ********* 2026-04-07 09:01:39.617040 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']}) 2026-04-07 09:01:39.617258 | instance | 2026-04-07 09:01:39.617596 | instance | TASK [Write new Ceph OSDs configuration file to disk] ************************** 2026-04-07 09:01:39.617891 | instance | Tuesday 07 April 2026 09:01:39 +0000 (0:00:00.034) 0:00:07.512 ********* 2026-04-07 09:01:39.984441 | instance | changed: [localhost] 2026-04-07 09:01:39.984530 | instance | 2026-04-07 09:01:39.984665 | instance | PLAY [Generate Kubernetes configuration for workspace] ************************* 2026-04-07 09:01:39.984786 | instance | 2026-04-07 09:01:39.984917 | instance | TASK [Ensure the Kubernetes configuration file exists] ************************* 2026-04-07 09:01:39.985048 | instance | Tuesday 07 April 2026 09:01:39 +0000 (0:00:00.368) 0:00:07.880 ********* 2026-04-07 09:01:40.189042 | instance | changed: [localhost] 2026-04-07 09:01:40.189244 | instance | 2026-04-07 09:01:40.189534 | instance | TASK [Load the current Kubernetes configuration into a variable] *************** 2026-04-07 09:01:40.189867 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.203) 0:00:08.084 ********* 2026-04-07 09:01:40.221463 | instance | ok: [localhost] 2026-04-07 09:01:40.221660 | instance | 2026-04-07 09:01:40.221846 | instance | TASK [Generate Kubernetes values for missing variables] ************************ 2026-04-07 09:01:40.222032 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.033) 0:00:08.117 ********* 2026-04-07 09:01:40.266689 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'}) 2026-04-07 09:01:40.266905 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42}) 2026-04-07 09:01:40.267170 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'}) 2026-04-07 09:01:40.267418 | instance | 2026-04-07 09:01:40.267679 | instance | TASK [Write new Kubernetes configuration file to disk] ************************* 2026-04-07 09:01:40.267936 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.044) 0:00:08.162 ********* 2026-04-07 09:01:40.642789 | instance | changed: [localhost] 2026-04-07 09:01:40.643042 | instance | 2026-04-07 09:01:40.643332 | instance | PLAY [Generate Keepalived configuration for workspace] ************************* 2026-04-07 09:01:40.643599 | instance | 2026-04-07 09:01:40.643862 | instance | TASK [Ensure the Keeaplived configuration file exists] ************************* 2026-04-07 09:01:40.644142 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.376) 0:00:08.538 ********* 2026-04-07 09:01:40.847132 | instance | changed: [localhost] 2026-04-07 09:01:40.847279 | instance | 2026-04-07 09:01:40.847481 | instance | TASK [Load the current Keepalived configuration into a variable] *************** 2026-04-07 09:01:40.847679 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.204) 0:00:08.742 ********* 2026-04-07 09:01:40.879478 | instance | ok: [localhost] 2026-04-07 09:01:40.879615 | instance | 2026-04-07 09:01:40.879817 | instance | TASK [Generate Keepalived values for missing variables] ************************ 2026-04-07 09:01:40.880015 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.031) 0:00:08.774 ********* 2026-04-07 09:01:40.915265 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'}) 2026-04-07 09:01:40.915415 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'}) 2026-04-07 09:01:40.915588 | instance | 2026-04-07 09:01:40.915776 | instance | TASK [Write new Keepalived configuration file to disk] ************************* 2026-04-07 09:01:40.915961 | instance | Tuesday 07 April 2026 09:01:40 +0000 (0:00:00.036) 0:00:08.810 ********* 2026-04-07 09:01:41.311825 | instance | changed: [localhost] 2026-04-07 09:01:41.312121 | instance | 2026-04-07 09:01:41.312494 | instance | PLAY [Generate endpoints for workspace] **************************************** 2026-04-07 09:01:41.312781 | instance | 2026-04-07 09:01:41.313127 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:01:41.313435 | instance | Tuesday 07 April 2026 09:01:41 +0000 (0:00:00.396) 0:00:09.207 ********* 2026-04-07 09:01:42.074207 | instance | ok: [localhost] 2026-04-07 09:01:42.074456 | instance | 2026-04-07 09:01:42.074840 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-07 09:01:42.075138 | instance | Tuesday 07 April 2026 09:01:42 +0000 (0:00:00.762) 0:00:09.970 ********* 2026-04-07 09:01:42.281088 | instance | changed: [localhost] 2026-04-07 09:01:42.281321 | instance | 2026-04-07 09:01:42.281603 | instance | TASK [Load the current endpoints into a variable] ****************************** 2026-04-07 09:01:42.281880 | instance | Tuesday 07 April 2026 09:01:42 +0000 (0:00:00.206) 0:00:10.176 ********* 2026-04-07 09:01:42.319822 | instance | ok: [localhost] 2026-04-07 09:01:42.320077 | instance | 2026-04-07 09:01:42.320369 | instance | TASK [Generate endpoint skeleton for missing variables] ************************ 2026-04-07 09:01:42.320685 | instance | Tuesday 07 April 2026 09:01:42 +0000 (0:00:00.039) 0:00:10.216 ********* 2026-04-07 09:01:43.068389 | instance | ok: [localhost] => (item=keycloak_host) 2026-04-07 09:01:43.068643 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host) 2026-04-07 09:01:43.068919 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host) 2026-04-07 09:01:43.069183 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host) 2026-04-07 09:01:43.069448 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name) 2026-04-07 09:01:43.069715 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host) 2026-04-07 09:01:43.069976 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host) 2026-04-07 09:01:43.070235 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host) 2026-04-07 09:01:43.070537 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host) 2026-04-07 09:01:43.070798 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host) 2026-04-07 09:01:43.071091 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host) 2026-04-07 09:01:43.071350 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host) 2026-04-07 09:01:43.071613 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host) 2026-04-07 09:01:43.071935 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host) 2026-04-07 09:01:43.072282 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host) 2026-04-07 09:01:43.072622 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host) 2026-04-07 09:01:43.072937 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host) 2026-04-07 09:01:43.073249 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host) 2026-04-07 09:01:43.073552 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host) 2026-04-07 09:01:43.073891 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host) 2026-04-07 09:01:43.074201 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host) 2026-04-07 09:01:43.074528 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host) 2026-04-07 09:01:43.074898 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host) 2026-04-07 09:01:43.075263 | instance | 2026-04-07 09:01:43.075569 | instance | TASK [Write new endpoints file to disk] **************************************** 2026-04-07 09:01:43.075876 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.747) 0:00:10.963 ********* 2026-04-07 09:01:43.454101 | instance | changed: [localhost] 2026-04-07 09:01:43.454343 | instance | 2026-04-07 09:01:43.454660 | instance | TASK [Ensure the endpoints file exists] **************************************** 2026-04-07 09:01:43.454932 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.385) 0:00:11.349 ********* 2026-04-07 09:01:43.676270 | instance | changed: [localhost] 2026-04-07 09:01:43.676380 | instance | 2026-04-07 09:01:43.676559 | instance | PLAY [Generate Neutron configuration for workspace] **************************** 2026-04-07 09:01:43.676716 | instance | 2026-04-07 09:01:43.676880 | instance | TASK [Ensure the Neutron configuration file exists] **************************** 2026-04-07 09:01:43.677051 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.222) 0:00:11.572 ********* 2026-04-07 09:01:43.911532 | instance | changed: [localhost] 2026-04-07 09:01:43.911646 | instance | 2026-04-07 09:01:43.911825 | instance | TASK [Load the current Neutron configuration into a variable] ****************** 2026-04-07 09:01:43.911994 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.235) 0:00:11.807 ********* 2026-04-07 09:01:43.950375 | instance | ok: [localhost] 2026-04-07 09:01:43.950672 | instance | 2026-04-07 09:01:43.950983 | instance | TASK [Generate Neutron values for missing variables] *************************** 2026-04-07 09:01:43.951266 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.039) 0:00:11.846 ********* 2026-04-07 09:01:43.995439 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]}) 2026-04-07 09:01:43.995738 | instance | 2026-04-07 09:01:43.996021 | instance | TASK [Write new Neutron configuration file to disk] **************************** 2026-04-07 09:01:43.996294 | instance | Tuesday 07 April 2026 09:01:43 +0000 (0:00:00.044) 0:00:11.891 ********* 2026-04-07 09:01:44.372028 | instance | changed: [localhost] 2026-04-07 09:01:44.372157 | instance | 2026-04-07 09:01:44.372339 | instance | PLAY [Generate Nova configuration for workspace] ******************************* 2026-04-07 09:01:44.372500 | instance | 2026-04-07 09:01:44.372678 | instance | TASK [Ensure the Nova configuration file exists] ******************************* 2026-04-07 09:01:44.372851 | instance | Tuesday 07 April 2026 09:01:44 +0000 (0:00:00.376) 0:00:12.267 ********* 2026-04-07 09:01:44.613796 | instance | changed: [localhost] 2026-04-07 09:01:44.614575 | instance | 2026-04-07 09:01:44.615010 | instance | TASK [Load the current Nova configuration into a variable] ********************* 2026-04-07 09:01:44.615297 | instance | Tuesday 07 April 2026 09:01:44 +0000 (0:00:00.241) 0:00:12.509 ********* 2026-04-07 09:01:44.652049 | instance | ok: [localhost] 2026-04-07 09:01:44.652261 | instance | 2026-04-07 09:01:44.652537 | instance | TASK [Generate Nova values for missing variables] ****************************** 2026-04-07 09:01:44.652809 | instance | Tuesday 07 April 2026 09:01:44 +0000 (0:00:00.038) 0:00:12.547 ********* 2026-04-07 09:01:44.695063 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]}) 2026-04-07 09:01:44.695280 | instance | 2026-04-07 09:01:44.695557 | instance | TASK [Write new Nova configuration file to disk] ******************************* 2026-04-07 09:01:44.695870 | instance | Tuesday 07 April 2026 09:01:44 +0000 (0:00:00.043) 0:00:12.590 ********* 2026-04-07 09:01:45.105201 | instance | changed: [localhost] 2026-04-07 09:01:45.105445 | instance | 2026-04-07 09:01:45.105728 | instance | PLAY [Generate secrets for workspace] ****************************************** 2026-04-07 09:01:45.105983 | instance | 2026-04-07 09:01:45.106341 | instance | TASK [Ensure the secrets file exists] ****************************************** 2026-04-07 09:01:45.106768 | instance | Tuesday 07 April 2026 09:01:45 +0000 (0:00:00.409) 0:00:13.000 ********* 2026-04-07 09:01:45.335303 | instance | changed: [localhost] 2026-04-07 09:01:45.335526 | instance | 2026-04-07 09:01:45.335934 | instance | TASK [Load the current secrets into a variable] ******************************** 2026-04-07 09:01:45.336562 | instance | Tuesday 07 April 2026 09:01:45 +0000 (0:00:00.230) 0:00:13.231 ********* 2026-04-07 09:01:45.370084 | instance | ok: [localhost] 2026-04-07 09:01:45.370309 | instance | 2026-04-07 09:01:45.370633 | instance | TASK [Generate secrets for missing variables] ********************************** 2026-04-07 09:01:45.370926 | instance | Tuesday 07 April 2026 09:01:45 +0000 (0:00:00.034) 0:00:13.265 ********* 2026-04-07 09:01:45.788520 | instance | ok: [localhost] => (item=heat_auth_encryption_key) 2026-04-07 09:01:45.788793 | instance | ok: [localhost] => (item=keepalived_password) 2026-04-07 09:01:45.789008 | instance | ok: [localhost] => (item=keycloak_admin_password) 2026-04-07 09:01:45.789228 | instance | ok: [localhost] => (item=keycloak_database_password) 2026-04-07 09:01:45.789462 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret) 2026-04-07 09:01:45.789673 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase) 2026-04-07 09:01:45.789884 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password) 2026-04-07 09:01:45.790093 | instance | ok: [localhost] => (item=octavia_heartbeat_key) 2026-04-07 09:01:45.790302 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password) 2026-04-07 09:01:45.790551 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key) 2026-04-07 09:01:45.790772 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password) 2026-04-07 09:01:45.790983 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password) 2026-04-07 09:01:45.791199 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password) 2026-04-07 09:01:45.791408 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password) 2026-04-07 09:01:45.791615 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password) 2026-04-07 09:01:45.791822 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password) 2026-04-07 09:01:45.792033 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password) 2026-04-07 09:01:45.792241 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password) 2026-04-07 09:01:45.792486 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password) 2026-04-07 09:01:45.792698 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password) 2026-04-07 09:01:45.792933 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password) 2026-04-07 09:01:45.793185 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password) 2026-04-07 09:01:45.793550 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password) 2026-04-07 09:01:45.793903 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password) 2026-04-07 09:01:45.794255 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password) 2026-04-07 09:01:45.794642 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password) 2026-04-07 09:01:45.794999 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret) 2026-04-07 09:01:45.795340 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password) 2026-04-07 09:01:45.795673 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password) 2026-04-07 09:01:45.796006 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password) 2026-04-07 09:01:45.796477 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password) 2026-04-07 09:01:45.796934 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password) 2026-04-07 09:01:45.797283 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password) 2026-04-07 09:01:45.797434 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password) 2026-04-07 09:01:45.797581 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password) 2026-04-07 09:01:45.797728 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password) 2026-04-07 09:01:45.797874 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password) 2026-04-07 09:01:45.798020 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password) 2026-04-07 09:01:45.798167 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password) 2026-04-07 09:01:45.798313 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password) 2026-04-07 09:01:45.798461 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password) 2026-04-07 09:01:45.798623 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password) 2026-04-07 09:01:45.798776 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password) 2026-04-07 09:01:45.798940 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password) 2026-04-07 09:01:45.799091 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password) 2026-04-07 09:01:45.799237 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password) 2026-04-07 09:01:45.799383 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password) 2026-04-07 09:01:45.799531 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password) 2026-04-07 09:01:45.799677 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password) 2026-04-07 09:01:45.799828 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password) 2026-04-07 09:01:45.799975 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password) 2026-04-07 09:01:45.800121 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password) 2026-04-07 09:01:45.800266 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password) 2026-04-07 09:01:45.800433 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password) 2026-04-07 09:01:45.800574 | instance | 2026-04-07 09:01:45.800724 | instance | TASK [Generate base64 encoded secrets] ***************************************** 2026-04-07 09:01:45.800872 | instance | Tuesday 07 April 2026 09:01:45 +0000 (0:00:00.418) 0:00:13.684 ********* 2026-04-07 09:01:45.849724 | instance | ok: [localhost] => (item=barbican_kek) 2026-04-07 09:01:45.849798 | instance | 2026-04-07 09:01:45.849975 | instance | TASK [Generate temporary files for generating keys for missing variables] ****** 2026-04-07 09:01:45.850133 | instance | Tuesday 07 April 2026 09:01:45 +0000 (0:00:00.059) 0:00:13.744 ********* 2026-04-07 09:01:46.288685 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-07 09:01:46.288963 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-07 09:01:46.289243 | instance | 2026-04-07 09:01:46.289519 | instance | TASK [Generate SSH keys for missing variables] ********************************* 2026-04-07 09:01:46.289792 | instance | Tuesday 07 April 2026 09:01:46 +0000 (0:00:00.440) 0:00:14.184 ********* 2026-04-07 09:01:52.659354 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-07 09:01:52.659680 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-07 09:01:52.659978 | instance | 2026-04-07 09:01:52.660353 | instance | TASK [Set values for SSH keys] ************************************************* 2026-04-07 09:01:52.660650 | instance | Tuesday 07 April 2026 09:01:52 +0000 (0:00:06.371) 0:00:20.555 ********* 2026-04-07 09:01:52.713487 | instance | ok: [localhost] => (item=manila_ssh_key) 2026-04-07 09:01:52.713882 | instance | ok: [localhost] => (item=nova_ssh_key) 2026-04-07 09:01:52.714192 | instance | 2026-04-07 09:01:52.714554 | instance | TASK [Delete the temporary files generated for SSH keys] *********************** 2026-04-07 09:01:52.714953 | instance | Tuesday 07 April 2026 09:01:52 +0000 (0:00:00.054) 0:00:20.609 ********* 2026-04-07 09:01:53.104745 | instance | changed: [localhost] => (item=manila_ssh_key) 2026-04-07 09:01:53.104946 | instance | changed: [localhost] => (item=nova_ssh_key) 2026-04-07 09:01:53.105123 | instance | 2026-04-07 09:01:53.105382 | instance | TASK [Write new secrets file to disk] ****************************************** 2026-04-07 09:01:53.105645 | instance | Tuesday 07 April 2026 09:01:53 +0000 (0:00:00.390) 0:00:21.000 ********* 2026-04-07 09:01:53.465588 | instance | changed: [localhost] 2026-04-07 09:01:53.465842 | instance | 2026-04-07 09:01:53.466151 | instance | TASK [Encrypt secrets file with Vault password] ******************************** 2026-04-07 09:01:53.466447 | instance | Tuesday 07 April 2026 09:01:53 +0000 (0:00:00.360) 0:00:21.361 ********* 2026-04-07 09:01:53.494284 | instance | skipping: [localhost] 2026-04-07 09:01:53.494502 | instance | 2026-04-07 09:01:53.494930 | instance | PLAY [Overwrite OSD devices with LVM-backed paths] ***************************** 2026-04-07 09:01:53.495223 | instance | 2026-04-07 09:01:53.495592 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:01:53.495957 | instance | Tuesday 07 April 2026 09:01:53 +0000 (0:00:00.029) 0:00:21.390 ********* 2026-04-07 09:01:54.197727 | instance | ok: [instance] 2026-04-07 09:01:54.197774 | instance | 2026-04-07 09:01:54.197780 | instance | TASK [Overwrite existing osds.yml file] **************************************** 2026-04-07 09:01:54.197788 | instance | Tuesday 07 April 2026 09:01:54 +0000 (0:00:00.702) 0:00:22.092 ********* 2026-04-07 09:01:54.588456 | instance | changed: [instance] 2026-04-07 09:01:54.588504 | instance | 2026-04-07 09:01:54.588511 | instance | PLAY [Setup networking] ******************************************************** 2026-04-07 09:01:54.588518 | instance | 2026-04-07 09:01:54.588523 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:01:54.588529 | instance | Tuesday 07 April 2026 09:01:54 +0000 (0:00:00.391) 0:00:22.484 ********* 2026-04-07 09:01:55.308647 | instance | ok: [instance] 2026-04-07 09:01:55.308683 | instance | 2026-04-07 09:01:55.308691 | instance | TASK [Create bridge for management network] ************************************ 2026-04-07 09:01:55.308697 | instance | Tuesday 07 April 2026 09:01:55 +0000 (0:00:00.720) 0:00:23.204 ********* 2026-04-07 09:01:55.635154 | instance | ok: [instance] 2026-04-07 09:01:55.635188 | instance | 2026-04-07 09:01:55.635194 | instance | TASK [Create fake interface for management bridge] ***************************** 2026-04-07 09:01:55.635199 | instance | Tuesday 07 April 2026 09:01:55 +0000 (0:00:00.326) 0:00:23.531 ********* 2026-04-07 09:01:55.866212 | instance | ok: [instance] 2026-04-07 09:01:55.866252 | instance | 2026-04-07 09:01:55.866258 | instance | TASK [Assign dummy interface to management bridge] ***************************** 2026-04-07 09:01:55.866263 | instance | Tuesday 07 April 2026 09:01:55 +0000 (0:00:00.230) 0:00:23.762 ********* 2026-04-07 09:01:56.083540 | instance | ok: [instance] 2026-04-07 09:01:56.083580 | instance | 2026-04-07 09:01:56.083586 | instance | TASK [Assign IP address for management bridge] ********************************* 2026-04-07 09:01:56.083591 | instance | Tuesday 07 April 2026 09:01:56 +0000 (0:00:00.216) 0:00:23.979 ********* 2026-04-07 09:01:56.295361 | instance | ok: [instance] 2026-04-07 09:01:56.295408 | instance | 2026-04-07 09:01:56.295416 | instance | TASK [Bring up interfaces] ***************************************************** 2026-04-07 09:01:56.295422 | instance | Tuesday 07 April 2026 09:01:56 +0000 (0:00:00.211) 0:00:24.191 ********* 2026-04-07 09:01:56.713817 | instance | ok: [instance] => (item=br-mgmt) 2026-04-07 09:01:56.713855 | instance | ok: [instance] => (item=dummy0) 2026-04-07 09:01:56.713861 | instance | 2026-04-07 09:01:56.713865 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-07 09:01:56.713870 | instance | 2026-04-07 09:01:56.713874 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:01:56.713878 | instance | Tuesday 07 April 2026 09:01:56 +0000 (0:00:00.418) 0:00:24.609 ********* 2026-04-07 09:01:57.458167 | instance | ok: [instance] 2026-04-07 09:01:57.458640 | instance | 2026-04-07 09:01:57.458653 | instance | TASK [Install depedencies] ***************************************************** 2026-04-07 09:01:57.458659 | instance | Tuesday 07 April 2026 09:01:57 +0000 (0:00:00.744) 0:00:25.353 ********* 2026-04-07 09:02:20.733520 | instance | changed: [instance] 2026-04-07 09:02:20.733645 | instance | 2026-04-07 09:02:20.734100 | instance | TASK [Start up service] ******************************************************** 2026-04-07 09:02:20.734146 | instance | Tuesday 07 April 2026 09:02:20 +0000 (0:00:23.275) 0:00:48.629 ********* 2026-04-07 09:02:21.346459 | instance | ok: [instance] 2026-04-07 09:02:21.346576 | instance | 2026-04-07 09:02:21.346972 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-07 09:02:21.347039 | instance | Tuesday 07 April 2026 09:02:21 +0000 (0:00:00.612) 0:00:49.242 ********* 2026-04-07 09:02:21.601838 | instance | ok: [instance] 2026-04-07 09:02:21.602027 | instance | 2026-04-07 09:02:21.602693 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-07 09:02:21.602804 | instance | Tuesday 07 April 2026 09:02:21 +0000 (0:00:00.255) 0:00:49.497 ********* 2026-04-07 09:02:22.000892 | instance | changed: [instance] 2026-04-07 09:02:22.000997 | instance | 2026-04-07 09:02:22.001065 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-07 09:02:22.001224 | instance | Tuesday 07 April 2026 09:02:21 +0000 (0:00:00.399) 0:00:49.897 ********* 2026-04-07 09:02:22.219953 | instance | ok: [instance] 2026-04-07 09:02:22.220023 | instance | 2026-04-07 09:02:22.220307 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-07 09:02:22.220364 | instance | Tuesday 07 April 2026 09:02:22 +0000 (0:00:00.218) 0:00:50.115 ********* 2026-04-07 09:02:22.248009 | instance | skipping: [instance] 2026-04-07 09:02:22.248113 | instance | 2026-04-07 09:02:22.248183 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-07 09:02:22.248334 | instance | Tuesday 07 April 2026 09:02:22 +0000 (0:00:00.028) 0:00:50.144 ********* 2026-04-07 09:02:22.868709 | instance | changed: [instance] => (item=osd0) 2026-04-07 09:02:22.869405 | instance | changed: [instance] => (item=osd1) 2026-04-07 09:02:22.869470 | instance | changed: [instance] => (item=osd2) 2026-04-07 09:02:22.869476 | instance | 2026-04-07 09:02:22.869481 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-07 09:02:22.869487 | instance | Tuesday 07 April 2026 09:02:22 +0000 (0:00:00.619) 0:00:50.764 ********* 2026-04-07 09:02:23.454894 | instance | changed: [instance] => (item=osd0) 2026-04-07 09:02:23.455011 | instance | changed: [instance] => (item=osd1) 2026-04-07 09:02:23.455840 | instance | changed: [instance] => (item=osd2) 2026-04-07 09:02:23.455907 | instance | 2026-04-07 09:02:23.455916 | instance | TASK [Start loop devices] ****************************************************** 2026-04-07 09:02:23.455924 | instance | Tuesday 07 April 2026 09:02:23 +0000 (0:00:00.586) 0:00:51.350 ********* 2026-04-07 09:02:24.187450 | instance | changed: [instance] => (item=osd0) 2026-04-07 09:02:24.187519 | instance | changed: [instance] => (item=osd1) 2026-04-07 09:02:24.187559 | instance | changed: [instance] => (item=osd2) 2026-04-07 09:02:24.187566 | instance | 2026-04-07 09:02:24.187573 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-07 09:02:24.187580 | instance | Tuesday 07 April 2026 09:02:24 +0000 (0:00:00.731) 0:00:52.082 ********* 2026-04-07 09:02:27.380704 | instance | changed: [instance] => (item=osd0) 2026-04-07 09:02:27.380793 | instance | changed: [instance] => (item=osd1) 2026-04-07 09:02:27.381301 | instance | changed: [instance] => (item=osd2) 2026-04-07 09:02:27.381538 | instance | 2026-04-07 09:02:27.381545 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-07 09:02:27.381550 | instance | Tuesday 07 April 2026 09:02:27 +0000 (0:00:03.194) 0:00:55.277 ********* 2026-04-07 09:02:29.422824 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-07 09:02:29.422948 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-07 09:02:29.423029 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-07 09:02:29.423148 | instance | 2026-04-07 09:02:29.423269 | instance | PLAY [controllers] ************************************************************* 2026-04-07 09:02:29.423383 | instance | 2026-04-07 09:02:29.423494 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:02:29.423651 | instance | Tuesday 07 April 2026 09:02:29 +0000 (0:00:02.041) 0:00:57.318 ********* 2026-04-07 09:02:30.363661 | instance | ok: [instance] 2026-04-07 09:02:30.363820 | instance | 2026-04-07 09:02:30.364143 | instance | TASK [Set masquerade rule] ***************************************************** 2026-04-07 09:02:30.364409 | instance | Tuesday 07 April 2026 09:02:30 +0000 (0:00:00.940) 0:00:58.259 ********* 2026-04-07 09:02:30.863813 | instance | changed: [instance] 2026-04-07 09:02:30.863937 | instance | 2026-04-07 09:02:30.864108 | instance | PLAY RECAP ********************************************************************* 2026-04-07 09:02:30.864319 | instance | instance : ok=26 changed=11 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-07 09:02:30.864476 | instance | localhost : ok=40 changed=21 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-07 09:02:30.864633 | instance | 2026-04-07 09:02:30.864783 | instance | Tuesday 07 April 2026 09:02:30 +0000 (0:00:00.500) 0:00:58.759 ********* 2026-04-07 09:02:30.864939 | instance | =============================================================================== 2026-04-07 09:02:30.865093 | instance | Install depedencies ---------------------------------------------------- 23.28s 2026-04-07 09:02:30.865250 | instance | Generate SSH keys for missing variables --------------------------------- 6.37s 2026-04-07 09:02:30.865407 | instance | Create a volume group for each loop device ------------------------------ 3.19s 2026-04-07 09:02:30.865567 | instance | Create a logical volume for each loop device ---------------------------- 2.04s 2026-04-07 09:02:30.865733 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.69s 2026-04-07 09:02:30.865945 | instance | Create folders for workspace -------------------------------------------- 1.21s 2026-04-07 09:02:30.866125 | instance | Purge "snapd" package --------------------------------------------------- 1.09s 2026-04-07 09:02:30.866304 | instance | Gathering Facts --------------------------------------------------------- 0.96s 2026-04-07 09:02:30.866466 | instance | Gathering Facts --------------------------------------------------------- 0.94s 2026-04-07 09:02:30.866652 | instance | Configure short hostname ------------------------------------------------ 0.83s 2026-04-07 09:02:30.866814 | instance | Gathering Facts --------------------------------------------------------- 0.76s 2026-04-07 09:02:30.867015 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.75s 2026-04-07 09:02:30.867158 | instance | Gathering Facts --------------------------------------------------------- 0.74s 2026-04-07 09:02:30.867311 | instance | Start loop devices ------------------------------------------------------ 0.73s 2026-04-07 09:02:30.867470 | instance | Gathering Facts --------------------------------------------------------- 0.72s 2026-04-07 09:02:30.867627 | instance | Gathering Facts --------------------------------------------------------- 0.70s 2026-04-07 09:02:30.867802 | instance | Create devices for Ceph ------------------------------------------------- 0.62s 2026-04-07 09:02:30.867981 | instance | Start up service -------------------------------------------------------- 0.61s 2026-04-07 09:02:30.868162 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.61s 2026-04-07 09:02:30.868345 | instance | Set permissions on loopback devices ------------------------------------- 0.59s 2026-04-07 09:02:30.941731 | instance | INFO [aio > prepare] Executed: Successful 2026-04-07 09:02:30.955612 | instance | INFO [aio > converge] Executing 2026-04-07 09:02:33.696416 | instance | 2026-04-07 09:02:33.696640 | instance | PLAY [all] ********************************************************************* 2026-04-07 09:02:33.696913 | instance | 2026-04-07 09:02:33.697203 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:02:33.697468 | instance | Tuesday 07 April 2026 09:02:33 +0000 (0:00:00.022) 0:00:00.022 ********* 2026-04-07 09:02:35.001553 | instance | ok: [instance] 2026-04-07 09:02:35.001745 | instance | 2026-04-07 09:02:35.002074 | instance | TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-04-07 09:02:35.002351 | instance | Tuesday 07 April 2026 09:02:34 +0000 (0:00:01.304) 0:00:01.327 ********* 2026-04-07 09:02:35.045696 | instance | skipping: [instance] 2026-04-07 09:02:35.045985 | instance | 2026-04-07 09:02:35.046190 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-07 09:02:35.046450 | instance | Tuesday 07 April 2026 09:02:35 +0000 (0:00:00.044) 0:00:01.371 ********* 2026-04-07 09:02:35.318633 | instance | ok: [instance] 2026-04-07 09:02:35.318876 | instance | 2026-04-07 09:02:35.319135 | instance | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-07 09:02:35.319383 | instance | 2026-04-07 09:02:35.319774 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:02:35.320059 | instance | Tuesday 07 April 2026 09:02:35 +0000 (0:00:00.272) 0:00:01.644 ********* 2026-04-07 09:02:36.246182 | instance | ok: [instance] 2026-04-07 09:02:36.246490 | instance | 2026-04-07 09:02:36.246913 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:02:36.247224 | instance | Tuesday 07 April 2026 09:02:36 +0000 (0:00:00.927) 0:00:02.571 ********* 2026-04-07 09:02:36.575799 | instance | ok: [instance] 2026-04-07 09:02:36.575903 | instance | 2026-04-07 09:02:36.576084 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:02:36.576255 | instance | Tuesday 07 April 2026 09:02:36 +0000 (0:00:00.330) 0:00:02.902 ********* 2026-04-07 09:02:36.619183 | instance | skipping: [instance] 2026-04-07 09:02:36.619254 | instance | 2026-04-07 09:02:36.619399 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-07 09:02:36.619566 | instance | Tuesday 07 April 2026 09:02:36 +0000 (0:00:00.043) 0:00:02.945 ********* 2026-04-07 09:02:36.949132 | instance | changed: [instance] 2026-04-07 09:02:36.949368 | instance | 2026-04-07 09:02:36.949661 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:02:36.949943 | instance | Tuesday 07 April 2026 09:02:36 +0000 (0:00:00.329) 0:00:03.275 ********* 2026-04-07 09:02:37.021461 | instance | ok: [instance] => { 2026-04-07 09:02:37.021729 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-04-07 09:02:37.021992 | instance | } 2026-04-07 09:02:37.022447 | instance | 2026-04-07 09:02:37.022758 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:02:37.023027 | instance | Tuesday 07 April 2026 09:02:37 +0000 (0:00:00.071) 0:00:03.347 ********* 2026-04-07 09:02:37.722584 | instance | changed: [instance] 2026-04-07 09:02:37.722754 | instance | 2026-04-07 09:02:37.722765 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:02:37.722784 | instance | Tuesday 07 April 2026 09:02:37 +0000 (0:00:00.700) 0:00:04.048 ********* 2026-04-07 09:02:37.771888 | instance | skipping: [instance] 2026-04-07 09:02:37.771959 | instance | 2026-04-07 09:02:37.772187 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:02:37.772224 | instance | Tuesday 07 April 2026 09:02:37 +0000 (0:00:00.050) 0:00:04.098 ********* 2026-04-07 09:02:37.820888 | instance | skipping: [instance] 2026-04-07 09:02:37.821270 | instance | 2026-04-07 09:02:37.821311 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:02:37.821317 | instance | Tuesday 07 April 2026 09:02:37 +0000 (0:00:00.048) 0:00:04.147 ********* 2026-04-07 09:02:38.049368 | instance | ok: [instance] 2026-04-07 09:02:38.049450 | instance | 2026-04-07 09:02:38.049678 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:02:38.049712 | instance | Tuesday 07 April 2026 09:02:38 +0000 (0:00:00.228) 0:00:04.376 ********* 2026-04-07 09:02:39.466716 | instance | ok: [instance] 2026-04-07 09:02:39.466805 | instance | 2026-04-07 09:02:39.466851 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:02:39.467004 | instance | Tuesday 07 April 2026 09:02:39 +0000 (0:00:01.417) 0:00:05.793 ********* 2026-04-07 09:02:39.531959 | instance | ok: [instance] => { 2026-04-07 09:02:39.532429 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-04-07 09:02:39.534337 | instance | } 2026-04-07 09:02:39.534358 | instance | 2026-04-07 09:02:39.534379 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:02:39.534389 | instance | Tuesday 07 April 2026 09:02:39 +0000 (0:00:00.065) 0:00:05.858 ********* 2026-04-07 09:02:40.609248 | instance | changed: [instance] 2026-04-07 09:02:40.609386 | instance | 2026-04-07 09:02:40.609601 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:02:40.609765 | instance | Tuesday 07 April 2026 09:02:40 +0000 (0:00:01.077) 0:00:06.935 ********* 2026-04-07 09:02:43.534191 | instance | changed: [instance] 2026-04-07 09:02:43.534253 | instance | 2026-04-07 09:02:43.534303 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-07 09:02:43.534681 | instance | Tuesday 07 April 2026 09:02:43 +0000 (0:00:02.924) 0:00:09.860 ********* 2026-04-07 09:02:43.565286 | instance | skipping: [instance] 2026-04-07 09:02:43.565437 | instance | 2026-04-07 09:02:43.565613 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-07 09:02:43.565917 | instance | Tuesday 07 April 2026 09:02:43 +0000 (0:00:00.031) 0:00:09.891 ********* 2026-04-07 09:02:43.595036 | instance | skipping: [instance] 2026-04-07 09:02:43.595138 | instance | 2026-04-07 09:02:43.595272 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-07 09:02:43.595461 | instance | Tuesday 07 April 2026 09:02:43 +0000 (0:00:00.029) 0:00:09.921 ********* 2026-04-07 09:02:43.630841 | instance | skipping: [instance] 2026-04-07 09:02:43.631035 | instance | 2026-04-07 09:02:43.631204 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-07 09:02:43.631381 | instance | Tuesday 07 April 2026 09:02:43 +0000 (0:00:00.032) 0:00:09.953 ********* 2026-04-07 09:02:49.849671 | instance | changed: [instance] 2026-04-07 09:02:49.849763 | instance | 2026-04-07 09:02:49.849776 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-07 09:02:49.849788 | instance | Tuesday 07 April 2026 09:02:49 +0000 (0:00:06.220) 0:00:16.174 ********* 2026-04-07 09:02:50.322608 | instance | changed: [instance] 2026-04-07 09:02:50.322810 | instance | 2026-04-07 09:02:50.323101 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-07 09:02:50.323381 | instance | Tuesday 07 April 2026 09:02:50 +0000 (0:00:00.474) 0:00:16.648 ********* 2026-04-07 09:02:51.326677 | instance | changed: [instance] => (item={'path': '/etc/containerd'}) 2026-04-07 09:02:51.326754 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-07 09:02:51.326769 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-07 09:02:51.326781 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-07 09:02:51.326792 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-07 09:02:51.326802 | instance | 2026-04-07 09:02:51.326811 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-07 09:02:51.326820 | instance | Tuesday 07 April 2026 09:02:51 +0000 (0:00:01.002) 0:00:17.650 ********* 2026-04-07 09:02:51.844809 | instance | changed: [instance] 2026-04-07 09:02:51.844881 | instance | 2026-04-07 09:02:51.845531 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-07 09:02:51.845692 | instance | Tuesday 07 April 2026 09:02:51 +0000 (0:00:00.512) 0:00:18.163 ********* 2026-04-07 09:02:51.845698 | instance | 2026-04-07 09:02:51.845703 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-07 09:02:51.845707 | instance | Tuesday 07 April 2026 09:02:51 +0000 (0:00:00.008) 0:00:18.171 ********* 2026-04-07 09:02:52.810252 | instance | ok: [instance] 2026-04-07 09:02:52.810328 | instance | 2026-04-07 09:02:52.810695 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-07 09:02:52.810773 | instance | Tuesday 07 April 2026 09:02:52 +0000 (0:00:00.965) 0:00:19.136 ********* 2026-04-07 09:02:53.308915 | instance | changed: [instance] 2026-04-07 09:02:53.309043 | instance | 2026-04-07 09:02:53.309130 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-07 09:02:53.309266 | instance | Tuesday 07 April 2026 09:02:53 +0000 (0:00:00.498) 0:00:19.635 ********* 2026-04-07 09:02:53.917090 | instance | changed: [instance] 2026-04-07 09:02:53.917207 | instance | 2026-04-07 09:02:53.917508 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:02:53.917586 | instance | Tuesday 07 April 2026 09:02:53 +0000 (0:00:00.607) 0:00:20.243 ********* 2026-04-07 09:02:54.172632 | instance | ok: [instance] 2026-04-07 09:02:54.172753 | instance | 2026-04-07 09:02:54.172833 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:02:54.173058 | instance | Tuesday 07 April 2026 09:02:54 +0000 (0:00:00.255) 0:00:20.498 ********* 2026-04-07 09:02:54.233436 | instance | ok: [instance] => { 2026-04-07 09:02:54.233529 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-07 09:02:54.233825 | instance | } 2026-04-07 09:02:54.233930 | instance | 2026-04-07 09:02:54.233951 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:02:54.234050 | instance | Tuesday 07 April 2026 09:02:54 +0000 (0:00:00.061) 0:00:20.559 ********* 2026-04-07 09:02:55.108912 | instance | changed: [instance] 2026-04-07 09:02:55.109036 | instance | 2026-04-07 09:02:55.109049 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:02:55.109137 | instance | Tuesday 07 April 2026 09:02:55 +0000 (0:00:00.875) 0:00:21.435 ********* 2026-04-07 09:02:59.475607 | instance | changed: [instance] 2026-04-07 09:02:59.475649 | instance | 2026-04-07 09:02:59.475655 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-07 09:02:59.475660 | instance | Tuesday 07 April 2026 09:02:59 +0000 (0:00:04.366) 0:00:25.801 ********* 2026-04-07 09:03:00.732395 | instance | ok: [instance] 2026-04-07 09:03:00.732431 | instance | 2026-04-07 09:03:00.732436 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-07 09:03:00.732441 | instance | Tuesday 07 April 2026 09:03:00 +0000 (0:00:01.256) 0:00:27.058 ********* 2026-04-07 09:03:02.265192 | instance | changed: [instance] 2026-04-07 09:03:02.265298 | instance | 2026-04-07 09:03:02.265526 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-07 09:03:02.265566 | instance | Tuesday 07 April 2026 09:03:02 +0000 (0:00:01.533) 0:00:28.591 ********* 2026-04-07 09:03:02.656633 | instance | changed: [instance] 2026-04-07 09:03:02.656716 | instance | 2026-04-07 09:03:02.656983 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-07 09:03:02.657022 | instance | Tuesday 07 April 2026 09:03:02 +0000 (0:00:00.391) 0:00:28.983 ********* 2026-04-07 09:03:03.308014 | instance | changed: [instance] => (item={'path': '/etc/docker'}) 2026-04-07 09:03:03.308180 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-07 09:03:03.308967 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-07 09:03:03.309011 | instance | 2026-04-07 09:03:03.309019 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-07 09:03:03.309026 | instance | Tuesday 07 April 2026 09:03:03 +0000 (0:00:00.651) 0:00:29.634 ********* 2026-04-07 09:03:03.694901 | instance | changed: [instance] 2026-04-07 09:03:03.694985 | instance | 2026-04-07 09:03:03.695216 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-07 09:03:03.695270 | instance | Tuesday 07 April 2026 09:03:03 +0000 (0:00:00.387) 0:00:30.021 ********* 2026-04-07 09:03:04.080640 | instance | changed: [instance] 2026-04-07 09:03:04.080722 | instance | 2026-04-07 09:03:04.080785 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-07 09:03:04.081304 | instance | Tuesday 07 April 2026 09:03:04 +0000 (0:00:00.374) 0:00:30.395 ********* 2026-04-07 09:03:04.081346 | instance | 2026-04-07 09:03:04.081352 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-07 09:03:04.081356 | instance | Tuesday 07 April 2026 09:03:04 +0000 (0:00:00.010) 0:00:30.406 ********* 2026-04-07 09:03:04.763419 | instance | ok: [instance] 2026-04-07 09:03:04.763473 | instance | 2026-04-07 09:03:04.763483 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-07 09:03:04.763491 | instance | Tuesday 07 April 2026 09:03:04 +0000 (0:00:00.682) 0:00:31.089 ********* 2026-04-07 09:03:06.073741 | instance | changed: [instance] 2026-04-07 09:03:06.073831 | instance | 2026-04-07 09:03:06.074105 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-07 09:03:06.074143 | instance | Tuesday 07 April 2026 09:03:06 +0000 (0:00:01.311) 0:00:32.400 ********* 2026-04-07 09:03:06.620622 | instance | changed: [instance] 2026-04-07 09:03:06.620681 | instance | 2026-04-07 09:03:06.620925 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-07 09:03:06.620941 | instance | Tuesday 07 April 2026 09:03:06 +0000 (0:00:00.546) 0:00:32.947 ********* 2026-04-07 09:03:06.677532 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-07 09:03:06.678038 | instance | 2026-04-07 09:03:06.678056 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-07 09:03:06.678076 | instance | Tuesday 07 April 2026 09:03:06 +0000 (0:00:00.056) 0:00:33.004 ********* 2026-04-07 09:03:12.096114 | instance | changed: [instance] 2026-04-07 09:03:12.096188 | instance | 2026-04-07 09:03:12.096466 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-07 09:03:12.096666 | instance | Tuesday 07 April 2026 09:03:12 +0000 (0:00:05.418) 0:00:38.422 ********* 2026-04-07 09:03:12.793162 | instance | ok: [instance] => (item=chronyd) 2026-04-07 09:03:12.793243 | instance | ok: [instance] => (item=sshd) 2026-04-07 09:03:12.793633 | instance | 2026-04-07 09:03:12.793672 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-07 09:03:12.793678 | instance | Tuesday 07 April 2026 09:03:12 +0000 (0:00:00.696) 0:00:39.119 ********* 2026-04-07 09:03:13.502742 | instance | changed: [instance] 2026-04-07 09:03:13.502854 | instance | 2026-04-07 09:03:13.503152 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-07 09:03:13.503194 | instance | Tuesday 07 April 2026 09:03:13 +0000 (0:00:00.709) 0:00:39.829 ********* 2026-04-07 09:03:13.720314 | instance | ok: [instance] 2026-04-07 09:03:13.720389 | instance | 2026-04-07 09:03:13.720646 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-07 09:03:13.720683 | instance | Tuesday 07 April 2026 09:03:13 +0000 (0:00:00.217) 0:00:40.047 ********* 2026-04-07 09:03:14.204763 | instance | changed: [instance] 2026-04-07 09:03:14.204846 | instance | 2026-04-07 09:03:14.205091 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-07 09:03:14.205106 | instance | Tuesday 07 April 2026 09:03:14 +0000 (0:00:00.484) 0:00:40.531 ********* 2026-04-07 09:03:14.598802 | instance | changed: [instance] 2026-04-07 09:03:14.598919 | instance | 2026-04-07 09:03:14.598934 | instance | TASK [vexxhost.ceph.mon : Get `cephadm ls` status] ***************************** 2026-04-07 09:03:14.598954 | instance | Tuesday 07 April 2026 09:03:14 +0000 (0:00:00.393) 0:00:40.925 ********* 2026-04-07 09:03:16.210508 | instance | ok: [instance] 2026-04-07 09:03:16.210921 | instance | 2026-04-07 09:03:16.210967 | instance | TASK [vexxhost.ceph.mon : Parse the `cephadm ls` output] *********************** 2026-04-07 09:03:16.210973 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:01.612) 0:00:42.537 ********* 2026-04-07 09:03:16.267175 | instance | ok: [instance] 2026-04-07 09:03:16.267260 | instance | 2026-04-07 09:03:16.267540 | instance | TASK [vexxhost.ceph.mon : Assimilate existing configs in `ceph.conf`] ********** 2026-04-07 09:03:16.267586 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.056) 0:00:42.593 ********* 2026-04-07 09:03:16.299285 | instance | skipping: [instance] 2026-04-07 09:03:16.299382 | instance | 2026-04-07 09:03:16.299656 | instance | TASK [vexxhost.ceph.mon : Adopt monitor to cluster] **************************** 2026-04-07 09:03:16.299746 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.032) 0:00:42.626 ********* 2026-04-07 09:03:16.331954 | instance | skipping: [instance] 2026-04-07 09:03:16.332046 | instance | 2026-04-07 09:03:16.332131 | instance | TASK [vexxhost.ceph.mon : Adopt manager to cluster] **************************** 2026-04-07 09:03:16.332270 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.032) 0:00:42.658 ********* 2026-04-07 09:03:16.368090 | instance | skipping: [instance] 2026-04-07 09:03:16.368635 | instance | 2026-04-07 09:03:16.368684 | instance | TASK [vexxhost.ceph.mon : Enable "cephadm" mgr module] ************************* 2026-04-07 09:03:16.368694 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.035) 0:00:42.694 ********* 2026-04-07 09:03:16.400365 | instance | skipping: [instance] 2026-04-07 09:03:16.400432 | instance | 2026-04-07 09:03:16.400564 | instance | TASK [vexxhost.ceph.mon : Set orchestrator backend to "cephadm"] *************** 2026-04-07 09:03:16.400700 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.032) 0:00:42.727 ********* 2026-04-07 09:03:16.429887 | instance | skipping: [instance] 2026-04-07 09:03:16.430005 | instance | 2026-04-07 09:03:16.430197 | instance | TASK [vexxhost.ceph.mon : Use `cephadm` user for cephadm] ********************** 2026-04-07 09:03:16.430352 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.029) 0:00:42.756 ********* 2026-04-07 09:03:16.463746 | instance | skipping: [instance] 2026-04-07 09:03:16.463861 | instance | 2026-04-07 09:03:16.464076 | instance | TASK [vexxhost.ceph.mon : Generate "cephadm" key] ****************************** 2026-04-07 09:03:16.464260 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.033) 0:00:42.790 ********* 2026-04-07 09:03:16.500147 | instance | skipping: [instance] 2026-04-07 09:03:16.500216 | instance | 2026-04-07 09:03:16.500355 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-07 09:03:16.500544 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.036) 0:00:42.826 ********* 2026-04-07 09:03:16.607399 | instance | ok: [instance] 2026-04-07 09:03:16.607478 | instance | 2026-04-07 09:03:16.607569 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-07 09:03:16.607762 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.107) 0:00:42.933 ********* 2026-04-07 09:03:16.865044 | instance | ok: [instance] => (item=instance) 2026-04-07 09:03:16.865105 | instance | 2026-04-07 09:03:16.865394 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-07 09:03:16.865430 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.257) 0:00:43.191 ********* 2026-04-07 09:03:16.915849 | instance | ok: [instance] 2026-04-07 09:03:16.915950 | instance | 2026-04-07 09:03:16.916218 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-07 09:03:16.916258 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.050) 0:00:43.242 ********* 2026-04-07 09:03:16.999216 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance 2026-04-07 09:03:16.999261 | instance | 2026-04-07 09:03:16.999267 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-07 09:03:16.999272 | instance | Tuesday 07 April 2026 09:03:16 +0000 (0:00:00.082) 0:00:43.325 ********* 2026-04-07 09:03:17.287975 | instance | changed: [instance] 2026-04-07 09:03:17.288054 | instance | 2026-04-07 09:03:17.288300 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-07 09:03:17.288339 | instance | Tuesday 07 April 2026 09:03:17 +0000 (0:00:00.289) 0:00:43.614 ********* 2026-04-07 09:03:18.008411 | instance | changed: [instance] => (item={'section': 'global', 'option': 'mon allow pool size one', 'value': True}) 2026-04-07 09:03:18.008508 | instance | changed: [instance] => (item={'section': 'global', 'option': 'osd crush chooseleaf type', 'value': 0}) 2026-04-07 09:03:18.008978 | instance | changed: [instance] => (item={'section': 'mon', 'option': 'auth allow insecure global id reclaim', 'value': False}) 2026-04-07 09:03:18.008992 | instance | 2026-04-07 09:03:18.008998 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap coomand] ******************************* 2026-04-07 09:03:18.009002 | instance | Tuesday 07 April 2026 09:03:18 +0000 (0:00:00.720) 0:00:44.335 ********* 2026-04-07 09:06:12.638640 | instance | ok: [instance] 2026-04-07 09:06:12.638714 | instance | 2026-04-07 09:06:12.638760 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-07 09:06:12.638911 | instance | Tuesday 07 April 2026 09:06:12 +0000 (0:02:54.629) 0:03:38.964 ********* 2026-04-07 09:06:12.879469 | instance | changed: [instance] 2026-04-07 09:06:12.879591 | instance | 2026-04-07 09:06:12.879769 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-07 09:06:12.879959 | instance | Tuesday 07 April 2026 09:06:12 +0000 (0:00:00.241) 0:03:39.205 ********* 2026-04-07 09:06:12.924419 | instance | ok: [instance] 2026-04-07 09:06:12.924470 | instance | 2026-04-07 09:06:12.924626 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-07 09:06:12.924745 | instance | Tuesday 07 April 2026 09:06:12 +0000 (0:00:00.045) 0:03:39.251 ********* 2026-04-07 09:06:13.025945 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-07 09:06:13.026042 | instance | 2026-04-07 09:06:13.026352 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-07 09:06:13.026416 | instance | Tuesday 07 April 2026 09:06:13 +0000 (0:00:00.101) 0:03:39.352 ********* 2026-04-07 09:06:14.735946 | instance | ok: [instance] 2026-04-07 09:06:14.736028 | instance | 2026-04-07 09:06:14.736052 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-07 09:06:14.736060 | instance | Tuesday 07 April 2026 09:06:14 +0000 (0:00:01.709) 0:03:41.061 ********* 2026-04-07 09:06:14.798408 | instance | ok: [instance] => (item=instance) 2026-04-07 09:06:14.798440 | instance | 2026-04-07 09:06:14.798445 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-07 09:06:14.798450 | instance | Tuesday 07 April 2026 09:06:14 +0000 (0:00:00.063) 0:03:41.124 ********* 2026-04-07 09:06:15.311515 | instance | ok: [instance] 2026-04-07 09:06:15.311613 | instance | 2026-04-07 09:06:15.311865 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-07 09:06:15.312054 | instance | Tuesday 07 April 2026 09:06:15 +0000 (0:00:00.513) 0:03:41.638 ********* 2026-04-07 09:06:17.470766 | instance | ok: [instance] 2026-04-07 09:06:17.470912 | instance | 2026-04-07 09:06:17.470924 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-07 09:06:17.470942 | instance | Tuesday 07 April 2026 09:06:17 +0000 (0:00:02.156) 0:03:43.794 ********* 2026-04-07 09:06:19.303306 | instance | ok: [instance] 2026-04-07 09:06:19.303360 | instance | 2026-04-07 09:06:19.303368 | instance | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-07 09:06:19.303374 | instance | Tuesday 07 April 2026 09:06:19 +0000 (0:00:01.834) 0:03:45.629 ********* 2026-04-07 09:06:29.738938 | instance | ok: [instance] 2026-04-07 09:06:29.739010 | instance | 2026-04-07 09:06:29.739296 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-07 09:06:29.739313 | instance | Tuesday 07 April 2026 09:06:29 +0000 (0:00:10.436) 0:03:56.065 ********* 2026-04-07 09:06:29.820945 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-07 09:06:29.821013 | instance | 2026-04-07 09:06:29.821294 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-07 09:06:29.821310 | instance | Tuesday 07 April 2026 09:06:29 +0000 (0:00:00.081) 0:03:56.147 ********* 2026-04-07 09:06:29.864377 | instance | skipping: [instance] 2026-04-07 09:06:29.864845 | instance | 2026-04-07 09:06:29.864869 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-07 09:06:29.864877 | instance | Tuesday 07 April 2026 09:06:29 +0000 (0:00:00.043) 0:03:56.191 ********* 2026-04-07 09:06:29.917974 | instance | skipping: [instance] => (item=instance) 2026-04-07 09:06:29.918519 | instance | skipping: [instance] 2026-04-07 09:06:29.918587 | instance | 2026-04-07 09:06:29.918594 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-07 09:06:29.918600 | instance | Tuesday 07 April 2026 09:06:29 +0000 (0:00:00.053) 0:03:56.244 ********* 2026-04-07 09:06:30.254048 | instance | ok: [instance] 2026-04-07 09:06:30.254190 | instance | 2026-04-07 09:06:30.254553 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-07 09:06:30.254595 | instance | Tuesday 07 April 2026 09:06:30 +0000 (0:00:00.336) 0:03:56.580 ********* 2026-04-07 09:06:32.320731 | instance | ok: [instance] 2026-04-07 09:06:32.320827 | instance | 2026-04-07 09:06:32.321087 | instance | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-07 09:06:32.321151 | instance | Tuesday 07 April 2026 09:06:32 +0000 (0:00:02.066) 0:03:58.646 ********* 2026-04-07 09:06:34.081238 | instance | ok: [instance] 2026-04-07 09:06:34.081319 | instance | 2026-04-07 09:06:34.081598 | instance | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-07 09:06:34.081667 | instance | Tuesday 07 April 2026 09:06:34 +0000 (0:00:01.760) 0:04:00.407 ********* 2026-04-07 09:06:35.737341 | instance | ok: [instance] 2026-04-07 09:06:35.737451 | instance | 2026-04-07 09:06:35.737521 | instance | TASK [vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module] *********** 2026-04-07 09:06:35.737682 | instance | Tuesday 07 April 2026 09:06:35 +0000 (0:00:01.656) 0:04:02.063 ********* 2026-04-07 09:06:38.258771 | instance | ok: [instance] 2026-04-07 09:06:38.258862 | instance | 2026-04-07 09:06:38.258960 | instance | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-07 09:06:38.259076 | instance | 2026-04-07 09:06:38.259209 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:06:38.259321 | instance | Tuesday 07 April 2026 09:06:38 +0000 (0:00:02.521) 0:04:04.585 ********* 2026-04-07 09:06:39.301594 | instance | ok: [instance] 2026-04-07 09:06:39.301661 | instance | 2026-04-07 09:06:39.301784 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:06:39.301912 | instance | Tuesday 07 April 2026 09:06:39 +0000 (0:00:01.042) 0:04:05.627 ********* 2026-04-07 09:06:39.534685 | instance | ok: [instance] 2026-04-07 09:06:39.534807 | instance | 2026-04-07 09:06:39.534823 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:06:39.534967 | instance | Tuesday 07 April 2026 09:06:39 +0000 (0:00:00.233) 0:04:05.860 ********* 2026-04-07 09:06:39.581556 | instance | skipping: [instance] 2026-04-07 09:06:39.581667 | instance | 2026-04-07 09:06:39.581790 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-07 09:06:39.581970 | instance | Tuesday 07 April 2026 09:06:39 +0000 (0:00:00.047) 0:04:05.908 ********* 2026-04-07 09:06:39.837089 | instance | ok: [instance] 2026-04-07 09:06:39.837201 | instance | 2026-04-07 09:06:39.837249 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:06:39.837390 | instance | Tuesday 07 April 2026 09:06:39 +0000 (0:00:00.254) 0:04:06.163 ********* 2026-04-07 09:06:39.899893 | instance | ok: [instance] => { 2026-04-07 09:06:39.899975 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-04-07 09:06:39.900083 | instance | } 2026-04-07 09:06:39.900185 | instance | 2026-04-07 09:06:39.900349 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:06:39.900472 | instance | Tuesday 07 April 2026 09:06:39 +0000 (0:00:00.062) 0:04:06.226 ********* 2026-04-07 09:06:40.268085 | instance | ok: [instance] 2026-04-07 09:06:40.268243 | instance | 2026-04-07 09:06:40.268259 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:06:40.268406 | instance | Tuesday 07 April 2026 09:06:40 +0000 (0:00:00.368) 0:04:06.594 ********* 2026-04-07 09:06:40.319455 | instance | skipping: [instance] 2026-04-07 09:06:40.319547 | instance | 2026-04-07 09:06:40.319684 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:06:40.319810 | instance | Tuesday 07 April 2026 09:06:40 +0000 (0:00:00.051) 0:04:06.645 ********* 2026-04-07 09:06:40.373619 | instance | skipping: [instance] 2026-04-07 09:06:40.373693 | instance | 2026-04-07 09:06:40.373833 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:06:40.373969 | instance | Tuesday 07 April 2026 09:06:40 +0000 (0:00:00.053) 0:04:06.699 ********* 2026-04-07 09:06:40.611593 | instance | ok: [instance] 2026-04-07 09:06:40.611678 | instance | 2026-04-07 09:06:40.611784 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:06:40.611911 | instance | Tuesday 07 April 2026 09:06:40 +0000 (0:00:00.238) 0:04:06.937 ********* 2026-04-07 09:06:42.092866 | instance | ok: [instance] 2026-04-07 09:06:42.092954 | instance | 2026-04-07 09:06:42.093088 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:06:42.093199 | instance | Tuesday 07 April 2026 09:06:42 +0000 (0:00:01.481) 0:04:08.418 ********* 2026-04-07 09:06:42.162121 | instance | ok: [instance] => { 2026-04-07 09:06:42.162208 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-04-07 09:06:42.162371 | instance | } 2026-04-07 09:06:42.162581 | instance | 2026-04-07 09:06:42.162764 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:06:42.163125 | instance | Tuesday 07 April 2026 09:06:42 +0000 (0:00:00.069) 0:04:08.488 ********* 2026-04-07 09:06:42.576352 | instance | ok: [instance] 2026-04-07 09:06:42.576478 | instance | 2026-04-07 09:06:42.576755 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:06:42.576937 | instance | Tuesday 07 April 2026 09:06:42 +0000 (0:00:00.413) 0:04:08.901 ********* 2026-04-07 09:06:44.538596 | instance | ok: [instance] 2026-04-07 09:06:44.538786 | instance | 2026-04-07 09:06:44.539071 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-07 09:06:44.539329 | instance | Tuesday 07 April 2026 09:06:44 +0000 (0:00:01.962) 0:04:10.864 ********* 2026-04-07 09:06:44.563461 | instance | skipping: [instance] 2026-04-07 09:06:44.563568 | instance | 2026-04-07 09:06:44.563575 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-07 09:06:44.563669 | instance | Tuesday 07 April 2026 09:06:44 +0000 (0:00:00.025) 0:04:10.890 ********* 2026-04-07 09:06:44.590116 | instance | skipping: [instance] 2026-04-07 09:06:44.590220 | instance | 2026-04-07 09:06:44.590232 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-07 09:06:44.590373 | instance | Tuesday 07 April 2026 09:06:44 +0000 (0:00:00.026) 0:04:10.916 ********* 2026-04-07 09:06:44.621609 | instance | skipping: [instance] 2026-04-07 09:06:44.621720 | instance | 2026-04-07 09:06:44.621735 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-07 09:06:44.621887 | instance | Tuesday 07 April 2026 09:06:44 +0000 (0:00:00.031) 0:04:10.948 ********* 2026-04-07 09:06:46.132743 | instance | ok: [instance] 2026-04-07 09:06:46.133046 | instance | 2026-04-07 09:06:46.133167 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-07 09:06:46.133289 | instance | Tuesday 07 April 2026 09:06:46 +0000 (0:00:01.510) 0:04:12.458 ********* 2026-04-07 09:06:46.575481 | instance | ok: [instance] 2026-04-07 09:06:46.575593 | instance | 2026-04-07 09:06:46.575668 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-07 09:06:46.575791 | instance | Tuesday 07 April 2026 09:06:46 +0000 (0:00:00.443) 0:04:12.901 ********* 2026-04-07 09:06:47.664461 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-07 09:06:47.664540 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-07 09:06:47.664682 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-07 09:06:47.664798 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-07 09:06:47.664934 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-07 09:06:47.665042 | instance | 2026-04-07 09:06:47.665162 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-07 09:06:47.665276 | instance | Tuesday 07 April 2026 09:06:47 +0000 (0:00:01.088) 0:04:13.990 ********* 2026-04-07 09:06:48.139036 | instance | ok: [instance] 2026-04-07 09:06:48.139115 | instance | 2026-04-07 09:06:48.139224 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-07 09:06:48.139348 | instance | Tuesday 07 April 2026 09:06:48 +0000 (0:00:00.467) 0:04:14.457 ********* 2026-04-07 09:06:48.139463 | instance | 2026-04-07 09:06:48.139625 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-07 09:06:48.139705 | instance | Tuesday 07 April 2026 09:06:48 +0000 (0:00:00.007) 0:04:14.465 ********* 2026-04-07 09:06:48.533744 | instance | ok: [instance] 2026-04-07 09:06:48.533833 | instance | 2026-04-07 09:06:48.533902 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:06:48.534052 | instance | Tuesday 07 April 2026 09:06:48 +0000 (0:00:00.394) 0:04:14.860 ********* 2026-04-07 09:06:48.762469 | instance | ok: [instance] 2026-04-07 09:06:48.762568 | instance | 2026-04-07 09:06:48.762709 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:06:48.762844 | instance | Tuesday 07 April 2026 09:06:48 +0000 (0:00:00.228) 0:04:15.089 ********* 2026-04-07 09:06:48.816738 | instance | ok: [instance] => { 2026-04-07 09:06:48.816888 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-07 09:06:48.817123 | instance | } 2026-04-07 09:06:48.817291 | instance | 2026-04-07 09:06:48.817481 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:06:48.817655 | instance | Tuesday 07 April 2026 09:06:48 +0000 (0:00:00.053) 0:04:15.143 ********* 2026-04-07 09:06:49.198259 | instance | ok: [instance] 2026-04-07 09:06:49.198370 | instance | 2026-04-07 09:06:49.198623 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:06:49.198824 | instance | Tuesday 07 April 2026 09:06:49 +0000 (0:00:00.381) 0:04:15.524 ********* 2026-04-07 09:06:52.285460 | instance | ok: [instance] 2026-04-07 09:06:52.285592 | instance | 2026-04-07 09:06:52.285956 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-07 09:06:52.286266 | instance | Tuesday 07 April 2026 09:06:52 +0000 (0:00:03.086) 0:04:18.611 ********* 2026-04-07 09:06:53.759519 | instance | ok: [instance] 2026-04-07 09:06:53.759617 | instance | 2026-04-07 09:06:53.759629 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-07 09:06:53.759639 | instance | Tuesday 07 April 2026 09:06:53 +0000 (0:00:01.472) 0:04:20.084 ********* 2026-04-07 09:06:53.992713 | instance | ok: [instance] 2026-04-07 09:06:53.992793 | instance | 2026-04-07 09:06:53.992915 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-07 09:06:53.993037 | instance | Tuesday 07 April 2026 09:06:53 +0000 (0:00:00.235) 0:04:20.319 ********* 2026-04-07 09:06:54.422160 | instance | ok: [instance] 2026-04-07 09:06:54.422248 | instance | 2026-04-07 09:06:54.422511 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-07 09:06:54.422558 | instance | Tuesday 07 April 2026 09:06:54 +0000 (0:00:00.429) 0:04:20.748 ********* 2026-04-07 09:06:55.048179 | instance | ok: [instance] => (item={'path': '/etc/docker'}) 2026-04-07 09:06:55.048756 | instance | ok: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-07 09:06:55.048773 | instance | ok: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-07 09:06:55.048779 | instance | 2026-04-07 09:06:55.048784 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-07 09:06:55.048789 | instance | Tuesday 07 April 2026 09:06:55 +0000 (0:00:00.626) 0:04:21.374 ********* 2026-04-07 09:06:55.416961 | instance | ok: [instance] 2026-04-07 09:06:55.417478 | instance | 2026-04-07 09:06:55.417526 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-07 09:06:55.417535 | instance | Tuesday 07 April 2026 09:06:55 +0000 (0:00:00.368) 0:04:21.743 ********* 2026-04-07 09:06:55.808176 | instance | ok: [instance] 2026-04-07 09:06:55.808302 | instance | 2026-04-07 09:06:55.809191 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-07 09:06:55.809243 | instance | Tuesday 07 April 2026 09:06:55 +0000 (0:00:00.384) 0:04:22.127 ********* 2026-04-07 09:06:55.809252 | instance | 2026-04-07 09:06:55.809258 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-07 09:06:55.809264 | instance | Tuesday 07 April 2026 09:06:55 +0000 (0:00:00.006) 0:04:22.134 ********* 2026-04-07 09:06:56.168948 | instance | ok: [instance] 2026-04-07 09:06:56.169034 | instance | 2026-04-07 09:06:56.169273 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-07 09:06:56.169315 | instance | Tuesday 07 April 2026 09:06:56 +0000 (0:00:00.361) 0:04:22.495 ********* 2026-04-07 09:06:56.227887 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-07 09:06:56.227978 | instance | 2026-04-07 09:06:56.228279 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-07 09:06:56.228327 | instance | Tuesday 07 April 2026 09:06:56 +0000 (0:00:00.058) 0:04:22.554 ********* 2026-04-07 09:06:57.656546 | instance | ok: [instance] 2026-04-07 09:06:57.656634 | instance | 2026-04-07 09:06:57.656860 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-07 09:06:57.656908 | instance | Tuesday 07 April 2026 09:06:57 +0000 (0:00:01.428) 0:04:23.983 ********* 2026-04-07 09:06:58.326609 | instance | ok: [instance] => (item=chronyd) 2026-04-07 09:06:58.326678 | instance | ok: [instance] => (item=sshd) 2026-04-07 09:06:58.326691 | instance | 2026-04-07 09:06:58.326701 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-07 09:06:58.326728 | instance | Tuesday 07 April 2026 09:06:58 +0000 (0:00:00.669) 0:04:24.652 ********* 2026-04-07 09:06:59.112998 | instance | ok: [instance] 2026-04-07 09:06:59.113076 | instance | 2026-04-07 09:06:59.113181 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-07 09:06:59.113297 | instance | Tuesday 07 April 2026 09:06:59 +0000 (0:00:00.786) 0:04:25.439 ********* 2026-04-07 09:06:59.328364 | instance | ok: [instance] 2026-04-07 09:06:59.328428 | instance | 2026-04-07 09:06:59.328706 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-07 09:06:59.328724 | instance | Tuesday 07 April 2026 09:06:59 +0000 (0:00:00.215) 0:04:25.654 ********* 2026-04-07 09:06:59.597014 | instance | ok: [instance] 2026-04-07 09:06:59.597085 | instance | 2026-04-07 09:06:59.597207 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-07 09:06:59.597325 | instance | Tuesday 07 April 2026 09:06:59 +0000 (0:00:00.268) 0:04:25.923 ********* 2026-04-07 09:06:59.827897 | instance | ok: [instance] 2026-04-07 09:06:59.827971 | instance | 2026-04-07 09:06:59.828245 | instance | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-07 09:06:59.828291 | instance | Tuesday 07 April 2026 09:06:59 +0000 (0:00:00.231) 0:04:26.154 ********* 2026-04-07 09:07:00.083571 | instance | ok: [instance] => (item=instance) 2026-04-07 09:07:00.084125 | instance | 2026-04-07 09:07:00.084175 | instance | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-07 09:07:00.084184 | instance | Tuesday 07 April 2026 09:07:00 +0000 (0:00:00.255) 0:04:26.409 ********* 2026-04-07 09:07:00.141564 | instance | ok: [instance] 2026-04-07 09:07:00.142148 | instance | 2026-04-07 09:07:00.142217 | instance | TASK [vexxhost.ceph.osd : Get `cephadm ls` status] ***************************** 2026-04-07 09:07:00.142226 | instance | Tuesday 07 April 2026 09:07:00 +0000 (0:00:00.057) 0:04:26.467 ********* 2026-04-07 09:07:05.489197 | instance | ok: [instance] 2026-04-07 09:07:05.489289 | instance | 2026-04-07 09:07:05.489664 | instance | TASK [vexxhost.ceph.osd : Parse the `cephadm ls` output] *********************** 2026-04-07 09:07:05.489939 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:05.348) 0:04:31.815 ********* 2026-04-07 09:07:05.539032 | instance | ok: [instance] 2026-04-07 09:07:05.539405 | instance | 2026-04-07 09:07:05.539453 | instance | TASK [Install Ceph host] ******************************************************* 2026-04-07 09:07:05.539461 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:00.049) 0:04:31.865 ********* 2026-04-07 09:07:05.600866 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-04-07 09:07:05.600948 | instance | 2026-04-07 09:07:05.601199 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-07 09:07:05.601239 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:00.061) 0:04:31.927 ********* 2026-04-07 09:07:05.644507 | instance | skipping: [instance] 2026-04-07 09:07:05.645061 | instance | 2026-04-07 09:07:05.645114 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-07 09:07:05.645123 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:00.043) 0:04:31.970 ********* 2026-04-07 09:07:05.690727 | instance | skipping: [instance] => (item=instance) 2026-04-07 09:07:05.690806 | instance | skipping: [instance] 2026-04-07 09:07:05.691182 | instance | 2026-04-07 09:07:05.691229 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-07 09:07:05.691235 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:00.046) 0:04:32.017 ********* 2026-04-07 09:07:05.993716 | instance | ok: [instance] 2026-04-07 09:07:05.993813 | instance | 2026-04-07 09:07:05.994021 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-07 09:07:05.994294 | instance | Tuesday 07 April 2026 09:07:05 +0000 (0:00:00.302) 0:04:32.320 ********* 2026-04-07 09:07:08.387973 | instance | ok: [instance] 2026-04-07 09:07:08.388076 | instance | 2026-04-07 09:07:08.388089 | instance | TASK [vexxhost.ceph.osd : Adopt OSDs to cluster] ******************************* 2026-04-07 09:07:08.388199 | instance | Tuesday 07 April 2026 09:07:08 +0000 (0:00:02.394) 0:04:34.714 ********* 2026-04-07 09:07:08.419698 | instance | skipping: [instance] 2026-04-07 09:07:08.420091 | instance | 2026-04-07 09:07:08.420143 | instance | TASK [vexxhost.ceph.osd : Wait until OSD added to cephadm] ********************* 2026-04-07 09:07:08.420149 | instance | Tuesday 07 April 2026 09:07:08 +0000 (0:00:00.031) 0:04:34.746 ********* 2026-04-07 09:07:08.446514 | instance | skipping: [instance] 2026-04-07 09:07:08.446741 | instance | 2026-04-07 09:07:08.446828 | instance | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-07 09:07:08.447007 | instance | Tuesday 07 April 2026 09:07:08 +0000 (0:00:00.026) 0:04:34.773 ********* 2026-04-07 09:07:13.836622 | instance | ok: [instance] 2026-04-07 09:07:13.836710 | instance | 2026-04-07 09:07:13.836814 | instance | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-07 09:07:13.836941 | instance | Tuesday 07 April 2026 09:07:13 +0000 (0:00:05.389) 0:04:40.163 ********* 2026-04-07 09:07:24.358780 | instance | ok: [instance] 2026-04-07 09:07:24.358875 | instance | 2026-04-07 09:07:24.359114 | instance | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-07 09:07:24.359158 | instance | Tuesday 07 April 2026 09:07:24 +0000 (0:00:10.522) 0:04:50.685 ********* 2026-04-07 09:09:08.462108 | instance | ok: [instance] => (item=/dev/ceph-instance-osd0/data) 2026-04-07 09:09:08.462741 | instance | ok: [instance] => (item=/dev/ceph-instance-osd1/data) 2026-04-07 09:09:08.462755 | instance | ok: [instance] => (item=/dev/ceph-instance-osd2/data) 2026-04-07 09:09:08.462765 | instance | 2026-04-07 09:09:08.462775 | instance | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-07 09:09:08.463359 | instance | Tuesday 07 April 2026 09:09:08 +0000 (0:01:44.101) 0:06:34.787 ********* 2026-04-07 09:09:11.640071 | instance | ok: [instance] 2026-04-07 09:09:11.640133 | instance | 2026-04-07 09:09:11.640429 | instance | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-07 09:09:11.640475 | instance | Tuesday 07 April 2026 09:09:11 +0000 (0:00:03.179) 0:06:37.966 ********* 2026-04-07 09:09:15.251848 | instance | ok: [instance] 2026-04-07 09:09:15.251943 | instance | 2026-04-07 09:09:15.252034 | instance | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-07 09:09:15.252187 | instance | Tuesday 07 April 2026 09:09:15 +0000 (0:00:03.610) 0:06:41.577 ********* 2026-04-07 09:09:15.320907 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for instance 2026-04-07 09:09:15.320973 | instance | 2026-04-07 09:09:15.321112 | instance | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-07 09:09:15.321279 | instance | Tuesday 07 April 2026 09:09:15 +0000 (0:00:00.069) 0:06:41.647 ********* 2026-04-07 09:09:15.370880 | instance | ok: [instance] 2026-04-07 09:09:15.370967 | instance | 2026-04-07 09:09:15.371031 | instance | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-07 09:09:15.371172 | instance | Tuesday 07 April 2026 09:09:15 +0000 (0:00:00.049) 0:06:41.696 ********* 2026-04-07 09:09:19.635977 | instance | ok: [instance] 2026-04-07 09:09:19.636049 | instance | 2026-04-07 09:09:19.636289 | instance | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-07 09:09:19.636334 | instance | Tuesday 07 April 2026 09:09:19 +0000 (0:00:04.265) 0:06:45.962 ********* 2026-04-07 09:09:19.674405 | instance | ok: [instance] 2026-04-07 09:09:19.674943 | instance | 2026-04-07 09:09:19.674989 | instance | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-07 09:09:19.674997 | instance | Tuesday 07 April 2026 09:09:19 +0000 (0:00:00.038) 0:06:46.000 ********* 2026-04-07 09:09:19.723277 | instance | skipping: [instance] => (item=1) 2026-04-07 09:09:19.723954 | instance | skipping: [instance] => (item=1) 2026-04-07 09:09:19.723997 | instance | skipping: [instance] => (item=1) 2026-04-07 09:09:19.724003 | instance | skipping: [instance] 2026-04-07 09:09:19.724008 | instance | 2026-04-07 09:09:19.724013 | instance | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-07 09:09:19.724018 | instance | Tuesday 07 April 2026 09:09:19 +0000 (0:00:00.048) 0:06:46.049 ********* 2026-04-07 09:09:19.768729 | instance | skipping: [instance] 2026-04-07 09:09:19.769309 | instance | 2026-04-07 09:09:19.769350 | instance | PLAY [all] ********************************************************************* 2026-04-07 09:09:19.769356 | instance | 2026-04-07 09:09:19.769360 | instance | TASK [Ensure RBD kernel module is loaded] ************************************** 2026-04-07 09:09:19.769365 | instance | Tuesday 07 April 2026 09:09:19 +0000 (0:00:00.045) 0:06:46.095 ********* 2026-04-07 09:09:20.215636 | instance | changed: [instance] 2026-04-07 09:09:20.216532 | instance | 2026-04-07 09:09:20.216578 | instance | PLAY [all] ********************************************************************* 2026-04-07 09:09:20.216587 | instance | 2026-04-07 09:09:20.216595 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:09:20.216602 | instance | Tuesday 07 April 2026 09:09:20 +0000 (0:00:00.446) 0:06:46.541 ********* 2026-04-07 09:09:21.215158 | instance | ok: [instance] 2026-04-07 09:09:21.215235 | instance | 2026-04-07 09:09:21.215482 | instance | TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ******************** 2026-04-07 09:09:21.215527 | instance | Tuesday 07 April 2026 09:09:21 +0000 (0:00:00.999) 0:06:47.541 ********* 2026-04-07 09:09:25.624502 | instance | changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576}) 2026-04-07 09:09:25.624591 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0}) 2026-04-07 09:09:25.626688 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1}) 2026-04-07 09:09:25.626765 | instance | changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000}) 2026-04-07 09:09:25.626776 | instance | changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000}) 2026-04-07 09:09:25.626786 | instance | changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304}) 2026-04-07 09:09:25.626795 | instance | changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304}) 2026-04-07 09:09:25.626804 | instance | changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304}) 2026-04-07 09:09:25.626812 | instance | changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304}) 2026-04-07 09:09:25.626821 | instance | changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304}) 2026-04-07 09:09:25.626830 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'}) 2026-04-07 09:09:25.626838 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'}) 2026-04-07 09:09:25.626847 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1}) 2026-04-07 09:09:25.626856 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1}) 2026-04-07 09:09:25.626864 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128}) 2026-04-07 09:09:25.626873 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-07 09:09:25.626881 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-07 09:09:25.626890 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128}) 2026-04-07 09:09:25.626899 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-07 09:09:25.626915 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-07 09:09:25.626925 | instance | 2026-04-07 09:09:25.626978 | instance | TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] *** 2026-04-07 09:09:25.627110 | instance | Tuesday 07 April 2026 09:09:25 +0000 (0:00:04.409) 0:06:51.950 ********* 2026-04-07 09:09:25.841259 | instance | changed: [instance] 2026-04-07 09:09:25.841341 | instance | 2026-04-07 09:09:25.841735 | instance | TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] ******* 2026-04-07 09:09:25.841780 | instance | Tuesday 07 April 2026 09:09:25 +0000 (0:00:00.216) 0:06:52.167 ********* 2026-04-07 09:09:26.217104 | instance | changed: [instance] 2026-04-07 09:09:26.217188 | instance | 2026-04-07 09:09:26.217422 | instance | TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] ********************** 2026-04-07 09:09:26.217474 | instance | Tuesday 07 April 2026 09:09:26 +0000 (0:00:00.376) 0:06:52.543 ********* 2026-04-07 09:09:26.480775 | instance | ok: [instance] 2026-04-07 09:09:26.480841 | instance | 2026-04-07 09:09:26.481128 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-07 09:09:26.481172 | instance | Tuesday 07 April 2026 09:09:26 +0000 (0:00:00.263) 0:06:52.807 ********* 2026-04-07 09:09:26.528682 | instance | ok: [instance] 2026-04-07 09:09:26.528763 | instance | 2026-04-07 09:09:26.529265 | instance | PLAY [Configure Kubernetes VIP] ************************************************ 2026-04-07 09:09:26.529311 | instance | 2026-04-07 09:09:26.529317 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:09:26.529322 | instance | Tuesday 07 April 2026 09:09:26 +0000 (0:00:00.047) 0:06:52.855 ********* 2026-04-07 09:09:27.476647 | instance | ok: [instance] 2026-04-07 09:09:27.476719 | instance | 2026-04-07 09:09:27.477003 | instance | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] *** 2026-04-07 09:09:27.477044 | instance | Tuesday 07 April 2026 09:09:27 +0000 (0:00:00.947) 0:06:53.803 ********* 2026-04-07 09:09:27.707088 | instance | changed: [instance] 2026-04-07 09:09:27.707157 | instance | 2026-04-07 09:09:27.707165 | instance | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] **************** 2026-04-07 09:09:27.707172 | instance | Tuesday 07 April 2026 09:09:27 +0000 (0:00:00.229) 0:06:54.032 ********* 2026-04-07 09:09:28.712866 | instance | ok: [instance] => (item=/etc/keepalived/keepalived.conf) 2026-04-07 09:09:28.713015 | instance | ok: [instance] => (item=/etc/keepalived/check_apiserver.sh) 2026-04-07 09:09:28.714020 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-04-07 09:09:28.714080 | instance | ok: [instance] => (item=/etc/haproxy/haproxy.cfg) 2026-04-07 09:09:28.714087 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-04-07 09:09:28.714095 | instance | 2026-04-07 09:09:28.714102 | instance | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] **** 2026-04-07 09:09:28.714108 | instance | Tuesday 07 April 2026 09:09:28 +0000 (0:00:01.006) 0:06:55.039 ********* 2026-04-07 09:09:28.942133 | instance | failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-04-07 09:09:29.124869 | instance | failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-04-07 09:09:29.296444 | instance | failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-04-07 09:09:29.306852 | instance | ...ignoring 2026-04-07 09:09:29.307348 | instance | 2026-04-07 09:09:29.307404 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] ********* 2026-04-07 09:09:29.307414 | instance | Tuesday 07 April 2026 09:09:29 +0000 (0:00:00.594) 0:06:55.633 ********* 2026-04-07 09:09:29.506387 | instance | ok: [instance] 2026-04-07 09:09:29.506458 | instance | 2026-04-07 09:09:29.506739 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] ********* 2026-04-07 09:09:29.506779 | instance | Tuesday 07 April 2026 09:09:29 +0000 (0:00:00.199) 0:06:55.833 ********* 2026-04-07 09:09:29.712482 | instance | ok: [instance] 2026-04-07 09:09:29.712552 | instance | 2026-04-07 09:09:29.712813 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************ 2026-04-07 09:09:29.712862 | instance | Tuesday 07 April 2026 09:09:29 +0000 (0:00:00.206) 0:06:56.039 ********* 2026-04-07 09:09:29.748612 | instance | ok: [instance] 2026-04-07 09:09:29.749013 | instance | 2026-04-07 09:09:29.749071 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] *** 2026-04-07 09:09:29.749078 | instance | Tuesday 07 April 2026 09:09:29 +0000 (0:00:00.035) 0:06:56.075 ********* 2026-04-07 09:09:29.790564 | instance | ok: [instance] 2026-04-07 09:09:29.790947 | instance | 2026-04-07 09:09:29.790989 | instance | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] *************** 2026-04-07 09:09:29.790995 | instance | Tuesday 07 April 2026 09:09:29 +0000 (0:00:00.042) 0:06:56.117 ********* 2026-04-07 09:09:30.247642 | instance | ok: [instance] 2026-04-07 09:09:30.247717 | instance | 2026-04-07 09:09:30.247982 | instance | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] ******* 2026-04-07 09:09:30.248024 | instance | Tuesday 07 April 2026 09:09:30 +0000 (0:00:00.457) 0:06:56.574 ********* 2026-04-07 09:09:30.514155 | instance | ok: [instance] 2026-04-07 09:09:30.514238 | instance | 2026-04-07 09:09:30.514660 | instance | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-04-07 09:09:30.514752 | instance | Tuesday 07 April 2026 09:09:30 +0000 (0:00:00.208) 0:06:56.782 ********* 2026-04-07 09:09:30.514764 | instance | 2026-04-07 09:09:30.514779 | instance | PLAY [Install Kubernetes] ****************************************************** 2026-04-07 09:09:30.514788 | instance | 2026-04-07 09:09:30.515025 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-07 09:09:30.515071 | instance | Tuesday 07 April 2026 09:09:30 +0000 (0:00:00.058) 0:06:56.841 ********* 2026-04-07 09:09:31.451981 | instance | ok: [instance] 2026-04-07 09:09:31.452556 | instance | 2026-04-07 09:09:31.452577 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:31.452584 | instance | Tuesday 07 April 2026 09:09:31 +0000 (0:00:00.937) 0:06:57.778 ********* 2026-04-07 09:09:31.689760 | instance | ok: [instance] 2026-04-07 09:09:31.690274 | instance | 2026-04-07 09:09:31.690292 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:09:31.690299 | instance | Tuesday 07 April 2026 09:09:31 +0000 (0:00:00.237) 0:06:58.016 ********* 2026-04-07 09:09:31.731413 | instance | skipping: [instance] 2026-04-07 09:09:31.731800 | instance | 2026-04-07 09:09:31.731815 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-07 09:09:31.731821 | instance | Tuesday 07 April 2026 09:09:31 +0000 (0:00:00.041) 0:06:58.058 ********* 2026-04-07 09:09:31.962742 | instance | ok: [instance] 2026-04-07 09:09:31.962840 | instance | 2026-04-07 09:09:31.963111 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:31.963148 | instance | Tuesday 07 April 2026 09:09:31 +0000 (0:00:00.231) 0:06:58.289 ********* 2026-04-07 09:09:32.027961 | instance | ok: [instance] => { 2026-04-07 09:09:32.028725 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-04-07 09:09:32.028745 | instance | } 2026-04-07 09:09:32.028753 | instance | 2026-04-07 09:09:32.028759 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:32.028765 | instance | Tuesday 07 April 2026 09:09:32 +0000 (0:00:00.065) 0:06:58.354 ********* 2026-04-07 09:09:32.391127 | instance | ok: [instance] 2026-04-07 09:09:32.391227 | instance | 2026-04-07 09:09:32.391478 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:32.391493 | instance | Tuesday 07 April 2026 09:09:32 +0000 (0:00:00.363) 0:06:58.717 ********* 2026-04-07 09:09:32.435576 | instance | skipping: [instance] 2026-04-07 09:09:32.436191 | instance | 2026-04-07 09:09:32.436210 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:32.436217 | instance | Tuesday 07 April 2026 09:09:32 +0000 (0:00:00.044) 0:06:58.762 ********* 2026-04-07 09:09:32.676487 | instance | ok: [instance] 2026-04-07 09:09:32.676582 | instance | 2026-04-07 09:09:32.676819 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-07 09:09:32.676836 | instance | Tuesday 07 April 2026 09:09:32 +0000 (0:00:00.241) 0:06:59.003 ********* 2026-04-07 09:09:34.028448 | instance | ok: [instance] 2026-04-07 09:09:34.028524 | instance | 2026-04-07 09:09:34.028790 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:34.028833 | instance | Tuesday 07 April 2026 09:09:34 +0000 (0:00:01.351) 0:07:00.355 ********* 2026-04-07 09:09:34.092118 | instance | ok: [instance] => { 2026-04-07 09:09:34.092203 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-04-07 09:09:34.092656 | instance | } 2026-04-07 09:09:34.092698 | instance | 2026-04-07 09:09:34.092703 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:34.092708 | instance | Tuesday 07 April 2026 09:09:34 +0000 (0:00:00.063) 0:07:00.418 ********* 2026-04-07 09:09:34.582723 | instance | ok: [instance] 2026-04-07 09:09:34.582808 | instance | 2026-04-07 09:09:34.583065 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:34.583108 | instance | Tuesday 07 April 2026 09:09:34 +0000 (0:00:00.490) 0:07:00.909 ********* 2026-04-07 09:09:36.607254 | instance | ok: [instance] 2026-04-07 09:09:36.607363 | instance | 2026-04-07 09:09:36.607577 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-07 09:09:36.607619 | instance | Tuesday 07 April 2026 09:09:36 +0000 (0:00:02.024) 0:07:02.933 ********* 2026-04-07 09:09:36.714986 | instance | skipping: [instance] 2026-04-07 09:09:36.715120 | instance | 2026-04-07 09:09:36.715131 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-07 09:09:36.715269 | instance | Tuesday 07 April 2026 09:09:36 +0000 (0:00:00.107) 0:07:03.041 ********* 2026-04-07 09:09:36.747965 | instance | skipping: [instance] 2026-04-07 09:09:36.748077 | instance | 2026-04-07 09:09:36.748343 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-07 09:09:36.748386 | instance | Tuesday 07 April 2026 09:09:36 +0000 (0:00:00.032) 0:07:03.074 ********* 2026-04-07 09:09:36.785264 | instance | skipping: [instance] 2026-04-07 09:09:36.785742 | instance | 2026-04-07 09:09:36.785781 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-07 09:09:36.785789 | instance | Tuesday 07 April 2026 09:09:36 +0000 (0:00:00.037) 0:07:03.111 ********* 2026-04-07 09:09:38.107008 | instance | ok: [instance] 2026-04-07 09:09:38.107109 | instance | 2026-04-07 09:09:38.107391 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-07 09:09:38.107433 | instance | Tuesday 07 April 2026 09:09:38 +0000 (0:00:01.321) 0:07:04.433 ********* 2026-04-07 09:09:38.519502 | instance | ok: [instance] 2026-04-07 09:09:38.519613 | instance | 2026-04-07 09:09:38.519952 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-07 09:09:38.519967 | instance | Tuesday 07 April 2026 09:09:38 +0000 (0:00:00.412) 0:07:04.846 ********* 2026-04-07 09:09:39.557396 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-07 09:09:39.557460 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-07 09:09:39.558174 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-07 09:09:39.558219 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-07 09:09:39.558225 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-07 09:09:39.558230 | instance | 2026-04-07 09:09:39.558235 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-07 09:09:39.558239 | instance | Tuesday 07 April 2026 09:09:39 +0000 (0:00:01.037) 0:07:05.883 ********* 2026-04-07 09:09:40.037322 | instance | ok: [instance] 2026-04-07 09:09:40.037406 | instance | 2026-04-07 09:09:40.037471 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-07 09:09:40.037969 | instance | Tuesday 07 April 2026 09:09:40 +0000 (0:00:00.473) 0:07:06.357 ********* 2026-04-07 09:09:40.038009 | instance | 2026-04-07 09:09:40.038015 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-07 09:09:40.038019 | instance | Tuesday 07 April 2026 09:09:40 +0000 (0:00:00.006) 0:07:06.363 ********* 2026-04-07 09:09:40.459018 | instance | ok: [instance] 2026-04-07 09:09:40.459096 | instance | 2026-04-07 09:09:40.459377 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] *** 2026-04-07 09:09:40.459420 | instance | Tuesday 07 April 2026 09:09:40 +0000 (0:00:00.421) 0:07:06.785 ********* 2026-04-07 09:09:42.278345 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible_collections.kubernetes.core.plugins.module_utils.k8s.exceptions.CoreException: Could not create API client: Invalid kube-config file. No configuration found. 2026-04-07 09:09:42.279036 | instance | fatal: [instance]: FAILED! => {"changed": false, "msg": "Could not create API client: Invalid kube-config file. No configuration found."} 2026-04-07 09:09:42.294042 | instance | ...ignoring 2026-04-07 09:09:42.294156 | instance | 2026-04-07 09:09:42.294273 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] *** 2026-04-07 09:09:42.294396 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:01.835) 0:07:08.620 ********* 2026-04-07 09:09:42.336656 | instance | skipping: [instance] 2026-04-07 09:09:42.337032 | instance | 2026-04-07 09:09:42.337239 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] *** 2026-04-07 09:09:42.337247 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.042) 0:07:08.663 ********* 2026-04-07 09:09:42.373678 | instance | skipping: [instance] 2026-04-07 09:09:42.373765 | instance | 2026-04-07 09:09:42.374051 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] *** 2026-04-07 09:09:42.374282 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.037) 0:07:08.700 ********* 2026-04-07 09:09:42.409572 | instance | skipping: [instance] 2026-04-07 09:09:42.409964 | instance | 2026-04-07 09:09:42.410033 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] *** 2026-04-07 09:09:42.410040 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.035) 0:07:08.736 ********* 2026-04-07 09:09:42.449340 | instance | skipping: [instance] 2026-04-07 09:09:42.449836 | instance | 2026-04-07 09:09:42.449869 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] *** 2026-04-07 09:09:42.449877 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.039) 0:07:08.775 ********* 2026-04-07 09:09:42.489734 | instance | skipping: [instance] 2026-04-07 09:09:42.489836 | instance | 2026-04-07 09:09:42.490091 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:42.490107 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.040) 0:07:08.816 ********* 2026-04-07 09:09:42.719958 | instance | ok: [instance] 2026-04-07 09:09:42.720024 | instance | 2026-04-07 09:09:42.720282 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:42.720323 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.230) 0:07:09.046 ********* 2026-04-07 09:09:42.762583 | instance | ok: [instance] => { 2026-04-07 09:09:42.762762 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm" 2026-04-07 09:09:42.762963 | instance | } 2026-04-07 09:09:42.763105 | instance | 2026-04-07 09:09:42.763253 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:42.763399 | instance | Tuesday 07 April 2026 09:09:42 +0000 (0:00:00.042) 0:07:09.088 ********* 2026-04-07 09:09:43.747013 | instance | changed: [instance] 2026-04-07 09:09:43.747202 | instance | 2026-04-07 09:09:43.747444 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:43.747686 | instance | Tuesday 07 April 2026 09:09:43 +0000 (0:00:00.984) 0:07:10.073 ********* 2026-04-07 09:09:43.794251 | instance | skipping: [instance] 2026-04-07 09:09:43.794550 | instance | 2026-04-07 09:09:43.794908 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:43.795177 | instance | Tuesday 07 April 2026 09:09:43 +0000 (0:00:00.047) 0:07:10.120 ********* 2026-04-07 09:09:44.023625 | instance | ok: [instance] 2026-04-07 09:09:44.023891 | instance | 2026-04-07 09:09:44.024189 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:44.024478 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.229) 0:07:10.350 ********* 2026-04-07 09:09:44.073477 | instance | ok: [instance] => { 2026-04-07 09:09:44.073740 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl" 2026-04-07 09:09:44.073998 | instance | } 2026-04-07 09:09:44.074241 | instance | 2026-04-07 09:09:44.074532 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:44.074803 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.050) 0:07:10.400 ********* 2026-04-07 09:09:44.854753 | instance | changed: [instance] 2026-04-07 09:09:44.855004 | instance | 2026-04-07 09:09:44.855437 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:44.855735 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.781) 0:07:11.181 ********* 2026-04-07 09:09:44.903108 | instance | skipping: [instance] 2026-04-07 09:09:44.903292 | instance | 2026-04-07 09:09:44.903655 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-07 09:09:44.903911 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.048) 0:07:11.229 ********* 2026-04-07 09:09:44.940459 | instance | skipping: [instance] 2026-04-07 09:09:44.940726 | instance | 2026-04-07 09:09:44.941038 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-07 09:09:44.941355 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.037) 0:07:11.266 ********* 2026-04-07 09:09:44.978917 | instance | skipping: [instance] 2026-04-07 09:09:44.979125 | instance | 2026-04-07 09:09:44.979453 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-07 09:09:44.979740 | instance | Tuesday 07 April 2026 09:09:44 +0000 (0:00:00.038) 0:07:11.305 ********* 2026-04-07 09:09:45.023623 | instance | skipping: [instance] 2026-04-07 09:09:45.023828 | instance | 2026-04-07 09:09:45.024091 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-07 09:09:45.024344 | instance | Tuesday 07 April 2026 09:09:45 +0000 (0:00:00.044) 0:07:11.349 ********* 2026-04-07 09:09:46.306674 | instance | ok: [instance] 2026-04-07 09:09:46.306748 | instance | 2026-04-07 09:09:46.306761 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-07 09:09:46.306780 | instance | Tuesday 07 April 2026 09:09:46 +0000 (0:00:01.282) 0:07:12.632 ********* 2026-04-07 09:09:46.712871 | instance | ok: [instance] 2026-04-07 09:09:46.712960 | instance | 2026-04-07 09:09:46.713318 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-07 09:09:46.713398 | instance | Tuesday 07 April 2026 09:09:46 +0000 (0:00:00.406) 0:07:13.038 ********* 2026-04-07 09:09:47.733797 | instance | ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-07 09:09:47.733912 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-07 09:09:47.733928 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-07 09:09:47.734649 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-07 09:09:47.734706 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-07 09:09:47.734713 | instance | 2026-04-07 09:09:47.734718 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-07 09:09:47.734722 | instance | Tuesday 07 April 2026 09:09:47 +0000 (0:00:01.021) 0:07:14.060 ********* 2026-04-07 09:09:48.200518 | instance | ok: [instance] 2026-04-07 09:09:48.200610 | instance | 2026-04-07 09:09:48.200682 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-07 09:09:48.201231 | instance | Tuesday 07 April 2026 09:09:48 +0000 (0:00:00.459) 0:07:14.519 ********* 2026-04-07 09:09:48.201295 | instance | 2026-04-07 09:09:48.201301 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-07 09:09:48.201306 | instance | Tuesday 07 April 2026 09:09:48 +0000 (0:00:00.006) 0:07:14.526 ********* 2026-04-07 09:09:48.581874 | instance | ok: [instance] 2026-04-07 09:09:48.582009 | instance | 2026-04-07 09:09:48.582023 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:48.582155 | instance | Tuesday 07 April 2026 09:09:48 +0000 (0:00:00.381) 0:07:14.908 ********* 2026-04-07 09:09:48.822587 | instance | ok: [instance] 2026-04-07 09:09:48.823012 | instance | 2026-04-07 09:09:48.823083 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:48.823090 | instance | Tuesday 07 April 2026 09:09:48 +0000 (0:00:00.239) 0:07:15.148 ********* 2026-04-07 09:09:48.886233 | instance | ok: [instance] => { 2026-04-07 09:09:48.886383 | instance | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz" 2026-04-07 09:09:48.886399 | instance | } 2026-04-07 09:09:48.886898 | instance | 2026-04-07 09:09:48.886960 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:48.886967 | instance | Tuesday 07 April 2026 09:09:48 +0000 (0:00:00.063) 0:07:15.212 ********* 2026-04-07 09:09:49.533158 | instance | changed: [instance] 2026-04-07 09:09:49.533291 | instance | 2026-04-07 09:09:49.533670 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:49.533797 | instance | Tuesday 07 April 2026 09:09:49 +0000 (0:00:00.646) 0:07:15.859 ********* 2026-04-07 09:09:51.929783 | instance | changed: [instance] 2026-04-07 09:09:51.930587 | instance | 2026-04-07 09:09:51.930653 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:51.930665 | instance | Tuesday 07 April 2026 09:09:51 +0000 (0:00:02.395) 0:07:18.254 ********* 2026-04-07 09:09:51.993136 | instance | ok: [instance] => { 2026-04-07 09:09:51.993753 | instance | "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz" 2026-04-07 09:09:51.993817 | instance | } 2026-04-07 09:09:51.993824 | instance | 2026-04-07 09:09:51.993829 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:51.993834 | instance | Tuesday 07 April 2026 09:09:51 +0000 (0:00:00.064) 0:07:18.319 ********* 2026-04-07 09:09:52.666262 | instance | changed: [instance] 2026-04-07 09:09:52.666339 | instance | 2026-04-07 09:09:52.666696 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:52.666772 | instance | Tuesday 07 April 2026 09:09:52 +0000 (0:00:00.673) 0:07:18.992 ********* 2026-04-07 09:09:54.076075 | instance | changed: [instance] 2026-04-07 09:09:54.076193 | instance | 2026-04-07 09:09:54.076479 | instance | TASK [vexxhost.containers.cri_tools : Create crictl config] ******************** 2026-04-07 09:09:54.076544 | instance | Tuesday 07 April 2026 09:09:54 +0000 (0:00:01.409) 0:07:20.402 ********* 2026-04-07 09:09:54.472706 | instance | changed: [instance] 2026-04-07 09:09:54.472808 | instance | 2026-04-07 09:09:54.473057 | instance | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] ********* 2026-04-07 09:09:54.473106 | instance | Tuesday 07 April 2026 09:09:54 +0000 (0:00:00.397) 0:07:20.799 ********* 2026-04-07 09:09:54.713505 | instance | changed: [instance] 2026-04-07 09:09:54.713618 | instance | 2026-04-07 09:09:54.714002 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:09:54.714073 | instance | Tuesday 07 April 2026 09:09:54 +0000 (0:00:00.240) 0:07:21.039 ********* 2026-04-07 09:09:54.947072 | instance | ok: [instance] 2026-04-07 09:09:54.947172 | instance | 2026-04-07 09:09:54.947449 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:09:54.947489 | instance | Tuesday 07 April 2026 09:09:54 +0000 (0:00:00.234) 0:07:21.273 ********* 2026-04-07 09:09:55.015470 | instance | ok: [instance] => { 2026-04-07 09:09:55.015552 | instance | "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz" 2026-04-07 09:09:55.016039 | instance | } 2026-04-07 09:09:55.016083 | instance | 2026-04-07 09:09:55.016088 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:09:55.016094 | instance | Tuesday 07 April 2026 09:09:55 +0000 (0:00:00.068) 0:07:21.342 ********* 2026-04-07 09:09:55.851181 | instance | changed: [instance] 2026-04-07 09:09:55.851261 | instance | 2026-04-07 09:09:55.851507 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:09:55.851549 | instance | Tuesday 07 April 2026 09:09:55 +0000 (0:00:00.835) 0:07:22.177 ********* 2026-04-07 09:09:58.497700 | instance | changed: [instance] 2026-04-07 09:09:58.497814 | instance | 2026-04-07 09:09:58.497846 | instance | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] *** 2026-04-07 09:09:58.498009 | instance | Tuesday 07 April 2026 09:09:58 +0000 (0:00:02.646) 0:07:24.824 ********* 2026-04-07 09:09:58.557055 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-04-07 09:09:58.557151 | instance | 2026-04-07 09:09:58.557398 | instance | TASK [vexxhost.containers.cni_plugins : Install additional packages] *********** 2026-04-07 09:09:58.557452 | instance | Tuesday 07 April 2026 09:09:58 +0000 (0:00:00.059) 0:07:24.883 ********* 2026-04-07 09:09:59.804621 | instance | ok: [instance] 2026-04-07 09:09:59.805118 | instance | 2026-04-07 09:09:59.805138 | instance | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] **************** 2026-04-07 09:09:59.805146 | instance | Tuesday 07 April 2026 09:09:59 +0000 (0:00:01.247) 0:07:26.131 ********* 2026-04-07 09:10:01.041243 | instance | changed: [instance] 2026-04-07 09:10:01.041322 | instance | 2026-04-07 09:10:01.041554 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] ********* 2026-04-07 09:10:01.041775 | instance | Tuesday 07 April 2026 09:10:01 +0000 (0:00:01.236) 0:07:27.367 ********* 2026-04-07 09:10:01.442826 | instance | changed: [instance] 2026-04-07 09:10:01.442933 | instance | 2026-04-07 09:10:01.443316 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ****** 2026-04-07 09:10:01.443366 | instance | Tuesday 07 April 2026 09:10:01 +0000 (0:00:00.401) 0:07:27.769 ********* 2026-04-07 09:10:02.273193 | instance | changed: [instance] => (item=br_netfilter) 2026-04-07 09:10:02.273271 | instance | ok: [instance] => (item=ip_tables) 2026-04-07 09:10:02.273858 | instance | changed: [instance] => (item=ip6_tables) 2026-04-07 09:10:02.273896 | instance | ok: [instance] => (item=nf_conntrack) 2026-04-07 09:10:02.273901 | instance | 2026-04-07 09:10:02.273906 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-07 09:10:02.273911 | instance | Tuesday 07 April 2026 09:10:02 +0000 (0:00:00.830) 0:07:28.599 ********* 2026-04-07 09:10:02.501032 | instance | ok: [instance] 2026-04-07 09:10:02.501095 | instance | 2026-04-07 09:10:02.501348 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-07 09:10:02.501394 | instance | Tuesday 07 April 2026 09:10:02 +0000 (0:00:00.227) 0:07:28.827 ********* 2026-04-07 09:10:02.545653 | instance | ok: [instance] => { 2026-04-07 09:10:02.545731 | instance | "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubelet" 2026-04-07 09:10:02.546231 | instance | } 2026-04-07 09:10:02.546295 | instance | 2026-04-07 09:10:02.546301 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-07 09:10:02.546306 | instance | Tuesday 07 April 2026 09:10:02 +0000 (0:00:00.044) 0:07:28.871 ********* 2026-04-07 09:10:03.626088 | instance | changed: [instance] 2026-04-07 09:10:03.626219 | instance | 2026-04-07 09:10:03.626235 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-07 09:10:03.626438 | instance | Tuesday 07 April 2026 09:10:03 +0000 (0:00:01.080) 0:07:29.952 ********* 2026-04-07 09:10:03.673404 | instance | skipping: [instance] 2026-04-07 09:10:03.673509 | instance | 2026-04-07 09:10:03.673814 | instance | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] *** 2026-04-07 09:10:03.673875 | instance | Tuesday 07 April 2026 09:10:03 +0000 (0:00:00.047) 0:07:29.999 ********* 2026-04-07 09:10:03.735300 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-04-07 09:10:03.735386 | instance | 2026-04-07 09:10:03.735657 | instance | TASK [vexxhost.kubernetes.kubelet : Install coreutils] ************************* 2026-04-07 09:10:03.735691 | instance | Tuesday 07 April 2026 09:10:03 +0000 (0:00:00.062) 0:07:30.061 ********* 2026-04-07 09:10:03.780574 | instance | skipping: [instance] 2026-04-07 09:10:03.780663 | instance | 2026-04-07 09:10:03.781036 | instance | TASK [vexxhost.kubernetes.kubelet : Install additional packages] *************** 2026-04-07 09:10:03.781079 | instance | Tuesday 07 April 2026 09:10:03 +0000 (0:00:00.045) 0:07:30.106 ********* 2026-04-07 09:10:10.131298 | instance | changed: [instance] 2026-04-07 09:10:10.132096 | instance | 2026-04-07 09:10:10.132169 | instance | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] ******************* 2026-04-07 09:10:10.132181 | instance | Tuesday 07 April 2026 09:10:10 +0000 (0:00:06.349) 0:07:36.456 ********* 2026-04-07 09:10:11.599166 | instance | changed: [instance] => (item={'name': 'net.ipv4.ip_forward', 'value': 1}) 2026-04-07 09:10:11.600297 | instance | changed: [instance] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1}) 2026-04-07 09:10:11.600362 | instance | changed: [instance] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1}) 2026-04-07 09:10:11.600368 | instance | changed: [instance] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0}) 2026-04-07 09:10:11.600373 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576}) 2026-04-07 09:10:11.600378 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192}) 2026-04-07 09:10:11.600382 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576}) 2026-04-07 09:10:11.600387 | instance | 2026-04-07 09:10:11.600392 | instance | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] *** 2026-04-07 09:10:11.600397 | instance | Tuesday 07 April 2026 09:10:11 +0000 (0:00:01.468) 0:07:37.925 ********* 2026-04-07 09:10:12.238103 | instance | changed: [instance] => (item=/etc/systemd/system/kubelet.service.d) 2026-04-07 09:10:12.238192 | instance | ok: [instance] => (item=/etc/kubernetes) 2026-04-07 09:10:12.238693 | instance | ok: [instance] => (item=/etc/kubernetes/manifests) 2026-04-07 09:10:12.238790 | instance | 2026-04-07 09:10:12.238803 | instance | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ******** 2026-04-07 09:10:12.238821 | instance | Tuesday 07 April 2026 09:10:12 +0000 (0:00:00.639) 0:07:38.564 ********* 2026-04-07 09:10:12.638427 | instance | changed: [instance] 2026-04-07 09:10:12.638503 | instance | 2026-04-07 09:10:12.638777 | instance | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] *** 2026-04-07 09:10:12.638797 | instance | Tuesday 07 April 2026 09:10:12 +0000 (0:00:00.400) 0:07:38.964 ********* 2026-04-07 09:10:13.049959 | instance | changed: [instance] 2026-04-07 09:10:13.050058 | instance | 2026-04-07 09:10:13.050290 | instance | TASK [vexxhost.kubernetes.kubelet : Check swap status] ************************* 2026-04-07 09:10:13.050347 | instance | Tuesday 07 April 2026 09:10:13 +0000 (0:00:00.411) 0:07:39.376 ********* 2026-04-07 09:10:13.302312 | instance | ok: [instance] 2026-04-07 09:10:13.302384 | instance | 2026-04-07 09:10:13.302639 | instance | TASK [vexxhost.kubernetes.kubelet : Disable swap] ****************************** 2026-04-07 09:10:13.302713 | instance | Tuesday 07 April 2026 09:10:13 +0000 (0:00:00.252) 0:07:39.629 ********* 2026-04-07 09:10:13.334267 | instance | skipping: [instance] 2026-04-07 09:10:13.334761 | instance | 2026-04-07 09:10:13.335220 | instance | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] *********** 2026-04-07 09:10:13.335243 | instance | Tuesday 07 April 2026 09:10:13 +0000 (0:00:00.031) 0:07:39.660 ********* 2026-04-07 09:10:13.887150 | instance | ok: [instance] => (item=swap) 2026-04-07 09:10:13.887228 | instance | ok: [instance] => (item=none) 2026-04-07 09:10:13.887579 | instance | 2026-04-07 09:10:13.887595 | instance | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] *** 2026-04-07 09:10:13.887602 | instance | Tuesday 07 April 2026 09:10:13 +0000 (0:00:00.552) 0:07:40.213 ********* 2026-04-07 09:10:14.282594 | instance | changed: [instance] 2026-04-07 09:10:14.282701 | instance | 2026-04-07 09:10:14.282943 | instance | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] ********************* 2026-04-07 09:10:14.283013 | instance | Tuesday 07 April 2026 09:10:14 +0000 (0:00:00.395) 0:07:40.608 ********* 2026-04-07 09:10:14.889988 | instance | changed: [instance] 2026-04-07 09:10:14.890079 | instance | 2026-04-07 09:10:14.890648 | instance | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] *********** 2026-04-07 09:10:14.891143 | instance | Tuesday 07 April 2026 09:10:14 +0000 (0:00:00.600) 0:07:41.208 ********* 2026-04-07 09:10:14.891175 | instance | 2026-04-07 09:10:14.891186 | instance | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] ***************** 2026-04-07 09:10:14.891201 | instance | Tuesday 07 April 2026 09:10:14 +0000 (0:00:00.007) 0:07:41.216 ********* 2026-04-07 09:10:15.675085 | instance | ok: [instance] 2026-04-07 09:10:15.675136 | instance | 2026-04-07 09:10:15.675144 | instance | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] ********** 2026-04-07 09:10:15.675175 | instance | Tuesday 07 April 2026 09:10:15 +0000 (0:00:00.784) 0:07:42.001 ********* 2026-04-07 09:10:16.280613 | instance | changed: [instance] 2026-04-07 09:10:16.280697 | instance | 2026-04-07 09:10:16.280975 | instance | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] ***** 2026-04-07 09:10:16.281044 | instance | Tuesday 07 April 2026 09:10:16 +0000 (0:00:00.605) 0:07:42.606 ********* 2026-04-07 09:10:17.616970 | instance | ok: [instance] 2026-04-07 09:10:17.617051 | instance | 2026-04-07 09:10:17.617357 | instance | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ****************** 2026-04-07 09:10:17.617397 | instance | Tuesday 07 April 2026 09:10:17 +0000 (0:00:01.336) 0:07:43.943 ********* 2026-04-07 09:10:18.414669 | instance | ok: [instance] 2026-04-07 09:10:18.414716 | instance | 2026-04-07 09:10:18.414942 | instance | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] ********* 2026-04-07 09:10:18.414958 | instance | Tuesday 07 April 2026 09:10:18 +0000 (0:00:00.797) 0:07:44.741 ********* 2026-04-07 09:10:18.652336 | instance | ok: [instance] 2026-04-07 09:10:18.652401 | instance | 2026-04-07 09:10:18.652651 | instance | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] *********** 2026-04-07 09:10:18.652694 | instance | Tuesday 07 April 2026 09:10:18 +0000 (0:00:00.237) 0:07:44.978 ********* 2026-04-07 09:10:19.478605 | instance | ok: [instance] 2026-04-07 09:10:19.478970 | instance | 2026-04-07 09:10:19.478983 | instance | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ******************** 2026-04-07 09:10:19.479055 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.826) 0:07:45.805 ********* 2026-04-07 09:10:19.570566 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for instance 2026-04-07 09:10:19.570646 | instance | 2026-04-07 09:10:19.570864 | instance | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] ********************** 2026-04-07 09:10:19.570908 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.091) 0:07:45.897 ********* 2026-04-07 09:10:19.649563 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for instance 2026-04-07 09:10:19.649643 | instance | 2026-04-07 09:10:19.649855 | instance | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] *** 2026-04-07 09:10:19.649895 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.079) 0:07:45.976 ********* 2026-04-07 09:10:19.884103 | instance | ok: [instance] => (item=instance) 2026-04-07 09:10:19.884178 | instance | 2026-04-07 09:10:19.884431 | instance | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] **** 2026-04-07 09:10:19.884478 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.234) 0:07:46.210 ********* 2026-04-07 09:10:19.936744 | instance | skipping: [instance] 2026-04-07 09:10:19.936833 | instance | 2026-04-07 09:10:19.937220 | instance | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] *** 2026-04-07 09:10:19.937271 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.052) 0:07:46.263 ********* 2026-04-07 09:10:19.988749 | instance | ok: [instance] 2026-04-07 09:10:19.988822 | instance | 2026-04-07 09:10:19.989066 | instance | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] ********** 2026-04-07 09:10:19.989107 | instance | Tuesday 07 April 2026 09:10:19 +0000 (0:00:00.052) 0:07:46.315 ********* 2026-04-07 09:10:20.029661 | instance | ok: [instance] => { 2026-04-07 09:10:20.029737 | instance | "msg": "instance" 2026-04-07 09:10:20.029851 | instance | } 2026-04-07 09:10:20.030026 | instance | 2026-04-07 09:10:20.030180 | instance | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] *** 2026-04-07 09:10:20.030327 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.040) 0:07:46.356 ********* 2026-04-07 09:10:20.527014 | instance | changed: [instance] 2026-04-07 09:10:20.527090 | instance | 2026-04-07 09:10:20.527194 | instance | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] ********************** 2026-04-07 09:10:20.527315 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.497) 0:07:46.853 ********* 2026-04-07 09:10:20.561984 | instance | skipping: [instance] 2026-04-07 09:10:20.562252 | instance | 2026-04-07 09:10:20.562596 | instance | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] *************** 2026-04-07 09:10:20.562966 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.034) 0:07:46.888 ********* 2026-04-07 09:10:20.596801 | instance | skipping: [instance] 2026-04-07 09:10:20.597154 | instance | 2026-04-07 09:10:20.597502 | instance | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] ************** 2026-04-07 09:10:20.597809 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.035) 0:07:46.923 ********* 2026-04-07 09:10:20.635057 | instance | skipping: [instance] 2026-04-07 09:10:20.635304 | instance | 2026-04-07 09:10:20.635597 | instance | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] ********************* 2026-04-07 09:10:20.635858 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.038) 0:07:46.961 ********* 2026-04-07 09:10:20.674050 | instance | skipping: [instance] 2026-04-07 09:10:20.674273 | instance | 2026-04-07 09:10:20.674564 | instance | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ******************** 2026-04-07 09:10:20.674834 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.039) 0:07:47.000 ********* 2026-04-07 09:10:20.711182 | instance | skipping: [instance] 2026-04-07 09:10:20.711414 | instance | 2026-04-07 09:10:20.711672 | instance | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] ************** 2026-04-07 09:10:20.712112 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.037) 0:07:47.037 ********* 2026-04-07 09:10:20.744627 | instance | skipping: [instance] 2026-04-07 09:10:20.744877 | instance | 2026-04-07 09:10:20.745158 | instance | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] ************* 2026-04-07 09:10:20.745421 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.033) 0:07:47.071 ********* 2026-04-07 09:10:20.784668 | instance | skipping: [instance] 2026-04-07 09:10:20.784891 | instance | 2026-04-07 09:10:20.785148 | instance | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] ********************* 2026-04-07 09:10:20.785403 | instance | Tuesday 07 April 2026 09:10:20 +0000 (0:00:00.040) 0:07:47.111 ********* 2026-04-07 09:14:56.079938 | instance | fatal: [instance]: FAILED! => {"changed": true, "cmd": "kubeadm init --config /etc/kubernetes/kubeadm.yaml --upload-certs --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests\n", "delta": "0:04:35.075205", "end": "2026-04-07 09:14:56.049292", "msg": "non-zero return code", "rc": 1, "start": "2026-04-07 09:10:20.974087", "stderr": "W0407 09:10:21.009056 45333 initconfiguration.go:336] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration\nerror execution phase wait-control-plane: couldn't initialize a Kubernetes cluster\nTo see the stack trace of this error execute with --v=5 or higher", "stderr_lines": ["W0407 09:10:21.009056 45333 initconfiguration.go:336] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration", "error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster", "To see the stack trace of this error execute with --v=5 or higher"], "stdout": "[init] Using Kubernetes version: v1.28.13\n[preflight] Running pre-flight checks\n[preflight] Pulling images required for setting up a Kubernetes cluster\n[preflight] This might take a minute or two, depending on the speed of your internet connection\n[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'\n[certs] Using certificateDir folder \"/etc/kubernetes/pki\"\n[certs] Generating \"ca\" certificate and key\n[certs] Generating \"apiserver\" certificate and key\n[certs] apiserver serving cert is signed for DNS names [instance kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 199.204.45.140 10.96.240.10]\n[certs] Generating \"apiserver-kubelet-client\" certificate and key\n[certs] Generating \"front-proxy-ca\" certificate and key\n[certs] Generating \"front-proxy-client\" certificate and key\n[certs] Generating \"etcd/ca\" certificate and key\n[certs] Generating \"etcd/server\" certificate and key\n[certs] etcd/server serving cert is signed for DNS names [instance localhost] and IPs [199.204.45.140 127.0.0.1 ::1]\n[certs] Generating \"etcd/peer\" certificate and key\n[certs] etcd/peer serving cert is signed for DNS names [instance localhost] and IPs [199.204.45.140 127.0.0.1 ::1]\n[certs] Generating \"etcd/healthcheck-client\" certificate and key\n[certs] Generating \"apiserver-etcd-client\" certificate and key\n[certs] Generating \"sa\" key and public key\n[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"\n[kubeconfig] Writing \"admin.conf\" kubeconfig file\n[kubeconfig] Writing \"kubelet.conf\" kubeconfig file\n[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file\n[kubeconfig] Writing \"scheduler.conf\" kubeconfig file\n[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"\n[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"\n[control-plane] Creating static Pod manifest for \"kube-apiserver\"\n[control-plane] Creating static Pod manifest for \"kube-controller-manager\"\n[control-plane] Creating static Pod manifest for \"kube-scheduler\"\n[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"\n[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"\n[kubelet-start] Starting the kubelet\n[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s\n[kubelet-check] Initial timeout of 40s passed.\n\nUnfortunately, an error has occurred:\n\ttimed out waiting for the condition\n\nThis error is likely caused by:\n\t- The kubelet is not running\n\t- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)\n\nIf you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:\n\t- 'systemctl status kubelet'\n\t- 'journalctl -xeu kubelet'\n\nAdditionally, a control plane component may have crashed or exited when started by the container runtime.\nTo troubleshoot, list all containers using your preferred container runtimes CLI.\nHere is one example how you may list all running Kubernetes containers by using crictl:\n\t- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock ps -a | grep kube | grep -v pause'\n\tOnce you have found the failing container, you can inspect its logs with:\n\t- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock logs CONTAINERID'", "stdout_lines": ["[init] Using Kubernetes version: v1.28.13", "[preflight] Running pre-flight checks", "[preflight] Pulling images required for setting up a Kubernetes cluster", "[preflight] This might take a minute or two, depending on the speed of your internet connection", "[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'", "[certs] Using certificateDir folder \"/etc/kubernetes/pki\"", "[certs] Generating \"ca\" certificate and key", "[certs] Generating \"apiserver\" certificate and key", "[certs] apiserver serving cert is signed for DNS names [instance kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 199.204.45.140 10.96.240.10]", "[certs] Generating \"apiserver-kubelet-client\" certificate and key", "[certs] Generating \"front-proxy-ca\" certificate and key", "[certs] Generating \"front-proxy-client\" certificate and key", "[certs] Generating \"etcd/ca\" certificate and key", "[certs] Generating \"etcd/server\" certificate and key", "[certs] etcd/server serving cert is signed for DNS names [instance localhost] and IPs [199.204.45.140 127.0.0.1 ::1]", "[certs] Generating \"etcd/peer\" certificate and key", "[certs] etcd/peer serving cert is signed for DNS names [instance localhost] and IPs [199.204.45.140 127.0.0.1 ::1]", "[certs] Generating \"etcd/healthcheck-client\" certificate and key", "[certs] Generating \"apiserver-etcd-client\" certificate and key", "[certs] Generating \"sa\" key and public key", "[kubeconfig] Using kubeconfig folder \"/etc/kubernetes\"", "[kubeconfig] Writing \"admin.conf\" kubeconfig file", "[kubeconfig] Writing \"kubelet.conf\" kubeconfig file", "[kubeconfig] Writing \"controller-manager.conf\" kubeconfig file", "[kubeconfig] Writing \"scheduler.conf\" kubeconfig file", "[etcd] Creating static Pod manifest for local etcd in \"/etc/kubernetes/manifests\"", "[control-plane] Using manifest folder \"/etc/kubernetes/manifests\"", "[control-plane] Creating static Pod manifest for \"kube-apiserver\"", "[control-plane] Creating static Pod manifest for \"kube-controller-manager\"", "[control-plane] Creating static Pod manifest for \"kube-scheduler\"", "[kubelet-start] Writing kubelet environment file with flags to file \"/var/lib/kubelet/kubeadm-flags.env\"", "[kubelet-start] Writing kubelet configuration to file \"/var/lib/kubelet/config.yaml\"", "[kubelet-start] Starting the kubelet", "[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory \"/etc/kubernetes/manifests\". This can take up to 4m0s", "[kubelet-check] Initial timeout of 40s passed.", "", "Unfortunately, an error has occurred:", "\ttimed out waiting for the condition", "", "This error is likely caused by:", "\t- The kubelet is not running", "\t- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)", "", "If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:", "\t- 'systemctl status kubelet'", "\t- 'journalctl -xeu kubelet'", "", "Additionally, a control plane component may have crashed or exited when started by the container runtime.", "To troubleshoot, list all containers using your preferred container runtimes CLI.", "Here is one example how you may list all running Kubernetes containers by using crictl:", "\t- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock ps -a | grep kube | grep -v pause'", "\tOnce you have found the failing container, you can inspect its logs with:", "\t- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock logs CONTAINERID'"]} 2026-04-07 09:14:56.082949 | instance | 2026-04-07 09:14:56.083231 | instance | PLAY RECAP ********************************************************************* 2026-04-07 09:14:56.083558 | instance | instance : ok=199 changed=54 unreachable=0 failed=1 skipped=54 rescued=0 ignored=2 2026-04-07 09:14:56.083825 | instance | 2026-04-07 09:14:56.084111 | instance | Tuesday 07 April 2026 09:14:56 +0000 (0:04:35.298) 0:12:22.409 ********* 2026-04-07 09:14:56.084396 | instance | =============================================================================== 2026-04-07 09:14:56.084685 | instance | vexxhost.kubernetes.kubernetes : Initialize cluster ------------------- 275.30s 2026-04-07 09:14:56.084965 | instance | vexxhost.ceph.mon : Run Bootstrap coomand ----------------------------- 174.63s 2026-04-07 09:14:56.085247 | instance | vexxhost.ceph.osd : Install OSDs -------------------------------------- 104.10s 2026-04-07 09:14:56.085548 | instance | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 10.52s 2026-04-07 09:14:56.085936 | instance | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 10.44s 2026-04-07 09:14:56.086200 | instance | vexxhost.kubernetes.kubelet : Install additional packages --------------- 6.35s 2026-04-07 09:14:56.086509 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.22s 2026-04-07 09:14:56.086833 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.42s 2026-04-07 09:14:56.087100 | instance | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.39s 2026-04-07 09:14:56.087362 | instance | vexxhost.ceph.osd : Get `cephadm ls` status ----------------------------- 5.35s 2026-04-07 09:14:56.087688 | instance | vexxhost.atmosphere.sysctl : Configure sysctl values -------------------- 4.41s 2026-04-07 09:14:56.087974 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.37s 2026-04-07 09:14:56.088238 | instance | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 4.27s 2026-04-07 09:14:56.088517 | instance | vexxhost.ceph.osd : Mark require osd release ---------------------------- 3.61s 2026-04-07 09:14:56.088781 | instance | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 3.18s 2026-04-07 09:14:56.089046 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-04-07 09:14:56.089311 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.92s 2026-04-07 09:14:56.089609 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.65s 2026-04-07 09:14:56.089953 | instance | vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module ----------- 2.52s 2026-04-07 09:14:56.090197 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.40s 2026-04-07 09:14:56.253540 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-07 09:14:56.253712 | instance | ERROR [aio > converge] Executed: Failed 2026-04-07 09:14:56.253847 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml 2026-04-07 09:14:56.484896 | instance | ERROR 2026-04-07 09:14:56.485200 | instance | { 2026-04-07 09:14:56.485242 | instance | "delta": "0:15:08.162794", 2026-04-07 09:14:56.485273 | instance | "end": "2026-04-07 09:14:56.341784", 2026-04-07 09:14:56.485301 | instance | "msg": "non-zero return code", 2026-04-07 09:14:56.485328 | instance | "rc": 2, 2026-04-07 09:14:56.485358 | instance | "start": "2026-04-07 08:59:48.178990" 2026-04-07 09:14:56.485384 | instance | } failure 2026-04-07 09:14:56.501657 | 2026-04-07 09:14:56.501782 | PLAY RECAP 2026-04-07 09:14:56.501831 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-07 09:14:56.501854 | 2026-04-07 09:14:56.654827 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-07 09:14:56.664155 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-07 09:14:57.286749 | 2026-04-07 09:14:57.287161 | PLAY [all] 2026-04-07 09:14:57.301668 | 2026-04-07 09:14:57.301758 | TASK [gather-host-logs : creating directory for system status] 2026-04-07 09:14:57.620020 | instance | changed 2026-04-07 09:14:57.626456 | 2026-04-07 09:14:57.626531 | TASK [gather-host-logs : Get logs for each host] 2026-04-07 09:14:57.970257 | instance | + systemd-cgls --full --all --no-pager 2026-04-07 09:14:57.985541 | instance | + ip addr 2026-04-07 09:14:57.988529 | instance | + ip route 2026-04-07 09:14:57.990088 | instance | + lsblk 2026-04-07 09:14:57.993902 | instance | + mount 2026-04-07 09:14:57.996346 | instance | + docker images 2026-04-07 09:14:58.015092 | instance | + brctl show 2026-04-07 09:14:58.015530 | instance | /bin/bash: line 8: brctl: command not found 2026-04-07 09:14:58.016230 | instance | + ps aux --sort=-%mem 2026-04-07 09:14:58.034880 | instance | + dpkg -l 2026-04-07 09:14:58.046738 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-07 09:14:58.047102 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-07 09:14:58.062330 | instance | + '[' '!' -z '' ']' 2026-04-07 09:14:58.163635 | instance | ok: Runtime: 0:00:00.096807 2026-04-07 09:14:58.171020 | 2026-04-07 09:14:58.171148 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-07 09:14:58.775888 | instance | changed: 2026-04-07 09:14:58.776120 | instance | created directory /var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/logs/instance 2026-04-07 09:14:58.776178 | instance | cd+++++++++ system/ 2026-04-07 09:14:58.776225 | instance | >f+++++++++ system/brctl-show.txt 2026-04-07 09:14:58.776258 | instance | >f+++++++++ system/docker-images.txt 2026-04-07 09:14:58.776289 | instance | >f+++++++++ system/ip-addr.txt 2026-04-07 09:14:58.776321 | instance | >f+++++++++ system/ip-route.txt 2026-04-07 09:14:58.776352 | instance | >f+++++++++ system/lsblk.txt 2026-04-07 09:14:58.776381 | instance | >f+++++++++ system/mount.txt 2026-04-07 09:14:58.776409 | instance | >f+++++++++ system/packages.txt 2026-04-07 09:14:58.776436 | instance | >f+++++++++ system/ps.txt 2026-04-07 09:14:58.776467 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-07 09:14:58.787702 | 2026-04-07 09:14:58.787843 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-07 09:14:58.978913 | instance | changed: "values" 2026-04-07 09:14:59.145460 | instance | changed: "releases" 2026-04-07 09:14:59.165133 | 2026-04-07 09:14:59.165349 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-07 09:14:59.431968 | instance | E0407 09:14:59.431427 46328 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:14:59.433026 | instance | E0407 09:14:59.432764 46328 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:14:59.434021 | instance | E0407 09:14:59.433949 46328 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:14:59.434842 | instance | E0407 09:14:59.434770 46328 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:14:59.435986 | instance | E0407 09:14:59.435934 46328 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:14:59.436026 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:14:59.702516 | instance | ok: Runtime: 0:00:00.069799 2026-04-07 09:14:59.709318 | 2026-04-07 09:14:59.709382 | TASK [helm-release-status : Downloads logs to executor] 2026-04-07 09:15:00.201413 | instance | changed: 2026-04-07 09:15:00.201736 | instance | cd+++++++++ helm/ 2026-04-07 09:15:00.201784 | instance | cd+++++++++ helm/releases/ 2026-04-07 09:15:00.201815 | instance | cd+++++++++ helm/values/ 2026-04-07 09:15:00.212500 | 2026-04-07 09:15:00.212580 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-07 09:15:00.424703 | instance | changed 2026-04-07 09:15:00.470238 | 2026-04-07 09:15:00.470589 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-07 09:15:00.689251 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-07 09:15:00.689336 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-07 09:15:00.697751 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-07 09:15:00.699006 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-07 09:15:00.747927 | instance | E0407 09:15:00.747789 46387 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.748829 | instance | E0407 09:15:00.748765 46387 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.751224 | instance | E0407 09:15:00.750840 46385 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.751372 | instance | E0407 09:15:00.751323 46387 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.752146 | instance | E0407 09:15:00.752084 46387 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.753329 | instance | E0407 09:15:00.753246 46385 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.753912 | instance | E0407 09:15:00.753871 46387 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.753940 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:00.753955 | instance | E0407 09:15:00.753934 46385 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.755789 | instance | E0407 09:15:00.755695 46385 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.756489 | instance | E0407 09:15:00.756459 46385 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.757917 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:00.763576 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-07 09:15:00.767922 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-07 09:15:00.818013 | instance | E0407 09:15:00.817906 46422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.818850 | instance | E0407 09:15:00.818808 46422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.820475 | instance | E0407 09:15:00.820436 46422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.820880 | instance | E0407 09:15:00.820846 46422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.822598 | instance | E0407 09:15:00.822566 46422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.822635 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:00.830406 | instance | E0407 09:15:00.829996 46429 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.832300 | instance | E0407 09:15:00.832248 46429 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.832789 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-07 09:15:00.832948 | instance | E0407 09:15:00.832922 46429 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.835039 | instance | E0407 09:15:00.834999 46429 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.835975 | instance | E0407 09:15:00.835914 46429 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.837243 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:00.880730 | instance | E0407 09:15:00.880616 46460 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.881862 | instance | E0407 09:15:00.881815 46460 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.882640 | instance | E0407 09:15:00.882590 46460 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.884560 | instance | E0407 09:15:00.884424 46460 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.884883 | instance | E0407 09:15:00.884853 46460 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:00.886144 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:01.009701 | instance | ok: Runtime: 0:00:00.210249 2026-04-07 09:15:01.017352 | 2026-04-07 09:15:01.017416 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-07 09:15:01.225695 | instance | changed 2026-04-07 09:15:01.230747 | 2026-04-07 09:15:01.230815 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-07 09:15:01.455354 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-07 09:15:01.455866 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-07 09:15:01.455885 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-07 09:15:01.503969 | instance | E0407 09:15:01.503789 46498 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:01.504777 | instance | E0407 09:15:01.504720 46498 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:01.506946 | instance | E0407 09:15:01.506758 46498 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:01.507647 | instance | E0407 09:15:01.507504 46498 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:01.509744 | instance | E0407 09:15:01.509684 46498 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:01.509769 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:01.779802 | instance | ok: Runtime: 0:00:00.065070 2026-04-07 09:15:01.788788 | 2026-04-07 09:15:01.788883 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-07 09:15:02.277973 | instance | changed: 2026-04-07 09:15:02.278197 | instance | cd+++++++++ objects/ 2026-04-07 09:15:02.278272 | instance | cd+++++++++ objects/cluster/ 2026-04-07 09:15:02.278304 | instance | cd+++++++++ objects/namespaced/ 2026-04-07 09:15:02.288758 | 2026-04-07 09:15:02.288825 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-07 09:15:02.487578 | instance | changed 2026-04-07 09:15:02.494133 | 2026-04-07 09:15:02.494194 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-07 09:15:02.735631 | instance | changed 2026-04-07 09:15:02.741831 | 2026-04-07 09:15:02.741933 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-07 09:15:03.008644 | instance | E0407 09:15:03.008428 46552 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:03.009423 | instance | E0407 09:15:03.009353 46552 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:03.011276 | instance | E0407 09:15:03.011192 46552 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:03.011967 | instance | E0407 09:15:03.011895 46552 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:03.014062 | instance | E0407 09:15:03.013995 46552 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:03.014095 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:03.282615 | instance | ok: Runtime: 0:00:00.067303 2026-04-07 09:15:03.288380 | 2026-04-07 09:15:03.288447 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-07 09:15:03.750711 | instance | changed: 2026-04-07 09:15:03.750892 | instance | cd+++++++++ pod-logs/ 2026-04-07 09:15:03.750921 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-07 09:15:03.761965 | 2026-04-07 09:15:03.762027 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-07 09:15:03.959619 | instance | changed 2026-04-07 09:15:03.966088 | 2026-04-07 09:15:03.966180 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-07 09:15:04.260029 | instance | E0407 09:15:04.259822 46598 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.260610 | instance | E0407 09:15:04.260557 46598 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.262471 | instance | E0407 09:15:04.262428 46598 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.263465 | instance | E0407 09:15:04.263417 46598 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.265418 | instance | E0407 09:15:04.265061 46598 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.265506 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:04.503627 | instance | ok: Runtime: 0:00:00.071346 2026-04-07 09:15:04.510308 | 2026-04-07 09:15:04.510397 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-07 09:15:04.768958 | instance | E0407 09:15:04.768788 46626 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.769813 | instance | E0407 09:15:04.769755 46626 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.772938 | instance | E0407 09:15:04.772739 46626 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.774805 | instance | E0407 09:15:04.774744 46626 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.775588 | instance | E0407 09:15:04.775547 46626 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:04.776817 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:04.781173 | instance | ceph-mgr endpoints: 2026-04-07 09:15:05.042058 | instance | ok: Runtime: 0:00:00.067243 2026-04-07 09:15:05.047328 | 2026-04-07 09:15:05.047395 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-07 09:15:05.302362 | instance | E0407 09:15:05.302159 46655 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:05.303034 | instance | E0407 09:15:05.302990 46655 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:05.305047 | instance | E0407 09:15:05.304988 46655 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:05.305639 | instance | E0407 09:15:05.305599 46655 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:05.307286 | instance | E0407 09:15:05.307227 46655 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-07 09:15:05.307319 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-07 09:15:05.587379 | instance | ok: Runtime: 0:00:00.069144 2026-04-07 09:15:05.593901 | 2026-04-07 09:15:05.593996 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-07 09:15:06.077929 | instance | changed: cd+++++++++ prometheus/ 2026-04-07 09:15:06.087831 | 2026-04-07 09:15:06.087893 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-07 09:15:06.323311 | instance | changed 2026-04-07 09:15:06.328366 | 2026-04-07 09:15:06.328431 | TASK [gather-selenium-data : Get selenium data] 2026-04-07 09:15:06.542102 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-07 09:15:06.543119 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-07 09:15:06.863557 | instance | ERROR 2026-04-07 09:15:06.863787 | instance | { 2026-04-07 09:15:06.863832 | instance | "delta": "0:00:00.005531", 2026-04-07 09:15:06.863860 | instance | "end": "2026-04-07 09:15:06.543385", 2026-04-07 09:15:06.863886 | instance | "msg": "non-zero return code", 2026-04-07 09:15:06.863911 | instance | "rc": 1, 2026-04-07 09:15:06.863936 | instance | "start": "2026-04-07 09:15:06.537854" 2026-04-07 09:15:06.863960 | instance | } 2026-04-07 09:15:06.863991 | instance | ERROR: Ignoring Errors 2026-04-07 09:15:06.869571 | 2026-04-07 09:15:06.869632 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-07 09:15:07.386422 | instance | changed: cd+++++++++ selenium/ 2026-04-07 09:15:07.392514 | 2026-04-07 09:15:07.392566 | PLAY RECAP 2026-04-07 09:15:07.392614 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-07 09:15:07.392638 | 2026-04-07 09:15:07.521265 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-07 09:15:07.533230 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-07 09:15:08.134781 | 2026-04-07 09:15:08.134932 | PLAY [all] 2026-04-07 09:15:08.253732 | 2026-04-07 09:15:08.253911 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-07 09:15:08.300108 | instance | skipping: Conditional result was False 2026-04-07 09:15:08.311256 | 2026-04-07 09:15:08.311388 | TASK [fetch-output : Set log path for single node] 2026-04-07 09:15:08.355677 | instance | ok 2026-04-07 09:15:08.360709 | 2026-04-07 09:15:08.360784 | LOOP [fetch-output : Ensure local output dirs] 2026-04-07 09:15:08.725459 | instance -> localhost | ok: "/var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/logs" 2026-04-07 09:15:08.929707 | instance -> localhost | changed: "/var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/artifacts" 2026-04-07 09:15:09.139420 | instance -> localhost | changed: "/var/lib/zuul/builds/83796d888f8e42aeb3f93002b9d02ee7/work/docs" 2026-04-07 09:15:09.159986 | 2026-04-07 09:15:09.160130 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-07 09:15:09.774868 | instance | changed: .d..t...... ./ 2026-04-07 09:15:09.775125 | instance | changed: All items complete 2026-04-07 09:15:09.775165 | 2026-04-07 09:15:10.209826 | instance | changed: .d..t...... ./ 2026-04-07 09:15:10.644683 | instance | changed: .d..t...... ./ 2026-04-07 09:15:10.669531 | 2026-04-07 09:15:10.669674 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-07 09:15:11.091301 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006988 2026-04-07 09:15:11.299553 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.005549 2026-04-07 09:15:11.308472 | 2026-04-07 09:15:11.308601 | PLAY [all] 2026-04-07 09:15:11.317783 | 2026-04-07 09:15:11.317882 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-07 09:15:11.726244 | instance | changed 2026-04-07 09:15:11.733362 | 2026-04-07 09:15:11.733438 | PLAY RECAP 2026-04-07 09:15:11.733492 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-07 09:15:11.733521 | 2026-04-07 09:15:11.852670 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-07 09:15:11.864945 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-07 09:15:12.432921 | 2026-04-07 09:15:12.433069 | PLAY [localhost] 2026-04-07 09:15:12.442703 | 2026-04-07 09:15:12.442775 | TASK [Generate Zuul manifest] 2026-04-07 09:15:12.465201 | localhost | ok 2026-04-07 09:15:12.479077 | 2026-04-07 09:15:12.479150 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-07 09:15:12.848991 | localhost | changed 2026-04-07 09:15:12.858627 | 2026-04-07 09:15:12.858698 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-07 09:15:12.889603 | localhost | ok 2026-04-07 09:15:12.898113 | 2026-04-07 09:15:12.898176 | TASK [Upload logs] 2026-04-07 09:15:12.919673 | localhost | ok 2026-04-07 09:15:13.016187 | 2026-04-07 09:15:13.016322 | TASK [Set zuul-log-path fact] 2026-04-07 09:15:13.035682 | localhost | ok 2026-04-07 09:15:13.049086 | 2026-04-07 09:15:13.049154 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-07 09:15:13.080592 | localhost | ok 2026-04-07 09:15:13.089608 | 2026-04-07 09:15:13.089670 | TASK [upload-logs : Create log directories] 2026-04-07 09:15:13.434218 | localhost | changed 2026-04-07 09:15:13.438968 | 2026-04-07 09:15:13.439036 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-07 09:15:13.786378 | localhost -> localhost | ok: Runtime: 0:00:00.004514 2026-04-07 09:15:13.791445 | 2026-04-07 09:15:13.791511 | TASK [upload-logs : Upload logs to log server] 2026-04-07 09:15:14.208149 | localhost | Output suppressed because no_log was given 2026-04-07 09:15:14.213840 | 2026-04-07 09:15:14.213932 | LOOP [upload-logs : Compress console log and json output] 2026-04-07 09:15:14.258727 | localhost | skipping: Conditional result was False 2026-04-07 09:15:14.265712 | localhost | skipping: Conditional result was False 2026-04-07 09:15:14.276818 | 2026-04-07 09:15:14.276967 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-07 09:15:14.318215 | localhost | skipping: Conditional result was False 2026-04-07 09:15:14.318589 | 2026-04-07 09:15:14.322260 | localhost | skipping: Conditional result was False 2026-04-07 09:15:14.331851 | 2026-04-07 09:15:14.331983 | LOOP [upload-logs : Upload console log and json output]