2026-04-17 10:52:54.871079 | Job console starting 2026-04-17 10:52:54.881579 | Updating git repos 2026-04-17 10:52:54.942889 | Cloning repos into workspace 2026-04-17 10:52:55.021242 | Restoring repo states 2026-04-17 10:52:55.040488 | Merging changes 2026-04-17 10:52:56.017426 | Checking out repos 2026-04-17 10:52:56.416078 | Preparing playbooks 2026-04-17 10:52:58.938330 | Running Ansible setup 2026-04-17 10:53:02.269871 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-17 10:53:02.826730 | 2026-04-17 10:53:02.826841 | PLAY [localhost] 2026-04-17 10:53:02.834322 | 2026-04-17 10:53:02.834390 | TASK [Gathering Facts] 2026-04-17 10:53:03.879579 | localhost | ok 2026-04-17 10:53:03.889344 | 2026-04-17 10:53:03.889445 | TASK [Setup log path fact] 2026-04-17 10:53:03.909190 | localhost | ok 2026-04-17 10:53:03.921311 | 2026-04-17 10:53:03.921374 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-17 10:53:03.950256 | localhost | ok 2026-04-17 10:53:03.958265 | 2026-04-17 10:53:03.958352 | TASK [emit-job-header : Print job information] 2026-04-17 10:53:03.995618 | # Job Information 2026-04-17 10:53:03.995805 | Ansible Version: 2.16.16 2026-04-17 10:53:03.995838 | Job: atmosphere-molecule-csi-rbd 2026-04-17 10:53:03.995861 | Pipeline: check 2026-04-17 10:53:03.995882 | Executor: 0a8996d2b663 2026-04-17 10:53:03.995902 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3834 2026-04-17 10:53:03.995926 | Event ID: 8225ce70-3a4b-11f1-9281-6fb3908ededd 2026-04-17 10:53:03.998835 | 2026-04-17 10:53:03.998909 | LOOP [emit-job-header : Print node information] 2026-04-17 10:53:04.091245 | localhost | ok: 2026-04-17 10:53:04.091844 | localhost | # Node Information 2026-04-17 10:53:04.092076 | localhost | Inventory Hostname: instance 2026-04-17 10:53:04.092353 | localhost | Hostname: np0000167112 2026-04-17 10:53:04.092579 | localhost | Username: zuul 2026-04-17 10:53:04.092868 | localhost | Distro: Ubuntu 22.04 2026-04-17 10:53:04.093232 | localhost | Provider: yul1 2026-04-17 10:53:04.093478 | localhost | Region: ca-ymq-1 2026-04-17 10:53:04.093701 | localhost | Label: ubuntu-jammy 2026-04-17 10:53:04.093978 | localhost | Product Name: OpenStack Nova 2026-04-17 10:53:04.094219 | localhost | Interface IP: 199.19.213.157 2026-04-17 10:53:04.116474 | 2026-04-17 10:53:04.116633 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-17 10:53:04.496763 | localhost -> localhost | changed 2026-04-17 10:53:04.507370 | 2026-04-17 10:53:04.507448 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-17 10:53:05.331481 | localhost -> localhost | changed 2026-04-17 10:53:05.338945 | 2026-04-17 10:53:05.339020 | PLAY [all] 2026-04-17 10:53:05.349999 | 2026-04-17 10:53:05.350061 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-17 10:53:05.565392 | instance -> localhost | ok 2026-04-17 10:53:05.575832 | 2026-04-17 10:53:05.575921 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-17 10:53:05.608929 | instance | ok 2026-04-17 10:53:05.622291 | instance | included: /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-17 10:53:05.627741 | 2026-04-17 10:53:05.627814 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-17 10:53:06.602433 | instance -> localhost | Generating public/private rsa key pair. 2026-04-17 10:53:06.602691 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/681c3536687a4cd68c4fc57efa6d59fb_id_rsa 2026-04-17 10:53:06.602735 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/681c3536687a4cd68c4fc57efa6d59fb_id_rsa.pub 2026-04-17 10:53:06.602767 | instance -> localhost | The key fingerprint is: 2026-04-17 10:53:06.602797 | instance -> localhost | SHA256:qJuXhQCCTJ2GminnD1ddW6Zi8GvnkeYNyPNDgBEeLzI zuul-build-sshkey 2026-04-17 10:53:06.602837 | instance -> localhost | The key's randomart image is: 2026-04-17 10:53:06.602867 | instance -> localhost | +---[RSA 3072]----+ 2026-04-17 10:53:06.602902 | instance -> localhost | |+.o . o. | 2026-04-17 10:53:06.602932 | instance -> localhost | |oo.+ .oo . o | 2026-04-17 10:53:06.602960 | instance -> localhost | |.+..E o*.. = | 2026-04-17 10:53:06.602988 | instance -> localhost | |= . .ooo* o | 2026-04-17 10:53:06.603015 | instance -> localhost | |.o o.+S= . | 2026-04-17 10:53:06.603042 | instance -> localhost | | o ... B B | 2026-04-17 10:53:06.603069 | instance -> localhost | | +. + O + | 2026-04-17 10:53:06.603097 | instance -> localhost | | .oo = . | 2026-04-17 10:53:06.603128 | instance -> localhost | | o. . | 2026-04-17 10:53:06.603156 | instance -> localhost | +----[SHA256]-----+ 2026-04-17 10:53:06.603217 | instance -> localhost | ok: Runtime: 0:00:00.517122 2026-04-17 10:53:06.611259 | 2026-04-17 10:53:06.611321 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-17 10:53:06.647649 | instance | ok 2026-04-17 10:53:06.662051 | instance | included: /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-17 10:53:06.670946 | 2026-04-17 10:53:06.671007 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-17 10:53:06.695026 | instance | skipping: Conditional result was False 2026-04-17 10:53:06.706503 | 2026-04-17 10:53:06.706643 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-17 10:53:07.127559 | instance | changed 2026-04-17 10:53:07.134539 | 2026-04-17 10:53:07.134666 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-17 10:53:07.323946 | instance | ok 2026-04-17 10:53:07.331531 | 2026-04-17 10:53:07.331616 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-17 10:53:07.800454 | instance | changed 2026-04-17 10:53:07.824431 | 2026-04-17 10:53:07.824531 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-17 10:53:08.319035 | instance | changed 2026-04-17 10:53:08.327572 | 2026-04-17 10:53:08.327649 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-17 10:53:08.354996 | instance | skipping: Conditional result was False 2026-04-17 10:53:08.370952 | 2026-04-17 10:53:08.371077 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-17 10:53:08.703044 | instance -> localhost | changed 2026-04-17 10:53:08.719288 | 2026-04-17 10:53:08.719392 | TASK [add-build-sshkey : Add back temp key] 2026-04-17 10:53:08.996002 | instance -> localhost | Identity added: /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/681c3536687a4cd68c4fc57efa6d59fb_id_rsa (zuul-build-sshkey) 2026-04-17 10:53:08.996217 | instance -> localhost | ok: Runtime: 0:00:00.015740 2026-04-17 10:53:09.005048 | 2026-04-17 10:53:09.005169 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-17 10:53:09.352365 | instance | ok 2026-04-17 10:53:09.359368 | 2026-04-17 10:53:09.359490 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-17 10:53:09.384857 | instance | skipping: Conditional result was False 2026-04-17 10:53:09.401887 | 2026-04-17 10:53:09.402013 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-17 10:53:09.720847 | instance | ok 2026-04-17 10:53:09.730707 | 2026-04-17 10:53:09.730779 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-17 10:53:11.344904 | instance | Output suppressed because no_log was given 2026-04-17 10:53:11.356101 | 2026-04-17 10:53:11.356162 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-17 10:53:11.539853 | instance | ok: "logs" 2026-04-17 10:53:11.540139 | instance | ok: All items complete 2026-04-17 10:53:11.540179 | 2026-04-17 10:53:11.686836 | instance | ok: "artifacts" 2026-04-17 10:53:11.839358 | instance | ok: "docs" 2026-04-17 10:53:11.852886 | 2026-04-17 10:53:11.853159 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-17 10:53:12.052624 | instance | changed: "logs" 2026-04-17 10:53:12.217873 | instance | changed: "artifacts" 2026-04-17 10:53:12.381226 | instance | changed: "docs" 2026-04-17 10:53:12.393519 | 2026-04-17 10:53:12.393617 | PLAY RECAP 2026-04-17 10:53:12.393664 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-17 10:53:12.393694 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 10:53:12.393716 | 2026-04-17 10:53:12.497248 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-17 10:53:12.501114 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-17 10:53:13.050065 | 2026-04-17 10:53:13.050177 | PLAY [all] 2026-04-17 10:53:13.061849 | 2026-04-17 10:53:13.061930 | TASK [setup-uv : Extract archive] 2026-04-17 10:53:15.301193 | instance | changed 2026-04-17 10:53:15.306908 | 2026-04-17 10:53:15.306987 | TASK [setup-uv : Print version] 2026-04-17 10:53:14.466855 | instance | uv 0.8.13 2026-04-17 10:53:15.843563 | instance | ok: Runtime: 0:00:00.013607 2026-04-17 10:53:15.850211 | 2026-04-17 10:53:15.850264 | PLAY RECAP 2026-04-17 10:53:15.850312 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 10:53:15.850338 | 2026-04-17 10:53:15.970771 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-17 10:53:15.975306 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-17 10:53:16.557362 | 2026-04-17 10:53:16.557478 | PLAY [all] 2026-04-17 10:53:16.568062 | 2026-04-17 10:53:16.568133 | TASK [Install "jq" for log collection] 2026-04-17 10:53:50.584741 | instance | changed 2026-04-17 10:53:50.590958 | 2026-04-17 10:53:50.591028 | TASK [Install pip3 for Python package management] 2026-04-17 10:53:55.177247 | instance | changed 2026-04-17 10:53:55.182209 | 2026-04-17 10:53:55.182274 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-17 10:53:58.433251 | instance | changed 2026-04-17 10:53:58.436130 | 2026-04-17 10:53:58.436184 | PLAY [all] 2026-04-17 10:53:58.444159 | 2026-04-17 10:53:58.444226 | TASK [ensure-go : Check installed go version] 2026-04-17 10:53:58.978507 | instance | ok: ERROR (ignored) 2026-04-17 10:53:58.978822 | instance | { 2026-04-17 10:53:58.978865 | instance | "failed_when_result": false, 2026-04-17 10:53:58.978894 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-17 10:53:58.978922 | instance | "rc": 2 2026-04-17 10:53:58.978954 | instance | } 2026-04-17 10:53:58.985558 | 2026-04-17 10:53:58.985633 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-17 10:53:59.040578 | instance | ok 2026-04-17 10:53:59.051412 | instance | included: /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-17 10:53:59.056483 | 2026-04-17 10:53:59.056544 | TASK [ensure-go : Create temp directory] 2026-04-17 10:53:59.385326 | instance | changed 2026-04-17 10:53:59.390448 | 2026-04-17 10:53:59.390512 | TASK [ensure-go : Get archive checksum] 2026-04-17 10:53:59.974167 | instance | ok: OK (64 bytes) 2026-04-17 10:53:59.982544 | 2026-04-17 10:53:59.982649 | TASK [ensure-go : Download go archive] 2026-04-17 10:54:01.134771 | instance | changed: OK (78559214 bytes) 2026-04-17 10:54:01.146811 | 2026-04-17 10:54:01.147051 | TASK [ensure-go : Install go] 2026-04-17 10:54:07.082353 | instance | changed 2026-04-17 10:54:07.089288 | 2026-04-17 10:54:07.089342 | PLAY [all] 2026-04-17 10:54:07.095313 | 2026-04-17 10:54:07.095369 | TASK [Copy inventory file for Zuul] 2026-04-17 10:54:07.811116 | instance | changed 2026-04-17 10:54:07.816971 | 2026-04-17 10:54:07.817047 | TASK [Switch "ansible_host" to private IP] 2026-04-17 10:54:08.101714 | instance | changed: 1 replacements made 2026-04-17 10:54:08.108427 | 2026-04-17 10:54:08.108493 | TASK [Run molecule prepare] 2026-04-17 10:54:08.352959 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-17 10:54:08.353116 | instance | Creating virtual environment at: .venv 2026-04-17 10:54:08.379951 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-17 10:54:08.411297 | instance | Downloading rjsonnet (1.2MiB) 2026-04-17 10:54:08.411518 | instance | Downloading kubernetes (1.9MiB) 2026-04-17 10:54:08.411821 | instance | Downloading cryptography (4.2MiB) 2026-04-17 10:54:08.412641 | instance | Downloading openstacksdk (1.7MiB) 2026-04-17 10:54:08.420371 | instance | Downloading pydantic-core (2.0MiB) 2026-04-17 10:54:08.421171 | instance | Downloading setuptools (1.1MiB) 2026-04-17 10:54:08.422012 | instance | Downloading ansible-core (2.1MiB) 2026-04-17 10:54:08.422352 | instance | Downloading pygments (1.2MiB) 2026-04-17 10:54:08.442930 | instance | Downloading netaddr (2.2MiB) 2026-04-17 10:54:08.710442 | instance | Building pyperclip==1.9.0 2026-04-17 10:54:08.724111 | instance | Downloading rjsonnet 2026-04-17 10:54:08.833591 | instance | Downloading pydantic-core 2026-04-17 10:54:08.878780 | instance | Downloading netaddr 2026-04-17 10:54:08.897658 | instance | Downloading pygments 2026-04-17 10:54:08.913017 | instance | Downloading cryptography 2026-04-17 10:54:08.940631 | instance | Downloading setuptools 2026-04-17 10:54:08.986923 | instance | Downloading kubernetes 2026-04-17 10:54:09.013181 | instance | Downloading ansible-core 2026-04-17 10:54:09.034008 | instance | Downloading openstacksdk 2026-04-17 10:54:09.422898 | instance | Built pyperclip==1.9.0 2026-04-17 10:54:09.567980 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-17 10:54:09.612170 | instance | Installed 83 packages in 42ms 2026-04-17 10:54:10.193992 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-17 10:54:10.793213 | instance | INFO [csi > discovery] scenario test matrix: prepare 2026-04-17 10:54:10.793369 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-04-17 10:54:48.989444 | instance | INFO [csi > prepare] Executing 2026-04-17 10:54:49.886553 | instance | 2026-04-17 10:54:49.887192 | instance | PLAY [Prepare] ***************************************************************** 2026-04-17 10:54:49.887545 | instance | 2026-04-17 10:54:49.887950 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-17 10:54:49.888401 | instance | Friday 17 April 2026 10:54:49 +0000 (0:00:00.025) 0:00:00.025 ********** 2026-04-17 10:54:51.030290 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-17 10:54:51.030343 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-17 10:54:51.030356 | instance | interpreter could change the meaning of that path. See 2026-04-17 10:54:51.030366 | instance | https://docs.ansible.com/ansible- 2026-04-17 10:54:51.030374 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-17 10:54:51.037793 | instance | ok: [instance] 2026-04-17 10:54:51.037827 | instance | 2026-04-17 10:54:51.037839 | instance | TASK [Configure short hostname] ************************************************ 2026-04-17 10:54:51.037850 | instance | Friday 17 April 2026 10:54:51 +0000 (0:00:01.150) 0:00:01.176 ********** 2026-04-17 10:54:51.700369 | instance | changed: [instance] 2026-04-17 10:54:51.700615 | instance | 2026-04-17 10:54:51.700628 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-17 10:54:51.700648 | instance | Friday 17 April 2026 10:54:51 +0000 (0:00:00.662) 0:00:01.839 ********** 2026-04-17 10:54:51.986419 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-17 10:54:51.986678 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-17 10:54:51.986948 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-17 10:54:51.999219 | instance | changed: [instance] 2026-04-17 10:54:51.999463 | instance | 2026-04-17 10:54:51.999728 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-17 10:54:51.999996 | instance | Friday 17 April 2026 10:54:51 +0000 (0:00:00.299) 0:00:02.138 ********** 2026-04-17 10:54:52.889291 | instance | ok: [instance] 2026-04-17 10:54:52.889547 | instance | 2026-04-17 10:54:52.889834 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-17 10:54:52.890130 | instance | 2026-04-17 10:54:52.890431 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-17 10:54:52.890743 | instance | Friday 17 April 2026 10:54:52 +0000 (0:00:00.890) 0:00:03.028 ********** 2026-04-17 10:54:53.591895 | instance | ok: [instance] 2026-04-17 10:54:53.592159 | instance | 2026-04-17 10:54:53.592489 | instance | TASK [Install depedencies] ***************************************************** 2026-04-17 10:54:53.592779 | instance | Friday 17 April 2026 10:54:53 +0000 (0:00:00.702) 0:00:03.731 ********** 2026-04-17 10:55:13.927015 | instance | changed: [instance] 2026-04-17 10:55:13.927280 | instance | 2026-04-17 10:55:13.927594 | instance | TASK [Start up service] ******************************************************** 2026-04-17 10:55:13.927958 | instance | Friday 17 April 2026 10:55:13 +0000 (0:00:20.334) 0:00:24.065 ********** 2026-04-17 10:55:14.461446 | instance | ok: [instance] 2026-04-17 10:55:14.461727 | instance | 2026-04-17 10:55:14.462025 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-17 10:55:14.462399 | instance | Friday 17 April 2026 10:55:14 +0000 (0:00:00.535) 0:00:24.600 ********** 2026-04-17 10:55:14.765589 | instance | ok: [instance] 2026-04-17 10:55:14.765814 | instance | 2026-04-17 10:55:14.766153 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-17 10:55:14.766465 | instance | Friday 17 April 2026 10:55:14 +0000 (0:00:00.303) 0:00:24.904 ********** 2026-04-17 10:55:15.406015 | instance | changed: [instance] 2026-04-17 10:55:15.406286 | instance | 2026-04-17 10:55:15.406590 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-17 10:55:15.406863 | instance | Friday 17 April 2026 10:55:15 +0000 (0:00:00.640) 0:00:25.544 ********** 2026-04-17 10:55:15.596401 | instance | ok: [instance] 2026-04-17 10:55:15.596681 | instance | 2026-04-17 10:55:15.596961 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-17 10:55:15.597228 | instance | Friday 17 April 2026 10:55:15 +0000 (0:00:00.190) 0:00:25.735 ********** 2026-04-17 10:55:15.613765 | instance | skipping: [instance] 2026-04-17 10:55:15.613977 | instance | 2026-04-17 10:55:15.614320 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-17 10:55:15.614605 | instance | Friday 17 April 2026 10:55:15 +0000 (0:00:00.017) 0:00:25.753 ********** 2026-04-17 10:55:16.147178 | instance | changed: [instance] => (item=osd0) 2026-04-17 10:55:16.147434 | instance | changed: [instance] => (item=osd1) 2026-04-17 10:55:16.147718 | instance | changed: [instance] => (item=osd2) 2026-04-17 10:55:16.147965 | instance | 2026-04-17 10:55:16.148284 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-17 10:55:16.148592 | instance | Friday 17 April 2026 10:55:16 +0000 (0:00:00.532) 0:00:26.286 ********** 2026-04-17 10:55:16.759135 | instance | changed: [instance] => (item=osd0) 2026-04-17 10:55:16.759374 | instance | changed: [instance] => (item=osd1) 2026-04-17 10:55:16.759659 | instance | changed: [instance] => (item=osd2) 2026-04-17 10:55:16.759917 | instance | 2026-04-17 10:55:16.760190 | instance | TASK [Start loop devices] ****************************************************** 2026-04-17 10:55:16.760539 | instance | Friday 17 April 2026 10:55:16 +0000 (0:00:00.612) 0:00:26.898 ********** 2026-04-17 10:55:17.455997 | instance | changed: [instance] => (item=osd0) 2026-04-17 10:55:17.456140 | instance | changed: [instance] => (item=osd1) 2026-04-17 10:55:17.456337 | instance | changed: [instance] => (item=osd2) 2026-04-17 10:55:17.456503 | instance | 2026-04-17 10:55:17.456697 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-17 10:55:17.456862 | instance | Friday 17 April 2026 10:55:17 +0000 (0:00:00.697) 0:00:27.595 ********** 2026-04-17 10:55:20.569811 | instance | changed: [instance] => (item=osd0) 2026-04-17 10:55:20.570200 | instance | changed: [instance] => (item=osd1) 2026-04-17 10:55:20.570505 | instance | changed: [instance] => (item=osd2) 2026-04-17 10:55:20.570806 | instance | 2026-04-17 10:55:20.571104 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-17 10:55:20.571400 | instance | Friday 17 April 2026 10:55:20 +0000 (0:00:03.113) 0:00:30.709 ********** 2026-04-17 10:55:22.457649 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-17 10:55:22.457900 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-17 10:55:22.458166 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-17 10:55:22.458412 | instance | 2026-04-17 10:55:22.458678 | instance | PLAY RECAP ********************************************************************* 2026-04-17 10:55:22.458982 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-17 10:55:22.459190 | instance | 2026-04-17 10:55:22.459508 | instance | Friday 17 April 2026 10:55:22 +0000 (0:00:01.888) 0:00:32.597 ********** 2026-04-17 10:55:22.459765 | instance | =============================================================================== 2026-04-17 10:55:22.460016 | instance | Install depedencies ---------------------------------------------------- 20.33s 2026-04-17 10:55:22.460304 | instance | Create a volume group for each loop device ------------------------------ 3.11s 2026-04-17 10:55:22.460585 | instance | Create a logical volume for each loop device ---------------------------- 1.89s 2026-04-17 10:55:22.460843 | instance | Gathering Facts --------------------------------------------------------- 1.15s 2026-04-17 10:55:22.461117 | instance | Purge "snapd" package --------------------------------------------------- 0.89s 2026-04-17 10:55:22.461377 | instance | Gathering Facts --------------------------------------------------------- 0.70s 2026-04-17 10:55:22.461629 | instance | Start loop devices ------------------------------------------------------ 0.70s 2026-04-17 10:55:22.461885 | instance | Configure short hostname ------------------------------------------------ 0.66s 2026-04-17 10:55:22.462139 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s 2026-04-17 10:55:22.462398 | instance | Set permissions on loopback devices ------------------------------------- 0.61s 2026-04-17 10:55:22.462647 | instance | Start up service -------------------------------------------------------- 0.54s 2026-04-17 10:55:22.462905 | instance | Create devices for Ceph ------------------------------------------------- 0.53s 2026-04-17 10:55:22.463157 | instance | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-04-17 10:55:22.463474 | instance | Ensure hostname inside hosts file --------------------------------------- 0.30s 2026-04-17 10:55:22.463731 | instance | Get list of all loopback devices ---------------------------------------- 0.19s 2026-04-17 10:55:22.463964 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-04-17 10:55:22.543591 | instance | INFO [csi > prepare] Executed: Successful 2026-04-17 10:55:22.544124 | instance | INFO Molecule executed 1 scenario (1 successful) 2026-04-17 10:55:23.068738 | instance | ok: Runtime: 0:01:14.339403 2026-04-17 10:55:23.071618 | 2026-04-17 10:55:23.071677 | PLAY RECAP 2026-04-17 10:55:23.071735 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 10:55:23.071765 | 2026-04-17 10:55:23.192499 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-17 10:55:23.195673 | RUN START: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-17 10:55:23.729132 | 2026-04-17 10:55:23.729243 | PLAY [all] 2026-04-17 10:55:23.739901 | 2026-04-17 10:55:23.739988 | TASK [Build atmosphere binary] 2026-04-17 10:55:24.079248 | instance | go: downloading github.com/spf13/cobra v1.9.1 2026-04-17 10:55:24.079408 | instance | go: downloading golang.org/x/sync v0.18.0 2026-04-17 10:55:24.310988 | instance | go: downloading github.com/spf13/pflag v1.0.7 2026-04-17 10:55:30.282770 | instance | ok: Runtime: 0:00:06.173842 2026-04-17 10:55:30.288460 | 2026-04-17 10:55:30.288519 | TASK [Deploy with parallel orchestrator] 2026-04-17 10:55:30.480258 | instance | ==> Multi-tag mode: ceph, kubernetes, csi 2026-04-17 10:55:30.480431 | instance | ==> Running preflight checks 2026-04-17 10:55:30.921327 | instance | [preflight] 2026-04-17 10:55:30.921365 | instance | [preflight] PLAY [Preflight checks] ******************************************************** 2026-04-17 10:55:30.921377 | instance | [preflight] 2026-04-17 10:55:30.921382 | instance | [preflight] TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-04-17 10:55:30.944737 | instance | [preflight] skipping: [instance] 2026-04-17 10:55:30.944771 | instance | [preflight] 2026-04-17 10:55:30.944782 | instance | [preflight] PLAY RECAP ********************************************************************* 2026-04-17 10:55:30.944798 | instance | [preflight] instance : ok=0 changed=0 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-17 10:55:30.944808 | instance | [preflight] 2026-04-17 10:55:31.000324 | instance | ==> Preflight checks passed 2026-04-17 10:55:31.000420 | instance | ==> Starting parallel deployment (subgraph) 2026-04-17 10:55:31.000496 | instance | ==> [kubernetes] Starting deployment 2026-04-17 10:55:31.000652 | instance | ==> [ceph] Starting deployment 2026-04-17 10:55:31.745259 | instance | [ceph/ceph] 2026-04-17 10:55:31.745350 | instance | [ceph/ceph] PLAY [all] ********************************************************************* 2026-04-17 10:55:31.745362 | instance | [ceph/ceph] 2026-04-17 10:55:31.745371 | instance | [ceph/ceph] TASK [Gathering Facts] ********************************************************* 2026-04-17 10:55:31.802865 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:31.802911 | instance | [kubernetes/kubernetes] PLAY [all] ********************************************************************* 2026-04-17 10:55:31.802930 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:31.802939 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-17 10:55:33.148878 | instance | [ceph/ceph] [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-17 10:55:33.148976 | instance | [ceph/ceph] interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-17 10:55:33.148988 | instance | [ceph/ceph] interpreter could change the meaning of that path. See 2026-04-17 10:55:33.148998 | instance | [ceph/ceph] https://docs.ansible.com/ansible- 2026-04-17 10:55:33.149007 | instance | [ceph/ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-17 10:55:33.158259 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:33.158295 | instance | [ceph/ceph] 2026-04-17 10:55:33.158306 | instance | [ceph/ceph] TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-04-17 10:55:33.199946 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:33.199982 | instance | [ceph/ceph] 2026-04-17 10:55:33.199993 | instance | [ceph/ceph] TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-17 10:55:33.240020 | instance | [kubernetes/kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-17 10:55:33.240062 | instance | [kubernetes/kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-17 10:55:33.240074 | instance | [kubernetes/kubernetes] interpreter could change the meaning of that path. See 2026-04-17 10:55:33.240084 | instance | [kubernetes/kubernetes] https://docs.ansible.com/ansible- 2026-04-17 10:55:33.240093 | instance | [kubernetes/kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-17 10:55:33.259462 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:33.259492 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:33.259500 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ******************** 2026-04-17 10:55:33.375913 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:33.376048 | instance | [ceph/ceph] 2026-04-17 10:55:33.376062 | instance | [ceph/ceph] PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-17 10:55:33.376072 | instance | [ceph/ceph] 2026-04-17 10:55:33.376082 | instance | [ceph/ceph] TASK [Gathering Facts] ********************************************************* 2026-04-17 10:55:34.415112 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:34.415176 | instance | [ceph/ceph] 2026-04-17 10:55:34.415184 | instance | [ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:34.859773 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:34.859819 | instance | [ceph/ceph] 2026-04-17 10:55:34.859827 | instance | [ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-17 10:55:34.899812 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:34.899860 | instance | [ceph/ceph] 2026-04-17 10:55:34.899871 | instance | [ceph/ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-17 10:55:35.325010 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:35.325087 | instance | [ceph/ceph] 2026-04-17 10:55:35.325100 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:35.393449 | instance | [ceph/ceph] ok: [instance] => { 2026-04-17 10:55:35.393517 | instance | [ceph/ceph] "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-17 10:55:35.393526 | instance | [ceph/ceph] } 2026-04-17 10:55:35.393532 | instance | [ceph/ceph] 2026-04-17 10:55:35.393538 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:36.153424 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:36.153462 | instance | [ceph/ceph] 2026-04-17 10:55:36.153470 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:55:36.195204 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:36.195243 | instance | [ceph/ceph] 2026-04-17 10:55:36.195252 | instance | [ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-17 10:55:36.242812 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:36.242869 | instance | [ceph/ceph] 2026-04-17 10:55:36.242881 | instance | [ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:36.555671 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:36.555765 | instance | [ceph/ceph] 2026-04-17 10:55:36.555784 | instance | [ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-17 10:55:37.817213 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:37.817271 | instance | [ceph/ceph] 2026-04-17 10:55:37.817279 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:37.882961 | instance | [ceph/ceph] ok: [instance] => { 2026-04-17 10:55:37.883022 | instance | [ceph/ceph] "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-17 10:55:37.883029 | instance | [ceph/ceph] } 2026-04-17 10:55:37.883035 | instance | [ceph/ceph] 2026-04-17 10:55:37.883046 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:38.695650 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:38.695959 | instance | [ceph/ceph] 2026-04-17 10:55:38.695977 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:55:40.037455 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576}) 2026-04-17 10:55:40.037524 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0}) 2026-04-17 10:55:40.037545 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1}) 2026-04-17 10:55:40.037554 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000}) 2026-04-17 10:55:40.037564 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000}) 2026-04-17 10:55:40.037573 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304}) 2026-04-17 10:55:40.037581 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304}) 2026-04-17 10:55:40.037590 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304}) 2026-04-17 10:55:40.037599 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304}) 2026-04-17 10:55:40.037623 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304}) 2026-04-17 10:55:40.037632 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'}) 2026-04-17 10:55:40.037641 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'}) 2026-04-17 10:55:40.037649 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1}) 2026-04-17 10:55:40.037658 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1}) 2026-04-17 10:55:40.037676 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128}) 2026-04-17 10:55:40.037685 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-17 10:55:40.037694 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-17 10:55:40.037702 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128}) 2026-04-17 10:55:40.037711 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-17 10:55:40.037720 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-17 10:55:40.037729 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:40.037738 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] *** 2026-04-17 10:55:40.438972 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:55:40.439047 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:40.439059 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] ******* 2026-04-17 10:55:41.159038 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:55:41.159084 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:41.159089 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] ********************** 2026-04-17 10:55:41.604746 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:41.604810 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:41.604823 | instance | [kubernetes/kubernetes] TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-17 10:55:41.691190 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:41.691257 | instance | [ceph/ceph] 2026-04-17 10:55:41.691269 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-17 10:55:41.721134 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:41.721179 | instance | [ceph/ceph] 2026-04-17 10:55:41.721191 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-17 10:55:41.746998 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:41.747014 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:41.747023 | instance | [kubernetes/kubernetes] PLAY [Configure Kubernetes VIP] ************************************************ 2026-04-17 10:55:41.747033 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:41.747041 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-17 10:55:41.752133 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:41.752166 | instance | [ceph/ceph] 2026-04-17 10:55:41.752177 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-17 10:55:41.781666 | instance | [ceph/ceph] skipping: [instance] 2026-04-17 10:55:41.781711 | instance | [ceph/ceph] 2026-04-17 10:55:41.781722 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-17 10:55:42.776318 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:42.776409 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:42.776422 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] *** 2026-04-17 10:55:43.082731 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:55:43.082791 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:43.082803 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] **************** 2026-04-17 10:55:44.457146 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf) 2026-04-17 10:55:44.457250 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh) 2026-04-17 10:55:44.457256 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-04-17 10:55:44.457261 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg) 2026-04-17 10:55:44.457272 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-04-17 10:55:44.457277 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:44.457281 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] **** 2026-04-17 10:55:45.407237 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-04-17 10:55:45.407274 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-04-17 10:55:45.407285 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-04-17 10:55:45.407290 | instance | [kubernetes/kubernetes] ...ignoring 2026-04-17 10:55:45.407295 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:45.407300 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] ********* 2026-04-17 10:55:45.677364 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:45.677456 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:45.677469 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] ********* 2026-04-17 10:55:45.945278 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:45.945317 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:45.945323 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************ 2026-04-17 10:55:45.977757 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:45.977791 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:45.977803 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] *** 2026-04-17 10:55:46.020822 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:46.020854 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:46.020865 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] *************** 2026-04-17 10:55:46.657202 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:46.657257 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:46.657269 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] ******* 2026-04-17 10:55:46.978163 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:46.978211 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:46.978219 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-04-17 10:55:46.978230 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:46.978236 | instance | [kubernetes/kubernetes] PLAY [Install Kubernetes] ****************************************************** 2026-04-17 10:55:46.978251 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:46.978258 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-17 10:55:47.233203 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:47.233234 | instance | [ceph/ceph] 2026-04-17 10:55:47.233239 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-17 10:55:47.903972 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:47.904026 | instance | [ceph/ceph] 2026-04-17 10:55:47.904034 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-17 10:55:47.914760 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:47.914814 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:47.914823 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:48.220094 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:48.220153 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:48.220169 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-17 10:55:48.254750 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:48.254812 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:48.254824 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-17 10:55:48.568709 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:48.568752 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:48.568758 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:48.665575 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:55:48.665613 | instance | [kubernetes/kubernetes] "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-17 10:55:48.665619 | instance | [kubernetes/kubernetes] } 2026-04-17 10:55:48.665624 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:48.665633 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:49.174782 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:49.174882 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:49.174911 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:55:49.218466 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:49.218538 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:49.218551 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:49.290040 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/etc/containerd'}) 2026-04-17 10:55:49.290113 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-17 10:55:49.290126 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-17 10:55:49.290136 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-17 10:55:49.290147 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-17 10:55:49.290158 | instance | [ceph/ceph] 2026-04-17 10:55:49.290168 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-17 10:55:49.529654 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:49.529739 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:49.529754 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-17 10:55:49.954386 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:49.954449 | instance | [ceph/ceph] 2026-04-17 10:55:49.954457 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-17 10:55:49.954464 | instance | [ceph/ceph] 2026-04-17 10:55:49.954470 | instance | [ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-17 10:55:50.746949 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:50.746996 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:50.747011 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:50.807765 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:55:50.808041 | instance | [kubernetes/kubernetes] "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz" 2026-04-17 10:55:50.808051 | instance | [kubernetes/kubernetes] } 2026-04-17 10:55:50.808059 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:50.808066 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:50.892888 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:50.892962 | instance | [ceph/ceph] 2026-04-17 10:55:50.892974 | instance | [ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-17 10:55:51.218211 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:51.218275 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:51.218288 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:55:51.437193 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:51.437264 | instance | [ceph/ceph] 2026-04-17 10:55:51.437276 | instance | [ceph/ceph] TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-17 10:55:52.078157 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:52.078224 | instance | [ceph/ceph] 2026-04-17 10:55:52.078236 | instance | [ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:52.380451 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:52.380512 | instance | [ceph/ceph] 2026-04-17 10:55:52.380524 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:52.428477 | instance | [ceph/ceph] ok: [instance] => { 2026-04-17 10:55:52.428517 | instance | [ceph/ceph] "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-17 10:55:52.428528 | instance | [ceph/ceph] } 2026-04-17 10:55:52.428537 | instance | [ceph/ceph] 2026-04-17 10:55:52.428546 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:53.294172 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:53.294209 | instance | [ceph/ceph] 2026-04-17 10:55:53.294215 | instance | [ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:55:53.422311 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:53.422350 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:53.422356 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-17 10:55:53.450661 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:53.450711 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:53.450723 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-17 10:55:53.475414 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:53.475442 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:53.475452 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-17 10:55:53.498678 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:53.498705 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:53.498714 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-17 10:55:54.687433 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:54.687481 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:54.687487 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-17 10:55:55.203396 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:55.203446 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:55.203454 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-17 10:55:56.695487 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-17 10:55:56.695584 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-17 10:55:56.695602 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-17 10:55:56.695615 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-17 10:55:56.695628 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-17 10:55:56.695642 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:56.695654 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-17 10:55:57.323971 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:57.324043 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:57.324055 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-17 10:55:57.324065 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:57.324074 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-17 10:55:57.767076 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:57.767139 | instance | [ceph/ceph] 2026-04-17 10:55:57.767151 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-17 10:55:57.995090 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:57.995187 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:57.995200 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] *** 2026-04-17 10:55:58.871012 | instance | [kubernetes/kubernetes] An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible_collections.kubernetes.core.plugins.module_utils.k8s.exceptions.CoreException: Could not create API client: Invalid kube-config file. No configuration found. 2026-04-17 10:55:58.871074 | instance | [kubernetes/kubernetes] fatal: [instance]: FAILED! => {"changed": false, "msg": "Could not create API client: Invalid kube-config file. No configuration found."} 2026-04-17 10:55:58.871088 | instance | [kubernetes/kubernetes] ...ignoring 2026-04-17 10:55:58.871094 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:58.871101 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] *** 2026-04-17 10:55:58.907152 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:58.907188 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:58.907216 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] *** 2026-04-17 10:55:58.935721 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:55:58.935778 | instance | [ceph/ceph] 2026-04-17 10:55:58.935790 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-17 10:55:58.942454 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:58.942488 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:58.942498 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] *** 2026-04-17 10:55:58.975400 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:58.975472 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:58.975484 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] *** 2026-04-17 10:55:59.008188 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:59.008244 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:59.008256 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] *** 2026-04-17 10:55:59.044395 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:55:59.044442 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:59.044453 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:55:59.363026 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:55:59.363104 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:59.363118 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:55:59.378136 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:59.378203 | instance | [ceph/ceph] 2026-04-17 10:55:59.378215 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-17 10:55:59.400811 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:55:59.400853 | instance | [kubernetes/kubernetes] "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm" 2026-04-17 10:55:59.400861 | instance | [kubernetes/kubernetes] } 2026-04-17 10:55:59.400868 | instance | [kubernetes/kubernetes] 2026-04-17 10:55:59.400873 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:55:59.918032 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:55:59.918085 | instance | [ceph/ceph] 2026-04-17 10:55:59.918097 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-17 10:56:00.297934 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:00.298003 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:00.298024 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:00.341335 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:00.341551 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:00.341564 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:56:00.643264 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:00.643315 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:00.643323 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:56:00.680290 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:56:00.680353 | instance | [kubernetes/kubernetes] "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl" 2026-04-17 10:56:00.680367 | instance | [kubernetes/kubernetes] } 2026-04-17 10:56:00.680381 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:00.680395 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:56:00.805777 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/etc/docker'}) 2026-04-17 10:56:00.805808 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-17 10:56:00.805813 | instance | [ceph/ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-17 10:56:00.805818 | instance | [ceph/ceph] 2026-04-17 10:56:00.805822 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-17 10:56:01.355050 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:56:01.355083 | instance | [ceph/ceph] 2026-04-17 10:56:01.355089 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-17 10:56:01.759658 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:01.759719 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:01.759732 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:01.805552 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:01.805616 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:01.805628 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-17 10:56:01.834696 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:01.834750 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:01.834762 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-17 10:56:01.862634 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:01.862701 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:01.862713 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-17 10:56:01.891307 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:01.891357 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:01.891365 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-17 10:56:01.911847 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:56:01.911908 | instance | [ceph/ceph] 2026-04-17 10:56:01.911920 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-17 10:56:01.911930 | instance | [ceph/ceph] 2026-04-17 10:56:01.911939 | instance | [ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-17 10:56:02.695388 | instance | [ceph/ceph] ok: [instance] 2026-04-17 10:56:02.695421 | instance | [ceph/ceph] 2026-04-17 10:56:02.695426 | instance | [ceph/ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-17 10:56:03.026031 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:03.026080 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:03.026092 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-17 10:56:03.583376 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:03.583431 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:03.583444 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-17 10:56:04.997425 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/etc/containerd'}) 2026-04-17 10:56:04.997586 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-17 10:56:04.997592 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-17 10:56:04.997597 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-17 10:56:04.997601 | instance | [kubernetes/kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-17 10:56:04.997607 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:04.997611 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-17 10:56:05.864053 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:05.864119 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:05.864133 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-17 10:56:05.864144 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:05.864154 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-17 10:56:06.305835 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:06.305885 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:06.305897 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:56:06.608011 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:06.608066 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:06.608086 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:56:06.661906 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:56:06.661963 | instance | [kubernetes/kubernetes] "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz" 2026-04-17 10:56:06.661976 | instance | [kubernetes/kubernetes] } 2026-04-17 10:56:06.661987 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:06.661997 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:56:07.395814 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:07.395874 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:07.395886 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:08.917361 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:08.917409 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:08.917416 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:56:08.968442 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:56:08.968483 | instance | [kubernetes/kubernetes] "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/critest-v1.35.0-linux-amd64.tar.gz" 2026-04-17 10:56:08.968489 | instance | [kubernetes/kubernetes] } 2026-04-17 10:56:08.968494 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:08.968498 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:56:09.836371 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:09.836487 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:09.836508 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:11.259061 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:11.259116 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:11.259128 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cri_tools : Create crictl config] ******************** 2026-04-17 10:56:11.857069 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:56:11.857112 | instance | [ceph/ceph] 2026-04-17 10:56:11.857117 | instance | [ceph/ceph] TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-17 10:56:11.862715 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:11.862733 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:11.862739 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] ********* 2026-04-17 10:56:12.183530 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:12.183594 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:12.183606 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:56:12.508524 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:12.508784 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:12.508804 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:56:12.538384 | instance | [ceph/ceph] changed: [instance] 2026-04-17 10:56:12.538420 | instance | [ceph/ceph] 2026-04-17 10:56:12.538426 | instance | [ceph/ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-17 10:56:12.558784 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:56:12.558865 | instance | [kubernetes/kubernetes] "msg": "https://github.com/containernetworking/plugins/releases/download/v1.9.0/cni-plugins-linux-amd64-v1.9.0.tgz" 2026-04-17 10:56:12.558874 | instance | [kubernetes/kubernetes] } 2026-04-17 10:56:12.558881 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:12.558888 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:56:12.593527 | instance | [ceph/ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-17 10:56:12.593580 | instance | [ceph/ceph] 2026-04-17 10:56:12.593588 | instance | [ceph/ceph] TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-17 10:56:13.589748 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:13.589823 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:13.589839 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:16.372443 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:16.372496 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:16.372504 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] *** 2026-04-17 10:56:16.425223 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml) 2026-04-17 10:56:16.425262 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:16.425270 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cni_plugins : Install additional packages] *********** 2026-04-17 10:56:17.622381 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:17.622460 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:17.622473 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] **************** 2026-04-17 10:56:17.917819 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:17.917898 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:17.917915 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] ********* 2026-04-17 10:56:18.446118 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:18.446173 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:18.446185 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ****** 2026-04-17 10:56:19.823955 | instance | [kubernetes/kubernetes] changed: [instance] => (item=br_netfilter) 2026-04-17 10:56:19.824019 | instance | [kubernetes/kubernetes] ok: [instance] => (item=ip_tables) 2026-04-17 10:56:19.824031 | instance | [kubernetes/kubernetes] changed: [instance] => (item=ip6_tables) 2026-04-17 10:56:19.824041 | instance | [kubernetes/kubernetes] changed: [instance] => (item=nf_conntrack) 2026-04-17 10:56:19.824050 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:19.824059 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-17 10:56:20.216793 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-17 10:56:20.216887 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:20.216901 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-17 10:56:20.256552 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-17 10:56:20.256587 | instance | [kubernetes/kubernetes] "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubelet" 2026-04-17 10:56:20.256600 | instance | [kubernetes/kubernetes] } 2026-04-17 10:56:20.256609 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:20.256618 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-17 10:56:21.408898 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-17 10:56:21.408967 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:21.408980 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-17 10:56:21.442176 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:21.442267 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:21.442302 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] *** 2026-04-17 10:56:21.492923 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml) 2026-04-17 10:56:21.492993 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:21.493006 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubelet : Install coreutils] ************************* 2026-04-17 10:56:21.520630 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-17 10:56:21.520680 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:21.520693 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kubelet : Install additional packages] *************** 2026-04-17 10:56:23.065895 | instance | [kubernetes/kubernetes] fatal: [instance]: FAILED! => {"cache_update_time": 1776423220, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\" install 'conntrack=1:1.4.6-2build2' 'ebtables=2.0.11-4build2' 'ethtool=1:5.16-1ubuntu0.2' 'socat=1.7.4.1-3ubuntu4'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14802 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", "rc": 100, "stderr": "E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14802 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14802 (apt-get)", "E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?"], "stdout": "", "stdout_lines": []} 2026-04-17 10:56:23.065981 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:23.065999 | instance | [kubernetes/kubernetes] PLAY RECAP ********************************************************************* 2026-04-17 10:56:23.066041 | instance | [kubernetes/kubernetes] instance : ok=65 changed=18 unreachable=0 failed=1 skipped=17 rescued=0 ignored=2 2026-04-17 10:56:23.066056 | instance | [kubernetes/kubernetes] 2026-04-17 10:56:32.899653 | instance | Error: component kubernetes failed: ansible-playbook failed for kubernetes/kubernetes: exit status 2 2026-04-17 10:56:32.899724 | instance | Usage: 2026-04-17 10:56:32.899733 | instance | atmosphere deploy [flags] 2026-04-17 10:56:32.899740 | instance | 2026-04-17 10:56:32.899746 | instance | Flags: 2026-04-17 10:56:32.899752 | instance | --concurrency int Max concurrent deployments per wave (0 = unlimited) 2026-04-17 10:56:32.899758 | instance | -h, --help help for deploy 2026-04-17 10:56:32.899764 | instance | -i, --inventory string Path to Ansible inventory file (required) 2026-04-17 10:56:32.899770 | instance | -t, --tags string Comma-separated list of component tags to deploy 2026-04-17 10:56:32.899776 | instance | 2026-04-17 10:56:32.899781 | instance | component kubernetes failed: ansible-playbook failed for kubernetes/kubernetes: exit status 2 2026-04-17 10:56:32.985200 | instance | ERROR 2026-04-17 10:56:32.985475 | instance | { 2026-04-17 10:56:32.985534 | instance | "delta": "0:01:02.429043", 2026-04-17 10:56:32.985579 | instance | "end": "2026-04-17 10:56:32.901887", 2026-04-17 10:56:32.985622 | instance | "msg": "non-zero return code", 2026-04-17 10:56:32.985657 | instance | "rc": 1, 2026-04-17 10:56:32.985685 | instance | "start": "2026-04-17 10:55:30.472844" 2026-04-17 10:56:32.985720 | instance | } failure 2026-04-17 10:56:32.994343 | 2026-04-17 10:56:32.994395 | PLAY RECAP 2026-04-17 10:56:32.994440 | instance | ok: 1 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-17 10:56:32.994461 | 2026-04-17 10:56:33.152805 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-17 10:56:33.158186 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-17 10:56:33.712356 | 2026-04-17 10:56:33.712464 | PLAY [all] 2026-04-17 10:56:33.725785 | 2026-04-17 10:56:33.725865 | TASK [gather-host-logs : creating directory for system status] 2026-04-17 10:56:34.062557 | instance | changed 2026-04-17 10:56:34.069640 | 2026-04-17 10:56:34.069750 | TASK [gather-host-logs : Get logs for each host] 2026-04-17 10:56:34.389786 | instance | + systemd-cgls --full --all --no-pager 2026-04-17 10:56:34.402019 | instance | + ip addr 2026-04-17 10:56:34.404191 | instance | + ip route 2026-04-17 10:56:34.407005 | instance | + lsblk 2026-04-17 10:56:34.410662 | instance | + mount 2026-04-17 10:56:34.412801 | instance | + docker images 2026-04-17 10:56:34.431230 | instance | + brctl show 2026-04-17 10:56:34.432014 | instance | /bin/bash: line 8: brctl: command not found 2026-04-17 10:56:34.432528 | instance | + ps aux --sort=-%mem 2026-04-17 10:56:34.484073 | instance | + dpkg -l 2026-04-17 10:56:34.499790 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-17 10:56:34.500473 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-17 10:56:34.519663 | instance | + '[' '!' -z '' ']' 2026-04-17 10:56:34.603636 | instance | ok: Runtime: 0:00:00.135653 2026-04-17 10:56:34.611257 | 2026-04-17 10:56:34.611324 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-17 10:56:35.202568 | instance | changed: 2026-04-17 10:56:35.202888 | instance | created directory /var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/logs/instance 2026-04-17 10:56:35.202939 | instance | cd+++++++++ system/ 2026-04-17 10:56:35.202980 | instance | >f+++++++++ system/brctl-show.txt 2026-04-17 10:56:35.203020 | instance | >f+++++++++ system/docker-images.txt 2026-04-17 10:56:35.203059 | instance | >f+++++++++ system/ip-addr.txt 2026-04-17 10:56:35.203099 | instance | >f+++++++++ system/ip-route.txt 2026-04-17 10:56:35.203135 | instance | >f+++++++++ system/lsblk.txt 2026-04-17 10:56:35.203175 | instance | >f+++++++++ system/mount.txt 2026-04-17 10:56:35.203212 | instance | >f+++++++++ system/packages.txt 2026-04-17 10:56:35.203244 | instance | >f+++++++++ system/ps.txt 2026-04-17 10:56:35.203277 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-17 10:56:35.216896 | 2026-04-17 10:56:35.217130 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-17 10:56:35.409523 | instance | changed: "values" 2026-04-17 10:56:35.577391 | instance | changed: "releases" 2026-04-17 10:56:35.596829 | 2026-04-17 10:56:35.597062 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-17 10:56:35.872631 | instance | E0417 10:56:35.872436 15820 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:35.873378 | instance | E0417 10:56:35.873336 15820 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:35.875127 | instance | E0417 10:56:35.875085 15820 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:35.875609 | instance | E0417 10:56:35.875580 15820 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:35.877361 | instance | E0417 10:56:35.877328 15820 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:35.877459 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:36.135349 | instance | ok: Runtime: 0:00:00.067788 2026-04-17 10:56:36.140577 | 2026-04-17 10:56:36.140656 | TASK [helm-release-status : Downloads logs to executor] 2026-04-17 10:56:36.623694 | instance | changed: 2026-04-17 10:56:36.623973 | instance | cd+++++++++ helm/ 2026-04-17 10:56:36.624001 | instance | cd+++++++++ helm/releases/ 2026-04-17 10:56:36.624023 | instance | cd+++++++++ helm/values/ 2026-04-17 10:56:36.633104 | 2026-04-17 10:56:36.633173 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-17 10:56:36.852895 | instance | changed 2026-04-17 10:56:36.858019 | 2026-04-17 10:56:36.858099 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-17 10:56:37.073122 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 10:56:37.073533 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 10:56:37.081715 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 10:56:37.084365 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 10:56:37.139317 | instance | E0417 10:56:37.139202 15875 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.139757 | instance | E0417 10:56:37.139716 15867 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.139959 | instance | E0417 10:56:37.139923 15875 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.140588 | instance | E0417 10:56:37.140548 15867 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.141688 | instance | E0417 10:56:37.141643 15875 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.142244 | instance | E0417 10:56:37.142224 15867 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.142482 | instance | E0417 10:56:37.142449 15875 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.142794 | instance | E0417 10:56:37.142775 15867 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.144329 | instance | E0417 10:56:37.144299 15875 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.144390 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:37.144812 | instance | E0417 10:56:37.144778 15867 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.144860 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:37.151255 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 10:56:37.152214 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 10:56:37.197978 | instance | E0417 10:56:37.197878 15896 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.198602 | instance | E0417 10:56:37.198579 15896 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.199823 | instance | E0417 10:56:37.199790 15896 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.200252 | instance | E0417 10:56:37.200229 15896 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.201816 | instance | E0417 10:56:37.201785 15896 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.201845 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:37.202749 | instance | E0417 10:56:37.202696 15894 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.203106 | instance | E0417 10:56:37.203087 15894 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.204897 | instance | E0417 10:56:37.204865 15894 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.205388 | instance | E0417 10:56:37.205367 15894 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.207047 | instance | E0417 10:56:37.207003 15894 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.207075 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:37.210680 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 10:56:37.260083 | instance | E0417 10:56:37.259880 15916 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.260595 | instance | E0417 10:56:37.260555 15916 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.262369 | instance | E0417 10:56:37.262307 15916 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.262980 | instance | E0417 10:56:37.262917 15916 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.264731 | instance | E0417 10:56:37.264675 15916 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.264784 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:37.412595 | instance | ok: Runtime: 0:00:00.205572 2026-04-17 10:56:37.420358 | 2026-04-17 10:56:37.420421 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-17 10:56:37.615581 | instance | changed 2026-04-17 10:56:37.621142 | 2026-04-17 10:56:37.621210 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-17 10:56:37.850708 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 10:56:37.850806 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 10:56:37.851004 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 10:56:37.898008 | instance | E0417 10:56:37.897917 15947 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.898487 | instance | E0417 10:56:37.898464 15947 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.900156 | instance | E0417 10:56:37.900134 15947 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.900791 | instance | E0417 10:56:37.900766 15947 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.902217 | instance | E0417 10:56:37.902199 15947 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:37.902278 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:38.185160 | instance | ok: Runtime: 0:00:00.062425 2026-04-17 10:56:38.191828 | 2026-04-17 10:56:38.191894 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-17 10:56:38.689794 | instance | changed: 2026-04-17 10:56:38.689992 | instance | cd+++++++++ objects/ 2026-04-17 10:56:38.690031 | instance | cd+++++++++ objects/cluster/ 2026-04-17 10:56:38.690061 | instance | cd+++++++++ objects/namespaced/ 2026-04-17 10:56:38.700248 | 2026-04-17 10:56:38.700312 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-17 10:56:38.905729 | instance | changed 2026-04-17 10:56:38.912064 | 2026-04-17 10:56:38.912124 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-17 10:56:39.120439 | instance | changed 2026-04-17 10:56:39.125277 | 2026-04-17 10:56:39.125346 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-17 10:56:39.399346 | instance | E0417 10:56:39.399239 15997 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:39.401068 | instance | E0417 10:56:39.401020 15997 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:39.401802 | instance | E0417 10:56:39.401765 15997 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:39.403804 | instance | E0417 10:56:39.403749 15997 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:39.404813 | instance | E0417 10:56:39.404755 15997 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:39.404941 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:39.658277 | instance | ok: Runtime: 0:00:00.070608 2026-04-17 10:56:39.664806 | 2026-04-17 10:56:39.664871 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-17 10:56:40.156261 | instance | changed: 2026-04-17 10:56:40.156520 | instance | cd+++++++++ pod-logs/ 2026-04-17 10:56:40.156574 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-17 10:56:40.167195 | 2026-04-17 10:56:40.167258 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-17 10:56:40.362484 | instance | changed 2026-04-17 10:56:40.368908 | 2026-04-17 10:56:40.369020 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-17 10:56:40.628492 | instance | E0417 10:56:40.628380 16039 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:40.630661 | instance | E0417 10:56:40.630627 16039 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:40.631404 | instance | E0417 10:56:40.631371 16039 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:40.633289 | instance | E0417 10:56:40.633245 16039 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:40.633838 | instance | E0417 10:56:40.633810 16039 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:40.635103 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:40.902629 | instance | ok: Runtime: 0:00:00.067225 2026-04-17 10:56:40.907398 | 2026-04-17 10:56:40.907468 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-17 10:56:41.163767 | instance | E0417 10:56:41.163613 16061 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.164907 | instance | E0417 10:56:41.164874 16061 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.165613 | instance | E0417 10:56:41.165576 16061 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.167459 | instance | E0417 10:56:41.167430 16061 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.168507 | instance | E0417 10:56:41.168449 16061 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.169641 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:41.174805 | instance | ceph-mgr endpoints: 2026-04-17 10:56:41.443502 | instance | ok: Runtime: 0:00:00.074062 2026-04-17 10:56:41.448891 | 2026-04-17 10:56:41.448981 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-17 10:56:41.700821 | instance | E0417 10:56:41.700610 16082 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.701352 | instance | E0417 10:56:41.701304 16082 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.702749 | instance | E0417 10:56:41.702699 16082 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.703216 | instance | E0417 10:56:41.703169 16082 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.704767 | instance | E0417 10:56:41.704729 16082 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused 2026-04-17 10:56:41.704801 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port? 2026-04-17 10:56:41.983349 | instance | ok: Runtime: 0:00:00.059565 2026-04-17 10:56:41.989990 | 2026-04-17 10:56:41.990074 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-17 10:56:42.520062 | instance | changed: cd+++++++++ prometheus/ 2026-04-17 10:56:42.528846 | 2026-04-17 10:56:42.528906 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-17 10:56:42.745249 | instance | changed 2026-04-17 10:56:42.749821 | 2026-04-17 10:56:42.749880 | TASK [gather-selenium-data : Get selenium data] 2026-04-17 10:56:42.955919 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-17 10:56:42.957000 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-17 10:56:43.291077 | instance | ERROR 2026-04-17 10:56:43.291384 | instance | { 2026-04-17 10:56:43.291449 | instance | "delta": "0:00:00.005954", 2026-04-17 10:56:43.291495 | instance | "end": "2026-04-17 10:56:42.957298", 2026-04-17 10:56:43.291538 | instance | "msg": "non-zero return code", 2026-04-17 10:56:43.291578 | instance | "rc": 1, 2026-04-17 10:56:43.291617 | instance | "start": "2026-04-17 10:56:42.951344" 2026-04-17 10:56:43.291656 | instance | } 2026-04-17 10:56:43.291707 | instance | ERROR: Ignoring Errors 2026-04-17 10:56:43.297806 | 2026-04-17 10:56:43.297865 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-17 10:56:43.766198 | instance | changed: cd+++++++++ selenium/ 2026-04-17 10:56:43.773616 | 2026-04-17 10:56:43.773680 | PLAY RECAP 2026-04-17 10:56:43.773735 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-17 10:56:43.773766 | 2026-04-17 10:56:43.871272 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-17 10:56:43.874072 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-17 10:56:44.413483 | 2026-04-17 10:56:44.413586 | PLAY [all] 2026-04-17 10:56:44.424596 | 2026-04-17 10:56:44.424672 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-17 10:56:44.460335 | instance | skipping: Conditional result was False 2026-04-17 10:56:44.465253 | 2026-04-17 10:56:44.465331 | TASK [fetch-output : Set log path for single node] 2026-04-17 10:56:44.494004 | instance | ok 2026-04-17 10:56:44.498375 | 2026-04-17 10:56:44.498440 | LOOP [fetch-output : Ensure local output dirs] 2026-04-17 10:56:44.848936 | instance -> localhost | ok: "/var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/logs" 2026-04-17 10:56:45.045778 | instance -> localhost | changed: "/var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/artifacts" 2026-04-17 10:56:45.258778 | instance -> localhost | changed: "/var/lib/zuul/builds/681c3536687a4cd68c4fc57efa6d59fb/work/docs" 2026-04-17 10:56:45.279221 | 2026-04-17 10:56:45.279343 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-17 10:56:45.874342 | instance | changed: .d..t...... ./ 2026-04-17 10:56:45.874535 | instance | changed: All items complete 2026-04-17 10:56:45.874562 | 2026-04-17 10:56:46.323342 | instance | changed: .d..t...... ./ 2026-04-17 10:56:46.758104 | instance | changed: .d..t...... ./ 2026-04-17 10:56:46.774656 | 2026-04-17 10:56:46.774772 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-17 10:56:47.205056 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006424 2026-04-17 10:56:47.415473 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.005637 2026-04-17 10:56:47.429574 | 2026-04-17 10:56:47.429696 | PLAY [all] 2026-04-17 10:56:47.436269 | 2026-04-17 10:56:47.436357 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-17 10:56:47.827443 | instance | changed 2026-04-17 10:56:47.834578 | 2026-04-17 10:56:47.834641 | PLAY RECAP 2026-04-17 10:56:47.834698 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-17 10:56:47.834727 | 2026-04-17 10:56:47.927749 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-17 10:56:47.931892 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-17 10:56:48.464149 | 2026-04-17 10:56:48.464488 | PLAY [localhost] 2026-04-17 10:56:48.474126 | 2026-04-17 10:56:48.474198 | TASK [Generate Zuul manifest] 2026-04-17 10:56:48.496278 | localhost | ok 2026-04-17 10:56:48.511638 | 2026-04-17 10:56:48.511716 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-17 10:56:48.817851 | localhost | changed 2026-04-17 10:56:48.830045 | 2026-04-17 10:56:48.830117 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-17 10:56:48.857493 | localhost | ok 2026-04-17 10:56:48.864327 | 2026-04-17 10:56:48.864390 | TASK [Upload logs] 2026-04-17 10:56:48.882782 | localhost | ok 2026-04-17 10:56:48.935430 | 2026-04-17 10:56:48.935535 | TASK [Set zuul-log-path fact] 2026-04-17 10:56:48.952884 | localhost | ok 2026-04-17 10:56:48.962955 | 2026-04-17 10:56:48.963024 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-17 10:56:48.990043 | localhost | ok 2026-04-17 10:56:48.996284 | 2026-04-17 10:56:48.996349 | TASK [upload-logs : Create log directories] 2026-04-17 10:56:49.368829 | localhost | changed 2026-04-17 10:56:49.375728 | 2026-04-17 10:56:49.375792 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-17 10:56:49.741121 | localhost -> localhost | ok: Runtime: 0:00:00.007023 2026-04-17 10:56:49.747355 | 2026-04-17 10:56:49.747430 | TASK [upload-logs : Upload logs to log server] 2026-04-17 10:56:50.176236 | localhost | Output suppressed because no_log was given 2026-04-17 10:56:50.179731 | 2026-04-17 10:56:50.179794 | LOOP [upload-logs : Compress console log and json output] 2026-04-17 10:56:50.223119 | localhost | skipping: Conditional result was False 2026-04-17 10:56:50.230566 | localhost | skipping: Conditional result was False 2026-04-17 10:56:50.242598 | 2026-04-17 10:56:50.242715 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-17 10:56:50.283043 | localhost | skipping: Conditional result was False 2026-04-17 10:56:50.283381 | 2026-04-17 10:56:50.287168 | localhost | skipping: Conditional result was False 2026-04-17 10:56:50.296809 | 2026-04-17 10:56:50.297032 | LOOP [upload-logs : Upload console log and json output]