2026-04-26 14:41:39.893637 | Job console starting 2026-04-26 14:41:39.900922 | Updating git repos 2026-04-26 14:41:39.944885 | Cloning repos into workspace 2026-04-26 14:41:43.306515 | Restoring repo states 2026-04-26 14:41:43.327184 | Merging changes 2026-04-26 14:41:44.934982 | Checking out repos 2026-04-26 14:41:45.836066 | Preparing playbooks 2026-04-26 14:41:56.140188 | Running Ansible setup 2026-04-26 14:41:59.808835 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-26 14:42:00.423437 | 2026-04-26 14:42:00.424005 | PLAY [localhost] 2026-04-26 14:42:00.433354 | 2026-04-26 14:42:00.433465 | TASK [Gathering Facts] 2026-04-26 14:42:01.332257 | localhost | ok 2026-04-26 14:42:01.346310 | 2026-04-26 14:42:01.346478 | TASK [Setup log path fact] 2026-04-26 14:42:01.367963 | localhost | ok 2026-04-26 14:42:01.384889 | 2026-04-26 14:42:01.385062 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-26 14:42:01.417927 | localhost | ok 2026-04-26 14:42:01.427154 | 2026-04-26 14:42:01.427266 | TASK [emit-job-header : Print job information] 2026-04-26 14:42:01.470865 | # Job Information 2026-04-26 14:42:01.471085 | Ansible Version: 2.16.16 2026-04-26 14:42:01.471133 | Job: atmosphere-molecule-csi-local-path-provisioner 2026-04-26 14:42:01.471167 | Pipeline: check 2026-04-26 14:42:01.471197 | Executor: 0a8996d2b663 2026-04-26 14:42:01.471226 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3877 2026-04-26 14:42:01.471259 | Event ID: f0773e20-417d-11f1-80ed-c725f047fe5a 2026-04-26 14:42:01.475367 | 2026-04-26 14:42:01.475468 | LOOP [emit-job-header : Print node information] 2026-04-26 14:42:01.571421 | localhost | ok: 2026-04-26 14:42:01.571751 | localhost | # Node Information 2026-04-26 14:42:01.571792 | localhost | Inventory Hostname: instance 2026-04-26 14:42:01.571823 | localhost | Hostname: np0000170329 2026-04-26 14:42:01.571851 | localhost | Username: zuul 2026-04-26 14:42:01.571882 | localhost | Distro: Ubuntu 22.04 2026-04-26 14:42:01.571914 | localhost | Provider: yul1 2026-04-26 14:42:01.571941 | localhost | Region: ca-ymq-1 2026-04-26 14:42:01.571967 | localhost | Label: ubuntu-jammy 2026-04-26 14:42:01.571993 | localhost | Product Name: OpenStack Nova 2026-04-26 14:42:01.572019 | localhost | Interface IP: 199.204.45.210 2026-04-26 14:42:01.585773 | 2026-04-26 14:42:01.606577 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-26 14:42:02.071179 | localhost -> localhost | changed 2026-04-26 14:42:02.081762 | 2026-04-26 14:42:02.081854 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-26 14:42:03.121070 | localhost -> localhost | changed 2026-04-26 14:42:03.130819 | 2026-04-26 14:42:03.130899 | PLAY [all] 2026-04-26 14:42:03.140342 | 2026-04-26 14:42:03.140407 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-26 14:42:03.367185 | instance -> localhost | ok 2026-04-26 14:42:03.375914 | 2026-04-26 14:42:03.376012 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-26 14:42:03.409144 | instance | ok 2026-04-26 14:42:03.644824 | instance | included: /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-26 14:42:03.650516 | 2026-04-26 14:42:03.650587 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-26 14:42:04.986946 | instance -> localhost | Generating public/private rsa key pair. 2026-04-26 14:42:04.987508 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/1d995c62ac3a4970b159c05f09b9833f_id_rsa 2026-04-26 14:42:04.987544 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/1d995c62ac3a4970b159c05f09b9833f_id_rsa.pub 2026-04-26 14:42:04.987567 | instance -> localhost | The key fingerprint is: 2026-04-26 14:42:04.987588 | instance -> localhost | SHA256:WKKKW0piejLzVzkLVBCUby4La9WEY8Zo20b74z4u70Q zuul-build-sshkey 2026-04-26 14:42:04.987624 | instance -> localhost | The key's randomart image is: 2026-04-26 14:42:04.987646 | instance -> localhost | +---[RSA 3072]----+ 2026-04-26 14:42:04.987676 | instance -> localhost | | .++ | 2026-04-26 14:42:04.987698 | instance -> localhost | | . . | 2026-04-26 14:42:04.987718 | instance -> localhost | | o +. . | 2026-04-26 14:42:04.987739 | instance -> localhost | | o O.++ | 2026-04-26 14:42:04.987759 | instance -> localhost | | . B.BE.S | 2026-04-26 14:42:04.987778 | instance -> localhost | | .o.B.* | 2026-04-26 14:42:04.987798 | instance -> localhost | |ooo= *.o | 2026-04-26 14:42:04.987818 | instance -> localhost | |O++ +.= | 2026-04-26 14:42:04.987841 | instance -> localhost | |+B.. B*o | 2026-04-26 14:42:04.987861 | instance -> localhost | +----[SHA256]-----+ 2026-04-26 14:42:04.987912 | instance -> localhost | ok: Runtime: 0:00:00.840600 2026-04-26 14:42:04.993134 | 2026-04-26 14:42:04.993207 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-26 14:42:05.016801 | instance | ok 2026-04-26 14:42:05.026533 | instance | included: /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-26 14:42:05.034592 | 2026-04-26 14:42:05.034740 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-26 14:42:05.059956 | instance | skipping: Conditional result was False 2026-04-26 14:42:05.067775 | 2026-04-26 14:42:05.067875 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-26 14:42:05.629435 | instance | changed 2026-04-26 14:42:05.636040 | 2026-04-26 14:42:05.636116 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-26 14:42:05.817418 | instance | ok 2026-04-26 14:42:05.822631 | 2026-04-26 14:42:05.822697 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-26 14:42:06.286996 | instance | changed 2026-04-26 14:42:06.292658 | 2026-04-26 14:42:06.292726 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-26 14:42:06.732227 | instance | changed 2026-04-26 14:42:06.738601 | 2026-04-26 14:42:06.738669 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-26 14:42:06.763214 | instance | skipping: Conditional result was False 2026-04-26 14:42:06.773346 | 2026-04-26 14:42:06.773438 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-26 14:42:07.182410 | instance -> localhost | changed 2026-04-26 14:42:07.192413 | 2026-04-26 14:42:07.192486 | TASK [add-build-sshkey : Add back temp key] 2026-04-26 14:42:07.579951 | instance -> localhost | Identity added: /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/1d995c62ac3a4970b159c05f09b9833f_id_rsa (zuul-build-sshkey) 2026-04-26 14:42:07.580203 | instance -> localhost | ok: Runtime: 0:00:00.015555 2026-04-26 14:42:07.588830 | 2026-04-26 14:42:07.588926 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-26 14:42:07.914483 | instance | ok 2026-04-26 14:42:07.919555 | 2026-04-26 14:42:07.919626 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-26 14:42:07.945279 | instance | skipping: Conditional result was False 2026-04-26 14:42:07.960165 | 2026-04-26 14:42:07.960263 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-26 14:42:08.288788 | instance | ok 2026-04-26 14:42:08.297471 | 2026-04-26 14:42:08.297542 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-26 14:42:09.996123 | instance | Output suppressed because no_log was given 2026-04-26 14:42:10.008016 | 2026-04-26 14:42:10.008132 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-26 14:42:10.203131 | instance | ok: "logs" 2026-04-26 14:42:10.203378 | instance | ok: All items complete 2026-04-26 14:42:10.203407 | 2026-04-26 14:42:10.356418 | instance | ok: "artifacts" 2026-04-26 14:42:10.518014 | instance | ok: "docs" 2026-04-26 14:42:10.527902 | 2026-04-26 14:42:10.527976 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-26 14:42:10.712495 | instance | changed: "logs" 2026-04-26 14:42:10.894704 | instance | changed: "artifacts" 2026-04-26 14:42:11.052146 | instance | changed: "docs" 2026-04-26 14:42:11.066180 | 2026-04-26 14:42:11.066247 | PLAY RECAP 2026-04-26 14:42:11.066290 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-26 14:42:11.066317 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-26 14:42:11.066338 | 2026-04-26 14:42:11.233201 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-26 14:42:11.235153 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-26 14:42:11.812995 | 2026-04-26 14:42:11.813153 | PLAY [all] 2026-04-26 14:42:11.825491 | 2026-04-26 14:42:11.825567 | TASK [setup-uv : Extract archive] 2026-04-26 14:42:14.064685 | instance | changed 2026-04-26 14:42:14.077868 | 2026-04-26 14:42:14.077982 | TASK [setup-uv : Print version] 2026-04-26 14:42:14.606097 | instance | uv 0.8.13 2026-04-26 14:42:14.624655 | instance | ok: Runtime: 0:00:00.012235 2026-04-26 14:42:14.633081 | 2026-04-26 14:42:14.633151 | PLAY RECAP 2026-04-26 14:42:14.633218 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-26 14:42:14.633252 | 2026-04-26 14:42:14.750086 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-26 14:42:14.754777 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-26 14:42:15.338828 | 2026-04-26 14:42:15.338976 | PLAY [all] 2026-04-26 14:42:15.350704 | 2026-04-26 14:42:15.350787 | TASK [Install "jq" for log collection] 2026-04-26 14:42:27.953679 | instance | changed 2026-04-26 14:42:27.958725 | 2026-04-26 14:42:27.958799 | TASK [Install pip3 for Python package management] 2026-04-26 14:42:32.998367 | instance | changed 2026-04-26 14:42:33.005175 | 2026-04-26 14:42:33.005260 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-26 14:42:36.352191 | instance | changed 2026-04-26 14:42:36.356030 | 2026-04-26 14:42:36.356104 | PLAY [all] 2026-04-26 14:42:36.365356 | 2026-04-26 14:42:36.365427 | TASK [ensure-go : Check installed go version] 2026-04-26 14:42:36.908473 | instance | ok: ERROR (ignored) 2026-04-26 14:42:36.908823 | instance | { 2026-04-26 14:42:36.908868 | instance | "failed_when_result": false, 2026-04-26 14:42:36.908899 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-26 14:42:36.908928 | instance | "rc": 2 2026-04-26 14:42:36.908979 | instance | } 2026-04-26 14:42:36.915526 | 2026-04-26 14:42:36.915619 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-26 14:42:36.970668 | instance | ok 2026-04-26 14:42:36.979589 | instance | included: /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-26 14:42:36.984266 | 2026-04-26 14:42:36.984333 | TASK [ensure-go : Create temp directory] 2026-04-26 14:42:37.295133 | instance | changed 2026-04-26 14:42:37.302251 | 2026-04-26 14:42:37.302352 | TASK [ensure-go : Get archive checksum] 2026-04-26 14:42:37.863909 | instance | ok: OK (64 bytes) 2026-04-26 14:42:37.871127 | 2026-04-26 14:42:37.871252 | TASK [ensure-go : Download go archive] 2026-04-26 14:42:39.152535 | instance | changed: OK (78559214 bytes) 2026-04-26 14:42:39.158093 | 2026-04-26 14:42:39.158158 | TASK [ensure-go : Install go] 2026-04-26 14:42:44.933001 | instance | changed 2026-04-26 14:42:44.940649 | 2026-04-26 14:42:44.940706 | PLAY [all] 2026-04-26 14:42:44.946837 | 2026-04-26 14:42:44.946901 | TASK [Copy inventory file for Zuul] 2026-04-26 14:42:45.682239 | instance | changed 2026-04-26 14:42:45.687876 | 2026-04-26 14:42:45.687957 | TASK [Switch "ansible_host" to private IP] 2026-04-26 14:42:46.014998 | instance | changed: 1 replacements made 2026-04-26 14:42:46.022665 | 2026-04-26 14:42:46.022750 | TASK [Run molecule prepare] 2026-04-26 14:42:46.265756 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-26 14:42:46.266002 | instance | Creating virtual environment at: .venv 2026-04-26 14:42:46.291408 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-26 14:42:46.313712 | instance | Downloading cryptography (4.2MiB) 2026-04-26 14:42:46.313857 | instance | Downloading pygments (1.2MiB) 2026-04-26 14:42:46.314039 | instance | Downloading kubernetes (1.9MiB) 2026-04-26 14:42:46.314599 | instance | Downloading openstacksdk (1.7MiB) 2026-04-26 14:42:46.314914 | instance | Downloading pydantic-core (2.0MiB) 2026-04-26 14:42:46.315121 | instance | Downloading netaddr (2.2MiB) 2026-04-26 14:42:46.316211 | instance | Downloading ansible-core (2.1MiB) 2026-04-26 14:42:46.337699 | instance | Downloading setuptools (1.1MiB) 2026-04-26 14:42:46.629387 | instance | Building pyperclip==1.9.0 2026-04-26 14:42:46.642552 | instance | Downloading rjsonnet (1.2MiB) 2026-04-26 14:42:46.737073 | instance | Downloading pydantic-core 2026-04-26 14:42:46.767811 | instance | Downloading rjsonnet 2026-04-26 14:42:46.791700 | instance | Downloading netaddr 2026-04-26 14:42:46.808720 | instance | Downloading pygments 2026-04-26 14:42:46.820305 | instance | Downloading cryptography 2026-04-26 14:42:46.855353 | instance | Downloading setuptools 2026-04-26 14:42:46.908946 | instance | Downloading kubernetes 2026-04-26 14:42:46.937408 | instance | Downloading ansible-core 2026-04-26 14:42:46.964166 | instance | Downloading openstacksdk 2026-04-26 14:42:47.376919 | instance | Built pyperclip==1.9.0 2026-04-26 14:42:47.529263 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-26 14:42:47.568720 | instance | Installed 83 packages in 37ms 2026-04-26 14:42:48.218495 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-26 14:42:48.811948 | instance | INFO [csi > discovery] scenario test matrix: prepare 2026-04-26 14:42:48.812045 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-04-26 14:43:27.896718 | instance | INFO [csi > prepare] Executing 2026-04-26 14:43:28.764097 | instance | 2026-04-26 14:43:28.764709 | instance | PLAY [Prepare] ***************************************************************** 2026-04-26 14:43:28.764973 | instance | 2026-04-26 14:43:28.765283 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-26 14:43:28.765543 | instance | Sunday 26 April 2026 14:43:28 +0000 (0:00:00.027) 0:00:00.027 ********** 2026-04-26 14:43:29.909665 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-26 14:43:29.909891 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-26 14:43:29.910158 | instance | interpreter could change the meaning of that path. See 2026-04-26 14:43:29.910464 | instance | https://docs.ansible.com/ansible- 2026-04-26 14:43:29.910729 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-26 14:43:29.920141 | instance | ok: [instance] 2026-04-26 14:43:29.920385 | instance | 2026-04-26 14:43:29.920647 | instance | TASK [Configure short hostname] ************************************************ 2026-04-26 14:43:29.920909 | instance | Sunday 26 April 2026 14:43:29 +0000 (0:00:01.156) 0:00:01.184 ********** 2026-04-26 14:43:30.633830 | instance | changed: [instance] 2026-04-26 14:43:30.634068 | instance | 2026-04-26 14:43:30.634375 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-26 14:43:30.634800 | instance | Sunday 26 April 2026 14:43:30 +0000 (0:00:00.713) 0:00:01.897 ********** 2026-04-26 14:43:30.914719 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-26 14:43:30.915003 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-26 14:43:30.915300 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-26 14:43:30.927760 | instance | changed: [instance] 2026-04-26 14:43:30.928051 | instance | 2026-04-26 14:43:30.928295 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-26 14:43:30.928676 | instance | Sunday 26 April 2026 14:43:30 +0000 (0:00:00.294) 0:00:02.191 ********** 2026-04-26 14:43:31.779349 | instance | ok: [instance] 2026-04-26 14:43:31.779476 | instance | 2026-04-26 14:43:31.779620 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-26 14:43:31.779807 | instance | 2026-04-26 14:43:31.780002 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-26 14:43:31.780202 | instance | Sunday 26 April 2026 14:43:31 +0000 (0:00:00.851) 0:00:03.043 ********** 2026-04-26 14:43:32.457790 | instance | ok: [instance] 2026-04-26 14:43:32.458025 | instance | 2026-04-26 14:43:32.458317 | instance | TASK [Install depedencies] ***************************************************** 2026-04-26 14:43:32.458628 | instance | Sunday 26 April 2026 14:43:32 +0000 (0:00:00.678) 0:00:03.721 ********** 2026-04-26 14:43:51.771084 | instance | changed: [instance] 2026-04-26 14:43:51.771238 | instance | 2026-04-26 14:43:51.771479 | instance | TASK [Start up service] ******************************************************** 2026-04-26 14:43:51.771734 | instance | Sunday 26 April 2026 14:43:51 +0000 (0:00:19.313) 0:00:23.034 ********** 2026-04-26 14:43:52.301455 | instance | ok: [instance] 2026-04-26 14:43:52.301809 | instance | 2026-04-26 14:43:52.302204 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-26 14:43:52.302655 | instance | Sunday 26 April 2026 14:43:52 +0000 (0:00:00.530) 0:00:23.564 ********** 2026-04-26 14:43:52.590198 | instance | ok: [instance] 2026-04-26 14:43:52.590457 | instance | 2026-04-26 14:43:52.591550 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-26 14:43:52.591572 | instance | Sunday 26 April 2026 14:43:52 +0000 (0:00:00.284) 0:00:23.849 ********** 2026-04-26 14:43:53.220535 | instance | changed: [instance] 2026-04-26 14:43:53.220691 | instance | 2026-04-26 14:43:53.220928 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-26 14:43:53.221090 | instance | Sunday 26 April 2026 14:43:53 +0000 (0:00:00.634) 0:00:24.484 ********** 2026-04-26 14:43:53.404192 | instance | ok: [instance] 2026-04-26 14:43:53.404446 | instance | 2026-04-26 14:43:53.404728 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-26 14:43:53.404998 | instance | Sunday 26 April 2026 14:43:53 +0000 (0:00:00.183) 0:00:24.667 ********** 2026-04-26 14:43:53.423514 | instance | skipping: [instance] 2026-04-26 14:43:53.423801 | instance | 2026-04-26 14:43:53.424158 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-26 14:43:53.424537 | instance | Sunday 26 April 2026 14:43:53 +0000 (0:00:00.019) 0:00:24.687 ********** 2026-04-26 14:43:53.940537 | instance | changed: [instance] => (item=osd0) 2026-04-26 14:43:53.940732 | instance | changed: [instance] => (item=osd1) 2026-04-26 14:43:53.940965 | instance | changed: [instance] => (item=osd2) 2026-04-26 14:43:53.941189 | instance | 2026-04-26 14:43:53.941415 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-26 14:43:53.941655 | instance | Sunday 26 April 2026 14:43:53 +0000 (0:00:00.516) 0:00:25.204 ********** 2026-04-26 14:43:54.539864 | instance | changed: [instance] => (item=osd0) 2026-04-26 14:43:54.539985 | instance | changed: [instance] => (item=osd1) 2026-04-26 14:43:54.540161 | instance | changed: [instance] => (item=osd2) 2026-04-26 14:43:54.540324 | instance | 2026-04-26 14:43:54.540501 | instance | TASK [Start loop devices] ****************************************************** 2026-04-26 14:43:54.540675 | instance | Sunday 26 April 2026 14:43:54 +0000 (0:00:00.599) 0:00:25.803 ********** 2026-04-26 14:43:55.192782 | instance | changed: [instance] => (item=osd0) 2026-04-26 14:43:55.192913 | instance | changed: [instance] => (item=osd1) 2026-04-26 14:43:55.193096 | instance | changed: [instance] => (item=osd2) 2026-04-26 14:43:55.193256 | instance | 2026-04-26 14:43:55.193417 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-26 14:43:55.193601 | instance | Sunday 26 April 2026 14:43:55 +0000 (0:00:00.652) 0:00:26.456 ********** 2026-04-26 14:43:58.149183 | instance | changed: [instance] => (item=osd0) 2026-04-26 14:43:58.149579 | instance | changed: [instance] => (item=osd1) 2026-04-26 14:43:58.149914 | instance | changed: [instance] => (item=osd2) 2026-04-26 14:43:58.150246 | instance | 2026-04-26 14:43:58.150672 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-26 14:43:58.151010 | instance | Sunday 26 April 2026 14:43:58 +0000 (0:00:02.955) 0:00:29.412 ********** 2026-04-26 14:43:59.973567 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-26 14:43:59.973956 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-26 14:43:59.974324 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-26 14:43:59.974742 | instance | 2026-04-26 14:43:59.975101 | instance | PLAY RECAP ********************************************************************* 2026-04-26 14:43:59.975515 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-26 14:43:59.975847 | instance | 2026-04-26 14:43:59.976204 | instance | Sunday 26 April 2026 14:43:59 +0000 (0:00:01.824) 0:00:31.237 ********** 2026-04-26 14:43:59.976552 | instance | =============================================================================== 2026-04-26 14:43:59.976932 | instance | Install depedencies ---------------------------------------------------- 19.31s 2026-04-26 14:43:59.977227 | instance | Create a volume group for each loop device ------------------------------ 2.96s 2026-04-26 14:43:59.977468 | instance | Create a logical volume for each loop device ---------------------------- 1.82s 2026-04-26 14:43:59.977710 | instance | Gathering Facts --------------------------------------------------------- 1.16s 2026-04-26 14:43:59.977953 | instance | Purge "snapd" package --------------------------------------------------- 0.85s 2026-04-26 14:43:59.978195 | instance | Configure short hostname ------------------------------------------------ 0.71s 2026-04-26 14:43:59.978471 | instance | Gathering Facts --------------------------------------------------------- 0.68s 2026-04-26 14:43:59.978716 | instance | Start loop devices ------------------------------------------------------ 0.65s 2026-04-26 14:43:59.978959 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.63s 2026-04-26 14:43:59.979198 | instance | Set permissions on loopback devices ------------------------------------- 0.60s 2026-04-26 14:43:59.979439 | instance | Start up service -------------------------------------------------------- 0.53s 2026-04-26 14:43:59.979683 | instance | Create devices for Ceph ------------------------------------------------- 0.52s 2026-04-26 14:43:59.979916 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-04-26 14:43:59.980148 | instance | Generate lvm.conf ------------------------------------------------------- 0.28s 2026-04-26 14:43:59.980387 | instance | Get list of all loopback devices ---------------------------------------- 0.18s 2026-04-26 14:43:59.980626 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-04-26 14:44:00.033651 | instance | INFO [csi > prepare] Executed: Successful 2026-04-26 14:44:00.033944 | instance | INFO Molecule executed 1 scenario (1 successful) 2026-04-26 14:44:00.165335 | instance | ok: Runtime: 0:01:13.895925 2026-04-26 14:44:00.170632 | 2026-04-26 14:44:00.170811 | PLAY RECAP 2026-04-26 14:44:00.170929 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-26 14:44:00.170990 | 2026-04-26 14:44:00.303058 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-26 14:44:00.305329 | RUN START: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-26 14:44:00.861894 | 2026-04-26 14:44:00.862016 | PLAY [all] 2026-04-26 14:44:00.872597 | 2026-04-26 14:44:00.872674 | TASK [Build atmosphere binary] 2026-04-26 14:44:01.273948 | instance | go: downloading github.com/spf13/cobra v1.9.1 2026-04-26 14:44:01.283383 | instance | go: downloading golang.org/x/sync v0.18.0 2026-04-26 14:44:01.555849 | instance | go: downloading github.com/spf13/pflag v1.0.7 2026-04-26 14:44:07.412117 | instance | ok: Runtime: 0:00:05.957804 2026-04-26 14:44:07.422873 | 2026-04-26 14:44:07.422984 | TASK [Deploy with parallel orchestrator] 2026-04-26 14:44:07.636289 | instance | ==> Multi-tag mode: kubernetes, csi 2026-04-26 14:44:07.636447 | instance | ==> Running preflight checks 2026-04-26 14:44:08.098167 | instance | [preflight] 2026-04-26 14:44:08.098207 | instance | [preflight] PLAY [Preflight checks] ******************************************************** 2026-04-26 14:44:08.098216 | instance | [preflight] 2026-04-26 14:44:08.098222 | instance | [preflight] TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-04-26 14:44:08.119901 | instance | [preflight] skipping: [instance] 2026-04-26 14:44:08.119919 | instance | [preflight] 2026-04-26 14:44:08.119924 | instance | [preflight] PLAY RECAP ********************************************************************* 2026-04-26 14:44:08.119935 | instance | [preflight] instance : ok=0 changed=0 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-26 14:44:08.119940 | instance | [preflight] 2026-04-26 14:44:08.170990 | instance | ==> Preflight checks passed 2026-04-26 14:44:08.171137 | instance | ==> Starting parallel deployment (subgraph) 2026-04-26 14:44:08.171187 | instance | ==> [kubernetes] Starting deployment 2026-04-26 14:44:08.954858 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:08.954909 | instance | [kubernetes/kubernetes] PLAY [all] ********************************************************************* 2026-04-26 14:44:08.954922 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:08.954931 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-26 14:44:10.265380 | instance | [kubernetes/kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-26 14:44:10.265447 | instance | [kubernetes/kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-26 14:44:10.265461 | instance | [kubernetes/kubernetes] interpreter could change the meaning of that path. See 2026-04-26 14:44:10.265477 | instance | [kubernetes/kubernetes] https://docs.ansible.com/ansible- 2026-04-26 14:44:10.265487 | instance | [kubernetes/kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-26 14:44:10.291587 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:10.291619 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:10.291630 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ******************** 2026-04-26 14:44:15.848380 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576}) 2026-04-26 14:44:15.848450 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0}) 2026-04-26 14:44:15.848467 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1}) 2026-04-26 14:44:15.848480 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000}) 2026-04-26 14:44:15.848493 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000}) 2026-04-26 14:44:15.848514 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304}) 2026-04-26 14:44:15.848526 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304}) 2026-04-26 14:44:15.848537 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304}) 2026-04-26 14:44:15.848546 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304}) 2026-04-26 14:44:15.848555 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304}) 2026-04-26 14:44:15.848567 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'}) 2026-04-26 14:44:15.848580 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'}) 2026-04-26 14:44:15.848592 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1}) 2026-04-26 14:44:15.848603 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1}) 2026-04-26 14:44:15.848638 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128}) 2026-04-26 14:44:15.848647 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-26 14:44:15.848656 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-26 14:44:15.848665 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128}) 2026-04-26 14:44:15.848676 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872}) 2026-04-26 14:44:15.848688 | instance | [kubernetes/kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768}) 2026-04-26 14:44:15.848700 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:15.848713 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] *** 2026-04-26 14:44:16.250608 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-26 14:44:16.250646 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:16.250653 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] ******* 2026-04-26 14:44:16.976591 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-26 14:44:16.976643 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:16.976657 | instance | [kubernetes/kubernetes] TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] ********************** 2026-04-26 14:44:17.478715 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:17.478773 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:17.478787 | instance | [kubernetes/kubernetes] TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-04-26 14:44:17.607941 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:17.608001 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:17.608012 | instance | [kubernetes/kubernetes] PLAY [Configure Kubernetes VIP] ************************************************ 2026-04-26 14:44:17.608023 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:17.608032 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-26 14:44:18.572534 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:18.572755 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:18.572768 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] *** 2026-04-26 14:44:18.885634 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-26 14:44:18.885673 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:18.885687 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] **************** 2026-04-26 14:44:20.292890 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf) 2026-04-26 14:44:20.292943 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh) 2026-04-26 14:44:20.292954 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml) 2026-04-26 14:44:20.292963 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg) 2026-04-26 14:44:20.292972 | instance | [kubernetes/kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml) 2026-04-26 14:44:20.292981 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:20.292991 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] **** 2026-04-26 14:44:21.152400 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257} 2026-04-26 14:44:21.152464 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257} 2026-04-26 14:44:21.152495 | instance | [kubernetes/kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257} 2026-04-26 14:44:21.152505 | instance | [kubernetes/kubernetes] ...ignoring 2026-04-26 14:44:21.152515 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:21.152526 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] ********* 2026-04-26 14:44:21.434626 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:21.434662 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:21.434668 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] ********* 2026-04-26 14:44:21.713249 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:21.713319 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:21.713331 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************ 2026-04-26 14:44:21.741859 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:21.741917 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:21.741926 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] *** 2026-04-26 14:44:21.775673 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:21.775744 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:21.775756 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] *************** 2026-04-26 14:44:22.419235 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:22.419275 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:22.419281 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] ******* 2026-04-26 14:44:22.770486 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:22.770540 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:22.770552 | instance | [kubernetes/kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] *************************** 2026-04-26 14:44:22.770563 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:22.770572 | instance | [kubernetes/kubernetes] PLAY [Install Kubernetes] ****************************************************** 2026-04-26 14:44:22.770580 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:22.770589 | instance | [kubernetes/kubernetes] TASK [Gathering Facts] ********************************************************* 2026-04-26 14:44:23.759599 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:23.759654 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:23.759666 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-26 14:44:24.057966 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:24.058034 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:24.058046 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-26 14:44:24.088768 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-26 14:44:24.088831 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:24.088841 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-26 14:44:24.430565 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-26 14:44:24.430623 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:24.430635 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-26 14:44:24.491566 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-26 14:44:24.491614 | instance | [kubernetes/kubernetes] "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-26 14:44:24.491631 | instance | [kubernetes/kubernetes] } 2026-04-26 14:44:24.491644 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:24.491655 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-26 14:44:25.247362 | instance | [kubernetes/kubernetes] changed: [instance] 2026-04-26 14:44:25.247437 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:25.247449 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-26 14:44:25.287801 | instance | [kubernetes/kubernetes] skipping: [instance] 2026-04-26 14:44:25.287870 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:25.287881 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-26 14:44:25.595797 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:25.595895 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:25.595908 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-26 14:44:26.810082 | instance | [kubernetes/kubernetes] ok: [instance] 2026-04-26 14:44:26.810165 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:26.810193 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-26 14:44:26.871330 | instance | [kubernetes/kubernetes] ok: [instance] => { 2026-04-26 14:44:26.871403 | instance | [kubernetes/kubernetes] "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-26 14:44:26.871415 | instance | [kubernetes/kubernetes] } 2026-04-26 14:44:26.871425 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:26.871434 | instance | [kubernetes/kubernetes] TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-26 14:44:49.021763 | instance | [kubernetes/kubernetes] FAILED - RETRYING: [instance]: Download item (4 retries left). 2026-04-26 14:44:49.021815 | instance | [kubernetes/kubernetes] FAILED - RETRYING: [instance]: Download item (3 retries left). 2026-04-26 14:44:49.021827 | instance | [kubernetes/kubernetes] FAILED - RETRYING: [instance]: Download item (2 retries left). 2026-04-26 14:44:49.021836 | instance | [kubernetes/kubernetes] FAILED - RETRYING: [instance]: Download item (1 retries left). 2026-04-26 14:44:49.021853 | instance | [kubernetes/kubernetes] fatal: [instance]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2026-04-26 14:44:49.021866 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:49.021876 | instance | [kubernetes/kubernetes] PLAY RECAP ********************************************************************* 2026-04-26 14:44:49.021886 | instance | [kubernetes/kubernetes] instance : ok=24 changed=6 unreachable=0 failed=1 skipped=2 rescued=0 ignored=1 2026-04-26 14:44:49.021895 | instance | [kubernetes/kubernetes] 2026-04-26 14:44:49.106736 | instance | Error: component kubernetes failed: ansible-playbook failed for kubernetes/kubernetes: exit status 2 2026-04-26 14:44:49.106824 | instance | Usage: 2026-04-26 14:44:49.106833 | instance | atmosphere deploy [flags] 2026-04-26 14:44:49.106841 | instance | 2026-04-26 14:44:49.106847 | instance | Flags: 2026-04-26 14:44:49.106854 | instance | --concurrency int Max concurrent deployments per wave (0 = unlimited) 2026-04-26 14:44:49.106860 | instance | -h, --help help for deploy 2026-04-26 14:44:49.106867 | instance | -i, --inventory string Path to Ansible inventory file (required) 2026-04-26 14:44:49.106873 | instance | -t, --tags string Comma-separated list of component tags to deploy 2026-04-26 14:44:49.106879 | instance | 2026-04-26 14:44:49.106885 | instance | component kubernetes failed: ansible-playbook failed for kubernetes/kubernetes: exit status 2 2026-04-26 14:44:49.518489 | instance | ERROR 2026-04-26 14:44:49.518805 | instance | { 2026-04-26 14:44:49.518870 | instance | "delta": "0:00:41.482330", 2026-04-26 14:44:49.518917 | instance | "end": "2026-04-26 14:44:49.107755", 2026-04-26 14:44:49.518959 | instance | "msg": "non-zero return code", 2026-04-26 14:44:49.518999 | instance | "rc": 1, 2026-04-26 14:44:49.519038 | instance | "start": "2026-04-26 14:44:07.625425" 2026-04-26 14:44:49.519082 | instance | } failure 2026-04-26 14:44:49.522827 | 2026-04-26 14:44:49.522873 | PLAY RECAP 2026-04-26 14:44:49.522917 | instance | ok: 1 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-26 14:44:49.522938 | 2026-04-26 14:44:49.643912 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main] 2026-04-26 14:44:49.648443 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-26 14:44:50.233744 | 2026-04-26 14:44:50.233867 | PLAY [all] 2026-04-26 14:44:50.248087 | 2026-04-26 14:44:50.248167 | TASK [gather-host-logs : creating directory for system status] 2026-04-26 14:44:50.596755 | instance | changed 2026-04-26 14:44:50.603859 | 2026-04-26 14:44:50.603970 | TASK [gather-host-logs : Get logs for each host] 2026-04-26 14:44:50.957540 | instance | + systemd-cgls --full --all --no-pager 2026-04-26 14:44:50.969586 | instance | + ip addr 2026-04-26 14:44:50.971141 | instance | + ip route 2026-04-26 14:44:50.972592 | instance | + lsblk 2026-04-26 14:44:50.975672 | instance | + mount 2026-04-26 14:44:50.977121 | instance | + docker images 2026-04-26 14:44:50.977411 | instance | /bin/bash: line 7: docker: command not found 2026-04-26 14:44:50.977572 | instance | + brctl show 2026-04-26 14:44:50.977870 | instance | /bin/bash: line 8: brctl: command not found 2026-04-26 14:44:50.978036 | instance | + ps aux --sort=-%mem 2026-04-26 14:44:51.003479 | instance | + dpkg -l 2026-04-26 14:44:51.009151 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-26 14:44:51.009437 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-26 14:44:51.009476 | instance | /bin/bash: line 11: docker: command not found 2026-04-26 14:44:51.009710 | instance | + '[' '!' -z '' ']' 2026-04-26 14:44:51.142363 | instance | ok: Runtime: 0:00:00.055489 2026-04-26 14:44:51.151333 | 2026-04-26 14:44:51.151430 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-26 14:44:51.787262 | instance | changed: 2026-04-26 14:44:51.787503 | instance | created directory /var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/logs/instance 2026-04-26 14:44:51.787545 | instance | cd+++++++++ system/ 2026-04-26 14:44:51.787576 | instance | >f+++++++++ system/brctl-show.txt 2026-04-26 14:44:51.787605 | instance | >f+++++++++ system/docker-images.txt 2026-04-26 14:44:51.787631 | instance | >f+++++++++ system/ip-addr.txt 2026-04-26 14:44:51.787662 | instance | >f+++++++++ system/ip-route.txt 2026-04-26 14:44:51.787692 | instance | >f+++++++++ system/lsblk.txt 2026-04-26 14:44:51.787719 | instance | >f+++++++++ system/mount.txt 2026-04-26 14:44:51.787747 | instance | >f+++++++++ system/packages.txt 2026-04-26 14:44:51.787774 | instance | >f+++++++++ system/ps.txt 2026-04-26 14:44:51.787799 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-26 14:44:51.799104 | 2026-04-26 14:44:51.799201 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-26 14:44:52.003914 | instance | changed: "values" 2026-04-26 14:44:52.170777 | instance | changed: "releases" 2026-04-26 14:44:52.191796 | 2026-04-26 14:44:52.191974 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-26 14:44:52.415607 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-26 14:44:52.728337 | instance | ok: Runtime: 0:00:00.005797 2026-04-26 14:44:52.743780 | 2026-04-26 14:44:52.743981 | TASK [helm-release-status : Downloads logs to executor] 2026-04-26 14:44:53.248920 | instance | changed: 2026-04-26 14:44:53.249229 | instance | cd+++++++++ helm/ 2026-04-26 14:44:53.249289 | instance | cd+++++++++ helm/releases/ 2026-04-26 14:44:53.249336 | instance | cd+++++++++ helm/values/ 2026-04-26 14:44:53.261610 | 2026-04-26 14:44:53.261685 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-26 14:44:53.467834 | instance | changed 2026-04-26 14:44:53.474183 | 2026-04-26 14:44:53.474277 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-26 14:44:53.680496 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-26 14:44:53.680547 | instance | 2026-04-26 14:44:53.685864 | instance | environment: line 1: kubectl: command not found 2026-04-26 14:44:53.686389 | instance | environment: line 1: kubectl: command not found 2026-04-26 14:44:53.687806 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-26 14:44:53.687847 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-26 14:44:53.690644 | instance | environment: line 1: kubectl: command not found 2026-04-26 14:44:53.691632 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-26 14:44:53.692970 | instance | environment: line 1: kubectl: command not found 2026-04-26 14:44:53.693794 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-26 14:44:53.695975 | instance | environment: line 1: kubectl: command not found 2026-04-26 14:44:53.697473 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-26 14:44:54.010438 | instance | ok: Runtime: 0:00:00.023220 2026-04-26 14:44:54.017381 | 2026-04-26 14:44:54.017474 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-26 14:44:54.222108 | instance | changed 2026-04-26 14:44:54.228669 | 2026-04-26 14:44:54.228763 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-26 14:44:54.483011 | instance | environment: line 5: kubectl: command not found 2026-04-26 14:44:54.483368 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-26 14:44:54.483837 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-26 14:44:54.485031 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-26 14:44:54.803135 | instance | ok: Runtime: 0:00:00.008298 2026-04-26 14:44:54.810793 | 2026-04-26 14:44:54.810863 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-26 14:44:55.298057 | instance | changed: 2026-04-26 14:44:55.298279 | instance | cd+++++++++ objects/ 2026-04-26 14:44:55.298317 | instance | cd+++++++++ objects/cluster/ 2026-04-26 14:44:55.298349 | instance | cd+++++++++ objects/namespaced/ 2026-04-26 14:44:55.310014 | 2026-04-26 14:44:55.310087 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-26 14:44:55.517733 | instance | changed 2026-04-26 14:44:55.523351 | 2026-04-26 14:44:55.523421 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-26 14:44:55.716283 | instance | changed 2026-04-26 14:44:55.721935 | 2026-04-26 14:44:55.722009 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-26 14:44:55.928931 | instance | environment: line 3: kubectl: command not found 2026-04-26 14:44:56.260052 | instance | ok: Runtime: 0:00:00.008671 2026-04-26 14:44:56.267939 | 2026-04-26 14:44:56.268034 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-26 14:44:56.775955 | instance | changed: 2026-04-26 14:44:56.776160 | instance | cd+++++++++ pod-logs/ 2026-04-26 14:44:56.776198 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-26 14:44:56.788143 | 2026-04-26 14:44:56.788216 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-26 14:44:56.985440 | instance | changed 2026-04-26 14:44:56.992169 | 2026-04-26 14:44:56.992259 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-26 14:44:57.212790 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-26 14:44:57.532106 | instance | ok: Runtime: 0:00:00.034899 2026-04-26 14:44:57.539499 | 2026-04-26 14:44:57.539594 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-26 14:44:57.743712 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-26 14:44:57.772259 | instance | ceph-mgr endpoints: 2026-04-26 14:44:58.078736 | instance | ok: Runtime: 0:00:00.035757 2026-04-26 14:44:58.085001 | 2026-04-26 14:44:58.085078 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-26 14:44:58.306074 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-26 14:44:58.620683 | instance | ok: Runtime: 0:00:00.038597 2026-04-26 14:44:58.627729 | 2026-04-26 14:44:58.627829 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-26 14:44:59.119503 | instance | changed: cd+++++++++ prometheus/ 2026-04-26 14:44:59.129020 | 2026-04-26 14:44:59.129089 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-26 14:44:59.337394 | instance | changed 2026-04-26 14:44:59.342208 | 2026-04-26 14:44:59.342274 | TASK [gather-selenium-data : Get selenium data] 2026-04-26 14:44:59.547940 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-26 14:44:59.548911 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-26 14:44:59.880656 | instance | ERROR 2026-04-26 14:44:59.880893 | instance | { 2026-04-26 14:44:59.880926 | instance | "delta": "0:00:00.004957", 2026-04-26 14:44:59.880947 | instance | "end": "2026-04-26 14:44:59.549156", 2026-04-26 14:44:59.881011 | instance | "msg": "non-zero return code", 2026-04-26 14:44:59.881031 | instance | "rc": 1, 2026-04-26 14:44:59.881049 | instance | "start": "2026-04-26 14:44:59.544199" 2026-04-26 14:44:59.881067 | instance | } 2026-04-26 14:44:59.881091 | instance | ERROR: Ignoring Errors 2026-04-26 14:44:59.886078 | 2026-04-26 14:44:59.886150 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-26 14:45:00.386867 | instance | changed: cd+++++++++ selenium/ 2026-04-26 14:45:00.395300 | 2026-04-26 14:45:00.395352 | PLAY RECAP 2026-04-26 14:45:00.395400 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-26 14:45:00.395422 | 2026-04-26 14:45:00.517856 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-26 14:45:00.522432 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-26 14:45:01.091924 | 2026-04-26 14:45:01.092058 | PLAY [all] 2026-04-26 14:45:01.103893 | 2026-04-26 14:45:01.103969 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-26 14:45:01.149269 | instance | skipping: Conditional result was False 2026-04-26 14:45:01.158621 | 2026-04-26 14:45:01.158765 | TASK [fetch-output : Set log path for single node] 2026-04-26 14:45:01.202112 | instance | ok 2026-04-26 14:45:01.208299 | 2026-04-26 14:45:01.208392 | LOOP [fetch-output : Ensure local output dirs] 2026-04-26 14:45:01.601605 | instance -> localhost | ok: "/var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/logs" 2026-04-26 14:45:01.802911 | instance -> localhost | changed: "/var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/artifacts" 2026-04-26 14:45:02.010204 | instance -> localhost | changed: "/var/lib/zuul/builds/1d995c62ac3a4970b159c05f09b9833f/work/docs" 2026-04-26 14:45:02.027962 | 2026-04-26 14:45:02.028140 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-26 14:45:02.644600 | instance | changed: .d..t...... ./ 2026-04-26 14:45:02.644855 | instance | changed: All items complete 2026-04-26 14:45:02.644895 | 2026-04-26 14:45:03.082811 | instance | changed: .d..t...... ./ 2026-04-26 14:45:03.531446 | instance | changed: .d..t...... ./ 2026-04-26 14:45:03.556491 | 2026-04-26 14:45:03.556678 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-26 14:45:03.980341 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007020 2026-04-26 14:45:04.212477 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007905 2026-04-26 14:45:04.225719 | 2026-04-26 14:45:04.225873 | PLAY [all] 2026-04-26 14:45:04.232866 | 2026-04-26 14:45:04.232937 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-26 14:45:04.672742 | instance | changed 2026-04-26 14:45:04.681043 | 2026-04-26 14:45:04.681135 | PLAY RECAP 2026-04-26 14:45:04.681217 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-26 14:45:04.681254 | 2026-04-26 14:45:04.838363 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-26 14:45:04.842649 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-26 14:45:05.403248 | 2026-04-26 14:45:05.403468 | PLAY [localhost] 2026-04-26 14:45:05.413289 | 2026-04-26 14:45:05.413359 | TASK [Generate Zuul manifest] 2026-04-26 14:45:05.437767 | localhost | ok 2026-04-26 14:45:05.454955 | 2026-04-26 14:45:05.455030 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-26 14:45:05.781021 | localhost | changed 2026-04-26 14:45:05.793530 | 2026-04-26 14:45:05.793641 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-26 14:45:05.825539 | localhost | ok 2026-04-26 14:45:05.834644 | 2026-04-26 14:45:05.834728 | TASK [Upload logs] 2026-04-26 14:45:05.868588 | localhost | ok 2026-04-26 14:45:05.928506 | 2026-04-26 14:45:05.928608 | TASK [Set zuul-log-path fact] 2026-04-26 14:45:05.952191 | localhost | ok 2026-04-26 14:45:05.962882 | 2026-04-26 14:45:05.962950 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-26 14:45:05.994254 | localhost | ok 2026-04-26 14:45:06.004054 | 2026-04-26 14:45:06.004152 | TASK [upload-logs : Create log directories] 2026-04-26 14:45:06.434541 | localhost | changed 2026-04-26 14:45:06.440762 | 2026-04-26 14:45:06.440841 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-26 14:45:06.868941 | localhost -> localhost | ok: Runtime: 0:00:00.006860 2026-04-26 14:45:06.876237 | 2026-04-26 14:45:06.876312 | TASK [upload-logs : Upload logs to log server] 2026-04-26 14:45:07.341362 | localhost | Output suppressed because no_log was given 2026-04-26 14:45:07.345071 | 2026-04-26 14:45:07.345142 | LOOP [upload-logs : Compress console log and json output] 2026-04-26 14:45:07.391325 | localhost | skipping: Conditional result was False 2026-04-26 14:45:07.398505 | localhost | skipping: Conditional result was False 2026-04-26 14:45:07.412260 | 2026-04-26 14:45:07.412485 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-26 14:45:07.453469 | localhost | skipping: Conditional result was False 2026-04-26 14:45:07.453878 | 2026-04-26 14:45:07.457481 | localhost | skipping: Conditional result was False 2026-04-26 14:45:07.473675 | 2026-04-26 14:45:07.473818 | LOOP [upload-logs : Upload console log and json output]