2026-04-18 16:38:50.577853 | Job console starting
2026-04-18 16:38:50.592062 | Updating git repos
2026-04-18 16:38:50.677778 | Cloning repos into workspace
2026-04-18 16:38:51.194404 | Restoring repo states
2026-04-18 16:38:51.216185 | Merging changes
2026-04-18 16:38:52.486986 | Checking out repos
2026-04-18 16:38:53.404347 | Preparing playbooks
2026-04-18 16:38:59.933913 | Running Ansible setup
2026-04-18 16:39:03.368536 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:39:03.996058 | 
2026-04-18 16:39:03.996173 | PLAY [localhost]
2026-04-18 16:39:04.004994 | 
2026-04-18 16:39:04.005071 | TASK [Gathering Facts]
2026-04-18 16:39:04.907155 | localhost | ok
2026-04-18 16:39:04.915666 | 
2026-04-18 16:39:04.915769 | TASK [Setup log path fact]
2026-04-18 16:39:04.935192 | localhost | ok
2026-04-18 16:39:04.947539 | 
2026-04-18 16:39:04.947627 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:39:04.977147 | localhost | ok
2026-04-18 16:39:04.986113 | 
2026-04-18 16:39:04.986260 | TASK [emit-job-header : Print job information]
2026-04-18 16:39:05.025794 | # Job Information
2026-04-18 16:39:05.026015 | Ansible Version: 2.16.16
2026-04-18 16:39:05.026065 | Job: atmosphere-molecule-csi-local-path-provisioner
2026-04-18 16:39:05.026099 | Pipeline: check
2026-04-18 16:39:05.026129 | Executor: 0a8996d2b663
2026-04-18 16:39:05.026158 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-18 16:39:05.026192 | Event ID: f78e0250-3b44-11f1-801e-4d73de902fe9
2026-04-18 16:39:05.030340 | 
2026-04-18 16:39:05.030434 | LOOP [emit-job-header : Print node information]
2026-04-18 16:39:05.131303 | localhost | ok:
2026-04-18 16:39:05.131595 | localhost | # Node Information
2026-04-18 16:39:05.131659 | localhost | Inventory Hostname: instance
2026-04-18 16:39:05.131709 | localhost | Hostname: np0000167410
2026-04-18 16:39:05.131754 | localhost | Username: zuul
2026-04-18 16:39:05.131805 | localhost | Distro: Ubuntu 22.04
2026-04-18 16:39:05.131850 | localhost | Provider: yul1
2026-04-18 16:39:05.131893 | localhost | Region: ca-ymq-1
2026-04-18 16:39:05.131935 | localhost | Label: ubuntu-jammy
2026-04-18 16:39:05.131976 | localhost | Product Name: OpenStack Nova
2026-04-18 16:39:05.132017 | localhost | Interface IP: 199.204.45.138
2026-04-18 16:39:05.149041 | 
2026-04-18 16:39:05.149165 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-18 16:39:05.527547 | localhost -> localhost | changed
2026-04-18 16:39:05.536684 | 
2026-04-18 16:39:05.536835 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-18 16:39:06.447248 | localhost -> localhost | changed
2026-04-18 16:39:06.454450 | 
2026-04-18 16:39:06.454519 | PLAY [all]
2026-04-18 16:39:06.467571 | 
2026-04-18 16:39:06.467672 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-18 16:39:06.693669 | instance -> localhost | ok
2026-04-18 16:39:06.699199 | 
2026-04-18 16:39:06.699263 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-18 16:39:06.727973 | instance | ok
2026-04-18 16:39:06.741026 | instance | included: /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:39:06.746345 | 
2026-04-18 16:39:06.746402 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-18 16:39:08.524372 | instance -> localhost | Generating public/private rsa key pair.
2026-04-18 16:39:08.524527 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/14c6e97120144ccc81137568fd051220_id_rsa
2026-04-18 16:39:08.524558 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/14c6e97120144ccc81137568fd051220_id_rsa.pub
2026-04-18 16:39:08.524745 | instance -> localhost | The key fingerprint is:
2026-04-18 16:39:08.524767 | instance -> localhost | SHA256:xd/kvcN9wlo2RwjiPNDF4nZLsHIydTs0kwlZnc1ShT4 zuul-build-sshkey
2026-04-18 16:39:08.524802 | instance -> localhost | The key's randomart image is:
2026-04-18 16:39:08.524824 | instance -> localhost | +---[RSA 3072]----+
2026-04-18 16:39:08.524850 | instance -> localhost | |          .=o+ *+|
2026-04-18 16:39:08.524872 | instance -> localhost | |         o=.O = o|
2026-04-18 16:39:08.524892 | instance -> localhost | |        .o=*.=.. |
2026-04-18 16:39:08.524912 | instance -> localhost | |        +==o==Eo |
2026-04-18 16:39:08.524932 | instance -> localhost | |        S*+o.o+.o|
2026-04-18 16:39:08.524952 | instance -> localhost | |           .....o|
2026-04-18 16:39:08.525001 | instance -> localhost | |              *++|
2026-04-18 16:39:08.525030 | instance -> localhost | |             + +o|
2026-04-18 16:39:08.525055 | instance -> localhost | |            .    |
2026-04-18 16:39:08.525075 | instance -> localhost | +----[SHA256]-----+
2026-04-18 16:39:08.525122 | instance -> localhost | ok: Runtime: 0:00:01.369620
2026-04-18 16:39:08.530389 | 
2026-04-18 16:39:08.530454 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-18 16:39:08.560570 | instance | ok
2026-04-18 16:39:08.570105 | instance | included: /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:39:08.577780 | 
2026-04-18 16:39:08.577844 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-18 16:39:08.601637 | instance | skipping: Conditional result was False
2026-04-18 16:39:08.611313 | 
2026-04-18 16:39:08.611477 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-18 16:39:09.058052 | instance | changed
2026-04-18 16:39:09.065147 | 
2026-04-18 16:39:09.065254 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-18 16:39:09.248444 | instance | ok
2026-04-18 16:39:09.256057 | 
2026-04-18 16:39:09.257270 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-18 16:39:09.718793 | instance | changed
2026-04-18 16:39:09.725169 | 
2026-04-18 16:39:09.725301 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-18 16:39:10.159682 | instance | changed
2026-04-18 16:39:10.164773 | 
2026-04-18 16:39:10.164849 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-18 16:39:10.188891 | instance | skipping: Conditional result was False
2026-04-18 16:39:10.200360 | 
2026-04-18 16:39:10.200526 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-18 16:39:10.672795 | instance -> localhost | changed
2026-04-18 16:39:10.692568 | 
2026-04-18 16:39:10.693071 | TASK [add-build-sshkey : Add back temp key]
2026-04-18 16:39:11.021854 | instance -> localhost | Identity added: /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/14c6e97120144ccc81137568fd051220_id_rsa (zuul-build-sshkey)
2026-04-18 16:39:11.022033 | instance -> localhost | ok: Runtime: 0:00:00.015402
2026-04-18 16:39:11.028250 | 
2026-04-18 16:39:11.028339 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-18 16:39:11.361133 | instance | ok
2026-04-18 16:39:11.367054 | 
2026-04-18 16:39:11.367139 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-18 16:39:11.391263 | instance | skipping: Conditional result was False
2026-04-18 16:39:11.403712 | 
2026-04-18 16:39:11.403775 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-18 16:39:11.739535 | instance | ok
2026-04-18 16:39:11.748202 | 
2026-04-18 16:39:11.748299 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-18 16:39:13.409925 | instance | Output suppressed because no_log was given
2026-04-18 16:39:13.419548 | 
2026-04-18 16:39:13.421251 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-18 16:39:13.599217 | instance | ok: "logs"
2026-04-18 16:39:13.599441 | instance | ok: All items complete
2026-04-18 16:39:13.599469 | 
2026-04-18 16:39:13.757148 | instance | ok: "artifacts"
2026-04-18 16:39:13.919876 | instance | ok: "docs"
2026-04-18 16:39:13.935977 | 
2026-04-18 16:39:13.936092 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-18 16:39:14.123018 | instance | changed: "logs"
2026-04-18 16:39:14.272167 | instance | changed: "artifacts"
2026-04-18 16:39:14.424832 | instance | changed: "docs"
2026-04-18 16:39:14.442166 | 
2026-04-18 16:39:14.442280 | PLAY RECAP
2026-04-18 16:39:14.442394 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:39:14.442438 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:39:14.442468 | 
2026-04-18 16:39:14.562302 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:39:14.570249 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:39:15.153865 | 
2026-04-18 16:39:15.154170 | PLAY [all]
2026-04-18 16:39:15.165525 | 
2026-04-18 16:39:15.165609 | TASK [setup-uv : Extract archive]
2026-04-18 16:39:19.283887 | instance | changed
2026-04-18 16:39:19.291274 | 
2026-04-18 16:39:19.291383 | TASK [setup-uv : Print version]
2026-04-18 16:39:19.625044 | instance | uv 0.8.13
2026-04-18 16:39:19.828182 | instance | ok: Runtime: 0:00:00.013898
2026-04-18 16:39:19.840097 | 
2026-04-18 16:39:19.840248 | PLAY RECAP
2026-04-18 16:39:19.840315 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:39:19.840346 | 
2026-04-18 16:39:19.940715 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:39:19.942562 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-18 16:39:20.513348 | 
2026-04-18 16:39:20.513491 | PLAY [all]
2026-04-18 16:39:20.525371 | 
2026-04-18 16:39:20.525490 | TASK [Install "jq" for log collection]
2026-04-18 16:39:35.248127 | instance | changed
2026-04-18 16:39:35.256004 | 
2026-04-18 16:39:35.256137 | TASK [Install pip3 for Python package management]
2026-04-18 16:39:39.518322 | instance | changed
2026-04-18 16:39:39.525291 | 
2026-04-18 16:39:39.525397 | TASK [Install Python "kubernetes" library for kubernetes.core modules]
2026-04-18 16:39:42.692536 | instance | changed
2026-04-18 16:39:42.695757 | 
2026-04-18 16:39:42.695830 | PLAY [all]
2026-04-18 16:39:42.703874 | 
2026-04-18 16:39:42.703937 | TASK [ensure-go : Check installed go version]
2026-04-18 16:39:43.234585 | instance | ok: ERROR (ignored)
2026-04-18 16:39:43.234791 | instance | {
2026-04-18 16:39:43.234825 | instance |   "failed_when_result": false,
2026-04-18 16:39:43.234846 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-18 16:39:43.234868 | instance |   "rc": 2
2026-04-18 16:39:43.234892 | instance | }
2026-04-18 16:39:43.239851 | 
2026-04-18 16:39:43.239927 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-18 16:39:43.290014 | instance | ok
2026-04-18 16:39:43.303155 | instance | included: /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-18 16:39:43.309920 | 
2026-04-18 16:39:43.310002 | TASK [ensure-go : Create temp directory]
2026-04-18 16:39:43.624144 | instance | changed
2026-04-18 16:39:43.631074 | 
2026-04-18 16:39:43.631176 | TASK [ensure-go : Get archive checksum]
2026-04-18 16:39:44.229115 | instance | ok: OK (64 bytes)
2026-04-18 16:39:44.237559 | 
2026-04-18 16:39:44.237643 | TASK [ensure-go : Download go archive]
2026-04-18 16:39:45.583432 | instance | changed: OK (78559214 bytes)
2026-04-18 16:39:45.589069 | 
2026-04-18 16:39:45.589138 | TASK [ensure-go : Install go]
2026-04-18 16:39:51.483681 | instance | changed
2026-04-18 16:39:51.501013 | 
2026-04-18 16:39:51.501109 | PLAY [all]
2026-04-18 16:39:51.507599 | 
2026-04-18 16:39:51.507665 | TASK [Copy inventory file for Zuul]
2026-04-18 16:39:52.349760 | instance | changed
2026-04-18 16:39:52.358047 | 
2026-04-18 16:39:52.358147 | TASK [Switch "ansible_host" to private IP]
2026-04-18 16:39:52.666019 | instance | changed: 1 replacements made
2026-04-18 16:39:52.673433 | 
2026-04-18 16:39:52.842182 | TASK [Run molecule prepare]
2026-04-18 16:39:53.122823 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-18 16:39:53.123017 | instance | Creating virtual environment at: .venv
2026-04-18 16:39:53.147628 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-18 16:39:53.173520 | instance | Downloading ansible-core (2.1MiB)
2026-04-18 16:39:53.174028 | instance | Downloading pydantic-core (2.0MiB)
2026-04-18 16:39:53.174249 | instance | Downloading rjsonnet (1.2MiB)
2026-04-18 16:39:53.175271 | instance | Downloading setuptools (1.1MiB)
2026-04-18 16:39:53.175542 | instance | Downloading pygments (1.2MiB)
2026-04-18 16:39:53.176907 | instance | Downloading cryptography (4.2MiB)
2026-04-18 16:39:53.177153 | instance | Downloading openstacksdk (1.7MiB)
2026-04-18 16:39:53.177927 | instance | Downloading kubernetes (1.9MiB)
2026-04-18 16:39:53.178450 | instance | Downloading netaddr (2.2MiB)
2026-04-18 16:39:53.505394 | instance |    Building pyperclip==1.9.0
2026-04-18 16:39:53.521215 | instance |  Downloading rjsonnet
2026-04-18 16:39:53.627842 | instance |  Downloading pydantic-core
2026-04-18 16:39:53.673250 | instance |  Downloading netaddr
2026-04-18 16:39:53.691915 | instance |  Downloading pygments
2026-04-18 16:39:53.707620 | instance |  Downloading cryptography
2026-04-18 16:39:53.736570 | instance |  Downloading setuptools
2026-04-18 16:39:53.801730 | instance |  Downloading kubernetes
2026-04-18 16:39:53.835153 | instance |  Downloading ansible-core
2026-04-18 16:39:53.863269 | instance |  Downloading openstacksdk
2026-04-18 16:39:54.296847 | instance |       Built pyperclip==1.9.0
2026-04-18 16:39:54.516530 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-18 16:39:54.562524 | instance | Installed 83 packages in 44ms
2026-04-18 16:39:55.186625 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-18 16:39:55.793724 | instance | INFO     [csi > discovery] scenario test matrix: prepare
2026-04-18 16:39:55.793812 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-18 16:40:36.985545 | instance | INFO     [csi > prepare] Executing
2026-04-18 16:40:37.957616 | instance |
2026-04-18 16:40:37.958133 | instance | PLAY [Prepare] *****************************************************************
2026-04-18 16:40:37.958489 | instance |
2026-04-18 16:40:37.958775 | instance | TASK [Gathering Facts] *********************************************************
2026-04-18 16:40:37.959050 | instance | Saturday 18 April 2026  16:40:37 +0000 (0:00:00.026)       0:00:00.026 ********
2026-04-18 16:40:39.107833 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-18 16:40:39.108136 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-18 16:40:39.108458 | instance | interpreter could change the meaning of that path. See
2026-04-18 16:40:39.108856 | instance | https://docs.ansible.com/ansible-
2026-04-18 16:40:39.109165 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:40:39.118399 | instance | ok: [instance]
2026-04-18 16:40:39.118677 | instance |
2026-04-18 16:40:39.118989 | instance | TASK [Configure short hostname] ************************************************
2026-04-18 16:40:39.119302 | instance | Saturday 18 April 2026  16:40:39 +0000 (0:00:01.161)       0:00:01.188 ********
2026-04-18 16:40:39.809068 | instance | changed: [instance]
2026-04-18 16:40:39.809293 | instance |
2026-04-18 16:40:39.809590 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-18 16:40:39.809883 | instance | Saturday 18 April 2026  16:40:39 +0000 (0:00:00.690)       0:00:01.878 ********
2026-04-18 16:40:40.098647 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-18 16:40:40.098858 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-18 16:40:40.099094 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-18 16:40:40.109450 | instance | changed: [instance]
2026-04-18 16:40:40.109701 | instance |
2026-04-18 16:40:40.109979 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-18 16:40:40.110254 | instance | Saturday 18 April 2026  16:40:40 +0000 (0:00:00.301)       0:00:02.179 ********
2026-04-18 16:40:40.900729 | instance | ok: [instance]
2026-04-18 16:40:40.900925 | instance |
2026-04-18 16:40:40.901199 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-18 16:40:40.901454 | instance |
2026-04-18 16:40:40.901723 | instance | TASK [Gathering Facts] *********************************************************
2026-04-18 16:40:40.901991 | instance | Saturday 18 April 2026  16:40:40 +0000 (0:00:00.790)       0:00:02.970 ********
2026-04-18 16:40:41.614821 | instance | ok: [instance]
2026-04-18 16:40:41.614942 | instance |
2026-04-18 16:40:41.615137 | instance | TASK [Install depedencies] *****************************************************
2026-04-18 16:40:41.615269 | instance | Saturday 18 April 2026  16:40:41 +0000 (0:00:00.713)       0:00:03.684 ********
2026-04-18 16:41:00.330505 | instance | changed: [instance]
2026-04-18 16:41:00.330578 | instance |
2026-04-18 16:41:00.330696 | instance | TASK [Start up service] ********************************************************
2026-04-18 16:41:00.330848 | instance | Saturday 18 April 2026  16:41:00 +0000 (0:00:18.715)       0:00:22.399 ********
2026-04-18 16:41:00.916807 | instance | ok: [instance]
2026-04-18 16:41:00.917168 | instance |
2026-04-18 16:41:00.917472 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-18 16:41:00.917767 | instance | Saturday 18 April 2026  16:41:00 +0000 (0:00:00.587)       0:00:22.986 ********
2026-04-18 16:41:01.209419 | instance | ok: [instance]
2026-04-18 16:41:01.209565 | instance |
2026-04-18 16:41:01.209747 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-18 16:41:01.209923 | instance | Saturday 18 April 2026  16:41:01 +0000 (0:00:00.292)       0:00:23.279 ********
2026-04-18 16:41:01.871928 | instance | changed: [instance]
2026-04-18 16:41:01.872192 | instance |
2026-04-18 16:41:01.872490 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-18 16:41:01.872787 | instance | Saturday 18 April 2026  16:41:01 +0000 (0:00:00.661)       0:00:23.941 ********
2026-04-18 16:41:02.057145 | instance | ok: [instance]
2026-04-18 16:41:02.057208 | instance |
2026-04-18 16:41:02.057363 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-18 16:41:02.057475 | instance | Saturday 18 April 2026  16:41:02 +0000 (0:00:00.186)       0:00:24.127 ********
2026-04-18 16:41:02.085890 | instance | skipping: [instance]
2026-04-18 16:41:02.085925 | instance |
2026-04-18 16:41:02.085933 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-18 16:41:02.085939 | instance | Saturday 18 April 2026  16:41:02 +0000 (0:00:00.027)       0:00:24.155 ********
2026-04-18 16:41:02.600706 | instance | changed: [instance] => (item=osd0)
2026-04-18 16:41:02.600809 | instance | changed: [instance] => (item=osd1)
2026-04-18 16:41:02.600921 | instance | changed: [instance] => (item=osd2)
2026-04-18 16:41:02.601039 | instance |
2026-04-18 16:41:02.601162 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-18 16:41:02.601313 | instance | Saturday 18 April 2026  16:41:02 +0000 (0:00:00.515)       0:00:24.671 ********
2026-04-18 16:41:03.236822 | instance | changed: [instance] => (item=osd0)
2026-04-18 16:41:03.236949 | instance | changed: [instance] => (item=osd1)
2026-04-18 16:41:03.237117 | instance | changed: [instance] => (item=osd2)
2026-04-18 16:41:03.237270 | instance |
2026-04-18 16:41:03.237434 | instance | TASK [Start loop devices] ******************************************************
2026-04-18 16:41:03.237603 | instance | Saturday 18 April 2026  16:41:03 +0000 (0:00:00.635)       0:00:25.306 ********
2026-04-18 16:41:03.961819 | instance | changed: [instance] => (item=osd0)
2026-04-18 16:41:03.962084 | instance | changed: [instance] => (item=osd1)
2026-04-18 16:41:03.962363 | instance | changed: [instance] => (item=osd2)
2026-04-18 16:41:03.962628 | instance |
2026-04-18 16:41:03.962967 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-18 16:41:03.963245 | instance | Saturday 18 April 2026  16:41:03 +0000 (0:00:00.724)       0:00:26.031 ********
2026-04-18 16:41:07.058873 | instance | changed: [instance] => (item=osd0)
2026-04-18 16:41:07.059131 | instance | changed: [instance] => (item=osd1)
2026-04-18 16:41:07.059411 | instance | changed: [instance] => (item=osd2)
2026-04-18 16:41:07.059679 | instance |
2026-04-18 16:41:07.059962 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-18 16:41:07.060270 | instance | Saturday 18 April 2026  16:41:07 +0000 (0:00:03.096)       0:00:29.128 ********
2026-04-18 16:41:08.903178 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-18 16:41:08.903420 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-18 16:41:08.903711 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-18 16:41:08.904011 | instance |
2026-04-18 16:41:08.904305 | instance | PLAY RECAP *********************************************************************
2026-04-18 16:41:08.904677 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-18 16:41:08.904959 | instance |
2026-04-18 16:41:08.905260 | instance | Saturday 18 April 2026  16:41:08 +0000 (0:00:01.844)       0:00:30.973 ********
2026-04-18 16:41:08.905610 | instance | ===============================================================================
2026-04-18 16:41:08.905903 | instance | Install depedencies ---------------------------------------------------- 18.72s
2026-04-18 16:41:08.906201 | instance | Create a volume group for each loop device ------------------------------ 3.10s
2026-04-18 16:41:08.906418 | instance | Create a logical volume for each loop device ---------------------------- 1.84s
2026-04-18 16:41:08.906588 | instance | Gathering Facts --------------------------------------------------------- 1.16s
2026-04-18 16:41:08.906764 | instance | Purge "snapd" package --------------------------------------------------- 0.79s
2026-04-18 16:41:08.906939 | instance | Start loop devices ------------------------------------------------------ 0.72s
2026-04-18 16:41:08.907111 | instance | Gathering Facts --------------------------------------------------------- 0.71s
2026-04-18 16:41:08.907274 | instance | Configure short hostname ------------------------------------------------ 0.69s
2026-04-18 16:41:08.907447 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s
2026-04-18 16:41:08.907621 | instance | Set permissions on loopback devices ------------------------------------- 0.64s
2026-04-18 16:41:08.907791 | instance | Start up service -------------------------------------------------------- 0.59s
2026-04-18 16:41:08.907961 | instance | Create devices for Ceph ------------------------------------------------- 0.52s
2026-04-18 16:41:08.908134 | instance | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-04-18 16:41:08.908302 | instance | Generate lvm.conf ------------------------------------------------------- 0.29s
2026-04-18 16:41:08.908467 | instance | Get list of all loopback devices ---------------------------------------- 0.19s
2026-04-18 16:41:08.908664 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-04-18 16:41:08.969420 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-18 16:41:08.969989 | instance | INFO     Molecule executed 1 scenario (1 successful)
2026-04-18 16:41:09.515003 | instance | ok: Runtime: 0:01:15.999508
2026-04-18 16:41:09.519796 | 
2026-04-18 16:41:09.519843 | PLAY RECAP
2026-04-18 16:41:09.519894 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:41:09.519916 | 
2026-04-18 16:41:09.668098 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-18 16:41:09.672357 | RUN START: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main]
2026-04-18 16:41:10.283619 | 
2026-04-18 16:41:10.283781 | PLAY [all]
2026-04-18 16:41:10.295749 | 
2026-04-18 16:41:10.295837 | TASK [Build atmosphere binary]
2026-04-18 16:41:10.666954 | instance | go: downloading github.com/spf13/cobra v1.9.1
2026-04-18 16:41:10.675723 | instance | go: downloading golang.org/x/sync v0.18.0
2026-04-18 16:41:10.824411 | instance | go: downloading github.com/spf13/pflag v1.0.7
2026-04-18 16:41:17.843466 | instance | ok: Runtime: 0:00:06.893228
2026-04-18 16:41:17.853550 | 
2026-04-18 16:41:17.853619 | TASK [Deploy with parallel orchestrator]
2026-04-18 16:41:18.068050 | instance | ==> Multi-tag mode: kubernetes, csi
2026-04-18 16:41:18.068260 | instance | ==> Running preflight checks
2026-04-18 16:41:18.532441 | instance | [preflight]
2026-04-18 16:41:18.532478 | instance | [preflight] PLAY [Preflight checks] ********************************************************
2026-04-18 16:41:18.532490 | instance | [preflight]
2026-04-18 16:41:18.532496 | instance | [preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-04-18 16:41:18.561635 | instance | [preflight] skipping: [instance]
2026-04-18 16:41:18.561670 | instance | [preflight]
2026-04-18 16:41:18.561682 | instance | [preflight] PLAY RECAP *********************************************************************
2026-04-18 16:41:18.561703 | instance | [preflight] instance                   : ok=0    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-18 16:41:18.561715 | instance | [preflight]
2026-04-18 16:41:18.632558 | instance | ==> Preflight checks passed
2026-04-18 16:41:18.632780 | instance | ==> Starting parallel deployment (subgraph)
2026-04-18 16:41:18.632835 | instance | ==> [kubernetes] Starting deployment
2026-04-18 16:41:19.448501 | instance | [kubernetes]
2026-04-18 16:41:19.448603 | instance | [kubernetes] PLAY [all] *********************************************************************
2026-04-18 16:41:19.448615 | instance | [kubernetes]
2026-04-18 16:41:19.448625 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-18 16:41:20.837600 | instance | [kubernetes] [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-18 16:41:20.837672 | instance | [kubernetes] interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-18 16:41:20.837684 | instance | [kubernetes] interpreter could change the meaning of that path. See
2026-04-18 16:41:20.837695 | instance | [kubernetes] https://docs.ansible.com/ansible-
2026-04-18 16:41:20.837704 | instance | [kubernetes] core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:41:20.858328 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:20.858361 | instance | [kubernetes]
2026-04-18 16:41:20.858372 | instance | [kubernetes] TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************
2026-04-18 16:41:27.759301 | instance | [kubernetes] changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})
2026-04-18 16:41:27.759342 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})
2026-04-18 16:41:27.759347 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})
2026-04-18 16:41:27.759352 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})
2026-04-18 16:41:27.759361 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})
2026-04-18 16:41:27.759366 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})
2026-04-18 16:41:27.759371 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})
2026-04-18 16:41:27.759375 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})
2026-04-18 16:41:27.759379 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})
2026-04-18 16:41:27.759383 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})
2026-04-18 16:41:27.759387 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})
2026-04-18 16:41:27.759391 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})
2026-04-18 16:41:27.759395 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})
2026-04-18 16:41:27.759399 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})
2026-04-18 16:41:27.759403 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})
2026-04-18 16:41:27.759407 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})
2026-04-18 16:41:27.759422 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})
2026-04-18 16:41:27.759426 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})
2026-04-18 16:41:27.759430 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})
2026-04-18 16:41:27.759434 | instance | [kubernetes] changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})
2026-04-18 16:41:27.759438 | instance | [kubernetes]
2026-04-18 16:41:27.759443 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***
2026-04-18 16:41:28.173701 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:28.173775 | instance | [kubernetes]
2026-04-18 16:41:28.173787 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] *******
2026-04-18 16:41:28.912798 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:28.912994 | instance | [kubernetes]
2026-04-18 16:41:28.913003 | instance | [kubernetes] TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] **********************
2026-04-18 16:41:29.395589 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:29.395628 | instance | [kubernetes]
2026-04-18 16:41:29.395635 | instance | [kubernetes] TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-18 16:41:29.530830 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:29.530893 | instance | [kubernetes]
2026-04-18 16:41:29.530905 | instance | [kubernetes] PLAY [Configure Kubernetes VIP] ************************************************
2026-04-18 16:41:29.530915 | instance | [kubernetes]
2026-04-18 16:41:29.530925 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-18 16:41:30.549736 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:30.549797 | instance | [kubernetes]
2026-04-18 16:41:30.549809 | instance | [kubernetes] TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-04-18 16:41:30.856005 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:30.856048 | instance | [kubernetes]
2026-04-18 16:41:30.856058 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-04-18 16:41:32.319779 | instance | [kubernetes] ok: [instance] => (item=/etc/keepalived/keepalived.conf)
2026-04-18 16:41:32.319815 | instance | [kubernetes] ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)
2026-04-18 16:41:32.319821 | instance | [kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-04-18 16:41:32.319826 | instance | [kubernetes] ok: [instance] => (item=/etc/haproxy/haproxy.cfg)
2026-04-18 16:41:32.319830 | instance | [kubernetes] ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-04-18 16:41:32.319834 | instance | [kubernetes]
2026-04-18 16:41:32.319839 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-04-18 16:41:33.279412 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-04-18 16:41:33.279476 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-04-18 16:41:33.279496 | instance | [kubernetes] failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-04-18 16:41:33.279507 | instance | [kubernetes] ...ignoring
2026-04-18 16:41:33.279517 | instance | [kubernetes]
2026-04-18 16:41:33.279527 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-04-18 16:41:33.569119 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:33.569195 | instance | [kubernetes]
2026-04-18 16:41:33.569207 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-04-18 16:41:33.858565 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:33.858618 | instance | [kubernetes]
2026-04-18 16:41:33.858630 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-04-18 16:41:33.889383 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:33.889429 | instance | [kubernetes]
2026-04-18 16:41:33.889437 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-04-18 16:41:33.922946 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:33.922980 | instance | [kubernetes]
2026-04-18 16:41:33.922990 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-04-18 16:41:34.542601 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:34.542672 | instance | [kubernetes]
2026-04-18 16:41:34.542684 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-04-18 16:41:34.919924 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:34.919968 | instance | [kubernetes]
2026-04-18 16:41:34.919975 | instance | [kubernetes] TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-04-18 16:41:34.919980 | instance | [kubernetes]
2026-04-18 16:41:34.919984 | instance | [kubernetes] PLAY [Install Kubernetes] ******************************************************
2026-04-18 16:41:34.919988 | instance | [kubernetes]
2026-04-18 16:41:34.919992 | instance | [kubernetes] TASK [Gathering Facts] *********************************************************
2026-04-18 16:41:35.915814 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:35.915875 | instance | [kubernetes]
2026-04-18 16:41:35.915883 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:41:36.220609 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:36.220667 | instance | [kubernetes]
2026-04-18 16:41:36.220679 | instance | [kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:41:36.260948 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:36.261007 | instance | [kubernetes]
2026-04-18 16:41:36.261019 | instance | [kubernetes] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-18 16:41:36.576689 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:36.576763 | instance | [kubernetes]
2026-04-18 16:41:36.576796 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:41:36.713837 | instance | [kubernetes] ok: [instance] => {
2026-04-18 16:41:36.713912 | instance | [kubernetes]     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-18 16:41:36.713925 | instance | [kubernetes] }
2026-04-18 16:41:36.713935 | instance | [kubernetes]
2026-04-18 16:41:36.713945 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:41:38.233129 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:38.233330 | instance | [kubernetes]
2026-04-18 16:41:38.233345 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:41:38.270251 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:38.270304 | instance | [kubernetes]
2026-04-18 16:41:38.270316 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:41:38.560989 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:38.561049 | instance | [kubernetes]
2026-04-18 16:41:38.561061 | instance | [kubernetes] TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:41:39.769152 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:39.769197 | instance | [kubernetes]
2026-04-18 16:41:39.769202 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:41:39.834197 | instance | [kubernetes] ok: [instance] => {
2026-04-18 16:41:39.834271 | instance | [kubernetes]     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz"
2026-04-18 16:41:39.834283 | instance | [kubernetes] }
2026-04-18 16:41:39.834319 | instance | [kubernetes]
2026-04-18 16:41:39.834340 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:41:40.758829 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:40.758885 | instance | [kubernetes]
2026-04-18 16:41:40.758897 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:41:43.616878 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:43.616932 | instance | [kubernetes]
2026-04-18 16:41:43.616944 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-18 16:41:43.643573 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:43.643618 | instance | [kubernetes]
2026-04-18 16:41:43.643626 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-18 16:41:43.673254 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:43.673303 | instance | [kubernetes]
2026-04-18 16:41:43.673310 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-18 16:41:43.702801 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:43.702851 | instance | [kubernetes]
2026-04-18 16:41:43.702858 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-18 16:41:49.164538 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:49.164692 | instance | [kubernetes]
2026-04-18 16:41:49.164699 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-18 16:41:49.743005 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:49.743079 | instance | [kubernetes]
2026-04-18 16:41:49.743092 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-18 16:41:51.168209 | instance | [kubernetes] changed: [instance] => (item={'path': '/etc/containerd'})
2026-04-18 16:41:51.168277 | instance | [kubernetes] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-18 16:41:51.168295 | instance | [kubernetes] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-18 16:41:51.168309 | instance | [kubernetes] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-18 16:41:51.168325 | instance | [kubernetes] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-18 16:41:51.168340 | instance | [kubernetes]
2026-04-18 16:41:51.168354 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-18 16:41:51.842554 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:51.842616 | instance | [kubernetes]
2026-04-18 16:41:51.842628 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-18 16:41:51.842638 | instance | [kubernetes]
2026-04-18 16:41:51.842648 | instance | [kubernetes] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-18 16:41:52.643208 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:52.643284 | instance | [kubernetes]
2026-04-18 16:41:52.643297 | instance | [kubernetes] RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-04-18 16:41:53.463415 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:53.463456 | instance | [kubernetes]
2026-04-18 16:41:53.463462 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-18 16:41:55.134171 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:55.134248 | instance | [kubernetes]
2026-04-18 16:41:55.134263 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-04-18 16:41:56.021510 | instance | [kubernetes] An exception occurred during task execution. To see the full traceback, use -vvv. The error was: ansible_collections.kubernetes.core.plugins.module_utils.k8s.exceptions.CoreException: Could not create API client: Invalid kube-config file. No configuration found.
2026-04-18 16:41:56.021610 | instance | [kubernetes] fatal: [instance]: FAILED! => {"changed": false, "msg": "Could not create API client: Invalid kube-config file. No configuration found."}
2026-04-18 16:41:56.021651 | instance | [kubernetes] ...ignoring
2026-04-18 16:41:56.021662 | instance | [kubernetes]
2026-04-18 16:41:56.021673 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-04-18 16:41:56.058946 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:56.059037 | instance | [kubernetes]
2026-04-18 16:41:56.059044 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-04-18 16:41:56.093086 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:56.093123 | instance | [kubernetes]
2026-04-18 16:41:56.093136 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-04-18 16:41:56.128375 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:56.128416 | instance | [kubernetes]
2026-04-18 16:41:56.128423 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-04-18 16:41:56.165292 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:56.165334 | instance | [kubernetes]
2026-04-18 16:41:56.165347 | instance | [kubernetes] TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-04-18 16:41:56.212016 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:56.212052 | instance | [kubernetes]
2026-04-18 16:41:56.212064 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:41:56.524402 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:56.524458 | instance | [kubernetes]
2026-04-18 16:41:56.524469 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:41:56.569427 | instance | [kubernetes] ok: [instance] => {
2026-04-18 16:41:56.569460 | instance | [kubernetes]     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm"
2026-04-18 16:41:56.569471 | instance | [kubernetes] }
2026-04-18 16:41:56.569481 | instance | [kubernetes]
2026-04-18 16:41:56.569490 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:41:57.470582 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:57.470649 | instance | [kubernetes]
2026-04-18 16:41:57.470661 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:41:57.516205 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:57.516270 | instance | [kubernetes]
2026-04-18 16:41:57.516282 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:41:57.819967 | instance | [kubernetes] ok: [instance]
2026-04-18 16:41:57.820028 | instance | [kubernetes]
2026-04-18 16:41:57.820036 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:41:57.866684 | instance | [kubernetes] ok: [instance] => {
2026-04-18 16:41:57.866734 | instance | [kubernetes]     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl"
2026-04-18 16:41:57.866747 | instance | [kubernetes] }
2026-04-18 16:41:57.866760 | instance | [kubernetes]
2026-04-18 16:41:57.866773 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:41:58.797179 | instance | [kubernetes] changed: [instance]
2026-04-18 16:41:58.797249 | instance | [kubernetes]
2026-04-18 16:41:58.797264 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:41:58.852133 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:58.852193 | instance | [kubernetes]
2026-04-18 16:41:58.852204 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-18 16:41:58.887037 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:58.887068 | instance | [kubernetes]
2026-04-18 16:41:58.887079 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-18 16:41:58.920171 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:58.920210 | instance | [kubernetes]
2026-04-18 16:41:58.920223 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-18 16:41:58.950667 | instance | [kubernetes] skipping: [instance]
2026-04-18 16:41:58.950722 | instance | [kubernetes]
2026-04-18 16:41:58.950734 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-18 16:42:00.054341 | instance | [kubernetes] ok: [instance]
2026-04-18 16:42:00.054408 | instance | [kubernetes]
2026-04-18 16:42:00.054449 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-18 16:42:00.609837 | instance | [kubernetes] ok: [instance]
2026-04-18 16:42:00.609887 | instance | [kubernetes]
2026-04-18 16:42:00.609899 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-18 16:42:01.957975 | instance | [kubernetes] ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-18 16:42:01.958035 | instance | [kubernetes] ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-18 16:42:01.958047 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-18 16:42:01.958057 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-18 16:42:01.958097 | instance | [kubernetes] ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-18 16:42:01.958107 | instance | [kubernetes]
2026-04-18 16:42:01.958117 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-18 16:42:02.564114 | instance | [kubernetes] ok: [instance]
2026-04-18 16:42:02.565577 | instance | [kubernetes]
2026-04-18 16:42:02.565593 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-18 16:42:02.565600 | instance | [kubernetes]
2026-04-18 16:42:02.565605 | instance | [kubernetes] TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-18 16:42:03.010902 | instance | [kubernetes] ok: [instance]
2026-04-18 16:42:03.010969 | instance | [kubernetes]
2026-04-18 16:42:03.010980 | instance | [kubernetes] TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:42:03.324090 | instance | [kubernetes] ok: [instance]
2026-04-18 16:42:03.324166 | instance | [kubernetes]
2026-04-18 16:42:03.324178 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:42:03.379081 | instance | [kubernetes] ok: [instance] => {
2026-04-18 16:42:03.379122 | instance | [kubernetes]     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz"
2026-04-18 16:42:03.379138 | instance | [kubernetes] }
2026-04-18 16:42:03.379151 | instance | [kubernetes]
2026-04-18 16:42:03.379193 | instance | [kubernetes] TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:42:35.549971 | instance | [kubernetes] FAILED - RETRYING: [instance]: Download item (4 retries left).
2026-04-18 16:42:35.550082 | instance | [kubernetes] FAILED - RETRYING: [instance]: Download item (3 retries left).
2026-04-18 16:42:35.550091 | instance | [kubernetes] FAILED - RETRYING: [instance]: Download item (2 retries left).
2026-04-18 16:42:35.550098 | instance | [kubernetes] FAILED - RETRYING: [instance]: Download item (1 retries left).
2026-04-18 16:42:35.550105 | instance | [kubernetes] fatal: [instance]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-04-18 16:42:35.550113 | instance | [kubernetes]
2026-04-18 16:42:35.550121 | instance | [kubernetes] PLAY RECAP *********************************************************************
2026-04-18 16:42:35.550130 | instance | [kubernetes] instance                   : ok=47   changed=16   unreachable=0    failed=1    skipped=15   rescued=0    ignored=2
2026-04-18 16:42:35.550137 | instance | [kubernetes]
2026-04-18 16:42:35.658897 | instance | Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2
2026-04-18 16:42:35.658975 | instance | Usage:
2026-04-18 16:42:35.658988 | instance |   atmosphere deploy [flags]
2026-04-18 16:42:35.658999 | instance |
2026-04-18 16:42:35.659009 | instance | Flags:
2026-04-18 16:42:35.659019 | instance |       --concurrency int    Max concurrent deployments per wave (0 = unlimited)
2026-04-18 16:42:35.659051 | instance |   -h, --help               help for deploy
2026-04-18 16:42:35.659062 | instance |   -i, --inventory string   Path to Ansible inventory file (required)
2026-04-18 16:42:35.659072 | instance |   -t, --tags string        Comma-separated list of component tags to deploy
2026-04-18 16:42:35.659082 | instance |
2026-04-18 16:42:35.659092 | instance | component kubernetes failed: ansible-playbook failed for kubernetes: exit status 2
2026-04-18 16:42:36.008681 | instance | ERROR
2026-04-18 16:42:36.009638 | instance | {
2026-04-18 16:42:36.009680 | instance |   "delta": "0:01:17.601834",
2026-04-18 16:42:36.009704 | instance |   "end": "2026-04-18 16:42:35.660146",
2026-04-18 16:42:36.009723 | instance |   "msg": "non-zero return code",
2026-04-18 16:42:36.009740 | instance |   "rc": 1,
2026-04-18 16:42:36.009758 | instance |   "start": "2026-04-18 16:41:18.058312"
2026-04-18 16:42:36.009778 | instance | }
failure
2026-04-18 16:42:36.014963 | 
2026-04-18 16:42:36.015015 | PLAY RECAP
2026-04-18 16:42:36.015077 | instance | ok: 1 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:42:36.015103 | 
2026-04-18 16:42:36.159696 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/molecule/csi/converge.yml@main]
2026-04-18 16:42:36.161945 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-18 16:42:36.767372 | 
2026-04-18 16:42:36.767547 | PLAY [all]
2026-04-18 16:42:36.782261 | 
2026-04-18 16:42:36.782378 | TASK [gather-host-logs : creating directory for system status]
2026-04-18 16:42:37.168479 | instance | changed
2026-04-18 16:42:37.177407 | 
2026-04-18 16:42:37.177511 | TASK [gather-host-logs : Get logs for each host]
2026-04-18 16:42:37.550236 | instance | + systemd-cgls --full --all --no-pager
2026-04-18 16:42:37.561466 | instance | + ip addr
2026-04-18 16:42:37.564022 | instance | + ip route
2026-04-18 16:42:37.566152 | instance | + lsblk
2026-04-18 16:42:37.569780 | instance | + mount
2026-04-18 16:42:37.571635 | instance | + docker images
2026-04-18 16:42:37.572221 | instance | /bin/bash: line 7: docker: command not found
2026-04-18 16:42:37.572462 | instance | + brctl show
2026-04-18 16:42:37.573085 | instance | /bin/bash: line 8: brctl: command not found
2026-04-18 16:42:37.573358 | instance | + ps aux --sort=-%mem
2026-04-18 16:42:37.586628 | instance | + dpkg -l
2026-04-18 16:42:37.594710 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-18 16:42:37.595345 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-18 16:42:37.595442 | instance | /bin/bash: line 11: docker: command not found
2026-04-18 16:42:37.595839 | instance | + '[' '!' -z '' ']'
2026-04-18 16:42:37.718889 | instance | ok: Runtime: 0:00:00.051389
2026-04-18 16:42:37.725639 | 
2026-04-18 16:42:37.725711 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-18 16:42:38.390159 | instance | changed:
2026-04-18 16:42:38.390499 | instance | created directory /var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/logs/instance
2026-04-18 16:42:38.390565 | instance | cd+++++++++ system/
2026-04-18 16:42:38.390614 | instance | >f+++++++++ system/brctl-show.txt
2026-04-18 16:42:38.390660 | instance | >f+++++++++ system/docker-images.txt
2026-04-18 16:42:38.390711 | instance | >f+++++++++ system/ip-addr.txt
2026-04-18 16:42:38.390778 | instance | >f+++++++++ system/ip-route.txt
2026-04-18 16:42:38.390830 | instance | >f+++++++++ system/lsblk.txt
2026-04-18 16:42:38.390876 | instance | >f+++++++++ system/mount.txt
2026-04-18 16:42:38.390923 | instance | >f+++++++++ system/packages.txt
2026-04-18 16:42:38.390997 | instance | >f+++++++++ system/ps.txt
2026-04-18 16:42:38.391044 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-18 16:42:38.400517 | 
2026-04-18 16:42:38.400586 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-18 16:42:38.603354 | instance | changed: "values"
2026-04-18 16:42:38.778576 | instance | changed: "releases"
2026-04-18 16:42:38.797278 | 
2026-04-18 16:42:38.797536 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-18 16:42:39.051501 | instance | E0418 16:42:39.051381   13078 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:39.052537 | instance | E0418 16:42:39.052484   13078 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:39.053274 | instance | E0418 16:42:39.053235   13078 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:39.055068 | instance | E0418 16:42:39.055040   13078 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:39.055774 | instance | E0418 16:42:39.055746   13078 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:39.056955 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:39.338028 | instance | ok: Runtime: 0:00:00.060943
2026-04-18 16:42:39.343397 | 
2026-04-18 16:42:39.343466 | TASK [helm-release-status : Downloads logs to executor]
2026-04-18 16:42:39.823222 | instance | changed:
2026-04-18 16:42:39.823471 | instance | cd+++++++++ helm/
2026-04-18 16:42:39.823510 | instance | cd+++++++++ helm/releases/
2026-04-18 16:42:39.823542 | instance | cd+++++++++ helm/values/
2026-04-18 16:42:39.834921 | 
2026-04-18 16:42:39.835007 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-18 16:42:40.034392 | instance | changed
2026-04-18 16:42:40.042065 | 
2026-04-18 16:42:40.042220 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-18 16:42:40.264109 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-18 16:42:40.264629 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-18 16:42:40.268842 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-18 16:42:40.270086 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-18 16:42:40.315789 | instance | E0418 16:42:40.315195   13130 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.316059 | instance | E0418 16:42:40.315961   13130 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.317711 | instance | E0418 16:42:40.317397   13130 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.317739 | instance | E0418 16:42:40.317680   13130 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.318962 | instance | E0418 16:42:40.318816   13130 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.318981 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:40.323863 | instance | E0418 16:42:40.323760   13128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.324473 | instance | E0418 16:42:40.324431   13128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.326030 | instance | E0418 16:42:40.325995   13128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.326642 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-18 16:42:40.326939 | instance | E0418 16:42:40.326894   13128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.328876 | instance | E0418 16:42:40.328805   13128 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.329100 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:40.336533 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-18 16:42:40.382743 | instance | E0418 16:42:40.382623   13151 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.383446 | instance | E0418 16:42:40.383416   13151 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.385272 | instance | E0418 16:42:40.385229   13151 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.385799 | instance | E0418 16:42:40.385769   13151 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.387436 | instance | E0418 16:42:40.387386   13151 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.387500 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:40.395815 | instance | E0418 16:42:40.395742   13159 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.395981 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-18 16:42:40.396194 | instance | E0418 16:42:40.396164   13159 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.397790 | instance | E0418 16:42:40.397757   13159 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.398446 | instance | E0418 16:42:40.398395   13159 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.400066 | instance | E0418 16:42:40.400029   13159 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.400122 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:40.448048 | instance | E0418 16:42:40.447892   13174 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.448825 | instance | E0418 16:42:40.448777   13174 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.450716 | instance | E0418 16:42:40.450665   13174 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.451286 | instance | E0418 16:42:40.451246   13174 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.453313 | instance | E0418 16:42:40.453261   13174 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:40.453342 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:40.580799 | instance | ok: Runtime: 0:00:00.203313
2026-04-18 16:42:40.588310 | 
2026-04-18 16:42:40.588427 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-18 16:42:40.805028 | instance | changed
2026-04-18 16:42:40.812029 | 
2026-04-18 16:42:40.812146 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-18 16:42:41.074571 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-18 16:42:41.075098 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-18 16:42:41.075158 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-18 16:42:41.126575 | instance | E0418 16:42:41.126444   13204 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:41.127098 | instance | E0418 16:42:41.127041   13204 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:41.128681 | instance | E0418 16:42:41.128636   13204 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:41.129952 | instance | E0418 16:42:41.129565   13204 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:41.131894 | instance | E0418 16:42:41.131819   13204 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:41.131942 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:41.399192 | instance | ok: Runtime: 0:00:00.069186
2026-04-18 16:42:41.405674 | 
2026-04-18 16:42:41.405739 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-18 16:42:41.884404 | instance | changed:
2026-04-18 16:42:41.884645 | instance | cd+++++++++ objects/
2026-04-18 16:42:41.884684 | instance | cd+++++++++ objects/cluster/
2026-04-18 16:42:41.884716 | instance | cd+++++++++ objects/namespaced/
2026-04-18 16:42:41.896028 | 
2026-04-18 16:42:41.896091 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-18 16:42:42.102995 | instance | changed
2026-04-18 16:42:42.109808 | 
2026-04-18 16:42:42.109896 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-18 16:42:42.310474 | instance | changed
2026-04-18 16:42:42.315561 | 
2026-04-18 16:42:42.315635 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-18 16:42:42.583300 | instance | E0418 16:42:42.583137   13258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:42.584421 | instance | E0418 16:42:42.584385   13258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:42.585156 | instance | E0418 16:42:42.585107   13258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:42.587275 | instance | E0418 16:42:42.587223   13258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:42.588468 | instance | E0418 16:42:42.588429   13258 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:42.588570 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:42.850853 | instance | ok: Runtime: 0:00:00.071454
2026-04-18 16:42:42.857347 | 
2026-04-18 16:42:42.857410 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-18 16:42:43.337567 | instance | changed:
2026-04-18 16:42:43.337751 | instance | cd+++++++++ pod-logs/
2026-04-18 16:42:43.337793 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-18 16:42:43.349958 | 
2026-04-18 16:42:43.350025 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-18 16:42:43.565784 | instance | changed
2026-04-18 16:42:43.574107 | 
2026-04-18 16:42:43.574177 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-18 16:42:43.856042 | instance | E0418 16:42:43.855871   13300 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:43.857065 | instance | E0418 16:42:43.857011   13300 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:43.857675 | instance | E0418 16:42:43.857628   13300 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:43.859871 | instance | E0418 16:42:43.859832   13300 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:43.860730 | instance | E0418 16:42:43.860675   13300 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:43.861961 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:44.110471 | instance | ok: Runtime: 0:00:00.077019
2026-04-18 16:42:44.116269 | 
2026-04-18 16:42:44.116335 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-18 16:42:44.378388 | instance | E0418 16:42:44.378288   13323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.379134 | instance | E0418 16:42:44.379117   13323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.380836 | instance | E0418 16:42:44.380799   13323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.381280 | instance | E0418 16:42:44.381259   13323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.382809 | instance | E0418 16:42:44.382792   13323 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.382891 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:44.388993 | instance | ceph-mgr endpoints:
2026-04-18 16:42:44.651867 | instance | ok: Runtime: 0:00:00.072978
2026-04-18 16:42:44.658805 | 
2026-04-18 16:42:44.658894 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-18 16:42:44.942509 | instance | E0418 16:42:44.942346   13345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.943284 | instance | E0418 16:42:44.943248   13345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.945337 | instance | E0418 16:42:44.945286   13345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.946034 | instance | E0418 16:42:44.945985   13345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.947902 | instance | E0418 16:42:44.947871   13345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-18 16:42:44.948021 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-18 16:42:45.195726 | instance | ok: Runtime: 0:00:00.072856
2026-04-18 16:42:45.200542 | 
2026-04-18 16:42:45.200603 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-18 16:42:45.700084 | instance | changed: cd+++++++++ prometheus/
2026-04-18 16:42:45.709134 | 
2026-04-18 16:42:45.709199 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-18 16:42:45.917423 | instance | changed
2026-04-18 16:42:45.922246 | 
2026-04-18 16:42:45.922309 | TASK [gather-selenium-data : Get selenium data]
2026-04-18 16:42:46.124314 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-18 16:42:46.125758 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-18 16:42:46.458551 | instance | ERROR
2026-04-18 16:42:46.458848 | instance | {
2026-04-18 16:42:46.458913 | instance |   "delta": "0:00:00.005323",
2026-04-18 16:42:46.458960 | instance |   "end": "2026-04-18 16:42:46.126058",
2026-04-18 16:42:46.459003 | instance |   "msg": "non-zero return code",
2026-04-18 16:42:46.459043 | instance |   "rc": 1,
2026-04-18 16:42:46.459082 | instance |   "start": "2026-04-18 16:42:46.120735"
2026-04-18 16:42:46.459121 | instance | }
2026-04-18 16:42:46.459172 | instance | ERROR: Ignoring Errors
2026-04-18 16:42:46.467972 | 
2026-04-18 16:42:46.468034 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-18 16:42:46.943509 | instance | changed: cd+++++++++ selenium/
2026-04-18 16:42:46.949392 | 
2026-04-18 16:42:46.949444 | PLAY RECAP
2026-04-18 16:42:46.949489 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-18 16:42:46.949513 | 
2026-04-18 16:42:47.053573 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-18 16:42:47.058081 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:42:47.651412 | 
2026-04-18 16:42:47.651586 | PLAY [all]
2026-04-18 16:42:47.663918 | 
2026-04-18 16:42:47.664000 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-18 16:42:47.710835 | instance | skipping: Conditional result was False
2026-04-18 16:42:47.721826 | 
2026-04-18 16:42:47.722002 | TASK [fetch-output : Set log path for single node]
2026-04-18 16:42:47.762463 | instance | ok
2026-04-18 16:42:47.767294 | 
2026-04-18 16:42:47.767378 | LOOP [fetch-output : Ensure local output dirs]
2026-04-18 16:42:48.176082 | instance -> localhost | ok: "/var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/logs"
2026-04-18 16:42:48.385311 | instance -> localhost | changed: "/var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/artifacts"
2026-04-18 16:42:48.598487 | instance -> localhost | changed: "/var/lib/zuul/builds/14c6e97120144ccc81137568fd051220/work/docs"
2026-04-18 16:42:48.616854 | 
2026-04-18 16:42:48.617667 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-18 16:42:49.246077 | instance | changed: .d..t...... ./
2026-04-18 16:42:49.246318 | instance | changed: All items complete
2026-04-18 16:42:49.246357 | 
2026-04-18 16:42:49.687161 | instance | changed: .d..t...... ./
2026-04-18 16:42:50.126811 | instance | changed: .d..t...... ./
2026-04-18 16:42:50.149368 | 
2026-04-18 16:42:50.149548 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-18 16:42:50.591572 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.008133
2026-04-18 16:42:50.830575 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008455
2026-04-18 16:42:50.849207 | 
2026-04-18 16:42:50.849363 | PLAY [all]
2026-04-18 16:42:50.855835 | 
2026-04-18 16:42:50.855902 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-18 16:42:51.276926 | instance | changed
2026-04-18 16:42:51.282534 | 
2026-04-18 16:42:51.282590 | PLAY RECAP
2026-04-18 16:42:51.282643 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:42:51.282666 | 
2026-04-18 16:42:51.433615 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:42:51.438038 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-18 16:42:51.979663 | 
2026-04-18 16:42:51.979775 | PLAY [localhost]
2026-04-18 16:42:51.989540 | 
2026-04-18 16:42:51.989613 | TASK [Generate Zuul manifest]
2026-04-18 16:42:52.022819 | localhost | ok
2026-04-18 16:42:52.039861 | 
2026-04-18 16:42:52.039975 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-18 16:42:52.357075 | localhost | changed
2026-04-18 16:42:52.369034 | 
2026-04-18 16:42:52.369113 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-18 16:42:52.401007 | localhost | ok
2026-04-18 16:42:52.409627 | 
2026-04-18 16:42:52.409721 | TASK [Upload logs]
2026-04-18 16:42:52.433214 | localhost | ok
2026-04-18 16:42:52.490695 | 
2026-04-18 16:42:52.490804 | TASK [Set zuul-log-path fact]
2026-04-18 16:42:52.512634 | localhost | ok
2026-04-18 16:42:52.524899 | 
2026-04-18 16:42:52.524986 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:42:52.556298 | localhost | ok
2026-04-18 16:42:52.565864 | 
2026-04-18 16:42:52.565960 | TASK [upload-logs : Create log directories]
2026-04-18 16:42:52.981639 | localhost | changed
2026-04-18 16:42:52.987162 | 
2026-04-18 16:42:52.987229 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-18 16:42:53.373335 | localhost -> localhost | ok: Runtime: 0:00:00.007169
2026-04-18 16:42:53.380529 | 
2026-04-18 16:42:53.380618 | TASK [upload-logs : Upload logs to log server]
2026-04-18 16:42:53.858378 | localhost | Output suppressed because no_log was given
2026-04-18 16:42:53.863267 | 
2026-04-18 16:42:53.863356 | LOOP [upload-logs : Compress console log and json output]
2026-04-18 16:42:53.902632 | localhost | skipping: Conditional result was False
2026-04-18 16:42:53.909114 | localhost | skipping: Conditional result was False
2026-04-18 16:42:53.919336 | 
2026-04-18 16:42:53.919531 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-18 16:42:53.953580 | localhost | skipping: Conditional result was False
2026-04-18 16:42:53.954223 | 
2026-04-18 16:42:53.957243 | localhost | skipping: Conditional result was False
2026-04-18 16:42:53.973233 | 
2026-04-18 16:42:53.973426 | LOOP [upload-logs : Upload console log and json output]