2026-04-17 08:19:57.068829 | Job console starting 2026-04-17 08:19:57.128452 | Updating git repos 2026-04-17 08:19:57.208929 | Cloning repos into workspace 2026-04-17 08:19:57.427679 | Restoring repo states 2026-04-17 08:19:57.446695 | Merging changes 2026-04-17 08:19:58.364478 | Checking out repos 2026-04-17 08:19:58.460030 | Preparing playbooks 2026-04-17 08:20:03.677720 | Running Ansible setup 2026-04-17 08:20:08.947836 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-17 08:20:09.547234 | 2026-04-17 08:20:09.547358 | PLAY [localhost] 2026-04-17 08:20:09.555950 | 2026-04-17 08:20:09.556043 | TASK [Gathering Facts] 2026-04-17 08:20:10.445626 | localhost | ok 2026-04-17 08:20:10.456491 | 2026-04-17 08:20:10.456670 | TASK [Setup log path fact] 2026-04-17 08:20:10.478199 | localhost | ok 2026-04-17 08:20:10.490196 | 2026-04-17 08:20:10.490303 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-17 08:20:10.520899 | localhost | ok 2026-04-17 08:20:10.531020 | 2026-04-17 08:20:10.550725 | TASK [emit-job-header : Print job information] 2026-04-17 08:20:10.593435 | # Job Information 2026-04-17 08:20:10.597388 | Ansible Version: 2.16.16 2026-04-17 08:20:10.597464 | Job: atmosphere-molecule-csi-rbd 2026-04-17 08:20:10.597502 | Pipeline: check 2026-04-17 08:20:10.597533 | Executor: 0a8996d2b663 2026-04-17 08:20:10.597563 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3834 2026-04-17 08:20:10.597597 | Event ID: 22e760f0-3a36-11f1-880d-f7c84e8af0b2 2026-04-17 08:20:10.601620 | 2026-04-17 08:20:10.601713 | LOOP [emit-job-header : Print node information] 2026-04-17 08:20:10.711842 | localhost | ok: 2026-04-17 08:20:10.712089 | localhost | # Node Information 2026-04-17 08:20:10.712133 | localhost | Inventory Hostname: instance 2026-04-17 08:20:10.712165 | localhost | Hostname: np0000167013 2026-04-17 08:20:10.712195 | localhost | Username: zuul 2026-04-17 08:20:10.712229 | localhost | Distro: Ubuntu 22.04 2026-04-17 08:20:10.712259 | localhost | Provider: yul1 2026-04-17 08:20:10.712287 | localhost | Region: ca-ymq-1 2026-04-17 08:20:10.712315 | localhost | Label: ubuntu-jammy 2026-04-17 08:20:10.712342 | localhost | Product Name: OpenStack Nova 2026-04-17 08:20:10.712369 | localhost | Interface IP: 199.204.45.244 2026-04-17 08:20:10.730296 | 2026-04-17 08:20:10.730478 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-17 08:20:11.197567 | localhost -> localhost | changed 2026-04-17 08:20:11.216714 | 2026-04-17 08:20:11.216813 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-17 08:20:12.147738 | localhost -> localhost | changed 2026-04-17 08:20:12.156360 | 2026-04-17 08:20:12.156435 | PLAY [all] 2026-04-17 08:20:12.171892 | 2026-04-17 08:20:12.171963 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-17 08:20:12.409155 | instance -> localhost | ok 2026-04-17 08:20:12.420590 | 2026-04-17 08:20:12.420709 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-17 08:20:12.451290 | instance | ok 2026-04-17 08:20:12.475910 | instance | included: /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-17 08:20:12.481236 | 2026-04-17 08:20:12.481296 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-17 08:20:13.313188 | instance -> localhost | Generating public/private rsa key pair. 2026-04-17 08:20:13.313345 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/340593059d78467c81c457e6a42273a1_id_rsa 2026-04-17 08:20:13.313374 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/340593059d78467c81c457e6a42273a1_id_rsa.pub 2026-04-17 08:20:13.313396 | instance -> localhost | The key fingerprint is: 2026-04-17 08:20:13.313417 | instance -> localhost | SHA256:hlvssR/P4PQeNJvZl2dV07xDGZmaOyM9sw8BUNEHYms zuul-build-sshkey 2026-04-17 08:20:13.313450 | instance -> localhost | The key's randomart image is: 2026-04-17 08:20:13.313471 | instance -> localhost | +---[RSA 3072]----+ 2026-04-17 08:20:13.313495 | instance -> localhost | | ..=o...o| 2026-04-17 08:20:13.313516 | instance -> localhost | | o o. =+| 2026-04-17 08:20:13.313536 | instance -> localhost | | E +++| 2026-04-17 08:20:13.313556 | instance -> localhost | | o . .o. +| 2026-04-17 08:20:13.313575 | instance -> localhost | | . S +..o.| 2026-04-17 08:20:13.313594 | instance -> localhost | | = o o &. +| 2026-04-17 08:20:13.313614 | instance -> localhost | | . o + *.B.+| 2026-04-17 08:20:13.313632 | instance -> localhost | | + * o.o.| 2026-04-17 08:20:13.313654 | instance -> localhost | | o.= .. | 2026-04-17 08:20:13.313674 | instance -> localhost | +----[SHA256]-----+ 2026-04-17 08:20:13.313722 | instance -> localhost | ok: Runtime: 0:00:00.390972 2026-04-17 08:20:13.318524 | 2026-04-17 08:20:13.318585 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-17 08:20:13.351695 | instance | ok 2026-04-17 08:20:13.362837 | instance | included: /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-17 08:20:13.370084 | 2026-04-17 08:20:13.370143 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-17 08:20:13.393859 | instance | skipping: Conditional result was False 2026-04-17 08:20:13.403920 | 2026-04-17 08:20:13.403982 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-17 08:20:13.822538 | instance | changed 2026-04-17 08:20:13.829214 | 2026-04-17 08:20:13.829308 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-17 08:20:14.015845 | instance | ok 2026-04-17 08:20:14.020837 | 2026-04-17 08:20:14.020909 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-17 08:20:14.488818 | instance | changed 2026-04-17 08:20:14.495916 | 2026-04-17 08:20:14.496010 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-17 08:20:14.961693 | instance | changed 2026-04-17 08:20:14.967729 | 2026-04-17 08:20:14.967796 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-17 08:20:14.992098 | instance | skipping: Conditional result was False 2026-04-17 08:20:15.067586 | 2026-04-17 08:20:15.067795 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-17 08:20:15.460137 | instance -> localhost | changed 2026-04-17 08:20:15.470442 | 2026-04-17 08:20:15.470565 | TASK [add-build-sshkey : Add back temp key] 2026-04-17 08:20:15.791670 | instance -> localhost | Identity added: /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/340593059d78467c81c457e6a42273a1_id_rsa (zuul-build-sshkey) 2026-04-17 08:20:15.791934 | instance -> localhost | ok: Runtime: 0:00:00.015641 2026-04-17 08:20:15.802123 | 2026-04-17 08:20:15.802206 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-17 08:20:16.122283 | instance | ok 2026-04-17 08:20:16.128790 | 2026-04-17 08:20:16.128891 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-17 08:20:16.163675 | instance | skipping: Conditional result was False 2026-04-17 08:20:16.178004 | 2026-04-17 08:20:16.178178 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-17 08:20:16.495670 | instance | ok 2026-04-17 08:20:16.539987 | 2026-04-17 08:20:16.540067 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-17 08:20:18.300624 | instance | Output suppressed because no_log was given 2026-04-17 08:20:18.318380 | 2026-04-17 08:20:18.318541 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-17 08:20:18.516052 | instance | ok: "logs" 2026-04-17 08:20:18.548111 | instance | ok: All items complete 2026-04-17 08:20:18.548236 | 2026-04-17 08:20:18.662286 | instance | ok: "artifacts" 2026-04-17 08:20:18.928310 | instance | ok: "docs" 2026-04-17 08:20:18.948464 | 2026-04-17 08:20:18.948674 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-17 08:20:19.135798 | instance | changed: "logs" 2026-04-17 08:20:19.290297 | instance | changed: "artifacts" 2026-04-17 08:20:19.440398 | instance | changed: "docs" 2026-04-17 08:20:19.459142 | 2026-04-17 08:20:19.459284 | PLAY RECAP 2026-04-17 08:20:19.459337 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-17 08:20:19.459367 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 08:20:19.459387 | 2026-04-17 08:20:19.644988 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-17 08:20:19.649019 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-17 08:20:20.218796 | 2026-04-17 08:20:20.265322 | PLAY [all] 2026-04-17 08:20:20.282136 | 2026-04-17 08:20:20.282239 | TASK [setup-uv : Extract archive] 2026-04-17 08:20:22.792089 | instance | changed 2026-04-17 08:20:23.181395 | 2026-04-17 08:20:23.181540 | TASK [setup-uv : Print version] 2026-04-17 08:20:24.054397 | instance | uv 0.8.13 2026-04-17 08:20:23.723781 | instance | ok: Runtime: 0:00:00.012878 2026-04-17 08:20:23.732631 | 2026-04-17 08:20:23.732726 | PLAY RECAP 2026-04-17 08:20:23.732793 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 08:20:23.732830 | 2026-04-17 08:20:23.867952 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-17 08:20:23.940371 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-17 08:20:24.514246 | 2026-04-17 08:20:24.514362 | PLAY [all] 2026-04-17 08:20:24.525176 | 2026-04-17 08:20:24.525252 | TASK [Install "jq" for log collection] 2026-04-17 08:21:40.367124 | instance | changed 2026-04-17 08:21:40.372690 | 2026-04-17 08:21:40.372786 | TASK [Install pip3 for Python package management] 2026-04-17 08:21:44.819124 | instance | changed 2026-04-17 08:21:44.826633 | 2026-04-17 08:21:44.826729 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-17 08:21:47.965210 | instance | changed 2026-04-17 08:21:47.967808 | 2026-04-17 08:21:47.967860 | PLAY [all] 2026-04-17 08:21:47.975474 | 2026-04-17 08:21:47.975550 | TASK [ensure-go : Check installed go version] 2026-04-17 08:21:48.508931 | instance | ok: ERROR (ignored) 2026-04-17 08:21:48.509834 | instance | { 2026-04-17 08:21:48.509872 | instance | "failed_when_result": false, 2026-04-17 08:21:48.509895 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-17 08:21:48.509917 | instance | "rc": 2 2026-04-17 08:21:48.509941 | instance | } 2026-04-17 08:21:48.514737 | 2026-04-17 08:21:48.514802 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-17 08:21:48.564738 | instance | ok 2026-04-17 08:21:48.574896 | instance | included: /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-17 08:21:48.580319 | 2026-04-17 08:21:48.580384 | TASK [ensure-go : Create temp directory] 2026-04-17 08:21:48.888014 | instance | changed 2026-04-17 08:21:48.895171 | 2026-04-17 08:21:48.895298 | TASK [ensure-go : Get archive checksum] 2026-04-17 08:21:49.500855 | instance | ok: OK (64 bytes) 2026-04-17 08:21:49.507989 | 2026-04-17 08:21:49.508075 | TASK [ensure-go : Download go archive] 2026-04-17 08:21:50.652884 | instance | changed: OK (78559214 bytes) 2026-04-17 08:21:50.659066 | 2026-04-17 08:21:50.659130 | TASK [ensure-go : Install go] 2026-04-17 08:21:56.486592 | instance | changed 2026-04-17 08:21:56.492852 | 2026-04-17 08:21:56.492927 | PLAY [all] 2026-04-17 08:21:56.498465 | 2026-04-17 08:21:56.498523 | TASK [Copy inventory file for Zuul] 2026-04-17 08:21:57.310553 | instance | changed 2026-04-17 08:21:57.318126 | 2026-04-17 08:21:57.318208 | TASK [Switch "ansible_host" to private IP] 2026-04-17 08:21:57.625634 | instance | changed: 1 replacements made 2026-04-17 08:21:57.631931 | 2026-04-17 08:21:57.631991 | TASK [Run molecule prepare] 2026-04-17 08:21:57.880440 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-04-17 08:21:57.880634 | instance | Creating virtual environment at: .venv 2026-04-17 08:21:57.918825 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-17 08:21:57.935584 | instance | Downloading setuptools (1.1MiB) 2026-04-17 08:21:57.935829 | instance | Downloading rjsonnet (1.2MiB) 2026-04-17 08:21:57.936296 | instance | Downloading pydantic-core (2.0MiB) 2026-04-17 08:21:57.936544 | instance | Downloading openstacksdk (1.7MiB) 2026-04-17 08:21:57.937130 | instance | Downloading pygments (1.2MiB) 2026-04-17 08:21:57.940051 | instance | Downloading cryptography (4.2MiB) 2026-04-17 08:21:57.940555 | instance | Downloading netaddr (2.2MiB) 2026-04-17 08:21:57.940803 | instance | Downloading kubernetes (1.9MiB) 2026-04-17 08:21:57.946499 | instance | Downloading ansible-core (2.1MiB) 2026-04-17 08:21:58.258765 | instance | Building pyperclip==1.9.0 2026-04-17 08:21:58.275552 | instance | Downloading rjsonnet 2026-04-17 08:21:58.369800 | instance | Downloading pydantic-core 2026-04-17 08:21:58.421333 | instance | Downloading netaddr 2026-04-17 08:21:58.431576 | instance | Downloading pygments 2026-04-17 08:21:58.442353 | instance | Downloading cryptography 2026-04-17 08:21:58.483769 | instance | Downloading setuptools 2026-04-17 08:21:58.533807 | instance | Downloading kubernetes 2026-04-17 08:21:58.563299 | instance | Downloading ansible-core 2026-04-17 08:21:58.593140 | instance | Downloading openstacksdk 2026-04-17 08:21:58.961342 | instance | Built pyperclip==1.9.0 2026-04-17 08:21:59.146656 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-04-17 08:21:59.191465 | instance | Installed 83 packages in 42ms 2026-04-17 08:21:59.883062 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-17 08:22:00.478636 | instance | INFO [csi > discovery] scenario test matrix: prepare 2026-04-17 08:22:00.478756 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-04-17 08:22:47.059606 | instance | INFO [csi > prepare] Executing 2026-04-17 08:22:47.978623 | instance | 2026-04-17 08:22:47.979523 | instance | PLAY [Prepare] ***************************************************************** 2026-04-17 08:22:47.979868 | instance | 2026-04-17 08:22:47.980197 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-17 08:22:47.980441 | instance | Friday 17 April 2026 08:22:47 +0000 (0:00:00.036) 0:00:00.036 ********** 2026-04-17 08:22:49.158921 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-17 08:22:49.159382 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-17 08:22:49.159870 | instance | interpreter could change the meaning of that path. See 2026-04-17 08:22:49.160237 | instance | https://docs.ansible.com/ansible- 2026-04-17 08:22:49.160541 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-17 08:22:49.168940 | instance | ok: [instance] 2026-04-17 08:22:49.169101 | instance | 2026-04-17 08:22:49.169273 | instance | TASK [Configure short hostname] ************************************************ 2026-04-17 08:22:49.169635 | instance | Friday 17 April 2026 08:22:49 +0000 (0:00:01.195) 0:00:01.232 ********** 2026-04-17 08:22:49.892421 | instance | changed: [instance] 2026-04-17 08:22:49.892521 | instance | 2026-04-17 08:22:49.892682 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-17 08:22:49.892856 | instance | Friday 17 April 2026 08:22:49 +0000 (0:00:00.723) 0:00:01.955 ********** 2026-04-17 08:22:50.189396 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-17 08:22:50.189628 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-04-17 08:22:50.189896 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-17 08:22:50.200005 | instance | changed: [instance] 2026-04-17 08:22:50.200260 | instance | 2026-04-17 08:22:50.200573 | instance | TASK [Purge "snapd" package] *************************************************** 2026-04-17 08:22:50.200844 | instance | Friday 17 April 2026 08:22:50 +0000 (0:00:00.307) 0:00:02.263 ********** 2026-04-17 08:22:51.191287 | instance | ok: [instance] 2026-04-17 08:22:51.191508 | instance | 2026-04-17 08:22:51.191785 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-04-17 08:22:51.192050 | instance | 2026-04-17 08:22:51.192319 | instance | TASK [Gathering Facts] ********************************************************* 2026-04-17 08:22:51.192590 | instance | Friday 17 April 2026 08:22:51 +0000 (0:00:00.990) 0:00:03.253 ********** 2026-04-17 08:22:51.907642 | instance | ok: [instance] 2026-04-17 08:22:51.907741 | instance | 2026-04-17 08:22:51.907830 | instance | TASK [Install depedencies] ***************************************************** 2026-04-17 08:22:51.907954 | instance | Friday 17 April 2026 08:22:51 +0000 (0:00:00.716) 0:00:03.970 ********** 2026-04-17 08:23:51.148870 | instance | changed: [instance] 2026-04-17 08:23:51.149416 | instance | 2026-04-17 08:23:51.149428 | instance | TASK [Start up service] ******************************************************** 2026-04-17 08:23:51.149436 | instance | Friday 17 April 2026 08:23:51 +0000 (0:00:59.240) 0:01:03.210 ********** 2026-04-17 08:23:51.727180 | instance | ok: [instance] 2026-04-17 08:23:51.727559 | instance | 2026-04-17 08:23:51.727870 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-04-17 08:23:51.728252 | instance | Friday 17 April 2026 08:23:51 +0000 (0:00:00.578) 0:01:03.789 ********** 2026-04-17 08:23:52.020795 | instance | ok: [instance] 2026-04-17 08:23:52.020911 | instance | 2026-04-17 08:23:52.021020 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-17 08:23:52.021151 | instance | Friday 17 April 2026 08:23:52 +0000 (0:00:00.294) 0:01:04.083 ********** 2026-04-17 08:23:52.665626 | instance | changed: [instance] 2026-04-17 08:23:52.665878 | instance | 2026-04-17 08:23:52.666154 | instance | TASK [Get list of all loopback devices] **************************************** 2026-04-17 08:23:52.666438 | instance | Friday 17 April 2026 08:23:52 +0000 (0:00:00.644) 0:01:04.728 ********** 2026-04-17 08:23:52.857614 | instance | ok: [instance] 2026-04-17 08:23:52.857934 | instance | 2026-04-17 08:23:52.858231 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-17 08:23:52.858498 | instance | Friday 17 April 2026 08:23:52 +0000 (0:00:00.191) 0:01:04.920 ********** 2026-04-17 08:23:52.878896 | instance | skipping: [instance] 2026-04-17 08:23:52.879130 | instance | 2026-04-17 08:23:52.879404 | instance | TASK [Create devices for Ceph] ************************************************* 2026-04-17 08:23:52.879676 | instance | Friday 17 April 2026 08:23:52 +0000 (0:00:00.021) 0:01:04.942 ********** 2026-04-17 08:23:53.443140 | instance | changed: [instance] => (item=osd0) 2026-04-17 08:23:53.443262 | instance | changed: [instance] => (item=osd1) 2026-04-17 08:23:53.443415 | instance | changed: [instance] => (item=osd2) 2026-04-17 08:23:53.443562 | instance | 2026-04-17 08:23:53.443717 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-04-17 08:23:53.443884 | instance | Friday 17 April 2026 08:23:53 +0000 (0:00:00.563) 0:01:05.505 ********** 2026-04-17 08:23:54.068382 | instance | changed: [instance] => (item=osd0) 2026-04-17 08:23:54.068651 | instance | changed: [instance] => (item=osd1) 2026-04-17 08:23:54.068919 | instance | changed: [instance] => (item=osd2) 2026-04-17 08:23:54.069177 | instance | 2026-04-17 08:23:54.069496 | instance | TASK [Start loop devices] ****************************************************** 2026-04-17 08:23:54.069787 | instance | Friday 17 April 2026 08:23:54 +0000 (0:00:00.625) 0:01:06.130 ********** 2026-04-17 08:23:54.791520 | instance | changed: [instance] => (item=osd0) 2026-04-17 08:23:54.791684 | instance | changed: [instance] => (item=osd1) 2026-04-17 08:23:54.791900 | instance | changed: [instance] => (item=osd2) 2026-04-17 08:23:54.792069 | instance | 2026-04-17 08:23:54.792283 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-04-17 08:23:54.792482 | instance | Friday 17 April 2026 08:23:54 +0000 (0:00:00.723) 0:01:06.854 ********** 2026-04-17 08:23:57.853513 | instance | changed: [instance] => (item=osd0) 2026-04-17 08:23:57.853604 | instance | changed: [instance] => (item=osd1) 2026-04-17 08:23:57.853790 | instance | changed: [instance] => (item=osd2) 2026-04-17 08:23:57.853934 | instance | 2026-04-17 08:23:57.854115 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-04-17 08:23:57.854261 | instance | Friday 17 April 2026 08:23:57 +0000 (0:00:03.062) 0:01:09.916 ********** 2026-04-17 08:23:59.688164 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-04-17 08:23:59.688398 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-04-17 08:23:59.688663 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-04-17 08:23:59.688930 | instance | 2026-04-17 08:23:59.689208 | instance | PLAY RECAP ********************************************************************* 2026-04-17 08:23:59.689599 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-17 08:23:59.690001 | instance | 2026-04-17 08:23:59.690337 | instance | Friday 17 April 2026 08:23:59 +0000 (0:00:01.834) 0:01:11.751 ********** 2026-04-17 08:23:59.690607 | instance | =============================================================================== 2026-04-17 08:23:59.690874 | instance | Install depedencies ---------------------------------------------------- 59.24s 2026-04-17 08:23:59.691139 | instance | Create a volume group for each loop device ------------------------------ 3.06s 2026-04-17 08:23:59.691410 | instance | Create a logical volume for each loop device ---------------------------- 1.83s 2026-04-17 08:23:59.691675 | instance | Gathering Facts --------------------------------------------------------- 1.20s 2026-04-17 08:23:59.691944 | instance | Purge "snapd" package --------------------------------------------------- 0.99s 2026-04-17 08:23:59.692208 | instance | Start loop devices ------------------------------------------------------ 0.72s 2026-04-17 08:23:59.692472 | instance | Configure short hostname ------------------------------------------------ 0.72s 2026-04-17 08:23:59.692738 | instance | Gathering Facts --------------------------------------------------------- 0.72s 2026-04-17 08:23:59.693011 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s 2026-04-17 08:23:59.693278 | instance | Set permissions on loopback devices ------------------------------------- 0.63s 2026-04-17 08:23:59.693589 | instance | Start up service -------------------------------------------------------- 0.58s 2026-04-17 08:23:59.694010 | instance | Create devices for Ceph ------------------------------------------------- 0.56s 2026-04-17 08:23:59.694298 | instance | Ensure hostname inside hosts file --------------------------------------- 0.31s 2026-04-17 08:23:59.694569 | instance | Generate lvm.conf ------------------------------------------------------- 0.29s 2026-04-17 08:23:59.694816 | instance | Get list of all loopback devices ---------------------------------------- 0.19s 2026-04-17 08:23:59.694985 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-04-17 08:23:59.752212 | instance | INFO [csi > prepare] Executed: Successful 2026-04-17 08:23:59.752735 | instance | INFO Molecule executed 1 scenario (1 successful) 2026-04-17 08:23:59.971807 | instance | ok: Runtime: 0:02:02.019966 2026-04-17 08:23:59.976422 | 2026-04-17 08:23:59.976521 | PLAY RECAP 2026-04-17 08:23:59.976620 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-17 08:23:59.976671 | 2026-04-17 08:24:00.088626 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-17 08:24:00.092870 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-17 08:24:00.685790 | 2026-04-17 08:24:00.685959 | PLAY [all] 2026-04-17 08:24:00.697775 | 2026-04-17 08:24:00.697930 | TASK [Copy inventory file for Zuul] 2026-04-17 08:24:01.576163 | instance | changed 2026-04-17 08:24:01.582694 | 2026-04-17 08:24:01.582774 | TASK [Switch "ansible_host" to private IP] 2026-04-17 08:24:01.872451 | instance | changed: 1 replacements made 2026-04-17 08:24:01.877906 | 2026-04-17 08:24:01.877977 | TASK [Run Molecule scenario] 2026-04-17 08:24:02.533091 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-04-17 08:24:02.975532 | instance | INFO [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-17 08:24:02.975662 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-04-17 08:24:15.233901 | instance | INFO [csi > dependency] Executing 2026-04-17 08:24:15.234086 | instance | WARNING [csi > dependency] Missing roles requirements file: requirements.yml 2026-04-17 08:24:15.234263 | instance | WARNING [csi > dependency] Missing collections requirements file: collections.yml 2026-04-17 08:24:15.234370 | instance | WARNING [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-17 08:24:15.241817 | instance | INFO [csi > cleanup] Executing 2026-04-17 08:24:15.242119 | instance | WARNING [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-17 08:24:15.249943 | instance | INFO [csi > destroy] Executing 2026-04-17 08:24:15.250015 | instance | WARNING [csi > destroy] Skipping, '--destroy=never' requested. 2026-04-17 08:24:15.250085 | instance | INFO [csi > destroy] Executed: Successful 2026-04-17 08:24:15.257457 | instance | INFO [csi > syntax] Executing 2026-04-17 08:24:15.910963 | instance | 2026-04-17 08:24:15.911210 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-04-17 08:24:15.948858 | instance | INFO [csi > syntax] Executed: Successful 2026-04-17 08:24:15.961600 | instance | INFO [csi > create] Executing 2026-04-17 08:24:15.963367 | instance | WARNING [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-17 08:24:15.970828 | instance | INFO [csi > prepare] Executing 2026-04-17 08:24:15.970921 | instance | WARNING [csi > prepare] Skipping, instances already prepared. 2026-04-17 08:24:15.970933 | instance | INFO [csi > prepare] Executed: Successful 2026-04-17 08:24:15.978207 | instance | INFO [csi > converge] Executing 2026-04-17 08:24:16.661504 | instance | 2026-04-17 08:24:16.661658 | instance | PLAY [all] ********************************************************************* 2026-04-17 08:24:16.661904 | instance | 2026-04-17 08:24:16.662166 | instance | TASK [Build atmosphere binary] ************************************************* 2026-04-17 08:24:16.662425 | instance | Friday 17 April 2026 08:24:16 +0000 (0:00:00.006) 0:00:00.006 ********** 2026-04-17 08:24:23.209674 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-04-17 08:24:23.210132 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-04-17 08:24:23.210858 | instance | interpreter could change the meaning of that path. See 2026-04-17 08:24:23.211248 | instance | https://docs.ansible.com/ansible- 2026-04-17 08:24:23.211646 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-04-17 08:24:23.216436 | instance | ok: [instance] 2026-04-17 08:24:23.216662 | instance | 2026-04-17 08:24:23.216823 | instance | TASK [Deploy with parallel orchestrator] *************************************** 2026-04-17 08:24:23.216983 | instance | Friday 17 April 2026 08:24:23 +0000 (0:00:06.554) 0:00:06.561 ********** 2026-04-17 08:25:39.943118 | instance | fatal: [instance]: FAILED! => {"changed": false, "cmd": ". .venv/bin/activate && ./bin/atmosphere deploy --inventory ./inventory.yaml \n", "delta": "0:01:16.537953", "end": "2026-04-17 08:25:39.911249", "msg": "non-zero return code", "rc": 1, "start": "2026-04-17 08:24:23.373296", "stderr": "Error: component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2\nUsage:\n atmosphere deploy [flags]\n\nFlags:\n --concurrency int Max concurrent deployments per wave (0 = unlimited)\n -h, --help help for deploy\n -i, --inventory string Path to Ansible inventory file (required)\n -t, --tags string Comma-separated list of component tags to deploy\n\ncomponent ceph failed: ansible-playbook failed for ceph/ceph: exit status 2", "stderr_lines": ["Error: component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2", "Usage:", " atmosphere deploy [flags]", "", "Flags:", " --concurrency int Max concurrent deployments per wave (0 = unlimited)", " -h, --help help for deploy", " -i, --inventory string Path to Ansible inventory file (required)", " -t, --tags string Comma-separated list of component tags to deploy", "", "component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2"], "stdout": "==> Running preflight checks\n[preflight] \n[preflight] PLAY [Preflight checks] ********************************************************\n[preflight] \n[preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************\n[preflight] skipping: [instance]\n[preflight] \n[preflight] PLAY RECAP *********************************************************************\n[preflight] instance : ok=0 changed=0 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 \n[preflight] \n==> Preflight checks passed\n==> Starting parallel deployment\n==> [udev] Starting deployment\n==> [ceph] Starting deployment\n==> [iscsi] Starting deployment\n==> [lpfc] Starting deployment\n==> [kubernetes] Starting deployment\n==> [multipathd] Starting deployment\n[udev/udev] \n[udev/udev] PLAY [controllers:computes] ****************************************************\n[udev/udev] \n[udev/udev] TASK [Gathering Facts] *********************************************************\n[multipathd/multipathd] \n[multipathd/multipathd] PLAY [controllers:computes] ****************************************************\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [Gathering Facts] *********************************************************\n[iscsi/iscsi] \n[iscsi/iscsi] PLAY [controllers:computes] ****************************************************\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [Gathering Facts] *********************************************************\n[lpfc/lpfc] \n[lpfc/lpfc] PLAY [controllers:computes] ****************************************************\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [Gathering Facts] *********************************************************\n[ceph/ceph] \n[ceph/ceph] PLAY [all] *********************************************************************\n[ceph/ceph] \n[ceph/ceph] TASK [Gathering Facts] *********************************************************\n[iscsi/iscsi] [WARNING]: Platform linux on host instance is using the discovered Python\n[iscsi/iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python\n[iscsi/iscsi] interpreter could change the meaning of that path. See\n[iscsi/iscsi] https://docs.ansible.com/ansible-\n[iscsi/iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[udev/udev] [WARNING]: Platform linux on host instance is using the discovered Python\n[udev/udev] interpreter at /usr/bin/python3.10, but future installation of another Python\n[udev/udev] interpreter could change the meaning of that path. See\n[udev/udev] https://docs.ansible.com/ansible-\n[udev/udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[iscsi/iscsi] ok: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************\n[udev/udev] ok: [instance]\n[udev/udev] \n[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***\n[lpfc/lpfc] [WARNING]: Platform linux on host instance is using the discovered Python\n[lpfc/lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python\n[lpfc/lpfc] interpreter could change the meaning of that path. See\n[lpfc/lpfc] https://docs.ansible.com/ansible-\n[lpfc/lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[lpfc/lpfc] ok: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********\n[multipathd/multipathd] [WARNING]: Platform linux on host instance is using the discovered Python\n[multipathd/multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python\n[multipathd/multipathd] interpreter could change the meaning of that path. See\n[multipathd/multipathd] https://docs.ansible.com/ansible-\n[multipathd/multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[multipathd/multipathd] ok: [instance]\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************\n[ceph/ceph] [WARNING]: Platform linux on host instance is using the discovered Python\n[ceph/ceph] interpreter at /usr/bin/python3.10, but future installation of another Python\n[ceph/ceph] interpreter could change the meaning of that path. See\n[ceph/ceph] https://docs.ansible.com/ansible-\n[ceph/ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [Fail if atmosphere_ceph_enabled is set] **********************************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] PLAY [Deploy Ceph monitors & managers] *****************************************\n[ceph/ceph] \n[ceph/ceph] TASK [Gathering Facts] *********************************************************\n[lpfc/lpfc] ok: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****\n[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***\n[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [Reboot the system if the configuration file has changed] *****************\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] PLAY RECAP *********************************************************************\n[lpfc/lpfc] instance : ok=2 changed=0 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 \n[lpfc/lpfc] \n==> [lpfc] Deployment complete\n[udev/udev] changed: [instance]\n[udev/udev] \n[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******\n[iscsi/iscsi] ok: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************\n[udev/udev] changed: [instance]\n[udev/udev] \n[udev/udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[udev/udev] ok: [instance]\n[udev/udev] \n[udev/udev] PLAY RECAP *********************************************************************\n[udev/udev] instance : ok=4 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 \n[udev/udev] \n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***\n==> [udev] Deployment complete\n[iscsi/iscsi] changed: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] PLAY RECAP *********************************************************************\n[iscsi/iscsi] instance : ok=3 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 \n[iscsi/iscsi] \n==> [iscsi] Deployment complete\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph] \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph] \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************\n[multipathd/multipathd] changed: [instance]\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] *******\n[ceph/ceph] changed: [instance] => (item={'path': '/etc/containerd'})\n[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create containerd config file] **********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Enable and start service] ***************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph] \"msg\": \"https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ******************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Ensure group \"docker\" exists] ***************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] *****\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create folders for configuration] ***********\n[ceph/ceph] changed: [instance] => (item={'path': '/etc/docker'})\n[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] ***********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Enable and start service] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******\n[ceph/ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.ceph.cephadm : Install packages] ********************************\n[ceph/ceph] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776414276, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\" install 'chrony=4.2-2ubuntu2'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}\n[ceph/ceph] \n[ceph/ceph] PLAY RECAP *********************************************************************\n[ceph/ceph] instance : ok=33 changed=19 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0 \n[ceph/ceph] ", "stdout_lines": ["==> Running preflight checks", "[preflight] ", "[preflight] PLAY [Preflight checks] ********************************************************", "[preflight] ", "[preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************", "[preflight] skipping: [instance]", "[preflight] ", "[preflight] PLAY RECAP *********************************************************************", "[preflight] instance : ok=0 changed=0 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 ", "[preflight] ", "==> Preflight checks passed", "==> Starting parallel deployment", "==> [udev] Starting deployment", "==> [ceph] Starting deployment", "==> [iscsi] Starting deployment", "==> [lpfc] Starting deployment", "==> [kubernetes] Starting deployment", "==> [multipathd] Starting deployment", "[udev/udev] ", "[udev/udev] PLAY [controllers:computes] ****************************************************", "[udev/udev] ", "[udev/udev] TASK [Gathering Facts] *********************************************************", "[multipathd/multipathd] ", "[multipathd/multipathd] PLAY [controllers:computes] ****************************************************", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [Gathering Facts] *********************************************************", "[iscsi/iscsi] ", "[iscsi/iscsi] PLAY [controllers:computes] ****************************************************", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [Gathering Facts] *********************************************************", "[lpfc/lpfc] ", "[lpfc/lpfc] PLAY [controllers:computes] ****************************************************", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [Gathering Facts] *********************************************************", "[ceph/ceph] ", "[ceph/ceph] PLAY [all] *********************************************************************", "[ceph/ceph] ", "[ceph/ceph] TASK [Gathering Facts] *********************************************************", "[iscsi/iscsi] [WARNING]: Platform linux on host instance is using the discovered Python", "[iscsi/iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python", "[iscsi/iscsi] interpreter could change the meaning of that path. See", "[iscsi/iscsi] https://docs.ansible.com/ansible-", "[iscsi/iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[udev/udev] [WARNING]: Platform linux on host instance is using the discovered Python", "[udev/udev] interpreter at /usr/bin/python3.10, but future installation of another Python", "[udev/udev] interpreter could change the meaning of that path. See", "[udev/udev] https://docs.ansible.com/ansible-", "[udev/udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[iscsi/iscsi] ok: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************", "[udev/udev] ok: [instance]", "[udev/udev] ", "[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***", "[lpfc/lpfc] [WARNING]: Platform linux on host instance is using the discovered Python", "[lpfc/lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python", "[lpfc/lpfc] interpreter could change the meaning of that path. See", "[lpfc/lpfc] https://docs.ansible.com/ansible-", "[lpfc/lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[lpfc/lpfc] ok: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********", "[multipathd/multipathd] [WARNING]: Platform linux on host instance is using the discovered Python", "[multipathd/multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python", "[multipathd/multipathd] interpreter could change the meaning of that path. See", "[multipathd/multipathd] https://docs.ansible.com/ansible-", "[multipathd/multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[multipathd/multipathd] ok: [instance]", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************", "[ceph/ceph] [WARNING]: Platform linux on host instance is using the discovered Python", "[ceph/ceph] interpreter at /usr/bin/python3.10, but future installation of another Python", "[ceph/ceph] interpreter could change the meaning of that path. See", "[ceph/ceph] https://docs.ansible.com/ansible-", "[ceph/ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [Fail if atmosphere_ceph_enabled is set] **********************************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] PLAY [Deploy Ceph monitors & managers] *****************************************", "[ceph/ceph] ", "[ceph/ceph] TASK [Gathering Facts] *********************************************************", "[lpfc/lpfc] ok: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [Reboot the system if the configuration file has changed] *****************", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] PLAY RECAP *********************************************************************", "[lpfc/lpfc] instance : ok=2 changed=0 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 ", "[lpfc/lpfc] ", "==> [lpfc] Deployment complete", "[udev/udev] changed: [instance]", "[udev/udev] ", "[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******", "[iscsi/iscsi] ok: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************", "[udev/udev] changed: [instance]", "[udev/udev] ", "[udev/udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[udev/udev] ok: [instance]", "[udev/udev] ", "[udev/udev] PLAY RECAP *********************************************************************", "[udev/udev] instance : ok=4 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 ", "[udev/udev] ", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***", "==> [udev] Deployment complete", "[iscsi/iscsi] changed: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] PLAY RECAP *********************************************************************", "[iscsi/iscsi] instance : ok=3 changed=1 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 ", "[iscsi/iscsi] ", "==> [iscsi] Deployment complete", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph] \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph] \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************", "[multipathd/multipathd] changed: [instance]", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] *******", "[ceph/ceph] changed: [instance] => (item={'path': '/etc/containerd'})", "[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create containerd config file] **********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Enable and start service] ***************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph] \"msg\": \"https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ******************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Ensure group \"docker\" exists] ***************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] *****", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create folders for configuration] ***********", "[ceph/ceph] changed: [instance] => (item={'path': '/etc/docker'})", "[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] ***********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Enable and start service] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******", "[ceph/ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.ceph.cephadm : Install packages] ********************************", "[ceph/ceph] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776414276, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\" install 'chrony=4.2-2ubuntu2'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12407 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}", "[ceph/ceph] ", "[ceph/ceph] PLAY RECAP *********************************************************************", "[ceph/ceph] instance : ok=33 changed=19 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0 ", "[ceph/ceph] "]} 2026-04-17 08:25:39.943426 | instance | 2026-04-17 08:25:39.943785 | instance | PLAY RECAP ********************************************************************* 2026-04-17 08:25:39.944099 | instance | instance : ok=1 changed=0 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-04-17 08:25:39.944351 | instance | 2026-04-17 08:25:39.944614 | instance | Friday 17 April 2026 08:25:39 +0000 (0:01:16.727) 0:01:23.288 ********** 2026-04-17 08:25:39.944948 | instance | =============================================================================== 2026-04-17 08:25:39.945269 | instance | Deploy with parallel orchestrator -------------------------------------- 76.73s 2026-04-17 08:25:39.945625 | instance | Build atmosphere binary ------------------------------------------------- 6.55s 2026-04-17 08:25:40.000107 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-04-17 08:25:40.000257 | instance | ERROR [csi > converge] Executed: Failed 2026-04-17 08:25:40.000402 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-04-17 08:25:40.530662 | instance | ERROR 2026-04-17 08:25:40.530897 | instance | { 2026-04-17 08:25:40.530938 | instance | "delta": "0:01:37.844721", 2026-04-17 08:25:40.530969 | instance | "end": "2026-04-17 08:25:40.054738", 2026-04-17 08:25:40.530996 | instance | "msg": "non-zero return code", 2026-04-17 08:25:40.531021 | instance | "rc": 2, 2026-04-17 08:25:40.531050 | instance | "start": "2026-04-17 08:24:02.210017" 2026-04-17 08:25:40.531080 | instance | } failure 2026-04-17 08:25:40.536630 | 2026-04-17 08:25:40.536690 | PLAY RECAP 2026-04-17 08:25:40.536748 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-17 08:25:40.536777 | 2026-04-17 08:25:40.686125 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-17 08:25:40.690430 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-17 08:25:41.289411 | 2026-04-17 08:25:41.289548 | PLAY [all] 2026-04-17 08:25:41.304670 | 2026-04-17 08:25:41.304804 | TASK [gather-host-logs : creating directory for system status] 2026-04-17 08:25:41.661929 | instance | changed 2026-04-17 08:25:41.667325 | 2026-04-17 08:25:41.667409 | TASK [gather-host-logs : Get logs for each host] 2026-04-17 08:25:41.996228 | instance | + systemd-cgls --full --all --no-pager 2026-04-17 08:25:42.006688 | instance | + ip addr 2026-04-17 08:25:42.008980 | instance | + ip route 2026-04-17 08:25:42.011497 | instance | + lsblk 2026-04-17 08:25:42.014647 | instance | + mount 2026-04-17 08:25:42.017096 | instance | + docker images 2026-04-17 08:25:42.033634 | instance | + brctl show 2026-04-17 08:25:42.034005 | instance | /bin/bash: line 8: brctl: command not found 2026-04-17 08:25:42.034110 | instance | + ps aux --sort=-%mem 2026-04-17 08:25:42.046911 | instance | + dpkg -l 2026-04-17 08:25:42.055904 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-17 08:25:42.056304 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-17 08:25:42.074799 | instance | + '[' '!' -z '' ']' 2026-04-17 08:25:42.204489 | instance | ok: Runtime: 0:00:00.083568 2026-04-17 08:25:42.210646 | 2026-04-17 08:25:42.210769 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-17 08:25:42.855414 | instance | changed: 2026-04-17 08:25:42.855624 | instance | created directory /var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/logs/instance 2026-04-17 08:25:42.855664 | instance | cd+++++++++ system/ 2026-04-17 08:25:42.855696 | instance | >f+++++++++ system/brctl-show.txt 2026-04-17 08:25:42.855725 | instance | >f+++++++++ system/docker-images.txt 2026-04-17 08:25:42.855752 | instance | >f+++++++++ system/ip-addr.txt 2026-04-17 08:25:42.855783 | instance | >f+++++++++ system/ip-route.txt 2026-04-17 08:25:42.855814 | instance | >f+++++++++ system/lsblk.txt 2026-04-17 08:25:42.855842 | instance | >f+++++++++ system/mount.txt 2026-04-17 08:25:42.855870 | instance | >f+++++++++ system/packages.txt 2026-04-17 08:25:42.855991 | instance | >f+++++++++ system/ps.txt 2026-04-17 08:25:42.856024 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-17 08:25:42.866671 | 2026-04-17 08:25:42.866742 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-17 08:25:43.056569 | instance | changed: "values" 2026-04-17 08:25:43.223629 | instance | changed: "releases" 2026-04-17 08:25:43.241693 | 2026-04-17 08:25:43.241851 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-17 08:25:43.431639 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-17 08:25:43.777095 | instance | ok: Runtime: 0:00:00.005429 2026-04-17 08:25:43.782227 | 2026-04-17 08:25:43.782309 | TASK [helm-release-status : Downloads logs to executor] 2026-04-17 08:25:44.263212 | instance | changed: 2026-04-17 08:25:44.263387 | instance | cd+++++++++ helm/ 2026-04-17 08:25:44.263533 | instance | cd+++++++++ helm/releases/ 2026-04-17 08:25:44.263571 | instance | cd+++++++++ helm/values/ 2026-04-17 08:25:44.279894 | 2026-04-17 08:25:44.280078 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-17 08:25:44.487307 | instance | changed 2026-04-17 08:25:44.494068 | 2026-04-17 08:25:44.494146 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-17 08:25:44.698802 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 08:25:44.699011 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 08:25:44.703944 | instance | environment: line 1: kubectl: command not found 2026-04-17 08:25:44.705345 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 08:25:44.706223 | instance | environment: line 1: kubectl: command not found 2026-04-17 08:25:44.707732 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 08:25:44.708942 | instance | environment: line 1: kubectl: command not found 2026-04-17 08:25:44.710150 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 08:25:44.710778 | instance | environment: line 1: kubectl: command not found 2026-04-17 08:25:44.711682 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 08:25:44.712474 | instance | environment: line 1: kubectl: command not found 2026-04-17 08:25:44.713172 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-17 08:25:45.032083 | instance | ok: Runtime: 0:00:00.022962 2026-04-17 08:25:45.039052 | 2026-04-17 08:25:45.039151 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-17 08:25:45.229938 | instance | changed 2026-04-17 08:25:45.236146 | 2026-04-17 08:25:45.236221 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-17 08:25:45.465967 | instance | environment: line 5: kubectl: command not found 2026-04-17 08:25:45.466803 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 08:25:45.467155 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 08:25:45.467383 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-17 08:25:45.802863 | instance | ok: Runtime: 0:00:00.007504 2026-04-17 08:25:45.811287 | 2026-04-17 08:25:45.811389 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-17 08:25:46.290806 | instance | changed: 2026-04-17 08:25:46.290981 | instance | cd+++++++++ objects/ 2026-04-17 08:25:46.291010 | instance | cd+++++++++ objects/cluster/ 2026-04-17 08:25:46.291035 | instance | cd+++++++++ objects/namespaced/ 2026-04-17 08:25:46.300314 | 2026-04-17 08:25:46.300384 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-17 08:25:46.495664 | instance | changed 2026-04-17 08:25:46.502376 | 2026-04-17 08:25:46.502464 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-17 08:25:46.703580 | instance | changed 2026-04-17 08:25:46.708511 | 2026-04-17 08:25:46.708579 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-17 08:25:46.904289 | instance | environment: line 3: kubectl: command not found 2026-04-17 08:25:47.237858 | instance | ok: Runtime: 0:00:00.007507 2026-04-17 08:25:47.245673 | 2026-04-17 08:25:47.245777 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-17 08:25:47.699838 | instance | changed: 2026-04-17 08:25:47.740225 | instance | cd+++++++++ pod-logs/ 2026-04-17 08:25:47.740294 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-17 08:25:47.753270 | 2026-04-17 08:25:47.753336 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-17 08:25:47.957393 | instance | changed 2026-04-17 08:25:47.964124 | 2026-04-17 08:25:47.964221 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-17 08:25:48.172219 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-17 08:25:48.503052 | instance | ok: Runtime: 0:00:00.035433 2026-04-17 08:25:48.510177 | 2026-04-17 08:25:48.510272 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-17 08:25:48.711698 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-17 08:25:48.742587 | instance | ceph-mgr endpoints: 2026-04-17 08:25:49.047352 | instance | ok: Runtime: 0:00:00.037796 2026-04-17 08:25:49.055879 | 2026-04-17 08:25:49.055965 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-17 08:25:49.255967 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-17 08:25:49.588103 | instance | ok: Runtime: 0:00:00.037894 2026-04-17 08:25:49.594566 | 2026-04-17 08:25:49.594637 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-17 08:25:50.083280 | instance | changed: cd+++++++++ prometheus/ 2026-04-17 08:25:50.092187 | 2026-04-17 08:25:50.092252 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-17 08:25:50.298600 | instance | changed 2026-04-17 08:25:50.305322 | 2026-04-17 08:25:50.305409 | TASK [gather-selenium-data : Get selenium data] 2026-04-17 08:25:50.502761 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-17 08:25:50.504207 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-17 08:25:50.839745 | instance | ERROR 2026-04-17 08:25:50.840045 | instance | { 2026-04-17 08:25:50.840112 | instance | "delta": "0:00:00.006007", 2026-04-17 08:25:50.840157 | instance | "end": "2026-04-17 08:25:50.504550", 2026-04-17 08:25:50.840204 | instance | "msg": "non-zero return code", 2026-04-17 08:25:50.840245 | instance | "rc": 1, 2026-04-17 08:25:50.840285 | instance | "start": "2026-04-17 08:25:50.498543" 2026-04-17 08:25:50.840324 | instance | } 2026-04-17 08:25:50.840374 | instance | ERROR: Ignoring Errors 2026-04-17 08:25:50.845377 | 2026-04-17 08:25:50.845452 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-17 08:25:51.313457 | instance | changed: cd+++++++++ selenium/ 2026-04-17 08:25:51.321517 | 2026-04-17 08:25:51.321601 | PLAY RECAP 2026-04-17 08:25:51.321668 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-17 08:25:51.321697 | 2026-04-17 08:25:51.448094 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-17 08:25:51.452348 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-17 08:25:52.051698 | 2026-04-17 08:25:52.051847 | PLAY [all] 2026-04-17 08:25:52.065145 | 2026-04-17 08:25:52.065238 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-17 08:25:52.110163 | instance | skipping: Conditional result was False 2026-04-17 08:25:52.118541 | 2026-04-17 08:25:52.118655 | TASK [fetch-output : Set log path for single node] 2026-04-17 08:25:52.157950 | instance | ok 2026-04-17 08:25:52.162654 | 2026-04-17 08:25:52.162725 | LOOP [fetch-output : Ensure local output dirs] 2026-04-17 08:25:52.563601 | instance -> localhost | ok: "/var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/logs" 2026-04-17 08:25:52.780000 | instance -> localhost | changed: "/var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/artifacts" 2026-04-17 08:25:52.985496 | instance -> localhost | changed: "/var/lib/zuul/builds/340593059d78467c81c457e6a42273a1/work/docs" 2026-04-17 08:25:53.009362 | 2026-04-17 08:25:53.009545 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-17 08:25:53.612861 | instance | changed: .d..t...... ./ 2026-04-17 08:25:53.613092 | instance | changed: All items complete 2026-04-17 08:25:53.613122 | 2026-04-17 08:25:54.067760 | instance | changed: .d..t...... ./ 2026-04-17 08:25:54.503782 | instance | changed: .d..t...... ./ 2026-04-17 08:25:54.522841 | 2026-04-17 08:25:54.522997 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-17 08:25:54.915825 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007125 2026-04-17 08:25:55.152841 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007066 2026-04-17 08:25:55.178287 | 2026-04-17 08:25:55.178431 | PLAY [all] 2026-04-17 08:25:55.185508 | 2026-04-17 08:25:55.185590 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-17 08:25:55.603235 | instance | changed 2026-04-17 08:25:55.608936 | 2026-04-17 08:25:55.609032 | PLAY RECAP 2026-04-17 08:25:55.609078 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-17 08:25:55.609099 | 2026-04-17 08:25:55.707829 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-17 08:25:55.712779 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-17 08:25:56.319216 | 2026-04-17 08:25:56.408213 | PLAY [localhost] 2026-04-17 08:25:56.423874 | 2026-04-17 08:25:56.423956 | TASK [Generate Zuul manifest] 2026-04-17 08:25:56.456146 | localhost | ok 2026-04-17 08:25:56.472834 | 2026-04-17 08:25:56.472917 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-17 08:25:56.887218 | localhost | changed 2026-04-17 08:25:56.900969 | 2026-04-17 08:25:56.901083 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-17 08:25:56.992577 | localhost | ok 2026-04-17 08:25:57.000188 | 2026-04-17 08:25:57.000265 | TASK [Upload logs] 2026-04-17 08:25:57.023235 | localhost | ok 2026-04-17 08:25:57.084880 | 2026-04-17 08:25:57.085029 | TASK [Set zuul-log-path fact] 2026-04-17 08:25:57.106520 | localhost | ok 2026-04-17 08:25:57.121651 | 2026-04-17 08:25:57.121792 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-17 08:25:57.153793 | localhost | ok 2026-04-17 08:25:57.160731 | 2026-04-17 08:25:57.160824 | TASK [upload-logs : Create log directories] 2026-04-17 08:25:57.548816 | localhost | changed 2026-04-17 08:25:57.555572 | 2026-04-17 08:25:57.555670 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-17 08:25:57.953848 | localhost -> localhost | ok: Runtime: 0:00:00.007857 2026-04-17 08:25:57.961099 | 2026-04-17 08:25:57.961198 | TASK [upload-logs : Upload logs to log server] 2026-04-17 08:25:58.432342 | localhost | Output suppressed because no_log was given 2026-04-17 08:25:58.437472 | 2026-04-17 08:25:58.437569 | LOOP [upload-logs : Compress console log and json output] 2026-04-17 08:25:58.489285 | localhost | skipping: Conditional result was False 2026-04-17 08:25:58.497028 | localhost | skipping: Conditional result was False 2026-04-17 08:25:58.515739 | 2026-04-17 08:25:58.515961 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-17 08:25:58.563944 | localhost | skipping: Conditional result was False 2026-04-17 08:25:58.564494 | 2026-04-17 08:25:58.568152 | localhost | skipping: Conditional result was False 2026-04-17 08:25:58.582703 | 2026-04-17 08:25:58.582922 | LOOP [upload-logs : Upload console log and json output]