2026-04-17 08:19:56.966480 | Job console starting
2026-04-17 08:19:56.974289 | Updating git repos
2026-04-17 08:19:57.101349 | Cloning repos into workspace
2026-04-17 08:19:57.378105 | Restoring repo states
2026-04-17 08:19:57.397314 | Merging changes
2026-04-17 08:19:58.658774 | Checking out repos
2026-04-17 08:19:58.767463 | Preparing playbooks
2026-04-17 08:20:03.921401 | Running Ansible setup
2026-04-17 08:20:07.940047 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-17 08:20:08.533478 | 
2026-04-17 08:20:08.533606 | PLAY [localhost]
2026-04-17 08:20:08.541255 | 
2026-04-17 08:20:08.541326 | TASK [Gathering Facts]
2026-04-17 08:20:09.376749 | localhost | ok
2026-04-17 08:20:09.394839 | 
2026-04-17 08:20:09.394950 | TASK [Setup log path fact]
2026-04-17 08:20:09.416904 | localhost | ok
2026-04-17 08:20:09.435884 | 
2026-04-17 08:20:09.435979 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-17 08:20:09.467528 | localhost | ok
2026-04-17 08:20:09.476201 | 
2026-04-17 08:20:09.476299 | TASK [emit-job-header : Print job information]
2026-04-17 08:20:09.519881 | # Job Information
2026-04-17 08:20:09.520232 | Ansible Version: 2.16.16
2026-04-17 08:20:09.520306 | Job: atmosphere-molecule-csi-local-path-provisioner
2026-04-17 08:20:09.520355 | Pipeline: check
2026-04-17 08:20:09.520415 | Executor: 0a8996d2b663
2026-04-17 08:20:09.520458 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3834
2026-04-17 08:20:09.520507 | Event ID: 22e760f0-3a36-11f1-880d-f7c84e8af0b2
2026-04-17 08:20:09.526467 | 
2026-04-17 08:20:09.526559 | LOOP [emit-job-header : Print node information]
2026-04-17 08:20:09.618888 | localhost | ok:
2026-04-17 08:20:09.619065 | localhost | # Node Information
2026-04-17 08:20:09.619093 | localhost | Inventory Hostname: instance
2026-04-17 08:20:09.619115 | localhost | Hostname: np0000167012
2026-04-17 08:20:09.619135 | localhost | Username: zuul
2026-04-17 08:20:09.619156 | localhost | Distro: Ubuntu 22.04
2026-04-17 08:20:09.619175 | localhost | Provider: yul1
2026-04-17 08:20:09.619194 | localhost | Region: ca-ymq-1
2026-04-17 08:20:09.619212 | localhost | Label: ubuntu-jammy
2026-04-17 08:20:09.619230 | localhost | Product Name: OpenStack Nova
2026-04-17 08:20:09.619248 | localhost | Interface IP: 199.204.45.65
2026-04-17 08:20:09.637271 | 
2026-04-17 08:20:09.637408 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-17 08:20:10.037019 | localhost -> localhost | changed
2026-04-17 08:20:10.046245 | 
2026-04-17 08:20:10.046319 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-17 08:20:10.935836 | localhost -> localhost | changed
2026-04-17 08:20:10.945411 | 
2026-04-17 08:20:10.945485 | PLAY [all]
2026-04-17 08:20:10.955392 | 
2026-04-17 08:20:10.955455 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-17 08:20:11.182249 | instance -> localhost | ok
2026-04-17 08:20:11.190578 | 
2026-04-17 08:20:11.190671 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-17 08:20:11.230878 | instance | ok
2026-04-17 08:20:11.248239 | instance | included: /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-17 08:20:11.254101 | 
2026-04-17 08:20:11.254193 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-17 08:20:12.837189 | instance -> localhost | Generating public/private rsa key pair.
2026-04-17 08:20:12.837351 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/576a0f358f1249ea91802ce9679e0eae_id_rsa
2026-04-17 08:20:12.837382 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/576a0f358f1249ea91802ce9679e0eae_id_rsa.pub
2026-04-17 08:20:12.837406 | instance -> localhost | The key fingerprint is:
2026-04-17 08:20:12.837428 | instance -> localhost | SHA256:IIxKEH1ZoaR2KYADnzT53J8Nap2VAUw6pxaZQDNXHfo zuul-build-sshkey
2026-04-17 08:20:12.837462 | instance -> localhost | The key's randomart image is:
2026-04-17 08:20:12.837484 | instance -> localhost | +---[RSA 3072]----+
2026-04-17 08:20:12.837507 | instance -> localhost | |Booo*o+=+o..     |
2026-04-17 08:20:12.837529 | instance -> localhost | |++oBoB +..o      |
2026-04-17 08:20:12.837550 | instance -> localhost | | oB+*.B o  o     |
2026-04-17 08:20:12.837576 | instance -> localhost | |.o oo..*..o      |
2026-04-17 08:20:12.837624 | instance -> localhost | |.     o+S*E      |
2026-04-17 08:20:12.837674 | instance -> localhost | |     .o = .      |
2026-04-17 08:20:12.837714 | instance -> localhost | |     .           |
2026-04-17 08:20:12.837744 | instance -> localhost | |                 |
2026-04-17 08:20:12.837775 | instance -> localhost | |                 |
2026-04-17 08:20:12.837798 | instance -> localhost | +----[SHA256]-----+
2026-04-17 08:20:12.837850 | instance -> localhost | ok: Runtime: 0:00:01.152239
2026-04-17 08:20:12.843105 | 
2026-04-17 08:20:12.843172 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-17 08:20:12.862824 | instance | ok
2026-04-17 08:20:12.872855 | instance | included: /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-17 08:20:12.883073 | 
2026-04-17 08:20:12.883198 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-17 08:20:12.906874 | instance | skipping: Conditional result was False
2026-04-17 08:20:12.914116 | 
2026-04-17 08:20:12.914193 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-17 08:20:13.341651 | instance | changed
2026-04-17 08:20:13.347588 | 
2026-04-17 08:20:13.347663 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-17 08:20:13.547650 | instance | ok
2026-04-17 08:20:13.555465 | 
2026-04-17 08:20:13.555577 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-17 08:20:14.037919 | instance | changed
2026-04-17 08:20:14.043812 | 
2026-04-17 08:20:14.043890 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-17 08:20:14.536837 | instance | changed
2026-04-17 08:20:14.541848 | 
2026-04-17 08:20:14.541910 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-17 08:20:14.566027 | instance | skipping: Conditional result was False
2026-04-17 08:20:14.576799 | 
2026-04-17 08:20:14.576862 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-17 08:20:14.957548 | instance -> localhost | changed
2026-04-17 08:20:14.975718 | 
2026-04-17 08:20:15.046253 | TASK [add-build-sshkey : Add back temp key]
2026-04-17 08:20:15.360029 | instance -> localhost | Identity added: /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/576a0f358f1249ea91802ce9679e0eae_id_rsa (zuul-build-sshkey)
2026-04-17 08:20:15.360704 | instance -> localhost | ok: Runtime: 0:00:00.012778
2026-04-17 08:20:15.371308 | 
2026-04-17 08:20:15.371609 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-17 08:20:15.692241 | instance | ok
2026-04-17 08:20:15.699040 | 
2026-04-17 08:20:15.699138 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-17 08:20:15.723387 | instance | skipping: Conditional result was False
2026-04-17 08:20:15.750396 | 
2026-04-17 08:20:15.750961 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-17 08:20:16.078790 | instance | ok
2026-04-17 08:20:16.124747 | 
2026-04-17 08:20:16.124898 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-17 08:20:18.283210 | instance | Output suppressed because no_log was given
2026-04-17 08:20:18.299308 | 
2026-04-17 08:20:18.299413 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-17 08:20:18.510143 | instance | ok: "logs"
2026-04-17 08:20:18.544990 | instance | ok: All items complete
2026-04-17 08:20:18.545115 | 
2026-04-17 08:20:18.682504 | instance | ok: "artifacts"
2026-04-17 08:20:18.926121 | instance | ok: "docs"
2026-04-17 08:20:18.947635 | 
2026-04-17 08:20:18.947812 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-17 08:20:19.144203 | instance | changed: "logs"
2026-04-17 08:20:19.306490 | instance | changed: "artifacts"
2026-04-17 08:20:19.471062 | instance | changed: "docs"
2026-04-17 08:20:19.486150 | 
2026-04-17 08:20:19.486286 | PLAY RECAP
2026-04-17 08:20:19.486336 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-17 08:20:19.486365 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-17 08:20:19.486385 | 
2026-04-17 08:20:19.610425 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-17 08:20:19.613279 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-17 08:20:20.237768 | 
2026-04-17 08:20:20.265601 | PLAY [all]
2026-04-17 08:20:20.285159 | 
2026-04-17 08:20:20.285257 | TASK [setup-uv : Extract archive]
2026-04-17 08:20:22.608313 | instance | changed
2026-04-17 08:20:22.614605 | 
2026-04-17 08:20:22.614687 | TASK [setup-uv : Print version]
2026-04-17 08:20:23.449703 | instance | uv 0.8.13
2026-04-17 08:20:23.181180 | instance | ok: Runtime: 0:00:00.011490
2026-04-17 08:20:23.189503 | 
2026-04-17 08:20:23.189585 | PLAY RECAP
2026-04-17 08:20:23.189649 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-17 08:20:23.189682 | 
2026-04-17 08:20:23.298844 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-17 08:20:23.330688 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-17 08:20:23.899325 | 
2026-04-17 08:20:23.936278 | PLAY [all]
2026-04-17 08:20:23.948251 | 
2026-04-17 08:20:23.948351 | TASK [Install "jq" for log collection]
2026-04-17 08:20:52.126201 | instance | changed
2026-04-17 08:20:52.131622 | 
2026-04-17 08:20:52.131694 | TASK [Install pip3 for Python package management]
2026-04-17 08:20:56.480914 | instance | changed
2026-04-17 08:20:56.489532 | 
2026-04-17 08:20:56.489623 | TASK [Install Python "kubernetes" library for kubernetes.core modules]
2026-04-17 08:20:59.908241 | instance | changed
2026-04-17 08:20:59.911882 | 
2026-04-17 08:20:59.911934 | PLAY [all]
2026-04-17 08:20:59.919613 | 
2026-04-17 08:20:59.919676 | TASK [ensure-go : Check installed go version]
2026-04-17 08:21:00.452856 | instance | ok: ERROR (ignored)
2026-04-17 08:21:00.453321 | instance | {
2026-04-17 08:21:00.453367 | instance |   "failed_when_result": false,
2026-04-17 08:21:00.453397 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-17 08:21:00.453428 | instance |   "rc": 2
2026-04-17 08:21:00.453459 | instance | }
2026-04-17 08:21:00.462355 | 
2026-04-17 08:21:00.462450 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-17 08:21:00.515134 | instance | ok
2026-04-17 08:21:00.525452 | instance | included: /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-17 08:21:00.530100 | 
2026-04-17 08:21:00.530164 | TASK [ensure-go : Create temp directory]
2026-04-17 08:21:00.829588 | instance | changed
2026-04-17 08:21:00.834693 | 
2026-04-17 08:21:00.834756 | TASK [ensure-go : Get archive checksum]
2026-04-17 08:21:01.427951 | instance | ok: OK (64 bytes)
2026-04-17 08:21:01.434098 | 
2026-04-17 08:21:01.434165 | TASK [ensure-go : Download go archive]
2026-04-17 08:21:02.613573 | instance | changed: OK (78559214 bytes)
2026-04-17 08:21:02.621129 | 
2026-04-17 08:21:02.621214 | TASK [ensure-go : Install go]
2026-04-17 08:21:08.358992 | instance | changed
2026-04-17 08:21:08.365464 | 
2026-04-17 08:21:08.365522 | PLAY [all]
2026-04-17 08:21:08.371416 | 
2026-04-17 08:21:08.371476 | TASK [Copy inventory file for Zuul]
2026-04-17 08:21:09.133725 | instance | changed
2026-04-17 08:21:09.140560 | 
2026-04-17 08:21:09.140723 | TASK [Switch "ansible_host" to private IP]
2026-04-17 08:21:09.450015 | instance | changed: 1 replacements made
2026-04-17 08:21:09.457754 | 
2026-04-17 08:21:09.457879 | TASK [Run molecule prepare]
2026-04-17 08:21:09.701411 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-17 08:21:09.701584 | instance | Creating virtual environment at: .venv
2026-04-17 08:21:09.723298 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-17 08:21:09.747953 | instance | Downloading ansible-core (2.1MiB)
2026-04-17 08:21:09.748076 | instance | Downloading kubernetes (1.9MiB)
2026-04-17 08:21:09.748409 | instance | Downloading openstacksdk (1.7MiB)
2026-04-17 08:21:09.750074 | instance | Downloading pygments (1.2MiB)
2026-04-17 08:21:09.750466 | instance | Downloading setuptools (1.1MiB)
2026-04-17 08:21:09.752721 | instance | Downloading pydantic-core (2.0MiB)
2026-04-17 08:21:09.752946 | instance | Downloading netaddr (2.2MiB)
2026-04-17 08:21:09.753198 | instance | Downloading cryptography (4.2MiB)
2026-04-17 08:21:09.781193 | instance | Downloading rjsonnet (1.2MiB)
2026-04-17 08:21:10.061187 | instance |    Building pyperclip==1.9.0
2026-04-17 08:21:10.085082 | instance |  Downloading rjsonnet
2026-04-17 08:21:10.198565 | instance |  Downloading pydantic-core
2026-04-17 08:21:10.243020 | instance |  Downloading pygments
2026-04-17 08:21:10.253667 | instance |  Downloading netaddr
2026-04-17 08:21:10.274831 | instance |  Downloading cryptography
2026-04-17 08:21:10.290924 | instance |  Downloading setuptools
2026-04-17 08:21:10.345215 | instance |  Downloading kubernetes
2026-04-17 08:21:10.379656 | instance |  Downloading ansible-core
2026-04-17 08:21:10.404818 | instance |  Downloading openstacksdk
2026-04-17 08:21:10.822857 | instance |       Built pyperclip==1.9.0
2026-04-17 08:21:10.917211 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-17 08:21:10.953997 | instance | Installed 83 packages in 34ms
2026-04-17 08:21:11.546345 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-17 08:21:12.163734 | instance | INFO     [csi > discovery] scenario test matrix: prepare
2026-04-17 08:21:12.163788 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-17 08:21:57.141096 | instance | INFO     [csi > prepare] Executing
2026-04-17 08:21:58.019313 | instance |
2026-04-17 08:21:58.019937 | instance | PLAY [Prepare] *****************************************************************
2026-04-17 08:21:58.020198 | instance |
2026-04-17 08:21:58.020492 | instance | TASK [Gathering Facts] *********************************************************
2026-04-17 08:21:58.020773 | instance | Friday 17 April 2026  08:21:58 +0000 (0:00:00.035)       0:00:00.035 **********
2026-04-17 08:21:59.139707 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-17 08:21:59.139981 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-17 08:21:59.140378 | instance | interpreter could change the meaning of that path. See
2026-04-17 08:21:59.140755 | instance | https://docs.ansible.com/ansible-
2026-04-17 08:21:59.141081 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-17 08:21:59.147680 | instance | ok: [instance]
2026-04-17 08:21:59.147926 | instance |
2026-04-17 08:21:59.148202 | instance | TASK [Configure short hostname] ************************************************
2026-04-17 08:21:59.148426 | instance | Friday 17 April 2026  08:21:59 +0000 (0:00:01.129)       0:00:01.165 **********
2026-04-17 08:21:59.841147 | instance | changed: [instance]
2026-04-17 08:21:59.841404 | instance |
2026-04-17 08:21:59.841706 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-17 08:21:59.841994 | instance | Friday 17 April 2026  08:21:59 +0000 (0:00:00.692)       0:00:01.857 **********
2026-04-17 08:22:00.122371 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-17 08:22:00.122648 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-17 08:22:00.122939 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-17 08:22:00.133988 | instance | changed: [instance]
2026-04-17 08:22:00.134348 | instance |
2026-04-17 08:22:00.134808 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-17 08:22:00.135376 | instance | Friday 17 April 2026  08:22:00 +0000 (0:00:00.293)       0:00:02.151 **********
2026-04-17 08:22:00.913284 | instance | ok: [instance]
2026-04-17 08:22:00.913540 | instance |
2026-04-17 08:22:00.913831 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-17 08:22:00.914112 | instance |
2026-04-17 08:22:00.914411 | instance | TASK [Gathering Facts] *********************************************************
2026-04-17 08:22:00.914696 | instance | Friday 17 April 2026  08:22:00 +0000 (0:00:00.779)       0:00:02.930 **********
2026-04-17 08:22:01.599288 | instance | ok: [instance]
2026-04-17 08:22:01.599588 | instance |
2026-04-17 08:22:01.599862 | instance | TASK [Install depedencies] *****************************************************
2026-04-17 08:22:01.600130 | instance | Friday 17 April 2026  08:22:01 +0000 (0:00:00.686)       0:00:03.617 **********
2026-04-17 08:22:48.647625 | instance | changed: [instance]
2026-04-17 08:22:48.648042 | instance |
2026-04-17 08:22:48.648496 | instance | TASK [Start up service] ********************************************************
2026-04-17 08:22:48.648830 | instance | Friday 17 April 2026  08:22:48 +0000 (0:00:47.047)       0:00:50.664 **********
2026-04-17 08:22:49.180761 | instance | ok: [instance]
2026-04-17 08:22:49.181051 | instance |
2026-04-17 08:22:49.181384 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-17 08:22:49.181692 | instance | Friday 17 April 2026  08:22:49 +0000 (0:00:00.533)       0:00:51.198 **********
2026-04-17 08:22:49.454666 | instance | ok: [instance]
2026-04-17 08:22:49.454766 | instance |
2026-04-17 08:22:49.454882 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-17 08:22:49.455007 | instance | Friday 17 April 2026  08:22:49 +0000 (0:00:00.274)       0:00:51.472 **********
2026-04-17 08:22:50.071260 | instance | changed: [instance]
2026-04-17 08:22:50.071565 | instance |
2026-04-17 08:22:50.071879 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-17 08:22:50.072178 | instance | Friday 17 April 2026  08:22:50 +0000 (0:00:00.616)       0:00:52.088 **********
2026-04-17 08:22:50.255079 | instance | ok: [instance]
2026-04-17 08:22:50.255530 | instance |
2026-04-17 08:22:50.255865 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-17 08:22:50.256163 | instance | Friday 17 April 2026  08:22:50 +0000 (0:00:00.183)       0:00:52.272 **********
2026-04-17 08:22:50.271588 | instance | skipping: [instance]
2026-04-17 08:22:50.271822 | instance |
2026-04-17 08:22:50.272114 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-17 08:22:50.272401 | instance | Friday 17 April 2026  08:22:50 +0000 (0:00:00.016)       0:00:52.289 **********
2026-04-17 08:22:50.767391 | instance | changed: [instance] => (item=osd0)
2026-04-17 08:22:50.767661 | instance | changed: [instance] => (item=osd1)
2026-04-17 08:22:50.767945 | instance | changed: [instance] => (item=osd2)
2026-04-17 08:22:50.768218 | instance |
2026-04-17 08:22:50.768490 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-17 08:22:50.768768 | instance | Friday 17 April 2026  08:22:50 +0000 (0:00:00.495)       0:00:52.784 **********
2026-04-17 08:22:51.356448 | instance | changed: [instance] => (item=osd0)
2026-04-17 08:22:51.356695 | instance | changed: [instance] => (item=osd1)
2026-04-17 08:22:51.356963 | instance | changed: [instance] => (item=osd2)
2026-04-17 08:22:51.357219 | instance |
2026-04-17 08:22:51.357550 | instance | TASK [Start loop devices] ******************************************************
2026-04-17 08:22:51.357828 | instance | Friday 17 April 2026  08:22:51 +0000 (0:00:00.588)       0:00:53.373 **********
2026-04-17 08:22:52.024287 | instance | changed: [instance] => (item=osd0)
2026-04-17 08:22:52.024552 | instance | changed: [instance] => (item=osd1)
2026-04-17 08:22:52.024811 | instance | changed: [instance] => (item=osd2)
2026-04-17 08:22:52.025100 | instance |
2026-04-17 08:22:52.025375 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-17 08:22:52.025681 | instance | Friday 17 April 2026  08:22:52 +0000 (0:00:00.667)       0:00:54.041 **********
2026-04-17 08:22:55.205823 | instance | changed: [instance] => (item=osd0)
2026-04-17 08:22:55.205940 | instance | changed: [instance] => (item=osd1)
2026-04-17 08:22:55.206075 | instance | changed: [instance] => (item=osd2)
2026-04-17 08:22:55.206208 | instance |
2026-04-17 08:22:55.206349 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-17 08:22:55.206492 | instance | Friday 17 April 2026  08:22:55 +0000 (0:00:03.181)       0:00:57.223 **********
2026-04-17 08:22:56.961239 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-17 08:22:56.961508 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-17 08:22:56.961770 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-17 08:22:56.962030 | instance |
2026-04-17 08:22:56.962303 | instance | PLAY RECAP *********************************************************************
2026-04-17 08:22:56.962604 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-17 08:22:56.962864 | instance |
2026-04-17 08:22:56.963139 | instance | Friday 17 April 2026  08:22:56 +0000 (0:00:01.755)       0:00:58.978 **********
2026-04-17 08:22:56.963490 | instance | ===============================================================================
2026-04-17 08:22:56.963750 | instance | Install depedencies ---------------------------------------------------- 47.05s
2026-04-17 08:22:56.964023 | instance | Create a volume group for each loop device ------------------------------ 3.18s
2026-04-17 08:22:56.964321 | instance | Create a logical volume for each loop device ---------------------------- 1.76s
2026-04-17 08:22:56.964592 | instance | Gathering Facts --------------------------------------------------------- 1.13s
2026-04-17 08:22:56.964864 | instance | Purge "snapd" package --------------------------------------------------- 0.78s
2026-04-17 08:22:56.965130 | instance | Configure short hostname ------------------------------------------------ 0.69s
2026-04-17 08:22:56.965397 | instance | Gathering Facts --------------------------------------------------------- 0.69s
2026-04-17 08:22:56.965663 | instance | Start loop devices ------------------------------------------------------ 0.67s
2026-04-17 08:22:56.965930 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s
2026-04-17 08:22:56.966197 | instance | Set permissions on loopback devices ------------------------------------- 0.59s
2026-04-17 08:22:56.966465 | instance | Start up service -------------------------------------------------------- 0.53s
2026-04-17 08:22:56.966730 | instance | Create devices for Ceph ------------------------------------------------- 0.50s
2026-04-17 08:22:56.967129 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-04-17 08:22:56.967531 | instance | Generate lvm.conf ------------------------------------------------------- 0.27s
2026-04-17 08:22:56.967811 | instance | Get list of all loopback devices ---------------------------------------- 0.18s
2026-04-17 08:22:56.968082 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-17 08:22:57.026694 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-17 08:22:57.027288 | instance | INFO     Molecule executed 1 scenario (1 successful)
2026-04-17 08:22:57.366613 | instance | ok: Runtime: 0:01:47.533224
2026-04-17 08:22:57.370899 | 
2026-04-17 08:22:57.370956 | PLAY RECAP
2026-04-17 08:22:57.371013 | instance | ok: 12 changed: 9 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-17 08:22:57.371040 | 
2026-04-17 08:22:57.491664 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-17 08:22:57.495650 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-17 08:22:58.102232 | 
2026-04-17 08:22:58.102370 | PLAY [all]
2026-04-17 08:22:58.113562 | 
2026-04-17 08:22:58.113635 | TASK [Copy inventory file for Zuul]
2026-04-17 08:22:58.904406 | instance | changed
2026-04-17 08:22:59.954250 | 
2026-04-17 08:22:59.954398 | TASK [Switch "ansible_host" to private IP]
2026-04-17 08:23:00.223856 | instance | changed: 1 replacements made
2026-04-17 08:23:00.229958 | 
2026-04-17 08:23:00.230029 | TASK [Run Molecule scenario]
2026-04-17 08:23:00.846699 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-17 08:23:01.232455 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-17 08:23:01.232515 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-17 08:23:13.168940 | instance | INFO     [csi > dependency] Executing
2026-04-17 08:23:13.169037 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-04-17 08:23:13.169052 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-04-17 08:23:13.169071 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-17 08:23:13.176231 | instance | INFO     [csi > cleanup] Executing
2026-04-17 08:23:13.176479 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-17 08:23:13.184022 | instance | INFO     [csi > destroy] Executing
2026-04-17 08:23:13.184086 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-04-17 08:23:13.184099 | instance | INFO     [csi > destroy] Executed: Successful
2026-04-17 08:23:13.191557 | instance | INFO     [csi > syntax] Executing
2026-04-17 08:23:13.849732 | instance |
2026-04-17 08:23:13.849843 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-17 08:23:13.887064 | instance | INFO     [csi > syntax] Executed: Successful
2026-04-17 08:23:13.905811 | instance | INFO     [csi > create] Executing
2026-04-17 08:23:13.909517 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-17 08:23:13.916962 | instance | INFO     [csi > prepare] Executing
2026-04-17 08:23:13.916985 | instance | WARNING  [csi > prepare] Skipping, instances already prepared.
2026-04-17 08:23:13.917083 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-17 08:23:13.924327 | instance | INFO     [csi > converge] Executing
2026-04-17 08:23:14.586702 | instance |
2026-04-17 08:23:14.586923 | instance | PLAY [all] *********************************************************************
2026-04-17 08:23:14.587136 | instance |
2026-04-17 08:23:14.587440 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-17 08:23:14.587707 | instance | Friday 17 April 2026  08:23:14 +0000 (0:00:00.006)       0:00:00.006 **********
2026-04-17 08:23:20.723816 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-17 08:23:20.724018 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-17 08:23:20.724111 | instance | interpreter could change the meaning of that path. See
2026-04-17 08:23:20.724274 | instance | https://docs.ansible.com/ansible-
2026-04-17 08:23:20.724462 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-17 08:23:20.727129 | instance | ok: [instance]
2026-04-17 08:23:20.727313 | instance |
2026-04-17 08:23:20.727480 | instance | TASK [Deploy with parallel orchestrator] ***************************************
2026-04-17 08:23:20.727647 | instance | Friday 17 April 2026  08:23:20 +0000 (0:00:06.140)       0:00:06.147 **********
2026-04-17 08:24:45.719308 | instance | fatal: [instance]: FAILED! => {"changed": false, "cmd": ". .venv/bin/activate && ./bin/atmosphere deploy --inventory ./inventory.yaml \n", "delta": "0:01:24.818132", "end": "2026-04-17 08:24:45.689119", "msg": "non-zero return code", "rc": 1, "start": "2026-04-17 08:23:20.870987", "stderr": "Error: component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int    Max concurrent deployments per wave (0 = unlimited)\n  -h, --help               help for deploy\n  -i, --inventory string   Path to Ansible inventory file (required)\n  -t, --tags string        Comma-separated list of component tags to deploy\n\ncomponent ceph failed: ansible-playbook failed for ceph/ceph: exit status 2", "stderr_lines": ["Error: component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int    Max concurrent deployments per wave (0 = unlimited)", "  -h, --help               help for deploy", "  -i, --inventory string   Path to Ansible inventory file (required)", "  -t, --tags string        Comma-separated list of component tags to deploy", "", "component ceph failed: ansible-playbook failed for ceph/ceph: exit status 2"], "stdout": "==> Running preflight checks\n[preflight] \n[preflight] PLAY [Preflight checks] ********************************************************\n[preflight] \n[preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************\n[preflight] skipping: [instance]\n[preflight] \n[preflight] PLAY RECAP *********************************************************************\n[preflight] instance                   : ok=0    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0   \n[preflight] \n==> Preflight checks passed\n==> Starting parallel deployment\n==> [udev] Starting deployment\n==> [multipathd] Starting deployment\n==> [ceph] Starting deployment\n==> [iscsi] Starting deployment\n==> [kubernetes] Starting deployment\n==> [lpfc] Starting deployment\n[udev/udev] \n[udev/udev] PLAY [controllers:computes] ****************************************************\n[udev/udev] \n[udev/udev] TASK [Gathering Facts] *********************************************************\n[iscsi/iscsi] \n[iscsi/iscsi] PLAY [controllers:computes] ****************************************************\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [Gathering Facts] *********************************************************\n[multipathd/multipathd] \n[multipathd/multipathd] PLAY [controllers:computes] ****************************************************\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [Gathering Facts] *********************************************************\n[lpfc/lpfc] \n[lpfc/lpfc] PLAY [controllers:computes] ****************************************************\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [Gathering Facts] *********************************************************\n[ceph/ceph] \n[ceph/ceph] PLAY [all] *********************************************************************\n[ceph/ceph] \n[ceph/ceph] TASK [Gathering Facts] *********************************************************\n[udev/udev] [WARNING]: Platform linux on host instance is using the discovered Python\n[udev/udev] interpreter at /usr/bin/python3.10, but future installation of another Python\n[udev/udev] interpreter could change the meaning of that path. See\n[udev/udev] https://docs.ansible.com/ansible-\n[udev/udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[udev/udev] ok: [instance]\n[udev/udev] \n[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***\n[iscsi/iscsi] [WARNING]: Platform linux on host instance is using the discovered Python\n[iscsi/iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python\n[iscsi/iscsi] interpreter could change the meaning of that path. See\n[iscsi/iscsi] https://docs.ansible.com/ansible-\n[iscsi/iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[iscsi/iscsi] ok: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************\n[multipathd/multipathd] [WARNING]: Platform linux on host instance is using the discovered Python\n[multipathd/multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python\n[multipathd/multipathd] interpreter could change the meaning of that path. See\n[multipathd/multipathd] https://docs.ansible.com/ansible-\n[multipathd/multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[multipathd/multipathd] ok: [instance]\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************\n[lpfc/lpfc] [WARNING]: Platform linux on host instance is using the discovered Python\n[lpfc/lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python\n[lpfc/lpfc] interpreter could change the meaning of that path. See\n[lpfc/lpfc] https://docs.ansible.com/ansible-\n[lpfc/lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[lpfc/lpfc] ok: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********\n[ceph/ceph] [WARNING]: Platform linux on host instance is using the discovered Python\n[ceph/ceph] interpreter at /usr/bin/python3.10, but future installation of another Python\n[ceph/ceph] interpreter could change the meaning of that path. See\n[ceph/ceph] https://docs.ansible.com/ansible-\n[ceph/ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [Fail if atmosphere_ceph_enabled is set] **********************************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] PLAY [Deploy Ceph monitors & managers] *****************************************\n[ceph/ceph] \n[ceph/ceph] TASK [Gathering Facts] *********************************************************\n[lpfc/lpfc] ok: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****\n[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***\n[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) \n[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) \n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] TASK [Reboot the system if the configuration file has changed] *****************\n[lpfc/lpfc] skipping: [instance]\n[lpfc/lpfc] \n[lpfc/lpfc] PLAY RECAP *********************************************************************\n[lpfc/lpfc] instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   \n[lpfc/lpfc] \n==> [lpfc] Deployment complete\n[udev/udev] changed: [instance]\n[udev/udev] \n[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******\n[iscsi/iscsi] ok: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************\n[udev/udev] changed: [instance]\n[udev/udev] \n[udev/udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[udev/udev] ok: [instance]\n[udev/udev] \n[udev/udev] PLAY RECAP *********************************************************************\n[udev/udev] instance                   : ok=4    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   \n[udev/udev] \n==> [udev] Deployment complete\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***\n[iscsi/iscsi] changed: [instance]\n[iscsi/iscsi] \n[iscsi/iscsi] PLAY RECAP *********************************************************************\n[iscsi/iscsi] instance                   : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   \n[iscsi/iscsi] \n==> [iscsi] Deployment complete\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph]     \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph]     \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********\n[ceph/ceph] skipping: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************\n[multipathd/multipathd] changed: [instance]\n[multipathd/multipathd] \n[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] *******\n[ceph/ceph] changed: [instance] => (item={'path': '/etc/containerd'})\n[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Create containerd config file] **********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.containerd : Enable and start service] ***************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******\n[ceph/ceph] ok: [instance] => {\n[ceph/ceph]     \"msg\": \"https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz\"\n[ceph/ceph] }\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ******************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Ensure group \"docker\" exists] ***************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] *****\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create folders for configuration] ***********\n[ceph/ceph] changed: [instance] => (item={'path': '/etc/docker'})\n[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})\n[ceph/ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] ***********\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************\n[ceph/ceph] ok: [instance]\n[ceph/ceph] \n[ceph/ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.containers.docker : Enable and start service] *******************\n[ceph/ceph] changed: [instance]\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******\n[ceph/ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)\n[ceph/ceph] \n[ceph/ceph] TASK [vexxhost.ceph.cephadm : Install packages] ********************************\n[ceph/ceph] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776414216, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\"       install 'chrony=4.2-2ubuntu2'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}\n[ceph/ceph] \n[ceph/ceph] PLAY RECAP *********************************************************************\n[ceph/ceph] instance                   : ok=33   changed=19   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0   \n[ceph/ceph] ", "stdout_lines": ["==> Running preflight checks", "[preflight] ", "[preflight] PLAY [Preflight checks] ********************************************************", "[preflight] ", "[preflight] TASK [Fail if atmosphere_ceph_enabled is set] **********************************", "[preflight] skipping: [instance]", "[preflight] ", "[preflight] PLAY RECAP *********************************************************************", "[preflight] instance                   : ok=0    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0   ", "[preflight] ", "==> Preflight checks passed", "==> Starting parallel deployment", "==> [udev] Starting deployment", "==> [multipathd] Starting deployment", "==> [ceph] Starting deployment", "==> [iscsi] Starting deployment", "==> [kubernetes] Starting deployment", "==> [lpfc] Starting deployment", "[udev/udev] ", "[udev/udev] PLAY [controllers:computes] ****************************************************", "[udev/udev] ", "[udev/udev] TASK [Gathering Facts] *********************************************************", "[iscsi/iscsi] ", "[iscsi/iscsi] PLAY [controllers:computes] ****************************************************", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [Gathering Facts] *********************************************************", "[multipathd/multipathd] ", "[multipathd/multipathd] PLAY [controllers:computes] ****************************************************", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [Gathering Facts] *********************************************************", "[lpfc/lpfc] ", "[lpfc/lpfc] PLAY [controllers:computes] ****************************************************", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [Gathering Facts] *********************************************************", "[ceph/ceph] ", "[ceph/ceph] PLAY [all] *********************************************************************", "[ceph/ceph] ", "[ceph/ceph] TASK [Gathering Facts] *********************************************************", "[udev/udev] [WARNING]: Platform linux on host instance is using the discovered Python", "[udev/udev] interpreter at /usr/bin/python3.10, but future installation of another Python", "[udev/udev] interpreter could change the meaning of that path. See", "[udev/udev] https://docs.ansible.com/ansible-", "[udev/udev] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[udev/udev] ok: [instance]", "[udev/udev] ", "[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for Pure Storage FlashArray] ***", "[iscsi/iscsi] [WARNING]: Platform linux on host instance is using the discovered Python", "[iscsi/iscsi] interpreter at /usr/bin/python3.10, but future installation of another Python", "[iscsi/iscsi] interpreter could change the meaning of that path. See", "[iscsi/iscsi] https://docs.ansible.com/ansible-", "[iscsi/iscsi] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[iscsi/iscsi] ok: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Install iscsi package] ***********************", "[multipathd/multipathd] [WARNING]: Platform linux on host instance is using the discovered Python", "[multipathd/multipathd] interpreter at /usr/bin/python3.10, but future installation of another Python", "[multipathd/multipathd] interpreter could change the meaning of that path. See", "[multipathd/multipathd] https://docs.ansible.com/ansible-", "[multipathd/multipathd] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[multipathd/multipathd] ok: [instance]", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************", "[lpfc/lpfc] [WARNING]: Platform linux on host instance is using the discovered Python", "[lpfc/lpfc] interpreter at /usr/bin/python3.10, but future installation of another Python", "[lpfc/lpfc] interpreter could change the meaning of that path. See", "[lpfc/lpfc] https://docs.ansible.com/ansible-", "[lpfc/lpfc] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[lpfc/lpfc] ok: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the \"lpfc\" module is loaded] ********", "[ceph/ceph] [WARNING]: Platform linux on host instance is using the discovered Python", "[ceph/ceph] interpreter at /usr/bin/python3.10, but future installation of another Python", "[ceph/ceph] interpreter could change the meaning of that path. See", "[ceph/ceph] https://docs.ansible.com/ansible-", "[ceph/ceph] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [Fail if atmosphere_ceph_enabled is set] **********************************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [Set a fact with the \"atmosphere_images\" for other plays] *****************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] PLAY [Deploy Ceph monitors & managers] *****************************************", "[ceph/ceph] ", "[ceph/ceph] TASK [Gathering Facts] *********************************************************", "[lpfc/lpfc] ok: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Install the configuration file] ***************", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Get the values for the module parameters] *****", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Detect if the run-time module parameters are set correctly] ***", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_lun_queue_depth) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_sg_seg_cnt) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_max_luns) ", "[lpfc/lpfc] skipping: [instance] => (item=lpfc_enable_fc4_type) ", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [vexxhost.atmosphere.lpfc : Update \"initramfs\" if the configuration file has changed] ***", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] TASK [Reboot the system if the configuration file has changed] *****************", "[lpfc/lpfc] skipping: [instance]", "[lpfc/lpfc] ", "[lpfc/lpfc] PLAY RECAP *********************************************************************", "[lpfc/lpfc] instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0   ", "[lpfc/lpfc] ", "==> [lpfc] Deployment complete", "[udev/udev] changed: [instance]", "[udev/udev] ", "[udev/udev] TASK [vexxhost.atmosphere.udev : Add udev rules for SCSI Unit Attention] *******", "[iscsi/iscsi] ok: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] TASK [vexxhost.atmosphere.iscsi : Ensure iscsid is started] ********************", "[udev/udev] changed: [instance]", "[udev/udev] ", "[udev/udev] RUNNING HANDLER [vexxhost.atmosphere.udev : Reload udev] ***********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[udev/udev] ok: [instance]", "[udev/udev] ", "[udev/udev] PLAY RECAP *********************************************************************", "[udev/udev] instance                   : ok=4    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   ", "[udev/udev] ", "==> [udev] Deployment complete", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***", "[iscsi/iscsi] changed: [instance]", "[iscsi/iscsi] ", "[iscsi/iscsi] PLAY RECAP *********************************************************************", "[iscsi/iscsi] instance                   : ok=3    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   ", "[iscsi/iscsi] ", "==> [iscsi] Deployment complete", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph]     \"msg\": \"https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.package : Update state for tar] **********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph]     \"msg\": \"https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Install SELinux packages] ***************", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********", "[ceph/ceph] skipping: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Install AppArmor packages] **************", "[multipathd/multipathd] changed: [instance]", "[multipathd/multipathd] ", "[multipathd/multipathd] TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create folders for configuration] *******", "[ceph/ceph] changed: [instance] => (item={'path': '/etc/containerd'})", "[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Create containerd config file] **********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.containerd : Enable and start service] ***************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.forget_package : Forget package] *********************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Starting download of file] *******", "[ceph/ceph] ok: [instance] => {", "[ceph/ceph]     \"msg\": \"https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz\"", "[ceph/ceph] }", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Download item] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.download_artifact : Extract archive] *****************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Install AppArmor packages] ******************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Ensure group \"docker\" exists] ***************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd service file for docker] *****", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create folders for configuration] ***********", "[ceph/ceph] changed: [instance] => (item={'path': '/etc/docker'})", "[ceph/ceph] changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})", "[ceph/ceph] changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Create docker daemon config file] ***********", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Force any restarts if necessary] ************", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************", "[ceph/ceph] ok: [instance]", "[ceph/ceph] ", "[ceph/ceph] RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.containers.docker : Enable and start service] *******************", "[ceph/ceph] changed: [instance]", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******", "[ceph/ceph] ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)", "[ceph/ceph] ", "[ceph/ceph] TASK [vexxhost.ceph.cephadm : Install packages] ********************************", "[ceph/ceph] fatal: [instance]: FAILED! => {\"cache_update_time\": 1776414216, \"cache_updated\": false, \"changed\": false, \"msg\": \"'/usr/bin/apt-get -y -o \\\"Dpkg::Options::=--force-confdef\\\" -o \\\"Dpkg::Options::=--force-confold\\\"       install 'chrony=4.2-2ubuntu2'' failed: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"rc\": 100, \"stderr\": \"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n\", \"stderr_lines\": [\"E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 12103 (apt-get)\", \"E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\"], \"stdout\": \"\", \"stdout_lines\": []}", "[ceph/ceph] ", "[ceph/ceph] PLAY RECAP *********************************************************************", "[ceph/ceph] instance                   : ok=33   changed=19   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0   ", "[ceph/ceph] "]}
2026-04-17 08:24:45.719637 | instance |
2026-04-17 08:24:45.719938 | instance | PLAY RECAP *********************************************************************
2026-04-17 08:24:45.720258 | instance | instance                   : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-04-17 08:24:45.720521 | instance |
2026-04-17 08:24:45.720840 | instance | Friday 17 April 2026  08:24:45 +0000 (0:01:24.991)       0:01:31.139 **********
2026-04-17 08:24:45.721118 | instance | ===============================================================================
2026-04-17 08:24:45.721406 | instance | Deploy with parallel orchestrator -------------------------------------- 84.99s
2026-04-17 08:24:45.721697 | instance | Build atmosphere binary ------------------------------------------------- 6.14s
2026-04-17 08:24:45.782821 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-17 08:24:45.782929 | instance | ERROR    [csi > converge] Executed: Failed
2026-04-17 08:24:45.783033 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-17 08:24:45.889667 | instance | ERROR
2026-04-17 08:24:45.889832 | instance | {
2026-04-17 08:24:45.889873 | instance |   "delta": "0:01:45.284628",
2026-04-17 08:24:45.889903 | instance |   "end": "2026-04-17 08:24:45.826898",
2026-04-17 08:24:45.889930 | instance |   "msg": "non-zero return code",
2026-04-17 08:24:45.889957 | instance |   "rc": 2,
2026-04-17 08:24:45.889985 | instance |   "start": "2026-04-17 08:23:00.542270"
2026-04-17 08:24:45.890015 | instance | }
failure
2026-04-17 08:24:45.898704 | 
2026-04-17 08:24:45.898767 | PLAY RECAP
2026-04-17 08:24:45.898828 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-17 08:24:45.898857 | 
2026-04-17 08:24:46.012710 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-17 08:24:46.016813 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-17 08:24:46.591442 | 
2026-04-17 08:24:46.591564 | PLAY [all]
2026-04-17 08:24:46.605408 | 
2026-04-17 08:24:46.605493 | TASK [gather-host-logs : creating directory for system status]
2026-04-17 08:24:46.930740 | instance | changed
2026-04-17 08:24:46.938065 | 
2026-04-17 08:24:46.938168 | TASK [gather-host-logs : Get logs for each host]
2026-04-17 08:24:47.279531 | instance | + systemd-cgls --full --all --no-pager
2026-04-17 08:24:47.288521 | instance | + ip addr
2026-04-17 08:24:47.291017 | instance | + ip route
2026-04-17 08:24:47.293738 | instance | + lsblk
2026-04-17 08:24:47.296511 | instance | + mount
2026-04-17 08:24:47.299147 | instance | + docker images
2026-04-17 08:24:47.320165 | instance | + brctl show
2026-04-17 08:24:47.320819 | instance | /bin/bash: line 8: brctl: command not found
2026-04-17 08:24:47.321145 | instance | + ps aux --sort=-%mem
2026-04-17 08:24:47.333917 | instance | + dpkg -l
2026-04-17 08:24:47.344973 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-17 08:24:47.345680 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-17 08:24:47.369121 | instance | + '[' '!' -z '' ']'
2026-04-17 08:24:47.475286 | instance | ok: Runtime: 0:00:00.096426
2026-04-17 08:24:47.481461 | 
2026-04-17 08:24:47.481564 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-17 08:24:48.143863 | instance | changed:
2026-04-17 08:24:48.144126 | instance | created directory /var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/logs/instance
2026-04-17 08:24:48.144170 | instance | cd+++++++++ system/
2026-04-17 08:24:48.144210 | instance | >f+++++++++ system/brctl-show.txt
2026-04-17 08:24:48.144242 | instance | >f+++++++++ system/docker-images.txt
2026-04-17 08:24:48.144271 | instance | >f+++++++++ system/ip-addr.txt
2026-04-17 08:24:48.144303 | instance | >f+++++++++ system/ip-route.txt
2026-04-17 08:24:48.144333 | instance | >f+++++++++ system/lsblk.txt
2026-04-17 08:24:48.144362 | instance | >f+++++++++ system/mount.txt
2026-04-17 08:24:48.144391 | instance | >f+++++++++ system/packages.txt
2026-04-17 08:24:48.144418 | instance | >f+++++++++ system/ps.txt
2026-04-17 08:24:48.144449 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-17 08:24:48.156968 | 
2026-04-17 08:24:48.157109 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-17 08:24:48.371370 | instance | changed: "values"
2026-04-17 08:24:48.532512 | instance | changed: "releases"
2026-04-17 08:24:48.550932 | 
2026-04-17 08:24:48.551155 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-17 08:24:48.754783 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-17 08:24:49.093187 | instance | ok: Runtime: 0:00:00.005614
2026-04-17 08:24:49.098413 | 
2026-04-17 08:24:49.098484 | TASK [helm-release-status : Downloads logs to executor]
2026-04-17 08:24:49.595437 | instance | changed:
2026-04-17 08:24:49.595629 | instance | cd+++++++++ helm/
2026-04-17 08:24:49.595669 | instance | cd+++++++++ helm/releases/
2026-04-17 08:24:49.595701 | instance | cd+++++++++ helm/values/
2026-04-17 08:24:49.607429 | 
2026-04-17 08:24:49.607531 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-17 08:24:49.801898 | instance | changed
2026-04-17 08:24:49.810108 | 
2026-04-17 08:24:49.810206 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-17 08:24:50.012166 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-17 08:24:50.012401 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-17 08:24:50.018693 | instance | environment: line 1: kubectl: command not found
2026-04-17 08:24:50.020183 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-17 08:24:50.021626 | instance | environment: line 1: kubectl: command not found
2026-04-17 08:24:50.022537 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-17 08:24:50.023814 | instance | environment: line 1: kubectl: command not found
2026-04-17 08:24:50.024755 | instance | environment: line 1: kubectl: command not found
2026-04-17 08:24:50.025242 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-17 08:24:50.025660 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-17 08:24:50.027593 | instance | environment: line 1: kubectl: command not found
2026-04-17 08:24:50.029061 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-17 08:24:50.344464 | instance | ok: Runtime: 0:00:00.024028
2026-04-17 08:24:50.350816 | 
2026-04-17 08:24:50.350885 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-17 08:24:50.549250 | instance | changed
2026-04-17 08:24:50.556346 | 
2026-04-17 08:24:50.556448 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-17 08:24:50.804454 | instance | environment: line 5: kubectl: command not found
2026-04-17 08:24:50.805547 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuexargs:
2026-04-17 08:24:50.805568 | instance | warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-17 08:24:50.806409 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-17 08:24:51.136588 | instance | ok: Runtime: 0:00:00.008599
2026-04-17 08:24:51.143773 | 
2026-04-17 08:24:51.143860 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-17 08:24:51.672484 | instance | changed:
2026-04-17 08:24:51.672644 | instance | cd+++++++++ objects/
2026-04-17 08:24:51.672672 | instance | cd+++++++++ objects/cluster/
2026-04-17 08:24:51.672695 | instance | cd+++++++++ objects/namespaced/
2026-04-17 08:24:51.681340 | 
2026-04-17 08:24:51.681403 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-17 08:24:51.887194 | instance | changed
2026-04-17 08:24:51.894528 | 
2026-04-17 08:24:51.894641 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-17 08:24:52.091747 | instance | changed
2026-04-17 08:24:52.098408 | 
2026-04-17 08:24:52.098501 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-17 08:24:52.300030 | instance | environment: line 3: kubectl: command not found
2026-04-17 08:24:52.634400 | instance | ok: Runtime: 0:00:00.011003
2026-04-17 08:24:52.641097 | 
2026-04-17 08:24:52.641184 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-17 08:24:53.127178 | instance | changed:
2026-04-17 08:24:53.127372 | instance | cd+++++++++ pod-logs/
2026-04-17 08:24:53.127407 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-17 08:24:53.141026 | 
2026-04-17 08:24:53.141175 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-17 08:24:53.356580 | instance | changed
2026-04-17 08:24:53.363856 | 
2026-04-17 08:24:53.363965 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-17 08:24:53.586525 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-17 08:24:53.910623 | instance | ok: Runtime: 0:00:00.037428
2026-04-17 08:24:53.917309 | 
2026-04-17 08:24:53.917380 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-17 08:24:54.125855 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-17 08:24:54.156923 | instance | ceph-mgr endpoints:
2026-04-17 08:24:54.452702 | instance | ok: Runtime: 0:00:00.037937
2026-04-17 08:24:54.460290 | 
2026-04-17 08:24:54.460408 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-17 08:24:54.677725 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-17 08:24:54.994250 | instance | ok: Runtime: 0:00:00.038793
2026-04-17 08:24:54.999492 | 
2026-04-17 08:24:54.999644 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-17 08:24:55.467614 | instance | changed: cd+++++++++ prometheus/
2026-04-17 08:24:55.479641 | 
2026-04-17 08:24:55.479745 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-17 08:24:55.691858 | instance | changed
2026-04-17 08:24:55.696700 | 
2026-04-17 08:24:55.696763 | TASK [gather-selenium-data : Get selenium data]
2026-04-17 08:24:55.905946 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-17 08:24:55.907576 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-17 08:24:56.228974 | instance | ERROR
2026-04-17 08:24:56.229278 | instance | {
2026-04-17 08:24:56.229311 | instance |   "delta": "0:00:00.006679",
2026-04-17 08:24:56.229332 | instance |   "end": "2026-04-17 08:24:55.907950",
2026-04-17 08:24:56.229354 | instance |   "msg": "non-zero return code",
2026-04-17 08:24:56.229380 | instance |   "rc": 1,
2026-04-17 08:24:56.229403 | instance |   "start": "2026-04-17 08:24:55.901271"
2026-04-17 08:24:56.229426 | instance | }
2026-04-17 08:24:56.229454 | instance | ERROR: Ignoring Errors
2026-04-17 08:24:56.235852 | 
2026-04-17 08:24:56.235951 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-17 08:24:56.721149 | instance | changed: cd+++++++++ selenium/
2026-04-17 08:24:56.727893 | 
2026-04-17 08:24:56.727966 | PLAY RECAP
2026-04-17 08:24:56.728034 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-17 08:24:56.728056 | 
2026-04-17 08:24:56.861400 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-17 08:24:56.865202 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-17 08:24:57.443129 | 
2026-04-17 08:24:57.443250 | PLAY [all]
2026-04-17 08:24:57.454844 | 
2026-04-17 08:24:57.454925 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-17 08:24:57.499218 | instance | skipping: Conditional result was False
2026-04-17 08:24:57.531024 | 
2026-04-17 08:24:57.531104 | TASK [fetch-output : Set log path for single node]
2026-04-17 08:24:57.562304 | instance | ok
2026-04-17 08:24:57.568359 | 
2026-04-17 08:24:57.568448 | LOOP [fetch-output : Ensure local output dirs]
2026-04-17 08:24:57.979717 | instance -> localhost | ok: "/var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/logs"
2026-04-17 08:24:58.191686 | instance -> localhost | changed: "/var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/artifacts"
2026-04-17 08:24:58.408273 | instance -> localhost | changed: "/var/lib/zuul/builds/576a0f358f1249ea91802ce9679e0eae/work/docs"
2026-04-17 08:24:58.424294 | 
2026-04-17 08:24:58.424443 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-17 08:24:59.039239 | instance | changed: .d..t...... ./
2026-04-17 08:24:59.039501 | instance | changed: All items complete
2026-04-17 08:24:59.039543 | 
2026-04-17 08:24:59.469636 | instance | changed: .d..t...... ./
2026-04-17 08:24:59.915989 | instance | changed: .d..t...... ./
2026-04-17 08:24:59.934752 | 
2026-04-17 08:24:59.934889 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-17 08:25:00.344698 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006967
2026-04-17 08:25:00.563391 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006631
2026-04-17 08:25:00.584198 | 
2026-04-17 08:25:00.584340 | PLAY [all]
2026-04-17 08:25:00.592647 | 
2026-04-17 08:25:00.592729 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-17 08:25:00.990814 | instance | changed
2026-04-17 08:25:00.998158 | 
2026-04-17 08:25:00.998244 | PLAY RECAP
2026-04-17 08:25:00.998306 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-17 08:25:00.998337 | 
2026-04-17 08:25:01.100823 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-17 08:25:01.104914 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-17 08:25:01.727490 | 
2026-04-17 08:25:01.727622 | PLAY [localhost]
2026-04-17 08:25:01.738651 | 
2026-04-17 08:25:01.738727 | TASK [Generate Zuul manifest]
2026-04-17 08:25:01.761930 | localhost | ok
2026-04-17 08:25:01.777616 | 
2026-04-17 08:25:01.777722 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-17 08:25:02.100298 | localhost | changed
2026-04-17 08:25:02.113500 | 
2026-04-17 08:25:02.113609 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-17 08:25:02.144016 | localhost | ok
2026-04-17 08:25:02.153412 | 
2026-04-17 08:25:02.153477 | TASK [Upload logs]
2026-04-17 08:25:02.173147 | localhost | ok
2026-04-17 08:25:02.236900 | 
2026-04-17 08:25:02.237079 | TASK [Set zuul-log-path fact]
2026-04-17 08:25:02.259178 | localhost | ok
2026-04-17 08:25:02.274155 | 
2026-04-17 08:25:02.274257 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-17 08:25:02.305782 | localhost | ok
2026-04-17 08:25:02.314251 | 
2026-04-17 08:25:02.314318 | TASK [upload-logs : Create log directories]
2026-04-17 08:25:02.737677 | localhost | changed
2026-04-17 08:25:02.743802 | 
2026-04-17 08:25:02.743890 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-17 08:25:03.159567 | localhost -> localhost | ok: Runtime: 0:00:00.004360
2026-04-17 08:25:03.165340 | 
2026-04-17 08:25:03.165424 | TASK [upload-logs : Upload logs to log server]
2026-04-17 08:25:03.661403 | localhost | Output suppressed because no_log was given
2026-04-17 08:25:03.664925 | 
2026-04-17 08:25:03.665015 | LOOP [upload-logs : Compress console log and json output]
2026-04-17 08:25:03.715403 | localhost | skipping: Conditional result was False
2026-04-17 08:25:03.725123 | localhost | skipping: Conditional result was False
2026-04-17 08:25:03.737163 | 
2026-04-17 08:25:03.737356 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-17 08:25:03.782096 | localhost | skipping: Conditional result was False
2026-04-17 08:25:03.782418 | 
2026-04-17 08:25:03.787014 | localhost | skipping: Conditional result was False
2026-04-17 08:25:03.802182 | 
2026-04-17 08:25:03.802268 | LOOP [upload-logs : Upload console log and json output]