2026-09-07 18:07:26.076820 | Job console starting
2026-09-07 18:07:26.087738 | Updating git repos
2026-09-07 18:07:29.283206 | Cloning repos into workspace
2026-09-07 18:07:51.393841 | Restoring repo states
2026-09-07 18:07:59.417738 | Merging changes
2026-09-07 18:08:00.549118 | Checking out repos
2026-09-07 18:08:03.028079 | Preparing playbooks
2026-09-07 18:08:05.921700 | Running Ansible setup
2026-09-07 18:08:09.484115 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-07 18:08:10.046306 | 
2026-09-07 18:08:10.046477 | PLAY [localhost]
2026-09-07 18:08:10.054357 | 
2026-09-07 18:08:10.054424 | TASK [Gathering Facts]
2026-09-07 18:08:10.922980 | localhost | ok
2026-09-07 18:08:10.936363 | 
2026-09-07 18:08:10.936569 | TASK [Setup log path fact]
2026-09-07 18:08:10.968020 | localhost | ok
2026-09-07 18:08:10.989049 | 
2026-09-07 18:08:10.989238 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-07 18:08:11.027140 | localhost | ok
2026-09-07 18:08:11.038700 | 
2026-09-07 18:08:11.038815 | TASK [emit-job-header : Print job information]
2026-09-07 18:08:11.092625 | # Job Information
2026-09-07 18:08:11.092922 | Ansible Version: 2.16.18
2026-09-07 18:08:11.093016 | Job: atmosphere-molecule-csi-rbd
2026-09-07 18:08:11.093064 | Pipeline: check
2026-09-07 18:08:11.093106 | Executor: 2d72f0692154
2026-09-07 18:08:11.093147 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3501
2026-09-07 18:08:11.093197 | Event ID: 79e27400-aae6-11f1-91af-67a8282c6b75
2026-09-07 18:08:11.098895 | 
2026-09-07 18:08:11.099043 | LOOP [emit-job-header : Print node information]
2026-09-07 18:08:11.185513 | localhost | ok:
2026-09-07 18:08:11.185803 | localhost | # Node Information
2026-09-07 18:08:11.185882 | localhost | Inventory Hostname: instance
2026-09-07 18:08:11.185930 | localhost | Hostname: np0000192140
2026-09-07 18:08:11.186008 | localhost | Username: zuul
2026-09-07 18:08:11.186062 | localhost | Distro: Ubuntu 22.04
2026-09-07 18:08:11.186104 | localhost | Provider: yul1
2026-09-07 18:08:11.186171 | localhost | Region: ca-ymq-1
2026-09-07 18:08:11.186301 | localhost | Label: ubuntu-jammy
2026-09-07 18:08:11.186381 | localhost | Product Name: OpenStack Nova
2026-09-07 18:08:11.186431 | localhost | Interface IP: 162.253.55.56
2026-09-07 18:08:11.199050 | 
2026-09-07 18:08:11.199196 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-09-07 18:08:11.559879 | localhost -> localhost | changed
2026-09-07 18:08:11.569381 | 
2026-09-07 18:08:11.569700 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-09-07 18:08:12.497767 | localhost -> localhost | changed
2026-09-07 18:08:12.508705 | 
2026-09-07 18:08:12.508820 | PLAY [all]
2026-09-07 18:08:12.523927 | 
2026-09-07 18:08:12.524075 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-09-07 18:08:12.792441 | instance -> localhost | ok
2026-09-07 18:08:12.804611 | 
2026-09-07 18:08:12.804776 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-09-07 18:08:12.839673 | instance | ok
2026-09-07 18:08:12.868605 | instance | included: /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-07 18:08:12.875934 | 
2026-09-07 18:08:12.876042 | TASK [add-build-sshkey : Create Temp SSH key]
2026-09-07 18:08:13.639907 | instance -> localhost | Generating public/private rsa key pair.
2026-09-07 18:08:13.640295 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/6fad926e4b0d434c9058f77903de6f3a_id_rsa
2026-09-07 18:08:13.640364 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/6fad926e4b0d434c9058f77903de6f3a_id_rsa.pub
2026-09-07 18:08:13.640409 | instance -> localhost | The key fingerprint is:
2026-09-07 18:08:13.640451 | instance -> localhost | SHA256:nMfuYaiU//e5D145kAYg0G8vqXiqCqLlSk6cmcdoWOg zuul-build-sshkey
2026-09-07 18:08:13.640578 | instance -> localhost | The key's randomart image is:
2026-09-07 18:08:13.640636 | instance -> localhost | +---[RSA 3072]----+
2026-09-07 18:08:13.640690 | instance -> localhost | |     .o. .       |
2026-09-07 18:08:13.640733 | instance -> localhost | |       .. .      |
2026-09-07 18:08:13.640772 | instance -> localhost | |        .  .     |
2026-09-07 18:08:13.640811 | instance -> localhost | | .     . =  . .  |
2026-09-07 18:08:13.640849 | instance -> localhost | |. .     S =  +   |
2026-09-07 18:08:13.640887 | instance -> localhost | |+.*    . * .. . .|
2026-09-07 18:08:13.640924 | instance -> localhost | |+E.o  + o =   .o.|
2026-09-07 18:08:13.640984 | instance -> localhost | |Oo.  o = o ... +.|
2026-09-07 18:08:13.641031 | instance -> localhost | |o+o...+ ..o. .=o.|
2026-09-07 18:08:13.641069 | instance -> localhost | +----[SHA256]-----+
2026-09-07 18:08:13.641165 | instance -> localhost | ok: Runtime: 0:00:00.300069
2026-09-07 18:08:13.653376 | 
2026-09-07 18:08:13.653519 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-09-07 18:08:13.688271 | instance | ok
2026-09-07 18:08:13.703845 | instance | included: /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-07 18:08:13.715085 | 
2026-09-07 18:08:13.715168 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-09-07 18:08:13.739775 | instance | skipping: Conditional result was False
2026-09-07 18:08:13.749908 | 
2026-09-07 18:08:13.750056 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-09-07 18:08:14.230355 | instance | changed
2026-09-07 18:08:14.244555 | 
2026-09-07 18:08:14.244802 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-09-07 18:08:14.482334 | instance | ok
2026-09-07 18:08:14.493415 | 
2026-09-07 18:08:14.493632 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-09-07 18:08:15.012320 | instance | changed
2026-09-07 18:08:15.024417 | 
2026-09-07 18:08:15.024648 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-09-07 18:08:15.497525 | instance | changed
2026-09-07 18:08:15.503314 | 
2026-09-07 18:08:15.503382 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-09-07 18:08:15.538351 | instance | skipping: Conditional result was False
2026-09-07 18:08:15.545524 | 
2026-09-07 18:08:15.545611 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-09-07 18:08:15.965030 | instance -> localhost | changed
2026-09-07 18:08:15.974849 | 
2026-09-07 18:08:15.974926 | TASK [add-build-sshkey : Add back temp key]
2026-09-07 18:08:16.293770 | instance -> localhost | Identity added: /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/6fad926e4b0d434c9058f77903de6f3a_id_rsa (zuul-build-sshkey)
2026-09-07 18:08:16.294160 | instance -> localhost | ok: Runtime: 0:00:00.022027
2026-09-07 18:08:16.300575 | 
2026-09-07 18:08:16.300661 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-09-07 18:08:16.639542 | instance | ok
2026-09-07 18:08:16.647861 | 
2026-09-07 18:08:16.648004 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-09-07 18:08:16.683455 | instance | skipping: Conditional result was False
2026-09-07 18:08:16.701503 | 
2026-09-07 18:08:16.701657 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-09-07 18:08:17.128913 | instance | ok
2026-09-07 18:08:17.136938 | 
2026-09-07 18:08:17.137091 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-09-07 18:08:20.863025 | instance | Output suppressed because no_log was given
2026-09-07 18:08:20.876811 | 
2026-09-07 18:08:20.876902 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-09-07 18:08:21.104334 | instance | ok: "logs"
2026-09-07 18:08:21.104694 | instance | ok: All items complete
2026-09-07 18:08:21.104734 | 
2026-09-07 18:08:21.283678 | instance | ok: "artifacts"
2026-09-07 18:08:21.432730 | instance | ok: "docs"
2026-09-07 18:08:21.452336 | 
2026-09-07 18:08:21.452623 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-09-07 18:08:21.681499 | instance | changed: "logs"
2026-09-07 18:08:21.869812 | instance | changed: "artifacts"
2026-09-07 18:08:22.055787 | instance | changed: "docs"
2026-09-07 18:08:22.077906 | 
2026-09-07 18:08:22.078092 | PLAY RECAP
2026-09-07 18:08:22.078179 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-07 18:08:22.078234 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 18:08:22.078272 | 
2026-09-07 18:08:22.285149 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-07 18:08:22.287545 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-07 18:08:22.926428 | 
2026-09-07 18:08:22.928854 | PLAY [all]
2026-09-07 18:08:22.939564 | 
2026-09-07 18:08:22.939642 | TASK [setup-uv : Extract archive]
2026-09-07 18:08:25.363970 | instance | changed
2026-09-07 18:08:25.376186 | 
2026-09-07 18:08:25.376348 | TASK [setup-uv : Print version]
2026-09-07 18:08:25.739056 | instance | uv 0.8.13
2026-09-07 18:08:25.922312 | instance | ok: Runtime: 0:00:00.012614
2026-09-07 18:08:25.943599 | 
2026-09-07 18:08:25.943804 | TASK [Install Ansible collection siblings]
2026-09-07 18:08:35.319682 | instance | changed:
2026-09-07 18:08:35.319964 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-07 18:08:35.320024 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-07 18:08:35.320066 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-07 18:08:35.320105 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-07 18:08:35.320143 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-09-07 18:08:35.320188 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-07 18:08:35.320228 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-07 18:08:35.320270 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-07 18:08:35.320306 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-07 18:08:35.320342 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-07 18:08:35.320378 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-07 18:08:35.320413 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-07 18:08:35.320447 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-09-07 18:08:35.320483 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-09-07 18:08:35.320772 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-09-07 18:08:35.320829 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-09-07 18:08:35.320867 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-09-07 18:08:35.320904 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-09-07 18:08:35.320969 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-09-07 18:08:35.321005 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-09-07 18:08:35.321038 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-09-07 18:08:35.321072 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-09-07 18:08:35.321109 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-07 18:08:35.321166 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-09-07 18:08:35.321202 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-09-07 18:08:35.321236 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-07 18:08:35.321269 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-07 18:08:35.321303 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-07 18:08:35.321336 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-09-07 18:08:35.321369 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-09-07 18:08:35.321402 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-07 18:08:35.321436 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-07 18:08:35.321470 | instance | Checked out ansible.netcommon to 1.2.0
2026-09-07 18:08:35.321505 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-07 18:08:35.321549 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.321583 | instance | Process install dependency map
2026-09-07 18:08:35.321618 | instance | Starting collection install process
2026-09-07 18:08:35.321652 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-09-07 18:08:35.321686 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-09-07 18:08:35.321721 | instance | ansible.netcommon:* was installed successfully
2026-09-07 18:08:35.321754 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-09-07 18:08:35.321787 | instance | Creating virtual environment at: .venv
2026-09-07 18:08:35.321821 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-07 18:08:35.321854 | instance | Downloading setuptools (1.1MiB)
2026-09-07 18:08:35.321887 | instance | Downloading ansible-core (2.1MiB)
2026-09-07 18:08:35.321941 | instance | Downloading rjsonnet (1.2MiB)
2026-09-07 18:08:35.321976 | instance | Downloading cryptography (4.2MiB)
2026-09-07 18:08:35.322011 | instance | Downloading netaddr (2.2MiB)
2026-09-07 18:08:35.322045 | instance | Downloading pygments (1.2MiB)
2026-09-07 18:08:35.322079 | instance | Downloading openstacksdk (1.7MiB)
2026-09-07 18:08:35.322113 | instance | Downloading kubernetes (1.9MiB)
2026-09-07 18:08:35.322147 | instance | Downloading pydantic-core (2.0MiB)
2026-09-07 18:08:35.322180 | instance |    Building pyperclip==1.9.0
2026-09-07 18:08:35.322217 | instance |  Downloading rjsonnet
2026-09-07 18:08:35.322251 | instance |  Downloading pydantic-core
2026-09-07 18:08:35.322285 | instance |  Downloading netaddr
2026-09-07 18:08:35.322320 | instance |  Downloading pygments
2026-09-07 18:08:35.322354 | instance |  Downloading cryptography
2026-09-07 18:08:35.322388 | instance |  Downloading setuptools
2026-09-07 18:08:35.322421 | instance |  Downloading kubernetes
2026-09-07 18:08:35.322455 | instance |  Downloading ansible-core
2026-09-07 18:08:35.322488 | instance |  Downloading openstacksdk
2026-09-07 18:08:35.322520 | instance |       Built pyperclip==1.9.0
2026-09-07 18:08:35.322552 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-07 18:08:35.322585 | instance | Installed 83 packages in 117ms
2026-09-07 18:08:35.322618 | instance | Checked out ansible.posix to 1.6.0
2026-09-07 18:08:35.322650 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-07 18:08:35.322683 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.322717 | instance | Process install dependency map
2026-09-07 18:08:35.322759 | instance | Starting collection install process
2026-09-07 18:08:35.322793 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-09-07 18:08:35.322827 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-09-07 18:08:35.322860 | instance | ansible.posix:1.6.0 was installed successfully
2026-09-07 18:08:35.322894 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.322946 | instance | 2.17.12
2026-09-07 18:08:35.322981 | instance | Checked out ansible.utils to v6.1.0
2026-09-07 18:08:35.323014 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-07 18:08:35.323047 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.323080 | instance | Process install dependency map
2026-09-07 18:08:35.323112 | instance | Starting collection install process
2026-09-07 18:08:35.323145 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-09-07 18:08:35.323179 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-09-07 18:08:35.323214 | instance | ansible.utils:6.1.0 was installed successfully
2026-09-07 18:08:35.323248 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.323281 | instance | 2.17.12
2026-09-07 18:08:35.323314 | instance | Checked out atmosphere.common to v0.7.0
2026-09-07 18:08:35.323348 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-07 18:08:35.323380 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.323413 | instance | Process install dependency map
2026-09-07 18:08:35.323446 | instance | Starting collection install process
2026-09-07 18:08:35.323478 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-09-07 18:08:35.323512 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-09-07 18:08:35.323545 | instance | atmosphere.common:0.7.0 was installed successfully
2026-09-07 18:08:35.323578 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.323611 | instance | 2.17.12
2026-09-07 18:08:35.323644 | instance | Checked out community.crypto to 2.2.3
2026-09-07 18:08:35.323678 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-07 18:08:35.323711 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.323744 | instance | Process install dependency map
2026-09-07 18:08:35.323778 | instance | Starting collection install process
2026-09-07 18:08:35.323810 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-09-07 18:08:35.323844 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-09-07 18:08:35.323876 | instance | community.crypto:2.2.3 was installed successfully
2026-09-07 18:08:35.323927 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.323964 | instance | 2.17.12
2026-09-07 18:08:35.323998 | instance | Checked out community.general to 7.3.0
2026-09-07 18:08:35.324031 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-09-07 18:08:35.324074 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.324108 | instance | Process install dependency map
2026-09-07 18:08:35.324142 | instance | Starting collection install process
2026-09-07 18:08:35.324175 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-09-07 18:08:35.324208 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-09-07 18:08:35.324241 | instance | community.general:7.3.0 was installed successfully
2026-09-07 18:08:35.324275 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.324309 | instance | 2.17.12
2026-09-07 18:08:35.324343 | instance | Checked out community.mysql to 3.6.0
2026-09-07 18:08:35.324379 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-07 18:08:35.324413 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.324446 | instance | Process install dependency map
2026-09-07 18:08:35.324480 | instance | Starting collection install process
2026-09-07 18:08:35.324562 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-09-07 18:08:35.324622 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-09-07 18:08:35.324685 | instance | community.mysql:3.6.0 was installed successfully
2026-09-07 18:08:35.324729 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.324764 | instance | 2.17.12
2026-09-07 18:08:35.324802 | instance | Checked out kubernetes.core to 2.4.0
2026-09-07 18:08:35.324841 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-07 18:08:35.324879 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.324942 | instance | Process install dependency map
2026-09-07 18:08:35.324983 | instance | Starting collection install process
2026-09-07 18:08:35.325020 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-09-07 18:08:35.325057 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-09-07 18:08:35.325093 | instance | kubernetes.core:2.4.0 was installed successfully
2026-09-07 18:08:35.325128 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.325163 | instance | 2.17.12
2026-09-07 18:08:35.325198 | instance | Checked out openstack.cloud to 2.6.0
2026-09-07 18:08:35.325234 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-07 18:08:35.325270 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.325307 | instance | Process install dependency map
2026-09-07 18:08:35.325342 | instance | Starting collection install process
2026-09-07 18:08:35.325378 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-09-07 18:08:35.325426 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-09-07 18:08:35.325478 | instance | openstack.cloud:2.6.0 was installed successfully
2026-09-07 18:08:35.325516 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.325551 | instance | 2.17.12
2026-09-07 18:08:35.325598 | instance | Checked out vexxhost.ceph to v4.2.0
2026-09-07 18:08:35.325636 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-07 18:08:35.325673 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.325833 | instance | Process install dependency map
2026-09-07 18:08:35.325957 | instance | Starting collection install process
2026-09-07 18:08:35.326003 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-09-07 18:08:35.326042 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-09-07 18:08:35.326080 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-09-07 18:08:35.326117 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.326151 | instance | 2.17.12
2026-09-07 18:08:35.326187 | instance | Checked out vexxhost.containers to v1.6.8
2026-09-07 18:08:35.326223 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-07 18:08:35.326259 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.326294 | instance | Process install dependency map
2026-09-07 18:08:35.326329 | instance | Starting collection install process
2026-09-07 18:08:35.326364 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-09-07 18:08:35.326400 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-09-07 18:08:35.326433 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-09-07 18:08:35.326468 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.326504 | instance | 2.17.12
2026-09-07 18:08:35.326538 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-09-07 18:08:35.326574 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-07 18:08:35.326611 | instance | Starting galaxy collection install process
2026-09-07 18:08:35.326645 | instance | Process install dependency map
2026-09-07 18:08:35.326680 | instance | Starting collection install process
2026-09-07 18:08:35.326715 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-09-07 18:08:35.326748 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-09-07 18:08:35.326783 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-09-07 18:08:35.326821 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 18:08:35.326857 | instance | 2.17.12
2026-09-07 18:08:35.337053 | 
2026-09-07 18:08:35.337152 | PLAY RECAP
2026-09-07 18:08:35.337236 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 18:08:35.337277 | 
2026-09-07 18:08:35.463651 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-07 18:08:35.467341 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-07 18:08:36.050065 | 
2026-09-07 18:08:36.050232 | PLAY [all]
2026-09-07 18:08:36.061597 | 
2026-09-07 18:08:36.061686 | TASK [Install "jq" for log collection]
2026-09-07 18:08:45.402598 | instance | changed
2026-09-07 18:08:45.414760 | 
2026-09-07 18:08:45.415088 | PLAY RECAP
2026-09-07 18:08:45.415204 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 18:08:45.415323 | 
2026-09-07 18:08:45.576579 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-07 18:08:45.581005 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-07 18:08:46.197830 | 
2026-09-07 18:08:46.198058 | PLAY [all]
2026-09-07 18:08:46.207945 | 
2026-09-07 18:08:46.208018 | LOOP [Check inventory directories]
2026-09-07 18:08:46.627778 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-09-07 18:08:46.803575 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-09-07 18:08:46.977749 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-09-07 18:08:46.996684 | 
2026-09-07 18:08:46.996925 | LOOP [Copy inventory file for Zuul]
2026-09-07 18:08:47.834621 | instance | changed:
2026-09-07 18:08:47.835068 | instance | {
2026-09-07 18:08:47.835137 | instance |   "ansible_loop_var": "item",
2026-09-07 18:08:47.835184 | instance |   "changed": false,
2026-09-07 18:08:47.835222 | instance |   "failed": false,
2026-09-07 18:08:47.835267 | instance |   "invocation": {
2026-09-07 18:08:47.835302 | instance |     "module_args": {
2026-09-07 18:08:47.835337 | instance |       "checksum_algorithm": "sha1",
2026-09-07 18:08:47.835372 | instance |       "follow": true,
2026-09-07 18:08:47.835407 | instance |       "get_attributes": true,
2026-09-07 18:08:47.835444 | instance |       "get_checksum": true,
2026-09-07 18:08:47.835478 | instance |       "get_mime": true,
2026-09-07 18:08:47.835512 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-09-07 18:08:47.835546 | instance |     }
2026-09-07 18:08:47.835579 | instance |   },
2026-09-07 18:08:47.835612 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-09-07 18:08:47.835646 | instance |   "stat": {
2026-09-07 18:08:47.835678 | instance |     "atime": 1788804508.230213,
2026-09-07 18:08:47.835713 | instance |     "attr_flags": "e",
2026-09-07 18:08:47.835747 | instance |     "attributes": [
2026-09-07 18:08:47.835779 | instance |       "extents"
2026-09-07 18:08:47.835812 | instance |     ],
2026-09-07 18:08:47.835845 | instance |     "block_size": 4096,
2026-09-07 18:08:47.835878 | instance |     "blocks": 8,
2026-09-07 18:08:47.835936 | instance |     "charset": "unknown",
2026-09-07 18:08:47.835972 | instance |     "ctime": 1788804506.8380766,
2026-09-07 18:08:47.836006 | instance |     "dev": 64513,
2026-09-07 18:08:47.836040 | instance |     "device_type": 0,
2026-09-07 18:08:47.836073 | instance |     "executable": true,
2026-09-07 18:08:47.836105 | instance |     "exists": true,
2026-09-07 18:08:47.836138 | instance |     "gid": 1000,
2026-09-07 18:08:47.836171 | instance |     "gr_name": "zuul",
2026-09-07 18:08:47.836204 | instance |     "inode": 1048210,
2026-09-07 18:08:47.836237 | instance |     "isblk": false,
2026-09-07 18:08:47.836271 | instance |     "ischr": false,
2026-09-07 18:08:47.836303 | instance |     "isdir": true,
2026-09-07 18:08:47.836336 | instance |     "isfifo": false,
2026-09-07 18:08:47.836368 | instance |     "isgid": false,
2026-09-07 18:08:47.836400 | instance |     "islnk": false,
2026-09-07 18:08:47.836433 | instance |     "isreg": false,
2026-09-07 18:08:47.836465 | instance |     "issock": false,
2026-09-07 18:08:47.836529 | instance |     "isuid": false,
2026-09-07 18:08:47.836569 | instance |     "mimetype": "unknown",
2026-09-07 18:08:47.836601 | instance |     "mode": "0755",
2026-09-07 18:08:47.836633 | instance |     "mtime": 1788804506.8380766,
2026-09-07 18:08:47.836666 | instance |     "nlink": 23,
2026-09-07 18:08:47.836698 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-09-07 18:08:47.836730 | instance |     "pw_name": "zuul",
2026-09-07 18:08:47.836764 | instance |     "readable": true,
2026-09-07 18:08:47.836798 | instance |     "rgrp": true,
2026-09-07 18:08:47.836832 | instance |     "roth": true,
2026-09-07 18:08:47.836904 | instance |     "rusr": true,
2026-09-07 18:08:47.836943 | instance |     "size": 4096,
2026-09-07 18:08:47.836977 | instance |     "uid": 1000,
2026-09-07 18:08:47.837010 | instance |     "version": "3058846306",
2026-09-07 18:08:47.837044 | instance |     "wgrp": false,
2026-09-07 18:08:47.837080 | instance |     "woth": false,
2026-09-07 18:08:47.837114 | instance |     "writeable": true,
2026-09-07 18:08:47.837147 | instance |     "wusr": true,
2026-09-07 18:08:47.837179 | instance |     "xgrp": true,
2026-09-07 18:08:47.837211 | instance |     "xoth": true,
2026-09-07 18:08:47.837242 | instance |     "xusr": true
2026-09-07 18:08:47.837275 | instance |   }
2026-09-07 18:08:47.837309 | instance | }
2026-09-07 18:08:47.837375 | instance | ok: All items complete
2026-09-07 18:08:47.837415 | 
2026-09-07 18:08:47.839956 | instance | skipping: Conditional result was False
2026-09-07 18:08:47.842543 | instance | skipping: Conditional result was False
2026-09-07 18:08:47.860088 | 
2026-09-07 18:08:47.860315 | LOOP [Switch "ansible_host" to private IP]
2026-09-07 18:08:48.225208 | instance | changed: 1 replacements made
2026-09-07 18:08:48.227464 | instance | skipping: Conditional result was False
2026-09-07 18:08:48.234717 | instance | skipping: Conditional result was False
2026-09-07 18:08:48.251990 | 
2026-09-07 18:08:48.252174 | TASK [Run Molecule scenario]
2026-09-07 18:08:49.214922 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-09-07 18:08:49.630871 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-09-07 18:08:49.630975 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-09-07 18:09:00.271580 | instance | INFO     [csi > dependency] Executing
2026-09-07 18:09:00.272003 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-09-07 18:09:00.272428 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-09-07 18:09:00.272673 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-09-07 18:09:00.287974 | instance | INFO     [csi > cleanup] Executing
2026-09-07 18:09:00.288947 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-07 18:09:00.300492 | instance | INFO     [csi > destroy] Executing
2026-09-07 18:09:00.300532 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-09-07 18:09:00.300723 | instance | INFO     [csi > destroy] Executed: Successful
2026-09-07 18:09:00.309514 | instance | INFO     [csi > syntax] Executing
2026-09-07 18:09:01.774002 | instance |
2026-09-07 18:09:01.774207 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 18:09:01.846299 | instance | INFO     [csi > syntax] Executed: Successful
2026-09-07 18:09:01.862060 | instance | INFO     [csi > create] Executing
2026-09-07 18:09:01.865480 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-07 18:09:01.879515 | instance | INFO     [csi > prepare] Executing
2026-09-07 18:09:02.669979 | instance |
2026-09-07 18:09:02.670152 | instance | PLAY [Prepare] *****************************************************************
2026-09-07 18:09:02.670368 | instance |
2026-09-07 18:09:02.670605 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 18:09:02.670868 | instance | Monday 07 September 2026  18:09:02 +0000 (0:00:00.023)       0:00:00.023 ******
2026-09-07 18:09:03.994715 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-07 18:09:03.994948 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-07 18:09:03.995180 | instance | interpreter could change the meaning of that path. See
2026-09-07 18:09:03.995423 | instance | https://docs.ansible.com/ansible-
2026-09-07 18:09:03.995652 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-07 18:09:04.005913 | instance | ok: [instance]
2026-09-07 18:09:04.006124 | instance |
2026-09-07 18:09:04.006353 | instance | TASK [Configure short hostname] ************************************************
2026-09-07 18:09:04.006585 | instance | Monday 07 September 2026  18:09:04 +0000 (0:00:01.336)       0:00:01.359 ******
2026-09-07 18:09:04.770178 | instance | changed: [instance]
2026-09-07 18:09:04.770342 | instance |
2026-09-07 18:09:04.770588 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-09-07 18:09:04.770860 | instance | Monday 07 September 2026  18:09:04 +0000 (0:00:00.763)       0:00:02.123 ******
2026-09-07 18:09:05.043150 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-09-07 18:09:05.043388 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-09-07 18:09:05.043666 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-09-07 18:09:05.052642 | instance | changed: [instance]
2026-09-07 18:09:05.052896 | instance |
2026-09-07 18:09:05.053138 | instance | TASK [Purge "snapd" package] ***************************************************
2026-09-07 18:09:05.053369 | instance | Monday 07 September 2026  18:09:05 +0000 (0:00:00.283)       0:00:02.406 ******
2026-09-07 18:09:06.001847 | instance | ok: [instance]
2026-09-07 18:09:06.002123 | instance |
2026-09-07 18:09:06.002433 | instance | PLAY [Create devices for Ceph] *************************************************
2026-09-07 18:09:06.002706 | instance |
2026-09-07 18:09:06.002983 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 18:09:06.003234 | instance | Monday 07 September 2026  18:09:05 +0000 (0:00:00.949)       0:00:03.355 ******
2026-09-07 18:09:06.781735 | instance | ok: [instance]
2026-09-07 18:09:06.781940 | instance |
2026-09-07 18:09:06.782240 | instance | TASK [Install depedencies] *****************************************************
2026-09-07 18:09:06.782449 | instance | Monday 07 September 2026  18:09:06 +0000 (0:00:00.779)       0:00:04.135 ******
2026-09-07 18:09:31.671645 | instance | changed: [instance]
2026-09-07 18:09:31.671814 | instance |
2026-09-07 18:09:31.672180 | instance | TASK [Start up service] ********************************************************
2026-09-07 18:09:31.672416 | instance | Monday 07 September 2026  18:09:31 +0000 (0:00:24.889)       0:00:29.024 ******
2026-09-07 18:09:32.228716 | instance | ok: [instance]
2026-09-07 18:09:32.228918 | instance |
2026-09-07 18:09:32.229190 | instance | TASK [Generate lvm.conf] *******************************************************
2026-09-07 18:09:32.229458 | instance | Monday 07 September 2026  18:09:32 +0000 (0:00:00.557)       0:00:29.582 ******
2026-09-07 18:09:32.579731 | instance | ok: [instance]
2026-09-07 18:09:32.579944 | instance |
2026-09-07 18:09:32.580362 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-09-07 18:09:32.580723 | instance | Monday 07 September 2026  18:09:32 +0000 (0:00:00.351)       0:00:29.933 ******
2026-09-07 18:09:33.314181 | instance | changed: [instance]
2026-09-07 18:09:33.315204 | instance |
2026-09-07 18:09:33.315285 | instance | TASK [Get list of all loopback devices] ****************************************
2026-09-07 18:09:33.315301 | instance | Monday 07 September 2026  18:09:33 +0000 (0:00:00.733)       0:00:30.667 ******
2026-09-07 18:09:33.553232 | instance | ok: [instance]
2026-09-07 18:09:33.553289 | instance |
2026-09-07 18:09:33.553301 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-09-07 18:09:33.553312 | instance | Monday 07 September 2026  18:09:33 +0000 (0:00:00.238)       0:00:30.905 ******
2026-09-07 18:09:33.580390 | instance | skipping: [instance]
2026-09-07 18:09:33.580646 | instance |
2026-09-07 18:09:33.581011 | instance | TASK [Create devices for Ceph] *************************************************
2026-09-07 18:09:33.581320 | instance | Monday 07 September 2026  18:09:33 +0000 (0:00:00.028)       0:00:30.934 ******
2026-09-07 18:09:34.180921 | instance | changed: [instance] => (item=osd0)
2026-09-07 18:09:34.182108 | instance | changed: [instance] => (item=osd1)
2026-09-07 18:09:34.182406 | instance | changed: [instance] => (item=osd2)
2026-09-07 18:09:34.182420 | instance |
2026-09-07 18:09:34.182429 | instance | TASK [Set permissions on loopback devices] *************************************
2026-09-07 18:09:34.182439 | instance | Monday 07 September 2026  18:09:34 +0000 (0:00:00.600)       0:00:31.534 ******
2026-09-07 18:09:34.870454 | instance | changed: [instance] => (item=osd0)
2026-09-07 18:09:34.870847 | instance | changed: [instance] => (item=osd1)
2026-09-07 18:09:34.871176 | instance | changed: [instance] => (item=osd2)
2026-09-07 18:09:34.871537 | instance |
2026-09-07 18:09:34.871861 | instance | TASK [Start loop devices] ******************************************************
2026-09-07 18:09:34.878659 | instance | Monday 07 September 2026  18:09:34 +0000 (0:00:00.689)       0:00:32.223 ******
2026-09-07 18:09:35.633803 | instance | changed: [instance] => (item=osd0)
2026-09-07 18:09:35.635052 | instance | changed: [instance] => (item=osd1)
2026-09-07 18:09:35.635127 | instance | changed: [instance] => (item=osd2)
2026-09-07 18:09:35.635140 | instance |
2026-09-07 18:09:35.635150 | instance | TASK [Create a volume group for each loop device] ******************************
2026-09-07 18:09:35.635162 | instance | Monday 07 September 2026  18:09:35 +0000 (0:00:00.763)       0:00:32.987 ******
2026-09-07 18:09:38.845760 | instance | changed: [instance] => (item=osd0)
2026-09-07 18:09:38.845852 | instance | changed: [instance] => (item=osd1)
2026-09-07 18:09:38.846600 | instance | changed: [instance] => (item=osd2)
2026-09-07 18:09:38.846676 | instance |
2026-09-07 18:09:38.846687 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-09-07 18:09:38.846694 | instance | Monday 07 September 2026  18:09:38 +0000 (0:00:03.212)       0:00:36.199 ******
2026-09-07 18:09:40.805392 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-09-07 18:09:40.806222 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-09-07 18:09:40.806262 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-09-07 18:09:40.806275 | instance |
2026-09-07 18:09:40.806310 | instance | PLAY RECAP *********************************************************************
2026-09-07 18:09:40.806844 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-09-07 18:09:40.806904 | instance |
2026-09-07 18:09:40.806923 | instance | Monday 07 September 2026  18:09:40 +0000 (0:00:01.960)       0:00:38.159 ******
2026-09-07 18:09:40.808006 | instance | ===============================================================================
2026-09-07 18:09:40.808043 | instance | Install depedencies ---------------------------------------------------- 24.89s
2026-09-07 18:09:40.808055 | instance | Create a volume group for each loop device ------------------------------ 3.21s
2026-09-07 18:09:40.808065 | instance | Create a logical volume for each loop device ---------------------------- 1.96s
2026-09-07 18:09:40.808081 | instance | Gathering Facts --------------------------------------------------------- 1.34s
2026-09-07 18:09:40.808351 | instance | Purge "snapd" package --------------------------------------------------- 0.95s
2026-09-07 18:09:40.808719 | instance | Gathering Facts --------------------------------------------------------- 0.78s
2026-09-07 18:09:40.809010 | instance | Configure short hostname ------------------------------------------------ 0.76s
2026-09-07 18:09:40.809318 | instance | Start loop devices ------------------------------------------------------ 0.76s
2026-09-07 18:09:40.809612 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.73s
2026-09-07 18:09:40.809902 | instance | Set permissions on loopback devices ------------------------------------- 0.69s
2026-09-07 18:09:40.810188 | instance | Create devices for Ceph ------------------------------------------------- 0.60s
2026-09-07 18:09:40.810495 | instance | Start up service -------------------------------------------------------- 0.56s
2026-09-07 18:09:40.810787 | instance | Generate lvm.conf ------------------------------------------------------- 0.35s
2026-09-07 18:09:40.811077 | instance | Ensure hostname inside hosts file --------------------------------------- 0.28s
2026-09-07 18:09:40.811393 | instance | Get list of all loopback devices ---------------------------------------- 0.24s
2026-09-07 18:09:40.811683 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-09-07 18:09:40.905196 | instance | INFO     [csi > prepare] Executed: Successful
2026-09-07 18:09:40.919766 | instance | INFO     [csi > converge] Executing
2026-09-07 18:09:42.263197 | instance |
2026-09-07 18:09:42.263638 | instance | PLAY [Debug CSI driver value] **************************************************
2026-09-07 18:09:42.264024 | instance |
2026-09-07 18:09:42.264359 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 18:09:42.264659 | instance | Monday 07 September 2026  18:09:42 +0000 (0:00:00.007)       0:00:00.007 ******
2026-09-07 18:09:43.313570 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-07 18:09:43.313947 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-07 18:09:43.314271 | instance | interpreter could change the meaning of that path. See
2026-09-07 18:09:43.314570 | instance | https://docs.ansible.com/ansible-
2026-09-07 18:09:43.314873 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-07 18:09:43.327644 | instance | ok: [instance]
2026-09-07 18:09:43.327966 | instance |
2026-09-07 18:09:43.328301 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-09-07 18:09:43.328601 | instance | Monday 07 September 2026  18:09:43 +0000 (0:00:01.064)       0:00:01.071 ******
2026-09-07 18:09:43.394189 | instance | ok: [instance] => {
2026-09-07 18:09:43.394527 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-09-07 18:09:43.394812 | instance | }
2026-09-07 18:09:43.395087 | instance |
2026-09-07 18:09:43.395397 | instance | PLAY [all] *********************************************************************
2026-09-07 18:09:43.395672 | instance |
2026-09-07 18:09:43.395993 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 18:09:43.396349 | instance | Monday 07 September 2026  18:09:43 +0000 (0:00:00.066)       0:00:01.138 ******
2026-09-07 18:09:44.376850 | instance | ok: [instance]
2026-09-07 18:09:44.377207 | instance |
2026-09-07 18:09:44.377543 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-09-07 18:09:44.377842 | instance | Monday 07 September 2026  18:09:44 +0000 (0:00:00.982)       0:00:02.120 ******
2026-09-07 18:09:44.430061 | instance | skipping: [instance]
2026-09-07 18:09:44.430391 | instance |
2026-09-07 18:09:44.430688 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-09-07 18:09:44.430979 | instance | Monday 07 September 2026  18:09:44 +0000 (0:00:00.053)       0:00:02.174 ******
2026-09-07 18:09:44.641384 | instance | ok: [instance]
2026-09-07 18:09:44.641701 | instance |
2026-09-07 18:09:44.642006 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-09-07 18:09:44.642313 | instance |
2026-09-07 18:09:44.642611 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 18:09:44.642927 | instance | Monday 07 September 2026  18:09:44 +0000 (0:00:00.211)       0:00:02.385 ******
2026-09-07 18:09:45.593214 | instance | ok: [instance]
2026-09-07 18:09:45.593604 | instance |
2026-09-07 18:09:45.593910 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 18:09:45.594213 | instance | Monday 07 September 2026  18:09:45 +0000 (0:00:00.950)       0:00:03.336 ******
2026-09-07 18:09:45.947046 | instance | ok: [instance]
2026-09-07 18:09:45.947382 | instance |
2026-09-07 18:09:45.947546 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 18:09:45.947689 | instance | Monday 07 September 2026  18:09:45 +0000 (0:00:00.352)       0:00:03.689 ******
2026-09-07 18:09:45.977975 | instance | skipping: [instance]
2026-09-07 18:09:45.977992 | instance |
2026-09-07 18:09:45.977997 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-09-07 18:09:45.978001 | instance | Monday 07 September 2026  18:09:45 +0000 (0:00:00.033)       0:00:03.722 ******
2026-09-07 18:09:46.346454 | instance | changed: [instance]
2026-09-07 18:09:46.346525 | instance |
2026-09-07 18:09:46.346538 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 18:09:46.346549 | instance | Monday 07 September 2026  18:09:46 +0000 (0:00:00.366)       0:00:04.089 ******
2026-09-07 18:09:46.438938 | instance | ok: [instance] => {
2026-09-07 18:09:46.438975 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-09-07 18:09:46.438987 | instance | }
2026-09-07 18:09:46.438997 | instance |
2026-09-07 18:09:46.439007 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 18:09:46.439016 | instance | Monday 07 September 2026  18:09:46 +0000 (0:00:00.092)       0:00:04.181 ******
2026-09-07 18:09:47.138126 | instance | changed: [instance]
2026-09-07 18:09:47.138229 | instance |
2026-09-07 18:09:47.138243 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 18:09:47.138254 | instance | Monday 07 September 2026  18:09:47 +0000 (0:00:00.699)       0:00:04.880 ******
2026-09-07 18:09:47.200671 | instance | skipping: [instance]
2026-09-07 18:09:47.201001 | instance |
2026-09-07 18:09:47.201371 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 18:09:47.201685 | instance | Monday 07 September 2026  18:09:47 +0000 (0:00:00.064)       0:00:04.945 ******
2026-09-07 18:09:47.256554 | instance | skipping: [instance]
2026-09-07 18:09:47.256850 | instance |
2026-09-07 18:09:47.257146 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 18:09:47.257466 | instance | Monday 07 September 2026  18:09:47 +0000 (0:00:00.055)       0:00:05.000 ******
2026-09-07 18:09:47.489423 | instance | ok: [instance]
2026-09-07 18:09:47.489675 | instance |
2026-09-07 18:09:47.489871 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 18:09:47.490064 | instance | Monday 07 September 2026  18:09:47 +0000 (0:00:00.232)       0:00:05.233 ******
2026-09-07 18:09:48.924257 | instance | ok: [instance]
2026-09-07 18:09:48.924604 | instance |
2026-09-07 18:09:48.924909 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 18:09:48.925249 | instance | Monday 07 September 2026  18:09:48 +0000 (0:00:01.434)       0:00:06.668 ******
2026-09-07 18:09:49.012581 | instance | ok: [instance] => {
2026-09-07 18:09:49.013000 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-09-07 18:09:49.013323 | instance | }
2026-09-07 18:09:49.013605 | instance |
2026-09-07 18:09:49.013903 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 18:09:49.014221 | instance | Monday 07 September 2026  18:09:48 +0000 (0:00:00.085)       0:00:06.753 ******
2026-09-07 18:09:49.699824 | instance | changed: [instance]
2026-09-07 18:09:49.700034 | instance |
2026-09-07 18:09:49.700202 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 18:09:49.700347 | instance | Monday 07 September 2026  18:09:49 +0000 (0:00:00.690)       0:00:07.443 ******
2026-09-07 18:09:52.627450 | instance | changed: [instance]
2026-09-07 18:09:52.627517 | instance |
2026-09-07 18:09:52.627529 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-09-07 18:09:52.627539 | instance | Monday 07 September 2026  18:09:52 +0000 (0:00:02.926)       0:00:10.370 ******
2026-09-07 18:09:52.665607 | instance | skipping: [instance]
2026-09-07 18:09:52.665637 | instance |
2026-09-07 18:09:52.665648 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-09-07 18:09:52.665657 | instance | Monday 07 September 2026  18:09:52 +0000 (0:00:00.038)       0:00:10.408 ******
2026-09-07 18:09:52.702440 | instance | skipping: [instance]
2026-09-07 18:09:52.702471 | instance |
2026-09-07 18:09:52.702481 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-09-07 18:09:52.702490 | instance | Monday 07 September 2026  18:09:52 +0000 (0:00:00.037)       0:00:10.445 ******
2026-09-07 18:09:52.741517 | instance | skipping: [instance]
2026-09-07 18:09:52.741812 | instance |
2026-09-07 18:09:52.742108 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-09-07 18:09:52.742428 | instance | Monday 07 September 2026  18:09:52 +0000 (0:00:00.040)       0:00:10.485 ******
2026-09-07 18:09:58.751352 | instance | changed: [instance]
2026-09-07 18:09:58.751424 | instance |
2026-09-07 18:09:58.751436 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-09-07 18:09:58.751446 | instance | Monday 07 September 2026  18:09:58 +0000 (0:00:06.008)       0:00:16.494 ******
2026-09-07 18:09:59.438327 | instance | changed: [instance]
2026-09-07 18:09:59.439419 | instance |
2026-09-07 18:09:59.439710 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-09-07 18:09:59.439739 | instance | Monday 07 September 2026  18:09:59 +0000 (0:00:00.687)       0:00:17.181 ******
2026-09-07 18:10:00.452545 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-09-07 18:10:00.452644 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-09-07 18:10:00.452657 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-09-07 18:10:00.452675 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-09-07 18:10:00.452686 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-09-07 18:10:00.452696 | instance |
2026-09-07 18:10:00.452705 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-09-07 18:10:00.452714 | instance | Monday 07 September 2026  18:10:00 +0000 (0:00:01.012)       0:00:18.194 ******
2026-09-07 18:10:01.096492 | instance | changed: [instance]
2026-09-07 18:10:01.096579 | instance |
2026-09-07 18:10:01.097341 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-09-07 18:10:01.097393 | instance | Monday 07 September 2026  18:10:01 +0000 (0:00:00.620)       0:00:18.814 ******
2026-09-07 18:10:01.097401 | instance |
2026-09-07 18:10:01.097408 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-07 18:10:01.097413 | instance | Monday 07 September 2026  18:10:01 +0000 (0:00:00.025)       0:00:18.840 ******
2026-09-07 18:10:02.182401 | instance | ok: [instance]
2026-09-07 18:10:02.182479 | instance |
2026-09-07 18:10:02.182670 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-09-07 18:10:02.182686 | instance | Monday 07 September 2026  18:10:02 +0000 (0:00:01.086)       0:00:19.926 ******
2026-09-07 18:10:02.712959 | instance | changed: [instance]
2026-09-07 18:10:02.713070 | instance |
2026-09-07 18:10:02.713081 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-09-07 18:10:02.713092 | instance | Monday 07 September 2026  18:10:02 +0000 (0:00:00.529)       0:00:20.455 ******
2026-09-07 18:10:03.296923 | instance | changed: [instance]
2026-09-07 18:10:03.297094 | instance |
2026-09-07 18:10:03.297630 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 18:10:03.297948 | instance | Monday 07 September 2026  18:10:03 +0000 (0:00:00.584)       0:00:21.040 ******
2026-09-07 18:10:03.553412 | instance | ok: [instance]
2026-09-07 18:10:03.554141 | instance |
2026-09-07 18:10:03.554211 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 18:10:03.554223 | instance | Monday 07 September 2026  18:10:03 +0000 (0:00:00.256)       0:00:21.296 ******
2026-09-07 18:10:03.640666 | instance | ok: [instance] => {
2026-09-07 18:10:03.641879 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-09-07 18:10:03.641970 | instance | }
2026-09-07 18:10:03.641983 | instance |
2026-09-07 18:10:03.641993 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 18:10:03.642004 | instance | Monday 07 September 2026  18:10:03 +0000 (0:00:00.087)       0:00:21.384 ******
2026-09-07 18:10:05.570590 | instance | changed: [instance]
2026-09-07 18:10:05.570666 | instance |
2026-09-07 18:10:05.571063 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 18:10:05.571126 | instance | Monday 07 September 2026  18:10:05 +0000 (0:00:01.930)       0:00:23.314 ******
2026-09-07 18:10:09.998504 | instance | changed: [instance]
2026-09-07 18:10:09.998611 | instance |
2026-09-07 18:10:09.998943 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-09-07 18:10:09.999003 | instance | Monday 07 September 2026  18:10:09 +0000 (0:00:04.427)       0:00:27.742 ******
2026-09-07 18:10:11.416608 | instance | ok: [instance]
2026-09-07 18:10:11.417326 | instance |
2026-09-07 18:10:11.417405 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-09-07 18:10:11.417417 | instance | Monday 07 September 2026  18:10:11 +0000 (0:00:01.417)       0:00:29.160 ******
2026-09-07 18:10:11.898652 | instance | changed: [instance]
2026-09-07 18:10:11.899434 | instance |
2026-09-07 18:10:11.899546 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-09-07 18:10:11.899559 | instance | Monday 07 September 2026  18:10:11 +0000 (0:00:00.482)       0:00:29.642 ******
2026-09-07 18:10:12.423978 | instance | changed: [instance]
2026-09-07 18:10:12.424068 | instance |
2026-09-07 18:10:12.424286 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-09-07 18:10:12.424519 | instance | Monday 07 September 2026  18:10:12 +0000 (0:00:00.525)       0:00:30.167 ******
2026-09-07 18:10:13.056315 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-09-07 18:10:13.056413 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-09-07 18:10:13.057054 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-09-07 18:10:13.057116 | instance |
2026-09-07 18:10:13.057124 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-09-07 18:10:13.057130 | instance | Monday 07 September 2026  18:10:13 +0000 (0:00:00.632)       0:00:30.800 ******
2026-09-07 18:10:13.577249 | instance | changed: [instance]
2026-09-07 18:10:13.577336 | instance |
2026-09-07 18:10:13.577697 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-09-07 18:10:13.577762 | instance | Monday 07 September 2026  18:10:13 +0000 (0:00:00.520)       0:00:31.321 ******
2026-09-07 18:10:14.125146 | instance | changed: [instance]
2026-09-07 18:10:14.125200 | instance |
2026-09-07 18:10:14.125208 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-09-07 18:10:14.125227 | instance | Monday 07 September 2026  18:10:14 +0000 (0:00:00.519)       0:00:31.840 ******
2026-09-07 18:10:14.125233 | instance |
2026-09-07 18:10:14.125238 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-07 18:10:14.125248 | instance | Monday 07 September 2026  18:10:14 +0000 (0:00:00.027)       0:00:31.868 ******
2026-09-07 18:10:14.932289 | instance | ok: [instance]
2026-09-07 18:10:14.932383 | instance |
2026-09-07 18:10:14.932693 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-09-07 18:10:14.932716 | instance | Monday 07 September 2026  18:10:14 +0000 (0:00:00.807)       0:00:32.676 ******
2026-09-07 18:10:15.861437 | instance | changed: [instance]
2026-09-07 18:10:15.862150 | instance |
2026-09-07 18:10:15.862182 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-09-07 18:10:15.862193 | instance | Monday 07 September 2026  18:10:15 +0000 (0:00:00.928)       0:00:33.604 ******
2026-09-07 18:10:16.485325 | instance | changed: [instance]
2026-09-07 18:10:16.485458 | instance |
2026-09-07 18:10:16.485864 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-09-07 18:10:16.485914 | instance | Monday 07 September 2026  18:10:16 +0000 (0:00:00.624)       0:00:34.229 ******
2026-09-07 18:10:16.557169 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-09-07 18:10:16.557641 | instance |
2026-09-07 18:10:16.557693 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-09-07 18:10:16.557702 | instance | Monday 07 September 2026  18:10:16 +0000 (0:00:00.071)       0:00:34.300 ******
2026-09-07 18:10:21.556581 | instance | changed: [instance]
2026-09-07 18:10:21.557353 | instance |
2026-09-07 18:10:21.557424 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-09-07 18:10:21.557437 | instance | Monday 07 September 2026  18:10:21 +0000 (0:00:04.999)       0:00:39.300 ******
2026-09-07 18:10:22.269561 | instance | ok: [instance] => (item=chronyd)
2026-09-07 18:10:22.269651 | instance | ok: [instance] => (item=sshd)
2026-09-07 18:10:22.269710 | instance |
2026-09-07 18:10:22.269980 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-09-07 18:10:22.270206 | instance | Monday 07 September 2026  18:10:22 +0000 (0:00:00.713)       0:00:40.013 ******
2026-09-07 18:10:30.536074 | instance | changed: [instance]
2026-09-07 18:10:30.536762 | instance |
2026-09-07 18:10:30.536794 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-09-07 18:10:30.536806 | instance | Monday 07 September 2026  18:10:30 +0000 (0:00:08.265)       0:00:48.279 ******
2026-09-07 18:10:30.766894 | instance | ok: [instance]
2026-09-07 18:10:30.767647 | instance |
2026-09-07 18:10:30.768013 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-09-07 18:10:30.768030 | instance | Monday 07 September 2026  18:10:30 +0000 (0:00:00.230)       0:00:48.510 ******
2026-09-07 18:10:31.254063 | instance | changed: [instance]
2026-09-07 18:10:31.254150 | instance |
2026-09-07 18:10:31.254623 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-09-07 18:10:31.254687 | instance | Monday 07 September 2026  18:10:31 +0000 (0:00:00.487)       0:00:48.997 ******
2026-09-07 18:10:31.622778 | instance | changed: [instance]
2026-09-07 18:10:31.622850 | instance |
2026-09-07 18:10:31.623074 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-09-07 18:10:31.623128 | instance | Monday 07 September 2026  18:10:31 +0000 (0:00:00.368)       0:00:49.366 ******
2026-09-07 18:10:31.876522 | instance | ok: [instance]
2026-09-07 18:10:31.876587 | instance |
2026-09-07 18:10:31.876594 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-09-07 18:10:31.876600 | instance | Monday 07 September 2026  18:10:31 +0000 (0:00:00.253)       0:00:49.620 ******
2026-09-07 18:10:32.136759 | instance | ok: [instance] => (item=instance)
2026-09-07 18:10:32.137497 | instance |
2026-09-07 18:10:32.137560 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-09-07 18:10:32.137573 | instance | Monday 07 September 2026  18:10:32 +0000 (0:00:00.260)       0:00:49.880 ******
2026-09-07 18:10:32.201403 | instance | ok: [instance]
2026-09-07 18:10:32.201872 | instance |
2026-09-07 18:10:32.201936 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-09-07 18:10:32.201945 | instance | Monday 07 September 2026  18:10:32 +0000 (0:00:00.064)       0:00:49.945 ******
2026-09-07 18:10:32.296476 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-09-07 18:10:32.296556 | instance |
2026-09-07 18:10:32.296615 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-09-07 18:10:32.296772 | instance | Monday 07 September 2026  18:10:32 +0000 (0:00:00.095)       0:00:50.040 ******
2026-09-07 18:10:32.601559 | instance | changed: [instance]
2026-09-07 18:10:32.601638 | instance |
2026-09-07 18:10:32.601867 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-09-07 18:10:32.601919 | instance | Monday 07 September 2026  18:10:32 +0000 (0:00:00.305)       0:00:50.345 ******
2026-09-07 18:10:33.335485 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-09-07 18:10:33.336060 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-09-07 18:10:33.336167 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-09-07 18:10:33.336804 | instance |
2026-09-07 18:10:33.336871 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-09-07 18:10:33.336886 | instance | Monday 07 September 2026  18:10:33 +0000 (0:00:00.733)       0:00:51.078 ******
2026-09-07 18:12:12.951059 | instance | ok: [instance]
2026-09-07 18:12:12.951176 | instance |
2026-09-07 18:12:12.951448 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-09-07 18:12:12.951690 | instance | Monday 07 September 2026  18:12:12 +0000 (0:01:39.615)       0:02:30.694 ******
2026-09-07 18:12:13.202227 | instance | changed: [instance]
2026-09-07 18:12:13.202386 | instance |
2026-09-07 18:12:13.202631 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-09-07 18:12:13.202863 | instance | Monday 07 September 2026  18:12:13 +0000 (0:00:00.251)       0:02:30.945 ******
2026-09-07 18:12:13.247600 | instance | ok: [instance]
2026-09-07 18:12:13.247853 | instance |
2026-09-07 18:12:13.248245 | instance | TASK [Install Ceph host] *******************************************************
2026-09-07 18:12:13.248500 | instance | Monday 07 September 2026  18:12:13 +0000 (0:00:00.045)       0:02:30.991 ******
2026-09-07 18:12:13.341633 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-09-07 18:12:13.341893 | instance |
2026-09-07 18:12:13.342178 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-09-07 18:12:13.342411 | instance | Monday 07 September 2026  18:12:13 +0000 (0:00:00.094)       0:02:31.086 ******
2026-09-07 18:12:15.026991 | instance | ok: [instance]
2026-09-07 18:12:15.027096 | instance |
2026-09-07 18:12:15.027288 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-09-07 18:12:15.027428 | instance | Monday 07 September 2026  18:12:15 +0000 (0:00:01.684)       0:02:32.770 ******
2026-09-07 18:12:15.108113 | instance | ok: [instance] => (item=instance)
2026-09-07 18:12:15.108324 | instance |
2026-09-07 18:12:15.108568 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-09-07 18:12:15.108804 | instance | Monday 07 September 2026  18:12:15 +0000 (0:00:00.080)       0:02:32.851 ******
2026-09-07 18:12:15.477560 | instance | ok: [instance]
2026-09-07 18:12:15.477790 | instance |
2026-09-07 18:12:15.478098 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-09-07 18:12:15.478348 | instance | Monday 07 September 2026  18:12:15 +0000 (0:00:00.369)       0:02:33.221 ******
2026-09-07 18:12:17.976042 | instance | ok: [instance]
2026-09-07 18:12:17.976119 | instance |
2026-09-07 18:12:17.976781 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-09-07 18:12:17.976853 | instance | Monday 07 September 2026  18:12:17 +0000 (0:00:02.497)       0:02:35.719 ******
2026-09-07 18:13:12.736803 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-09-07 18:13:12.737710 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_u0myy89b/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_u0myy89b/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_u0myy89b/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_u0myy89b/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBQ/p5q3Ma9JSAAwLhVlqXQ+pe1DVXPJEdgcfUZNQ75lpSASGHMlBwQQb8=: Malformed input [buffer:3]\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBQ/p5q3Ma9JSAAwLhVlqXQ+pe1DVXPJEdgcfUZNQ75lpSASGHMlBwQQb8=: Malformed input [buffer:3]\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBQ/p5q3Ma9JSAAwLhVlqXQ+pe1DVXPJEdgcfUZNQ75lpSASGHMlBwQQb8=: Malformed input [buffer:3]\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T18:13:12.544+0000 7f3845f2d640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-09-07 18:13:12.741499 | instance |
2026-09-07 18:13:12.744012 | instance | PLAY RECAP *********************************************************************
2026-09-07 18:13:12.744046 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0
2026-09-07 18:13:12.744057 | instance |
2026-09-07 18:13:12.744067 | instance | Monday 07 September 2026  18:13:12 +0000 (0:00:54.766)       0:03:30.486 ******
2026-09-07 18:13:12.744076 | instance | ===============================================================================
2026-09-07 18:13:12.744084 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 99.62s
2026-09-07 18:13:12.744093 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 54.77s
2026-09-07 18:13:12.744101 | instance | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 8.27s
2026-09-07 18:13:12.744110 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.01s
2026-09-07 18:13:12.744118 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.00s
2026-09-07 18:13:12.744131 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.43s
2026-09-07 18:13:12.747276 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.93s
2026-09-07 18:13:12.747338 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.50s
2026-09-07 18:13:12.747348 | instance | vexxhost.containers.download_artifact : Download item ------------------- 1.93s
2026-09-07 18:13:12.747357 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.89s
2026-09-07 18:13:12.747366 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.68s
2026-09-07 18:13:12.747393 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.43s
2026-09-07 18:13:12.747402 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.42s
2026-09-07 18:13:12.747411 | instance | Gathering Facts --------------------------------------------------------- 1.06s
2026-09-07 18:13:12.747419 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 1.01s
2026-09-07 18:13:12.747428 | instance | Gathering Facts --------------------------------------------------------- 0.98s
2026-09-07 18:13:12.747436 | instance | Gathering Facts --------------------------------------------------------- 0.95s
2026-09-07 18:13:12.747444 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 0.93s
2026-09-07 18:13:12.747453 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.73s
2026-09-07 18:13:12.747461 | instance | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.71s
2026-09-07 18:13:12.848256 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 18:13:12.848578 | instance | ERROR    [csi > converge] Executed: Failed
2026-09-07 18:13:12.848772 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 18:13:13.157236 | instance | ERROR
2026-09-07 18:13:13.157747 | instance | {
2026-09-07 18:13:13.157883 | instance |   "delta": "0:04:24.277426",
2026-09-07 18:13:13.158003 | instance |   "end": "2026-09-07 18:13:12.916816",
2026-09-07 18:13:13.158047 | instance |   "msg": "non-zero return code",
2026-09-07 18:13:13.158114 | instance |   "rc": 2,
2026-09-07 18:13:13.158237 | instance |   "start": "2026-09-07 18:08:48.639390"
2026-09-07 18:13:13.158319 | instance | }
failure
2026-09-07 18:13:13.171773 | 
2026-09-07 18:13:13.171994 | PLAY RECAP
2026-09-07 18:13:13.172193 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-09-07 18:13:13.172330 | 
2026-09-07 18:13:13.381415 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-07 18:13:13.387921 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-07 18:13:14.035958 | 
2026-09-07 18:13:14.036115 | PLAY [all]
2026-09-07 18:13:14.050610 | 
2026-09-07 18:13:14.050686 | TASK [gather-host-logs : creating directory for system status]
2026-09-07 18:13:14.429183 | instance | changed
2026-09-07 18:13:14.439539 | 
2026-09-07 18:13:14.439651 | TASK [gather-host-logs : Get logs for each host]
2026-09-07 18:13:14.847078 | instance | + systemd-cgls --full --all --no-pager
2026-09-07 18:13:14.862925 | instance | + ip addr
2026-09-07 18:13:14.865720 | instance | + ip route
2026-09-07 18:13:14.868556 | instance | + lsblk
2026-09-07 18:13:14.873870 | instance | + mount
2026-09-07 18:13:14.876858 | instance | + docker images
2026-09-07 18:13:14.900657 | instance | + brctl show
2026-09-07 18:13:14.901255 | instance | /bin/bash: line 8: brctl: command not found
2026-09-07 18:13:14.901575 | instance | + ps aux --sort=-%mem
2026-09-07 18:13:14.921964 | instance | + dpkg -l
2026-09-07 18:13:14.933796 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-09-07 18:13:14.934328 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-09-07 18:13:14.955777 | instance | + '[' '!' -z '' ']'
2026-09-07 18:13:15.000631 | instance | ok: Runtime: 0:00:00.113662
2026-09-07 18:13:15.008662 | 
2026-09-07 18:13:15.008751 | TASK [gather-host-logs : Downloads logs to executor]
2026-09-07 18:13:15.751124 | instance | changed:
2026-09-07 18:13:15.751388 | instance | created directory /var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/logs/instance
2026-09-07 18:13:15.751444 | instance | cd+++++++++ system/
2026-09-07 18:13:15.751487 | instance | >f+++++++++ system/brctl-show.txt
2026-09-07 18:13:15.751527 | instance | >f+++++++++ system/docker-images.txt
2026-09-07 18:13:15.751564 | instance | >f+++++++++ system/ip-addr.txt
2026-09-07 18:13:15.751690 | instance | >f+++++++++ system/ip-route.txt
2026-09-07 18:13:15.751751 | instance | >f+++++++++ system/lsblk.txt
2026-09-07 18:13:15.751791 | instance | >f+++++++++ system/mount.txt
2026-09-07 18:13:15.751829 | instance | >f+++++++++ system/packages.txt
2026-09-07 18:13:15.751866 | instance | >f+++++++++ system/ps.txt
2026-09-07 18:13:15.751907 | instance | >f+++++++++ system/systemd-cgls.txt
2026-09-07 18:13:15.769422 | 
2026-09-07 18:13:15.769587 | LOOP [helm-release-status : creating directory for helm release status]
2026-09-07 18:13:16.019961 | instance | changed: "values"
2026-09-07 18:13:16.206099 | instance | changed: "releases"
2026-09-07 18:13:16.218950 | 
2026-09-07 18:13:16.219187 | TASK [helm-release-status : Gather get release status for helm charts]
2026-09-07 18:13:16.482083 | instance | /bin/bash: line 3: kubectl: command not found
2026-09-07 18:13:16.770843 | instance | ok: Runtime: 0:00:00.005426
2026-09-07 18:13:16.780248 | 
2026-09-07 18:13:16.780395 | TASK [helm-release-status : Downloads logs to executor]
2026-09-07 18:13:17.330507 | instance | changed:
2026-09-07 18:13:17.330766 | instance | cd+++++++++ helm/
2026-09-07 18:13:17.330823 | instance | cd+++++++++ helm/releases/
2026-09-07 18:13:17.330865 | instance | cd+++++++++ helm/values/
2026-09-07 18:13:17.348333 | 
2026-09-07 18:13:17.348583 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-09-07 18:13:17.567950 | instance | changed
2026-09-07 18:13:17.579872 | 
2026-09-07 18:13:17.580050 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-09-07 18:13:17.882388 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 18:13:17.882645 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 18:13:17.888270 | instance | environment: line 1: kubectl: command not found
2026-09-07 18:13:17.889758 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 18:13:17.890378 | instance | environment: line 1: kubectl: command not found
2026-09-07 18:13:17.892135 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 18:13:17.893580 | instance | environment: line 1: kubectl: command not found
2026-09-07 18:13:17.895016 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 18:13:17.896212 | instance | environment: line 1: kubectl: command not found
2026-09-07 18:13:17.897248 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 18:13:17.899034 | instance | environment: line 1: kubectl: command not found
2026-09-07 18:13:17.900375 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 18:13:18.125554 | instance | ok: Runtime: 0:00:00.025411
2026-09-07 18:13:18.135607 | 
2026-09-07 18:13:18.135814 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-09-07 18:13:18.364279 | instance | changed
2026-09-07 18:13:18.374476 | 
2026-09-07 18:13:18.374661 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-09-07 18:13:18.617878 | instance | environment: line 5: kubectl: command not found
2026-09-07 18:13:18.618717 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 18:13:18.619137 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 18:13:18.619797 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 18:13:18.921251 | instance | ok: Runtime: 0:00:00.008966
2026-09-07 18:13:18.931742 | 
2026-09-07 18:13:18.931942 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-09-07 18:13:19.468214 | instance | changed:
2026-09-07 18:13:19.468377 | instance | cd+++++++++ objects/
2026-09-07 18:13:19.468404 | instance | cd+++++++++ objects/cluster/
2026-09-07 18:13:19.468423 | instance | cd+++++++++ objects/namespaced/
2026-09-07 18:13:19.476355 | 
2026-09-07 18:13:19.476415 | TASK [gather-pod-logs : creating directory for pod logs]
2026-09-07 18:13:19.690189 | instance | changed
2026-09-07 18:13:19.699261 | 
2026-09-07 18:13:19.699388 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-09-07 18:13:19.917576 | instance | changed
2026-09-07 18:13:19.927085 | 
2026-09-07 18:13:19.927229 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-09-07 18:13:20.216306 | instance | environment: line 3: kubectl: command not found
2026-09-07 18:13:20.474652 | instance | ok: Runtime: 0:00:00.008436
2026-09-07 18:13:20.483599 | 
2026-09-07 18:13:20.563649 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-09-07 18:13:21.096862 | instance | changed:
2026-09-07 18:13:21.097106 | instance | cd+++++++++ pod-logs/
2026-09-07 18:13:21.097162 | instance | cd+++++++++ pod-logs/failed-pods/
2026-09-07 18:13:21.114709 | 
2026-09-07 18:13:21.114897 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-09-07 18:13:21.341227 | instance | changed
2026-09-07 18:13:21.423969 | 
2026-09-07 18:13:21.424127 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-09-07 18:13:21.670495 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-07 18:13:21.972878 | instance | ok: Runtime: 0:00:00.053751
2026-09-07 18:13:21.981970 | 
2026-09-07 18:13:21.982103 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-09-07 18:13:22.234774 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-07 18:13:22.281515 | instance | ceph-mgr endpoints:
2026-09-07 18:13:22.537176 | instance | ok: Runtime: 0:00:00.052963
2026-09-07 18:13:22.550508 | 
2026-09-07 18:13:22.550604 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-09-07 18:13:22.785108 | instance | /bin/bash: line 4: kubectl: command not found
2026-09-07 18:13:23.095534 | instance | ok: Runtime: 0:00:00.050683
2026-09-07 18:13:23.105137 | 
2026-09-07 18:13:23.105299 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-09-07 18:13:23.652699 | instance | changed: cd+++++++++ prometheus/
2026-09-07 18:13:23.670023 | 
2026-09-07 18:13:23.670154 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-09-07 18:13:23.889912 | instance | changed
2026-09-07 18:13:23.895962 | 
2026-09-07 18:13:23.896049 | TASK [gather-selenium-data : Get selenium data]
2026-09-07 18:13:24.198168 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-09-07 18:13:24.199829 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-09-07 18:13:24.459187 | instance | ERROR
2026-09-07 18:13:24.459465 | instance | {
2026-09-07 18:13:24.459534 | instance |   "delta": "0:00:00.005804",
2026-09-07 18:13:24.459581 | instance |   "end": "2026-09-07 18:13:24.200218",
2026-09-07 18:13:24.459628 | instance |   "msg": "non-zero return code",
2026-09-07 18:13:24.459671 | instance |   "rc": 1,
2026-09-07 18:13:24.459724 | instance |   "start": "2026-09-07 18:13:24.194414"
2026-09-07 18:13:24.459777 | instance | }
2026-09-07 18:13:24.459828 | instance | ERROR: Ignoring Errors
2026-09-07 18:13:24.469601 | 
2026-09-07 18:13:24.469731 | TASK [gather-selenium-data : Downloads logs to executor]
2026-09-07 18:13:25.133135 | instance | changed: cd+++++++++ selenium/
2026-09-07 18:13:25.145611 | 
2026-09-07 18:13:25.145848 | PLAY RECAP
2026-09-07 18:13:25.146018 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-09-07 18:13:25.146119 | 
2026-09-07 18:13:25.301979 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-07 18:13:25.311897 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-07 18:13:25.954605 | 
2026-09-07 18:13:25.954745 | PLAY [all]
2026-09-07 18:13:25.965682 | 
2026-09-07 18:13:25.965755 | TASK [fetch-output : Set log path for multiple nodes]
2026-09-07 18:13:26.039933 | instance | skipping: Conditional result was False
2026-09-07 18:13:26.050422 | 
2026-09-07 18:13:26.050587 | TASK [fetch-output : Set log path for single node]
2026-09-07 18:13:26.093525 | instance | ok
2026-09-07 18:13:26.103446 | 
2026-09-07 18:13:26.103581 | LOOP [fetch-output : Ensure local output dirs]
2026-09-07 18:13:26.494794 | instance -> localhost | ok: "/var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/logs"
2026-09-07 18:13:26.726619 | instance -> localhost | changed: "/var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/artifacts"
2026-09-07 18:13:26.966690 | instance -> localhost | changed: "/var/lib/zuul/builds/6fad926e4b0d434c9058f77903de6f3a/work/docs"
2026-09-07 18:13:26.985475 | 
2026-09-07 18:13:27.072001 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-09-07 18:13:27.805612 | instance | changed: .d..t...... ./
2026-09-07 18:13:27.806138 | instance | changed: All items complete
2026-09-07 18:13:27.806245 | 
2026-09-07 18:13:28.325955 | instance | changed: .d..t...... ./
2026-09-07 18:13:28.898977 | instance | changed: .d..t...... ./
2026-09-07 18:13:28.924634 | 
2026-09-07 18:13:28.924837 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-09-07 18:13:29.342771 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.009645
2026-09-07 18:13:29.624856 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007475
2026-09-07 18:13:29.645159 | 
2026-09-07 18:13:29.645390 | PLAY [all]
2026-09-07 18:13:29.656702 | 
2026-09-07 18:13:29.656842 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-09-07 18:13:30.137361 | instance | changed
2026-09-07 18:13:30.147544 | 
2026-09-07 18:13:30.147640 | PLAY RECAP
2026-09-07 18:13:30.147727 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-07 18:13:30.147770 | 
2026-09-07 18:13:30.304302 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-07 18:13:30.307989 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-09-07 18:13:30.897300 | 
2026-09-07 18:13:30.897461 | PLAY [localhost]
2026-09-07 18:13:30.907300 | 
2026-09-07 18:13:30.907382 | TASK [Generate Zuul manifest]
2026-09-07 18:13:31.025769 | localhost | ok
2026-09-07 18:13:31.058537 | 
2026-09-07 18:13:31.058689 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-09-07 18:13:31.480911 | localhost | changed
2026-09-07 18:13:31.551152 | 
2026-09-07 18:13:31.551384 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-09-07 18:13:31.646782 | localhost | ok
2026-09-07 18:13:31.667087 | 
2026-09-07 18:13:31.667192 | TASK [Upload logs]
2026-09-07 18:13:31.694684 | localhost | ok
2026-09-07 18:13:31.821704 | 
2026-09-07 18:13:31.821863 | TASK [Set zuul-log-path fact]
2026-09-07 18:13:31.852896 | localhost | ok
2026-09-07 18:13:31.875195 | 
2026-09-07 18:13:31.875350 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-07 18:13:31.928909 | localhost | ok
2026-09-07 18:13:31.938233 | 
2026-09-07 18:13:31.938343 | TASK [upload-logs : Create log directories]
2026-09-07 18:13:32.368577 | localhost | changed
2026-09-07 18:13:32.379007 | 
2026-09-07 18:13:32.379152 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-09-07 18:13:32.786128 | localhost -> localhost | ok: Runtime: 0:00:00.004736
2026-09-07 18:13:32.795848 | 
2026-09-07 18:13:32.795990 | TASK [upload-logs : Upload logs to log server]
2026-09-07 18:13:33.291508 | localhost | Output suppressed because no_log was given
2026-09-07 18:13:33.349672 | 
2026-09-07 18:13:33.349836 | LOOP [upload-logs : Compress console log and json output]
2026-09-07 18:13:33.412574 | localhost | skipping: Conditional result was False
2026-09-07 18:13:33.420146 | localhost | skipping: Conditional result was False
2026-09-07 18:13:33.434125 | 
2026-09-07 18:13:33.434347 | LOOP [upload-logs : Upload compressed console log and json output]
2026-09-07 18:13:33.495799 | localhost | skipping: Conditional result was False
2026-09-07 18:13:33.498056 | 
2026-09-07 18:13:33.500125 | localhost | skipping: Conditional result was False
2026-09-07 18:13:33.510363 | 
2026-09-07 18:13:33.510547 | LOOP [upload-logs : Upload console log and json output]