2026-09-07 03:30:17.617812 | Job console starting
2026-09-07 03:30:17.629817 | Updating git repos
2026-09-07 03:30:20.875018 | Cloning repos into workspace
2026-09-07 03:30:37.128214 | Restoring repo states
2026-09-07 03:30:42.589231 | Merging changes
2026-09-07 03:30:43.651661 | Checking out repos
2026-09-07 03:30:45.994993 | Preparing playbooks
2026-09-07 03:30:47.875262 | Running Ansible setup
2026-09-07 03:30:52.250844 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-07 03:30:52.886013 | 
2026-09-07 03:30:52.886267 | PLAY [localhost]
2026-09-07 03:30:52.893890 | 
2026-09-07 03:30:52.893983 | TASK [Gathering Facts]
2026-09-07 03:30:53.774534 | localhost | ok
2026-09-07 03:30:53.791574 | 
2026-09-07 03:30:54.108577 | TASK [Setup log path fact]
2026-09-07 03:30:54.131147 | localhost | ok
2026-09-07 03:30:54.154668 | 
2026-09-07 03:30:54.154814 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-07 03:30:54.193633 | localhost | ok
2026-09-07 03:30:54.201891 | 
2026-09-07 03:30:54.202039 | TASK [emit-job-header : Print job information]
2026-09-07 03:30:54.240077 | # Job Information
2026-09-07 03:30:54.240247 | Ansible Version: 2.16.18
2026-09-07 03:30:54.240282 | Job: atmosphere-molecule-csi-rbd
2026-09-07 03:30:54.240303 | Pipeline: check
2026-09-07 03:30:54.240323 | Executor: 2d72f0692154
2026-09-07 03:30:54.240364 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4094
2026-09-07 03:30:54.240407 | Event ID: d6e6a0d0-aa6a-11f1-82e0-1a17012a3916
2026-09-07 03:30:54.244186 | 
2026-09-07 03:30:54.244337 | LOOP [emit-job-header : Print node information]
2026-09-07 03:30:54.326017 | localhost | ok:
2026-09-07 03:30:54.326344 | localhost | # Node Information
2026-09-07 03:30:54.326374 | localhost | Inventory Hostname: instance
2026-09-07 03:30:54.326395 | localhost | Hostname: np0000192037
2026-09-07 03:30:54.326454 | localhost | Username: zuul
2026-09-07 03:30:54.326480 | localhost | Distro: Ubuntu 22.04
2026-09-07 03:30:54.326498 | localhost | Provider: yul1
2026-09-07 03:30:54.326517 | localhost | Region: ca-ymq-1
2026-09-07 03:30:54.326534 | localhost | Label: ubuntu-jammy
2026-09-07 03:30:54.326552 | localhost | Product Name: OpenStack Nova
2026-09-07 03:30:54.326569 | localhost | Interface IP: 162.253.55.126
2026-09-07 03:30:54.335194 | 
2026-09-07 03:30:54.335442 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-09-07 03:30:54.724433 | localhost -> localhost | changed
2026-09-07 03:30:54.730119 | 
2026-09-07 03:30:54.730214 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-09-07 03:30:55.606057 | localhost -> localhost | changed
2026-09-07 03:30:55.611313 | 
2026-09-07 03:30:55.611383 | PLAY [all]
2026-09-07 03:30:55.618732 | 
2026-09-07 03:30:55.618820 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-09-07 03:30:55.875076 | instance -> localhost | ok
2026-09-07 03:30:55.885448 | 
2026-09-07 03:30:55.885583 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-09-07 03:30:55.903388 | instance | ok
2026-09-07 03:30:55.914968 | instance | included: /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-07 03:30:55.920553 | 
2026-09-07 03:30:55.920623 | TASK [add-build-sshkey : Create Temp SSH key]
2026-09-07 03:30:56.777503 | instance -> localhost | Generating public/private rsa key pair.
2026-09-07 03:30:56.777770 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/6932c2ae20d941f7bd7bda6d856c074d_id_rsa
2026-09-07 03:30:56.777832 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/6932c2ae20d941f7bd7bda6d856c074d_id_rsa.pub
2026-09-07 03:30:56.777902 | instance -> localhost | The key fingerprint is:
2026-09-07 03:30:56.777946 | instance -> localhost | SHA256:GNt7mCJbdHydGofPG3z/9iM6zYoZrv5mPxy4eJnNEEI zuul-build-sshkey
2026-09-07 03:30:56.778006 | instance -> localhost | The key's randomart image is:
2026-09-07 03:30:56.778047 | instance -> localhost | +---[RSA 3072]----+
2026-09-07 03:30:56.778096 | instance -> localhost | |                 |
2026-09-07 03:30:56.778139 | instance -> localhost | |       E         |
2026-09-07 03:30:56.778178 | instance -> localhost | |      o          |
2026-09-07 03:30:56.778218 | instance -> localhost | |       B . o .   |
2026-09-07 03:30:56.778257 | instance -> localhost | |      + S * +    |
2026-09-07 03:30:56.778295 | instance -> localhost | |     . . B O     |
2026-09-07 03:30:56.778332 | instance -> localhost | |    . o =.@ O .  |
2026-09-07 03:30:56.778369 | instance -> localhost | |     + o.O+* B o.|
2026-09-07 03:30:56.778435 | instance -> localhost | |    . .o*=.+* ..B|
2026-09-07 03:30:56.778475 | instance -> localhost | +----[SHA256]-----+
2026-09-07 03:30:56.778561 | instance -> localhost | ok: Runtime: 0:00:00.439160
2026-09-07 03:30:56.791988 | 
2026-09-07 03:30:56.792213 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-09-07 03:30:56.817264 | instance | ok
2026-09-07 03:30:56.832838 | instance | included: /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-07 03:30:56.843163 | 
2026-09-07 03:30:56.843281 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-09-07 03:30:56.866906 | instance | skipping: Conditional result was False
2026-09-07 03:30:56.877081 | 
2026-09-07 03:30:56.877213 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-09-07 03:30:57.322785 | instance | changed
2026-09-07 03:30:57.333349 | 
2026-09-07 03:30:57.333494 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-09-07 03:30:57.520830 | instance | ok
2026-09-07 03:30:57.525805 | 
2026-09-07 03:30:57.525879 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-09-07 03:30:57.997173 | instance | changed
2026-09-07 03:30:58.002691 | 
2026-09-07 03:30:58.002766 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-09-07 03:30:58.471482 | instance | changed
2026-09-07 03:30:58.480803 | 
2026-09-07 03:30:58.480966 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-09-07 03:30:58.515501 | instance | skipping: Conditional result was False
2026-09-07 03:30:58.522904 | 
2026-09-07 03:30:58.523065 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-09-07 03:30:58.999877 | instance -> localhost | changed
2026-09-07 03:30:59.014215 | 
2026-09-07 03:30:59.014349 | TASK [add-build-sshkey : Add back temp key]
2026-09-07 03:30:59.328444 | instance -> localhost | Identity added: /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/6932c2ae20d941f7bd7bda6d856c074d_id_rsa (zuul-build-sshkey)
2026-09-07 03:30:59.328731 | instance -> localhost | ok: Runtime: 0:00:00.014916
2026-09-07 03:30:59.334695 | 
2026-09-07 03:30:59.334791 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-09-07 03:30:59.648136 | instance | ok
2026-09-07 03:30:59.652609 | 
2026-09-07 03:30:59.652698 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-09-07 03:30:59.686613 | instance | skipping: Conditional result was False
2026-09-07 03:30:59.697286 | 
2026-09-07 03:30:59.697415 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-09-07 03:31:00.042929 | instance | ok
2026-09-07 03:31:00.051824 | 
2026-09-07 03:31:00.051972 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-09-07 03:31:03.600253 | instance | Output suppressed because no_log was given
2026-09-07 03:31:03.608522 | 
2026-09-07 03:31:03.608598 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-09-07 03:31:03.820661 | instance | ok: "logs"
2026-09-07 03:31:03.820946 | instance | ok: All items complete
2026-09-07 03:31:03.820977 | 
2026-09-07 03:31:03.956881 | instance | ok: "artifacts"
2026-09-07 03:31:04.154463 | instance | ok: "docs"
2026-09-07 03:31:04.167218 | 
2026-09-07 03:31:04.167314 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-09-07 03:31:04.406016 | instance | changed: "logs"
2026-09-07 03:31:04.603363 | instance | changed: "artifacts"
2026-09-07 03:31:04.756456 | instance | changed: "docs"
2026-09-07 03:31:04.779803 | 
2026-09-07 03:31:04.779999 | PLAY RECAP
2026-09-07 03:31:04.780138 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-07 03:31:04.780211 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 03:31:04.780276 | 
2026-09-07 03:31:04.945147 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-07 03:31:04.947834 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-07 03:31:05.517750 | 
2026-09-07 03:31:05.517923 | PLAY [all]
2026-09-07 03:31:05.532727 | 
2026-09-07 03:31:05.532894 | TASK [setup-uv : Extract archive]
2026-09-07 03:31:07.730862 | instance | changed
2026-09-07 03:31:07.744043 | 
2026-09-07 03:31:07.744265 | TASK [setup-uv : Print version]
2026-09-07 03:31:08.148691 | instance | uv 0.8.13
2026-09-07 03:31:08.283611 | instance | ok: Runtime: 0:00:00.012525
2026-09-07 03:31:08.291642 | 
2026-09-07 03:31:08.291781 | TASK [Install Ansible collection siblings]
2026-09-07 03:31:17.148178 | instance | changed:
2026-09-07 03:31:17.148395 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-07 03:31:17.148442 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-07 03:31:17.148479 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-07 03:31:17.148535 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-07 03:31:17.148571 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-09-07 03:31:17.148609 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-07 03:31:17.148645 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-07 03:31:17.148680 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-07 03:31:17.148712 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-07 03:31:17.148744 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-07 03:31:17.148777 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-07 03:31:17.148810 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-07 03:31:17.148841 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-09-07 03:31:17.148873 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-09-07 03:31:17.148905 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-09-07 03:31:17.148937 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-09-07 03:31:17.148968 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-09-07 03:31:17.149001 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-09-07 03:31:17.149032 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-09-07 03:31:17.149064 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-09-07 03:31:17.149095 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-09-07 03:31:17.149126 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-09-07 03:31:17.149160 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-07 03:31:17.149208 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-09-07 03:31:17.149242 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-09-07 03:31:17.149274 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-07 03:31:17.149306 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-07 03:31:17.149338 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-07 03:31:17.149391 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-09-07 03:31:17.149424 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-09-07 03:31:17.149454 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-07 03:31:17.149487 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-07 03:31:17.149519 | instance | Checked out ansible.netcommon to 1.2.0
2026-09-07 03:31:17.149551 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-07 03:31:17.149592 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.149625 | instance | Process install dependency map
2026-09-07 03:31:17.149657 | instance | Starting collection install process
2026-09-07 03:31:17.149688 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-09-07 03:31:17.149719 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-09-07 03:31:17.149926 | instance | ansible.netcommon:* was installed successfully
2026-09-07 03:31:17.149965 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-09-07 03:31:17.149998 | instance | Creating virtual environment at: .venv
2026-09-07 03:31:17.150030 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-07 03:31:17.150062 | instance | Downloading pydantic-core (2.0MiB)
2026-09-07 03:31:17.150093 | instance | Downloading ansible-core (2.1MiB)
2026-09-07 03:31:17.150131 | instance | Downloading netaddr (2.2MiB)
2026-09-07 03:31:17.150164 | instance | Downloading cryptography (4.2MiB)
2026-09-07 03:31:17.150195 | instance | Downloading rjsonnet (1.2MiB)
2026-09-07 03:31:17.150227 | instance | Downloading setuptools (1.1MiB)
2026-09-07 03:31:17.150259 | instance | Downloading kubernetes (1.9MiB)
2026-09-07 03:31:17.150291 | instance | Downloading pygments (1.2MiB)
2026-09-07 03:31:17.150322 | instance | Downloading openstacksdk (1.7MiB)
2026-09-07 03:31:17.150371 | instance |    Building pyperclip==1.9.0
2026-09-07 03:31:17.150407 | instance |  Downloading rjsonnet
2026-09-07 03:31:17.150440 | instance |  Downloading pydantic-core
2026-09-07 03:31:17.150471 | instance |  Downloading netaddr
2026-09-07 03:31:17.150502 | instance |  Downloading pygments
2026-09-07 03:31:17.150534 | instance |  Downloading cryptography
2026-09-07 03:31:17.150565 | instance |  Downloading setuptools
2026-09-07 03:31:17.150596 | instance |  Downloading kubernetes
2026-09-07 03:31:17.150628 | instance |  Downloading ansible-core
2026-09-07 03:31:17.150660 | instance |  Downloading openstacksdk
2026-09-07 03:31:17.150691 | instance |       Built pyperclip==1.9.0
2026-09-07 03:31:17.150723 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-07 03:31:17.150755 | instance | Installed 83 packages in 62ms
2026-09-07 03:31:17.150786 | instance | Checked out ansible.posix to 1.6.0
2026-09-07 03:31:17.150817 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-07 03:31:17.150849 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.150880 | instance | Process install dependency map
2026-09-07 03:31:17.150919 | instance | Starting collection install process
2026-09-07 03:31:17.150952 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-09-07 03:31:17.150984 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-09-07 03:31:17.151014 | instance | ansible.posix:1.6.0 was installed successfully
2026-09-07 03:31:17.151045 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.151076 | instance | 2.17.12
2026-09-07 03:31:17.151107 | instance | Checked out ansible.utils to v6.1.0
2026-09-07 03:31:17.151138 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-07 03:31:17.151170 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.151201 | instance | Process install dependency map
2026-09-07 03:31:17.151232 | instance | Starting collection install process
2026-09-07 03:31:17.151263 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-09-07 03:31:17.151294 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-09-07 03:31:17.151325 | instance | ansible.utils:6.1.0 was installed successfully
2026-09-07 03:31:17.151372 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.151406 | instance | 2.17.12
2026-09-07 03:31:17.151438 | instance | Checked out atmosphere.common to v0.7.0
2026-09-07 03:31:17.151469 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-07 03:31:17.151501 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.151533 | instance | Process install dependency map
2026-09-07 03:31:17.151564 | instance | Starting collection install process
2026-09-07 03:31:17.151596 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-09-07 03:31:17.151628 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-09-07 03:31:17.151659 | instance | atmosphere.common:0.7.0 was installed successfully
2026-09-07 03:31:17.151689 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.151721 | instance | 2.17.12
2026-09-07 03:31:17.151751 | instance | Checked out community.crypto to 2.2.3
2026-09-07 03:31:17.151782 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-07 03:31:17.151814 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.151845 | instance | Process install dependency map
2026-09-07 03:31:17.151876 | instance | Starting collection install process
2026-09-07 03:31:17.151912 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-09-07 03:31:17.151943 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-09-07 03:31:17.151975 | instance | community.crypto:2.2.3 was installed successfully
2026-09-07 03:31:17.152006 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.152037 | instance | 2.17.12
2026-09-07 03:31:17.152068 | instance | Checked out community.general to 7.3.0
2026-09-07 03:31:17.152098 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-09-07 03:31:17.152136 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.152169 | instance | Process install dependency map
2026-09-07 03:31:17.152377 | instance | Starting collection install process
2026-09-07 03:31:17.152411 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-09-07 03:31:17.152442 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-09-07 03:31:17.152473 | instance | community.general:7.3.0 was installed successfully
2026-09-07 03:31:17.152578 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.152617 | instance | 2.17.12
2026-09-07 03:31:17.152649 | instance | Checked out community.mysql to 3.6.0
2026-09-07 03:31:17.152684 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-07 03:31:17.152716 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.152748 | instance | Process install dependency map
2026-09-07 03:31:17.152779 | instance | Starting collection install process
2026-09-07 03:31:17.152810 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-09-07 03:31:17.152841 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-09-07 03:31:17.152872 | instance | community.mysql:3.6.0 was installed successfully
2026-09-07 03:31:17.152903 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.152933 | instance | 2.17.12
2026-09-07 03:31:17.152964 | instance | Checked out kubernetes.core to 2.4.0
2026-09-07 03:31:17.152995 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-07 03:31:17.153027 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.153058 | instance | Process install dependency map
2026-09-07 03:31:17.153090 | instance | Starting collection install process
2026-09-07 03:31:17.153121 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-09-07 03:31:17.153152 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-09-07 03:31:17.153183 | instance | kubernetes.core:2.4.0 was installed successfully
2026-09-07 03:31:17.153400 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.153437 | instance | 2.17.12
2026-09-07 03:31:17.153469 | instance | Checked out openstack.cloud to 2.6.0
2026-09-07 03:31:17.153500 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-07 03:31:17.153531 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.153562 | instance | Process install dependency map
2026-09-07 03:31:17.153593 | instance | Starting collection install process
2026-09-07 03:31:17.153624 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-09-07 03:31:17.153655 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-09-07 03:31:17.153686 | instance | openstack.cloud:2.6.0 was installed successfully
2026-09-07 03:31:17.153716 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.153747 | instance | 2.17.12
2026-09-07 03:31:17.153785 | instance | Checked out vexxhost.ceph to v4.2.0
2026-09-07 03:31:17.153819 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-07 03:31:17.153850 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.153881 | instance | Process install dependency map
2026-09-07 03:31:17.153911 | instance | Starting collection install process
2026-09-07 03:31:17.153941 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-09-07 03:31:17.153972 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-09-07 03:31:17.154003 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-09-07 03:31:17.154034 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.154065 | instance | 2.17.12
2026-09-07 03:31:17.154096 | instance | Checked out vexxhost.containers to v1.6.8
2026-09-07 03:31:17.154127 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-07 03:31:17.154158 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.154189 | instance | Process install dependency map
2026-09-07 03:31:17.154220 | instance | Starting collection install process
2026-09-07 03:31:17.154250 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-09-07 03:31:17.154280 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-09-07 03:31:17.154311 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-09-07 03:31:17.154342 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.154392 | instance | 2.17.12
2026-09-07 03:31:17.154424 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-09-07 03:31:17.154455 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-07 03:31:17.154487 | instance | Starting galaxy collection install process
2026-09-07 03:31:17.154518 | instance | Process install dependency map
2026-09-07 03:31:17.154548 | instance | Starting collection install process
2026-09-07 03:31:17.154578 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-09-07 03:31:17.154609 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-09-07 03:31:17.154640 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-09-07 03:31:17.154671 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-07 03:31:17.154701 | instance | 2.17.12
2026-09-07 03:31:17.162734 | 
2026-09-07 03:31:17.162797 | PLAY RECAP
2026-09-07 03:31:17.162861 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 03:31:17.162897 | 
2026-09-07 03:31:17.292078 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-07 03:31:17.296566 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-07 03:31:17.867768 | 
2026-09-07 03:31:17.868086 | PLAY [all]
2026-09-07 03:31:17.878857 | 
2026-09-07 03:31:17.878973 | TASK [Install "jq" for log collection]
2026-09-07 03:31:26.617258 | instance | changed
2026-09-07 03:31:26.625057 | 
2026-09-07 03:31:26.625207 | PLAY RECAP
2026-09-07 03:31:26.625316 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-07 03:31:26.625816 | 
2026-09-07 03:31:26.815003 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-07 03:31:26.884902 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-07 03:31:27.474173 | 
2026-09-07 03:31:27.474312 | PLAY [all]
2026-09-07 03:31:27.484635 | 
2026-09-07 03:31:27.484731 | LOOP [Check inventory directories]
2026-09-07 03:31:27.821066 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-09-07 03:31:28.001130 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-09-07 03:31:28.156460 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-09-07 03:31:28.167868 | 
2026-09-07 03:31:28.168064 | LOOP [Copy inventory file for Zuul]
2026-09-07 03:31:29.009775 | instance | changed:
2026-09-07 03:31:29.009944 | instance | {
2026-09-07 03:31:29.009973 | instance |   "ansible_loop_var": "item",
2026-09-07 03:31:29.009994 | instance |   "changed": false,
2026-09-07 03:31:29.010013 | instance |   "failed": false,
2026-09-07 03:31:29.010038 | instance |   "invocation": {
2026-09-07 03:31:29.010056 | instance |     "module_args": {
2026-09-07 03:31:29.010074 | instance |       "checksum_algorithm": "sha1",
2026-09-07 03:31:29.010092 | instance |       "follow": true,
2026-09-07 03:31:29.010108 | instance |       "get_attributes": true,
2026-09-07 03:31:29.010125 | instance |       "get_checksum": true,
2026-09-07 03:31:29.010142 | instance |       "get_mime": true,
2026-09-07 03:31:29.010158 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-09-07 03:31:29.010174 | instance |     }
2026-09-07 03:31:29.010191 | instance |   },
2026-09-07 03:31:29.010207 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-09-07 03:31:29.010224 | instance |   "stat": {
2026-09-07 03:31:29.010239 | instance |     "atime": 1788751870.3239365,
2026-09-07 03:31:29.010256 | instance |     "attr_flags": "e",
2026-09-07 03:31:29.010273 | instance |     "attributes": [
2026-09-07 03:31:29.010289 | instance |       "extents"
2026-09-07 03:31:29.010305 | instance |     ],
2026-09-07 03:31:29.010339 | instance |     "block_size": 4096,
2026-09-07 03:31:29.010357 | instance |     "blocks": 8,
2026-09-07 03:31:29.010373 | instance |     "charset": "unknown",
2026-09-07 03:31:29.010391 | instance |     "ctime": 1788751869.059898,
2026-09-07 03:31:29.010408 | instance |     "dev": 64513,
2026-09-07 03:31:29.010424 | instance |     "device_type": 0,
2026-09-07 03:31:29.010441 | instance |     "executable": true,
2026-09-07 03:31:29.010457 | instance |     "exists": true,
2026-09-07 03:31:29.010472 | instance |     "gid": 1000,
2026-09-07 03:31:29.010488 | instance |     "gr_name": "zuul",
2026-09-07 03:31:29.010504 | instance |     "inode": 1048104,
2026-09-07 03:31:29.010521 | instance |     "isblk": false,
2026-09-07 03:31:29.010538 | instance |     "ischr": false,
2026-09-07 03:31:29.010554 | instance |     "isdir": true,
2026-09-07 03:31:29.010570 | instance |     "isfifo": false,
2026-09-07 03:31:29.010586 | instance |     "isgid": false,
2026-09-07 03:31:29.010602 | instance |     "islnk": false,
2026-09-07 03:31:29.010618 | instance |     "isreg": false,
2026-09-07 03:31:29.010634 | instance |     "issock": false,
2026-09-07 03:31:29.010650 | instance |     "isuid": false,
2026-09-07 03:31:29.010666 | instance |     "mimetype": "unknown",
2026-09-07 03:31:29.010682 | instance |     "mode": "0755",
2026-09-07 03:31:29.010698 | instance |     "mtime": 1788751869.059898,
2026-09-07 03:31:29.010715 | instance |     "nlink": 22,
2026-09-07 03:31:29.010731 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-09-07 03:31:29.010748 | instance |     "pw_name": "zuul",
2026-09-07 03:31:29.010768 | instance |     "readable": true,
2026-09-07 03:31:29.010784 | instance |     "rgrp": true,
2026-09-07 03:31:29.010800 | instance |     "roth": true,
2026-09-07 03:31:29.010824 | instance |     "rusr": true,
2026-09-07 03:31:29.010847 | instance |     "size": 4096,
2026-09-07 03:31:29.010869 | instance |     "uid": 1000,
2026-09-07 03:31:29.010887 | instance |     "version": "3961686460",
2026-09-07 03:31:29.010903 | instance |     "wgrp": false,
2026-09-07 03:31:29.010922 | instance |     "woth": false,
2026-09-07 03:31:29.010938 | instance |     "writeable": true,
2026-09-07 03:31:29.010954 | instance |     "wusr": true,
2026-09-07 03:31:29.010970 | instance |     "xgrp": true,
2026-09-07 03:31:29.010985 | instance |     "xoth": true,
2026-09-07 03:31:29.011001 | instance |     "xusr": true
2026-09-07 03:31:29.011018 | instance |   }
2026-09-07 03:31:29.011034 | instance | }
2026-09-07 03:31:29.011066 | instance | ok: All items complete
2026-09-07 03:31:29.011086 | 
2026-09-07 03:31:29.016749 | instance | skipping: Conditional result was False
2026-09-07 03:31:29.028450 | instance | skipping: Conditional result was False
2026-09-07 03:31:29.044600 | 
2026-09-07 03:31:29.045053 | LOOP [Switch "ansible_host" to private IP]
2026-09-07 03:31:29.396733 | instance | changed: 1 replacements made
2026-09-07 03:31:29.399134 | instance | skipping: Conditional result was False
2026-09-07 03:31:29.400294 | instance | skipping: Conditional result was False
2026-09-07 03:31:29.414060 | 
2026-09-07 03:31:29.414183 | TASK [Run Molecule scenario]
2026-09-07 03:31:30.305726 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-09-07 03:31:30.699500 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-09-07 03:31:30.699566 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-09-07 03:31:40.969850 | instance | INFO     [csi > dependency] Executing
2026-09-07 03:31:40.970030 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-09-07 03:31:40.970261 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-09-07 03:31:40.970392 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-09-07 03:31:40.979941 | instance | INFO     [csi > cleanup] Executing
2026-09-07 03:31:40.980573 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-07 03:31:40.992030 | instance | INFO     [csi > destroy] Executing
2026-09-07 03:31:40.992137 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-09-07 03:31:40.992236 | instance | INFO     [csi > destroy] Executed: Successful
2026-09-07 03:31:41.001684 | instance | INFO     [csi > syntax] Executing
2026-09-07 03:31:42.513013 | instance |
2026-09-07 03:31:42.513269 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 03:31:42.572432 | instance | INFO     [csi > syntax] Executed: Successful
2026-09-07 03:31:42.587884 | instance | INFO     [csi > create] Executing
2026-09-07 03:31:42.591553 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-07 03:31:42.606057 | instance | INFO     [csi > prepare] Executing
2026-09-07 03:31:43.371910 | instance |
2026-09-07 03:31:43.372084 | instance | PLAY [Prepare] *****************************************************************
2026-09-07 03:31:43.372293 | instance |
2026-09-07 03:31:43.372563 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 03:31:43.372790 | instance | Monday 07 September 2026  03:31:43 +0000 (0:00:00.022)       0:00:00.022 ******
2026-09-07 03:31:44.595856 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-07 03:31:44.595925 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-07 03:31:44.596053 | instance | interpreter could change the meaning of that path. See
2026-09-07 03:31:44.596163 | instance | https://docs.ansible.com/ansible-
2026-09-07 03:31:44.596267 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-07 03:31:44.608238 | instance | ok: [instance]
2026-09-07 03:31:44.608318 | instance |
2026-09-07 03:31:44.608422 | instance | TASK [Configure short hostname] ************************************************
2026-09-07 03:31:44.608637 | instance | Monday 07 September 2026  03:31:44 +0000 (0:00:01.236)       0:00:01.259 ******
2026-09-07 03:31:45.352895 | instance | changed: [instance]
2026-09-07 03:31:45.353037 | instance |
2026-09-07 03:31:45.353255 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-09-07 03:31:45.353422 | instance | Monday 07 September 2026  03:31:45 +0000 (0:00:00.743)       0:00:02.003 ******
2026-09-07 03:31:45.653831 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-09-07 03:31:45.653962 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-09-07 03:31:45.654132 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-09-07 03:31:45.663972 | instance | changed: [instance]
2026-09-07 03:31:45.664110 | instance |
2026-09-07 03:31:45.664289 | instance | TASK [Purge "snapd" package] ***************************************************
2026-09-07 03:31:45.664451 | instance | Monday 07 September 2026  03:31:45 +0000 (0:00:00.311)       0:00:02.314 ******
2026-09-07 03:31:46.467170 | instance | ok: [instance]
2026-09-07 03:31:46.467420 | instance |
2026-09-07 03:31:46.467713 | instance | PLAY [Create devices for Ceph] *************************************************
2026-09-07 03:31:46.467911 | instance |
2026-09-07 03:31:46.468134 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 03:31:46.468419 | instance | Monday 07 September 2026  03:31:46 +0000 (0:00:00.803)       0:00:03.118 ******
2026-09-07 03:31:47.213060 | instance | ok: [instance]
2026-09-07 03:31:47.213247 | instance |
2026-09-07 03:31:47.213511 | instance | TASK [Install depedencies] *****************************************************
2026-09-07 03:31:47.213756 | instance | Monday 07 September 2026  03:31:47 +0000 (0:00:00.745)       0:00:03.863 ******
2026-09-07 03:32:10.902788 | instance | changed: [instance]
2026-09-07 03:32:10.902914 | instance |
2026-09-07 03:32:10.902927 | instance | TASK [Start up service] ********************************************************
2026-09-07 03:32:10.902943 | instance | Monday 07 September 2026  03:32:10 +0000 (0:00:23.689)       0:00:27.552 ******
2026-09-07 03:32:11.508197 | instance | ok: [instance]
2026-09-07 03:32:11.508650 | instance |
2026-09-07 03:32:11.508675 | instance | TASK [Generate lvm.conf] *******************************************************
2026-09-07 03:32:11.508685 | instance | Monday 07 September 2026  03:32:11 +0000 (0:00:00.606)       0:00:28.159 ******
2026-09-07 03:32:11.810716 | instance | ok: [instance]
2026-09-07 03:32:11.811004 | instance |
2026-09-07 03:32:11.811316 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-09-07 03:32:11.811664 | instance | Monday 07 September 2026  03:32:11 +0000 (0:00:00.301)       0:00:28.460 ******
2026-09-07 03:32:12.520004 | instance | changed: [instance]
2026-09-07 03:32:12.520143 | instance |
2026-09-07 03:32:12.520274 | instance | TASK [Get list of all loopback devices] ****************************************
2026-09-07 03:32:12.520386 | instance | Monday 07 September 2026  03:32:12 +0000 (0:00:00.710)       0:00:29.171 ******
2026-09-07 03:32:12.701476 | instance | ok: [instance]
2026-09-07 03:32:12.701818 | instance |
2026-09-07 03:32:12.702200 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-09-07 03:32:12.702523 | instance | Monday 07 September 2026  03:32:12 +0000 (0:00:00.180)       0:00:29.351 ******
2026-09-07 03:32:12.726027 | instance | skipping: [instance]
2026-09-07 03:32:12.726228 | instance |
2026-09-07 03:32:12.726499 | instance | TASK [Create devices for Ceph] *************************************************
2026-09-07 03:32:12.726805 | instance | Monday 07 September 2026  03:32:12 +0000 (0:00:00.024)       0:00:29.376 ******
2026-09-07 03:32:13.297143 | instance | changed: [instance] => (item=osd0)
2026-09-07 03:32:13.297267 | instance | changed: [instance] => (item=osd1)
2026-09-07 03:32:13.297410 | instance | changed: [instance] => (item=osd2)
2026-09-07 03:32:13.297599 | instance |
2026-09-07 03:32:13.297831 | instance | TASK [Set permissions on loopback devices] *************************************
2026-09-07 03:32:13.297997 | instance | Monday 07 September 2026  03:32:13 +0000 (0:00:00.571)       0:00:29.948 ******
2026-09-07 03:32:13.904959 | instance | changed: [instance] => (item=osd0)
2026-09-07 03:32:13.905012 | instance | changed: [instance] => (item=osd1)
2026-09-07 03:32:13.905023 | instance | changed: [instance] => (item=osd2)
2026-09-07 03:32:13.905033 | instance |
2026-09-07 03:32:13.905042 | instance | TASK [Start loop devices] ******************************************************
2026-09-07 03:32:13.905052 | instance | Monday 07 September 2026  03:32:13 +0000 (0:00:00.606)       0:00:30.554 ******
2026-09-07 03:32:14.695504 | instance | changed: [instance] => (item=osd0)
2026-09-07 03:32:14.696529 | instance | changed: [instance] => (item=osd1)
2026-09-07 03:32:14.696575 | instance | changed: [instance] => (item=osd2)
2026-09-07 03:32:14.696584 | instance |
2026-09-07 03:32:14.696591 | instance | TASK [Create a volume group for each loop device] ******************************
2026-09-07 03:32:14.696598 | instance | Monday 07 September 2026  03:32:14 +0000 (0:00:00.791)       0:00:31.346 ******
2026-09-07 03:32:18.131262 | instance | changed: [instance] => (item=osd0)
2026-09-07 03:32:18.132663 | instance | changed: [instance] => (item=osd1)
2026-09-07 03:32:18.132723 | instance | changed: [instance] => (item=osd2)
2026-09-07 03:32:18.132735 | instance |
2026-09-07 03:32:18.132745 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-09-07 03:32:18.132755 | instance | Monday 07 September 2026  03:32:18 +0000 (0:00:03.435)       0:00:34.781 ******
2026-09-07 03:32:20.152687 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-09-07 03:32:20.152748 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-09-07 03:32:20.152782 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-09-07 03:32:20.152802 | instance |
2026-09-07 03:32:20.154831 | instance | PLAY RECAP *********************************************************************
2026-09-07 03:32:20.154907 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-09-07 03:32:20.154919 | instance |
2026-09-07 03:32:20.154928 | instance | Monday 07 September 2026  03:32:20 +0000 (0:00:02.021)       0:00:36.803 ******
2026-09-07 03:32:20.154938 | instance | ===============================================================================
2026-09-07 03:32:20.154946 | instance | Install depedencies ---------------------------------------------------- 23.69s
2026-09-07 03:32:20.154963 | instance | Create a volume group for each loop device ------------------------------ 3.44s
2026-09-07 03:32:20.155176 | instance | Create a logical volume for each loop device ---------------------------- 2.02s
2026-09-07 03:32:20.155515 | instance | Gathering Facts --------------------------------------------------------- 1.24s
2026-09-07 03:32:20.155802 | instance | Purge "snapd" package --------------------------------------------------- 0.80s
2026-09-07 03:32:20.156110 | instance | Start loop devices ------------------------------------------------------ 0.79s
2026-09-07 03:32:20.156394 | instance | Gathering Facts --------------------------------------------------------- 0.75s
2026-09-07 03:32:20.156676 | instance | Configure short hostname ------------------------------------------------ 0.74s
2026-09-07 03:32:20.157088 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.71s
2026-09-07 03:32:20.157389 | instance | Set permissions on loopback devices ------------------------------------- 0.61s
2026-09-07 03:32:20.157668 | instance | Start up service -------------------------------------------------------- 0.61s
2026-09-07 03:32:20.157943 | instance | Create devices for Ceph ------------------------------------------------- 0.57s
2026-09-07 03:32:20.158280 | instance | Ensure hostname inside hosts file --------------------------------------- 0.31s
2026-09-07 03:32:20.158652 | instance | Generate lvm.conf ------------------------------------------------------- 0.30s
2026-09-07 03:32:20.159047 | instance | Get list of all loopback devices ---------------------------------------- 0.18s
2026-09-07 03:32:20.159354 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-09-07 03:32:20.231633 | instance | INFO     [csi > prepare] Executed: Successful
2026-09-07 03:32:20.246176 | instance | INFO     [csi > converge] Executing
2026-09-07 03:32:21.623224 | instance |
2026-09-07 03:32:21.623579 | instance | PLAY [Debug CSI driver value] **************************************************
2026-09-07 03:32:21.623866 | instance |
2026-09-07 03:32:21.624192 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 03:32:21.624490 | instance | Monday 07 September 2026  03:32:21 +0000 (0:00:00.007)       0:00:00.007 ******
2026-09-07 03:32:22.657997 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-07 03:32:22.658410 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-07 03:32:22.658769 | instance | interpreter could change the meaning of that path. See
2026-09-07 03:32:22.659121 | instance | https://docs.ansible.com/ansible-
2026-09-07 03:32:22.659461 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-07 03:32:22.671342 | instance | ok: [instance]
2026-09-07 03:32:22.671660 | instance |
2026-09-07 03:32:22.672019 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-09-07 03:32:22.672336 | instance | Monday 07 September 2026  03:32:22 +0000 (0:00:01.047)       0:00:01.055 ******
2026-09-07 03:32:22.729873 | instance | ok: [instance] => {
2026-09-07 03:32:22.730262 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-09-07 03:32:22.730554 | instance | }
2026-09-07 03:32:22.730889 | instance |
2026-09-07 03:32:22.731236 | instance | PLAY [all] *********************************************************************
2026-09-07 03:32:22.731507 | instance |
2026-09-07 03:32:22.731811 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 03:32:22.732207 | instance | Monday 07 September 2026  03:32:22 +0000 (0:00:00.058)       0:00:01.113 ******
2026-09-07 03:32:23.651638 | instance | ok: [instance]
2026-09-07 03:32:23.651802 | instance |
2026-09-07 03:32:23.651955 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-09-07 03:32:23.652094 | instance | Monday 07 September 2026  03:32:23 +0000 (0:00:00.921)       0:00:02.035 ******
2026-09-07 03:32:23.698023 | instance | skipping: [instance]
2026-09-07 03:32:23.698222 | instance |
2026-09-07 03:32:23.698413 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-09-07 03:32:23.698600 | instance | Monday 07 September 2026  03:32:23 +0000 (0:00:00.046)       0:00:02.081 ******
2026-09-07 03:32:23.903242 | instance | ok: [instance]
2026-09-07 03:32:23.903427 | instance |
2026-09-07 03:32:23.903575 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-09-07 03:32:23.903710 | instance |
2026-09-07 03:32:23.903847 | instance | TASK [Gathering Facts] *********************************************************
2026-09-07 03:32:23.904047 | instance | Monday 07 September 2026  03:32:23 +0000 (0:00:00.204)       0:00:02.286 ******
2026-09-07 03:32:24.831435 | instance | ok: [instance]
2026-09-07 03:32:24.831622 | instance |
2026-09-07 03:32:24.831999 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 03:32:24.832310 | instance | Monday 07 September 2026  03:32:24 +0000 (0:00:00.928)       0:00:03.214 ******
2026-09-07 03:32:25.166001 | instance | ok: [instance]
2026-09-07 03:32:25.166266 | instance |
2026-09-07 03:32:25.166558 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 03:32:25.166765 | instance | Monday 07 September 2026  03:32:25 +0000 (0:00:00.332)       0:00:03.547 ******
2026-09-07 03:32:25.218228 | instance | skipping: [instance]
2026-09-07 03:32:25.218613 | instance |
2026-09-07 03:32:25.219045 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-09-07 03:32:25.219356 | instance | Monday 07 September 2026  03:32:25 +0000 (0:00:00.054)       0:00:03.601 ******
2026-09-07 03:32:25.573684 | instance | changed: [instance]
2026-09-07 03:32:25.574067 | instance |
2026-09-07 03:32:25.574393 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 03:32:25.574758 | instance | Monday 07 September 2026  03:32:25 +0000 (0:00:00.355)       0:00:03.957 ******
2026-09-07 03:32:25.661584 | instance | ok: [instance] => {
2026-09-07 03:32:25.661823 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-09-07 03:32:25.662086 | instance | }
2026-09-07 03:32:25.662269 | instance |
2026-09-07 03:32:25.662450 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 03:32:25.662632 | instance | Monday 07 September 2026  03:32:25 +0000 (0:00:00.087)       0:00:04.045 ******
2026-09-07 03:32:26.239773 | instance | changed: [instance]
2026-09-07 03:32:26.240221 | instance |
2026-09-07 03:32:26.240565 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 03:32:26.240872 | instance | Monday 07 September 2026  03:32:26 +0000 (0:00:00.577)       0:00:04.622 ******
2026-09-07 03:32:26.300681 | instance | skipping: [instance]
2026-09-07 03:32:26.301177 | instance |
2026-09-07 03:32:26.301559 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 03:32:26.301961 | instance | Monday 07 September 2026  03:32:26 +0000 (0:00:00.061)       0:00:04.684 ******
2026-09-07 03:32:26.356058 | instance | skipping: [instance]
2026-09-07 03:32:26.356389 | instance |
2026-09-07 03:32:26.356729 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 03:32:26.357086 | instance | Monday 07 September 2026  03:32:26 +0000 (0:00:00.055)       0:00:04.739 ******
2026-09-07 03:32:26.590018 | instance | ok: [instance]
2026-09-07 03:32:26.590361 | instance |
2026-09-07 03:32:26.590556 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-07 03:32:26.590770 | instance | Monday 07 September 2026  03:32:26 +0000 (0:00:00.233)       0:00:04.973 ******
2026-09-07 03:32:27.891693 | instance | ok: [instance]
2026-09-07 03:32:27.891972 | instance |
2026-09-07 03:32:27.892178 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 03:32:27.892411 | instance | Monday 07 September 2026  03:32:27 +0000 (0:00:01.301)       0:00:06.274 ******
2026-09-07 03:32:27.975566 | instance | ok: [instance] => {
2026-09-07 03:32:27.975735 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-09-07 03:32:27.976011 | instance | }
2026-09-07 03:32:27.976385 | instance |
2026-09-07 03:32:27.976695 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 03:32:27.977019 | instance | Monday 07 September 2026  03:32:27 +0000 (0:00:00.081)       0:00:06.356 ******
2026-09-07 03:32:28.591369 | instance | changed: [instance]
2026-09-07 03:32:28.591580 | instance |
2026-09-07 03:32:28.591950 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 03:32:28.592252 | instance | Monday 07 September 2026  03:32:28 +0000 (0:00:00.616)       0:00:06.973 ******
2026-09-07 03:32:31.511783 | instance | changed: [instance]
2026-09-07 03:32:31.512489 | instance |
2026-09-07 03:32:31.513185 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-09-07 03:32:31.513692 | instance | Monday 07 September 2026  03:32:31 +0000 (0:00:02.921)       0:00:09.894 ******
2026-09-07 03:32:31.543242 | instance | skipping: [instance]
2026-09-07 03:32:31.543491 | instance |
2026-09-07 03:32:31.543916 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-09-07 03:32:31.544133 | instance | Monday 07 September 2026  03:32:31 +0000 (0:00:00.032)       0:00:09.926 ******
2026-09-07 03:32:31.579248 | instance | skipping: [instance]
2026-09-07 03:32:31.579395 | instance |
2026-09-07 03:32:31.579620 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-09-07 03:32:31.579844 | instance | Monday 07 September 2026  03:32:31 +0000 (0:00:00.035)       0:00:09.961 ******
2026-09-07 03:32:31.615249 | instance | skipping: [instance]
2026-09-07 03:32:31.615399 | instance |
2026-09-07 03:32:31.615635 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-09-07 03:32:31.615875 | instance | Monday 07 September 2026  03:32:31 +0000 (0:00:00.034)       0:00:09.996 ******
2026-09-07 03:32:36.659593 | instance | changed: [instance]
2026-09-07 03:32:36.660548 | instance |
2026-09-07 03:32:36.660608 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-09-07 03:32:36.660624 | instance | Monday 07 September 2026  03:32:36 +0000 (0:00:05.045)       0:00:15.042 ******
2026-09-07 03:32:37.262221 | instance | changed: [instance]
2026-09-07 03:32:37.262795 | instance |
2026-09-07 03:32:37.262857 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-09-07 03:32:37.263099 | instance | Monday 07 September 2026  03:32:37 +0000 (0:00:00.602)       0:00:15.645 ******
2026-09-07 03:32:38.249960 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-09-07 03:32:38.250863 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-09-07 03:32:38.250926 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-09-07 03:32:38.250955 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-09-07 03:32:38.252054 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-09-07 03:32:38.252113 | instance |
2026-09-07 03:32:38.252126 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-09-07 03:32:38.252136 | instance | Monday 07 September 2026  03:32:38 +0000 (0:00:00.987)       0:00:16.633 ******
2026-09-07 03:32:38.879481 | instance | changed: [instance]
2026-09-07 03:32:38.879558 | instance |
2026-09-07 03:32:38.880366 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-09-07 03:32:38.880411 | instance | Monday 07 September 2026  03:32:38 +0000 (0:00:00.604)       0:00:17.237 ******
2026-09-07 03:32:38.880420 | instance |
2026-09-07 03:32:38.880429 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-07 03:32:38.880437 | instance | Monday 07 September 2026  03:32:38 +0000 (0:00:00.025)       0:00:17.263 ******
2026-09-07 03:32:39.832820 | instance | ok: [instance]
2026-09-07 03:32:39.832897 | instance |
2026-09-07 03:32:39.833123 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-09-07 03:32:39.833155 | instance | Monday 07 September 2026  03:32:39 +0000 (0:00:00.953)       0:00:18.217 ******
2026-09-07 03:32:40.308649 | instance | changed: [instance]
2026-09-07 03:32:40.309534 | instance |
2026-09-07 03:32:40.309570 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-09-07 03:32:40.309581 | instance | Monday 07 September 2026  03:32:40 +0000 (0:00:00.475)       0:00:18.692 ******
2026-09-07 03:32:40.937579 | instance | changed: [instance]
2026-09-07 03:32:40.937637 | instance |
2026-09-07 03:32:40.937671 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-07 03:32:40.937681 | instance | Monday 07 September 2026  03:32:40 +0000 (0:00:00.628)       0:00:19.320 ******
2026-09-07 03:32:41.177098 | instance | ok: [instance]
2026-09-07 03:32:41.177180 | instance |
2026-09-07 03:32:41.177192 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-07 03:32:41.177202 | instance | Monday 07 September 2026  03:32:41 +0000 (0:00:00.239)       0:00:19.559 ******
2026-09-07 03:32:41.253213 | instance | ok: [instance] => {
2026-09-07 03:32:41.253251 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-09-07 03:32:41.253262 | instance | }
2026-09-07 03:32:41.253272 | instance |
2026-09-07 03:32:41.253281 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-07 03:32:41.253291 | instance | Monday 07 September 2026  03:32:41 +0000 (0:00:00.075)       0:00:19.635 ******
2026-09-07 03:32:42.150829 | instance | changed: [instance]
2026-09-07 03:32:42.150907 | instance |
2026-09-07 03:32:42.151502 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-07 03:32:42.151558 | instance | Monday 07 September 2026  03:32:42 +0000 (0:00:00.898)       0:00:20.533 ******
2026-09-07 03:32:46.589229 | instance | changed: [instance]
2026-09-07 03:32:46.589426 | instance |
2026-09-07 03:32:46.589746 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-09-07 03:32:46.589790 | instance | Monday 07 September 2026  03:32:46 +0000 (0:00:04.439)       0:00:24.973 ******
2026-09-07 03:32:47.715711 | instance | ok: [instance]
2026-09-07 03:32:47.715787 | instance |
2026-09-07 03:32:47.716017 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-09-07 03:32:47.716055 | instance | Monday 07 September 2026  03:32:47 +0000 (0:00:01.126)       0:00:26.099 ******
2026-09-07 03:32:48.096638 | instance | changed: [instance]
2026-09-07 03:32:48.097102 | instance |
2026-09-07 03:32:48.097154 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-09-07 03:32:48.097162 | instance | Monday 07 September 2026  03:32:48 +0000 (0:00:00.380)       0:00:26.480 ******
2026-09-07 03:32:48.567664 | instance | changed: [instance]
2026-09-07 03:32:48.568374 | instance |
2026-09-07 03:32:48.568423 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-09-07 03:32:48.568435 | instance | Monday 07 September 2026  03:32:48 +0000 (0:00:00.470)       0:00:26.951 ******
2026-09-07 03:32:49.175300 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-09-07 03:32:49.176569 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-09-07 03:32:49.176621 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-09-07 03:32:49.176632 | instance |
2026-09-07 03:32:49.176642 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-09-07 03:32:49.176651 | instance | Monday 07 September 2026  03:32:49 +0000 (0:00:00.607)       0:00:27.558 ******
2026-09-07 03:32:49.667864 | instance | changed: [instance]
2026-09-07 03:32:49.668801 | instance |
2026-09-07 03:32:49.668856 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-09-07 03:32:49.668871 | instance | Monday 07 September 2026  03:32:49 +0000 (0:00:00.492)       0:00:28.051 ******
2026-09-07 03:32:50.196398 | instance | changed: [instance]
2026-09-07 03:32:50.196512 | instance |
2026-09-07 03:32:50.197681 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-09-07 03:32:50.197742 | instance | Monday 07 September 2026  03:32:50 +0000 (0:00:00.504)       0:00:28.555 ******
2026-09-07 03:32:50.197750 | instance |
2026-09-07 03:32:50.197756 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-07 03:32:50.197767 | instance | Monday 07 September 2026  03:32:50 +0000 (0:00:00.024)       0:00:28.579 ******
2026-09-07 03:32:50.995182 | instance | ok: [instance]
2026-09-07 03:32:50.995967 | instance |
2026-09-07 03:32:50.996022 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-09-07 03:32:50.996034 | instance | Monday 07 September 2026  03:32:50 +0000 (0:00:00.798)       0:00:29.378 ******
2026-09-07 03:32:51.944832 | instance | changed: [instance]
2026-09-07 03:32:51.945535 | instance |
2026-09-07 03:32:51.945567 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-09-07 03:32:51.945579 | instance | Monday 07 September 2026  03:32:51 +0000 (0:00:00.949)       0:00:30.328 ******
2026-09-07 03:32:52.566251 | instance | changed: [instance]
2026-09-07 03:32:52.566717 | instance |
2026-09-07 03:32:52.566738 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-09-07 03:32:52.566746 | instance | Monday 07 September 2026  03:32:52 +0000 (0:00:00.621)       0:00:30.950 ******
2026-09-07 03:32:52.641074 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-09-07 03:32:52.641815 | instance |
2026-09-07 03:32:52.641846 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-09-07 03:32:52.641858 | instance | Monday 07 September 2026  03:32:52 +0000 (0:00:00.074)       0:00:31.024 ******
2026-09-07 03:32:57.576196 | instance | changed: [instance]
2026-09-07 03:32:57.576257 | instance |
2026-09-07 03:32:57.576268 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-09-07 03:32:57.576278 | instance | Monday 07 September 2026  03:32:57 +0000 (0:00:04.934)       0:00:35.958 ******
2026-09-07 03:32:58.249930 | instance | ok: [instance] => (item=chronyd)
2026-09-07 03:32:58.250047 | instance | ok: [instance] => (item=sshd)
2026-09-07 03:32:58.250544 | instance |
2026-09-07 03:32:58.250725 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-09-07 03:32:58.250740 | instance | Monday 07 September 2026  03:32:58 +0000 (0:00:00.674)       0:00:36.633 ******
2026-09-07 03:33:06.344366 | instance | changed: [instance]
2026-09-07 03:33:06.345427 | instance |
2026-09-07 03:33:06.345486 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-09-07 03:33:06.345497 | instance | Monday 07 September 2026  03:33:06 +0000 (0:00:08.093)       0:00:44.727 ******
2026-09-07 03:33:06.559248 | instance | ok: [instance]
2026-09-07 03:33:06.560010 | instance |
2026-09-07 03:33:06.560062 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-09-07 03:33:06.560073 | instance | Monday 07 September 2026  03:33:06 +0000 (0:00:00.215)       0:00:44.942 ******
2026-09-07 03:33:07.029633 | instance | changed: [instance]
2026-09-07 03:33:07.029725 | instance |
2026-09-07 03:33:07.030089 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-09-07 03:33:07.030139 | instance | Monday 07 September 2026  03:33:07 +0000 (0:00:00.470)       0:00:45.413 ******
2026-09-07 03:33:07.377987 | instance | changed: [instance]
2026-09-07 03:33:07.378793 | instance |
2026-09-07 03:33:07.378866 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-09-07 03:33:07.378878 | instance | Monday 07 September 2026  03:33:07 +0000 (0:00:00.348)       0:00:45.761 ******
2026-09-07 03:33:07.587320 | instance | ok: [instance]
2026-09-07 03:33:07.587414 | instance |
2026-09-07 03:33:07.587721 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-09-07 03:33:07.587766 | instance | Monday 07 September 2026  03:33:07 +0000 (0:00:00.209)       0:00:45.971 ******
2026-09-07 03:33:07.848439 | instance | ok: [instance] => (item=instance)
2026-09-07 03:33:07.848492 | instance |
2026-09-07 03:33:07.848503 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-09-07 03:33:07.848513 | instance | Monday 07 September 2026  03:33:07 +0000 (0:00:00.259)       0:00:46.231 ******
2026-09-07 03:33:07.918712 | instance | ok: [instance]
2026-09-07 03:33:07.918752 | instance |
2026-09-07 03:33:07.918760 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-09-07 03:33:07.918766 | instance | Monday 07 September 2026  03:33:07 +0000 (0:00:00.071)       0:00:46.302 ******
2026-09-07 03:33:08.012231 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-09-07 03:33:08.012660 | instance |
2026-09-07 03:33:08.012705 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-09-07 03:33:08.012713 | instance | Monday 07 September 2026  03:33:08 +0000 (0:00:00.093)       0:00:46.396 ******
2026-09-07 03:33:08.287923 | instance | changed: [instance]
2026-09-07 03:33:08.287983 | instance |
2026-09-07 03:33:08.288262 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-09-07 03:33:08.288297 | instance | Monday 07 September 2026  03:33:08 +0000 (0:00:00.275)       0:00:46.671 ******
2026-09-07 03:33:08.999945 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-09-07 03:33:09.000017 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-09-07 03:33:09.000453 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-09-07 03:33:09.000494 | instance |
2026-09-07 03:33:09.000499 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-09-07 03:33:09.000504 | instance | Monday 07 September 2026  03:33:08 +0000 (0:00:00.712)       0:00:47.384 ******
2026-09-07 03:34:33.174085 | instance | ok: [instance]
2026-09-07 03:34:33.175327 | instance |
2026-09-07 03:34:33.175388 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-09-07 03:34:33.175403 | instance | Monday 07 September 2026  03:34:33 +0000 (0:01:24.173)       0:02:11.557 ******
2026-09-07 03:34:33.406738 | instance | changed: [instance]
2026-09-07 03:34:33.406819 | instance |
2026-09-07 03:34:33.406971 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-09-07 03:34:33.407118 | instance | Monday 07 September 2026  03:34:33 +0000 (0:00:00.230)       0:02:11.787 ******
2026-09-07 03:34:33.445724 | instance | ok: [instance]
2026-09-07 03:34:33.445839 | instance |
2026-09-07 03:34:33.446005 | instance | TASK [Install Ceph host] *******************************************************
2026-09-07 03:34:33.446159 | instance | Monday 07 September 2026  03:34:33 +0000 (0:00:00.041)       0:02:11.829 ******
2026-09-07 03:34:33.521595 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-09-07 03:34:33.521666 | instance |
2026-09-07 03:34:33.521869 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-09-07 03:34:33.521915 | instance | Monday 07 September 2026  03:34:33 +0000 (0:00:00.076)       0:02:11.905 ******
2026-09-07 03:34:35.135107 | instance | ok: [instance]
2026-09-07 03:34:35.135170 | instance |
2026-09-07 03:34:35.135190 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-09-07 03:34:35.135201 | instance | Monday 07 September 2026  03:34:35 +0000 (0:00:01.611)       0:02:13.517 ******
2026-09-07 03:34:35.203674 | instance | ok: [instance] => (item=instance)
2026-09-07 03:34:35.203722 | instance |
2026-09-07 03:34:35.203734 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-09-07 03:34:35.203744 | instance | Monday 07 September 2026  03:34:35 +0000 (0:00:00.068)       0:02:13.586 ******
2026-09-07 03:34:35.544052 | instance | ok: [instance]
2026-09-07 03:34:35.544093 | instance |
2026-09-07 03:34:35.544101 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-09-07 03:34:35.544108 | instance | Monday 07 September 2026  03:34:35 +0000 (0:00:00.341)       0:02:13.927 ******
2026-09-07 03:34:37.944277 | instance | ok: [instance]
2026-09-07 03:34:37.944344 | instance |
2026-09-07 03:34:37.944356 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-09-07 03:34:37.944366 | instance | Monday 07 September 2026  03:34:37 +0000 (0:00:02.398)       0:02:16.326 ******
2026-09-07 03:35:20.622162 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-09-07 03:35:20.622261 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_b9un79er/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_b9un79er/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_b9un79er/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_b9un79er/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCfMJ5qKxiMDSAAs5zC2ZVJlH7m0cPMC419v2WeCvhHDp0Wjd3hCkoohyU=: Malformed input [buffer:3]\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCfMJ5qKxiMDSAAs5zC2ZVJlH7m0cPMC419v2WeCvhHDp0Wjd3hCkoohyU=: Malformed input [buffer:3]\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgCfMJ5qKxiMDSAAs5zC2ZVJlH7m0cPMC419v2WeCvhHDp0Wjd3hCkoohyU=: Malformed input [buffer:3]\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-07T03:35:20.462+0000 7f7bdda46640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-09-07 03:35:20.623959 | instance |
2026-09-07 03:35:20.626803 | instance | PLAY RECAP *********************************************************************
2026-09-07 03:35:20.626871 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=7    rescued=0    ignored=0
2026-09-07 03:35:20.626883 | instance |
2026-09-07 03:35:20.626895 | instance | Monday 07 September 2026  03:35:20 +0000 (0:00:42.681)       0:02:59.008 ******
2026-09-07 03:35:20.626905 | instance | ===============================================================================
2026-09-07 03:35:20.626914 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 84.17s
2026-09-07 03:35:20.626923 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 42.68s
2026-09-07 03:35:20.626933 | instance | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 8.09s
2026-09-07 03:35:20.626942 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.05s
2026-09-07 03:35:20.626951 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.93s
2026-09-07 03:35:20.626960 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.44s
2026-09-07 03:35:20.626995 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.92s
2026-09-07 03:35:20.627106 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.40s
2026-09-07 03:35:20.627411 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.75s
2026-09-07 03:35:20.627729 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.61s
2026-09-07 03:35:20.628015 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.30s
2026-09-07 03:35:20.628297 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.13s
2026-09-07 03:35:20.628644 | instance | Gathering Facts --------------------------------------------------------- 1.05s
2026-09-07 03:35:20.628932 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.99s
2026-09-07 03:35:20.629214 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 0.95s
2026-09-07 03:35:20.629526 | instance | Gathering Facts --------------------------------------------------------- 0.93s
2026-09-07 03:35:20.629827 | instance | Gathering Facts --------------------------------------------------------- 0.92s
2026-09-07 03:35:20.630169 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.90s
2026-09-07 03:35:20.630462 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.71s
2026-09-07 03:35:20.630821 | instance | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.67s
2026-09-07 03:35:20.733460 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 03:35:20.733764 | instance | ERROR    [csi > converge] Executed: Failed
2026-09-07 03:35:20.733966 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-07 03:35:21.233865 | instance | ERROR
2026-09-07 03:35:21.234023 | instance | {
2026-09-07 03:35:21.234051 | instance |   "delta": "0:03:51.039632",
2026-09-07 03:35:21.234071 | instance |   "end": "2026-09-07 03:35:20.802458",
2026-09-07 03:35:21.234095 | instance |   "msg": "non-zero return code",
2026-09-07 03:35:21.234121 | instance |   "rc": 2,
2026-09-07 03:35:21.234145 | instance |   "start": "2026-09-07 03:31:29.762826"
2026-09-07 03:35:21.234167 | instance | }
failure
2026-09-07 03:35:21.239750 | 
2026-09-07 03:35:21.239854 | PLAY RECAP
2026-09-07 03:35:21.239925 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-09-07 03:35:21.239989 | 
2026-09-07 03:35:21.384580 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-07 03:35:21.387291 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-07 03:35:22.531257 | 
2026-09-07 03:35:22.531388 | PLAY [all]
2026-09-07 03:35:22.546484 | 
2026-09-07 03:35:22.546600 | TASK [gather-host-logs : creating directory for system status]
2026-09-07 03:35:22.983380 | instance | changed
2026-09-07 03:35:22.994606 | 
2026-09-07 03:35:22.995412 | TASK [gather-host-logs : Get logs for each host]
2026-09-07 03:35:23.376305 | instance | + systemd-cgls --full --all --no-pager
2026-09-07 03:35:23.391562 | instance | + ip addr
2026-09-07 03:35:23.394737 | instance | + ip route
2026-09-07 03:35:23.397317 | instance | + lsblk
2026-09-07 03:35:23.402664 | instance | + mount
2026-09-07 03:35:23.405635 | instance | + docker images
2026-09-07 03:35:23.430934 | instance | + brctl show
2026-09-07 03:35:23.431535 | instance | /bin/bash: line 8: brctl: command not found
2026-09-07 03:35:23.431873 | instance | + ps aux --sort=-%mem
2026-09-07 03:35:23.452021 | instance | + dpkg -l
2026-09-07 03:35:23.463360 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-09-07 03:35:23.463898 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-09-07 03:35:23.485326 | instance | + '[' '!' -z '' ']'
2026-09-07 03:35:23.541042 | instance | ok: Runtime: 0:00:00.113745
2026-09-07 03:35:23.550324 | 
2026-09-07 03:35:23.550441 | TASK [gather-host-logs : Downloads logs to executor]
2026-09-07 03:35:24.159187 | instance | changed:
2026-09-07 03:35:24.159373 | instance | created directory /var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/logs/instance
2026-09-07 03:35:24.159409 | instance | cd+++++++++ system/
2026-09-07 03:35:24.159434 | instance | >f+++++++++ system/brctl-show.txt
2026-09-07 03:35:24.159458 | instance | >f+++++++++ system/docker-images.txt
2026-09-07 03:35:24.159484 | instance | >f+++++++++ system/ip-addr.txt
2026-09-07 03:35:24.159511 | instance | >f+++++++++ system/ip-route.txt
2026-09-07 03:35:24.159535 | instance | >f+++++++++ system/lsblk.txt
2026-09-07 03:35:24.159558 | instance | >f+++++++++ system/mount.txt
2026-09-07 03:35:24.159581 | instance | >f+++++++++ system/packages.txt
2026-09-07 03:35:24.159605 | instance | >f+++++++++ system/ps.txt
2026-09-07 03:35:24.159631 | instance | >f+++++++++ system/systemd-cgls.txt
2026-09-07 03:35:24.171098 | 
2026-09-07 03:35:24.171217 | LOOP [helm-release-status : creating directory for helm release status]
2026-09-07 03:35:24.394848 | instance | changed: "values"
2026-09-07 03:35:24.581301 | instance | changed: "releases"
2026-09-07 03:35:24.597793 | 
2026-09-07 03:35:24.598003 | TASK [helm-release-status : Gather get release status for helm charts]
2026-09-07 03:35:24.842559 | instance | /bin/bash: line 3: kubectl: command not found
2026-09-07 03:35:25.146100 | instance | ok: Runtime: 0:00:00.005532
2026-09-07 03:35:25.156022 | 
2026-09-07 03:35:25.156154 | TASK [helm-release-status : Downloads logs to executor]
2026-09-07 03:35:25.633484 | instance | changed:
2026-09-07 03:35:25.633689 | instance | cd+++++++++ helm/
2026-09-07 03:35:25.633750 | instance | cd+++++++++ helm/releases/
2026-09-07 03:35:25.633838 | instance | cd+++++++++ helm/values/
2026-09-07 03:35:25.645691 | 
2026-09-07 03:35:25.645833 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-09-07 03:35:25.871967 | instance | changed
2026-09-07 03:35:25.883154 | 
2026-09-07 03:35:25.883353 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-09-07 03:35:26.208623 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 03:35:26.208828 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 03:35:26.213277 | instance | environment: line 1: kubectl: command not found
2026-09-07 03:35:26.213797 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 03:35:26.214470 | instance | environment: line 1: kubectl: command not found
2026-09-07 03:35:26.215293 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 03:35:26.218530 | instance | environment: line 1: kubectl: command not found
2026-09-07 03:35:26.219219 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 03:35:26.220388 | instance | environment: line 1: kubectl: command not found
2026-09-07 03:35:26.221080 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 03:35:26.222279 | instance | environment: line 1: kubectl: command not found
2026-09-07 03:35:26.222650 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-07 03:35:26.431678 | instance | ok: Runtime: 0:00:00.020688
2026-09-07 03:35:26.440684 | 
2026-09-07 03:35:26.440855 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-09-07 03:35:26.666896 | instance | changed
2026-09-07 03:35:26.673180 | 
2026-09-07 03:35:26.673329 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-09-07 03:35:26.894580 | instance | environment: line 5: kubectl: command not found
2026-09-07 03:35:26.896244 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 03:35:26.897649 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 03:35:26.897672 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-07 03:35:27.209416 | instance | ok: Runtime: 0:00:00.007212
2026-09-07 03:35:27.219354 | 
2026-09-07 03:35:27.219496 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-09-07 03:35:27.738983 | instance | changed:
2026-09-07 03:35:27.739242 | instance | cd+++++++++ objects/
2026-09-07 03:35:27.739301 | instance | cd+++++++++ objects/cluster/
2026-09-07 03:35:27.739501 | instance | cd+++++++++ objects/namespaced/
2026-09-07 03:35:27.758716 | 
2026-09-07 03:35:27.758888 | TASK [gather-pod-logs : creating directory for pod logs]
2026-09-07 03:35:27.978859 | instance | changed
2026-09-07 03:35:27.988675 | 
2026-09-07 03:35:27.988878 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-09-07 03:35:28.212655 | instance | changed
2026-09-07 03:35:28.217267 | 
2026-09-07 03:35:28.217333 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-09-07 03:35:28.422642 | instance | environment: line 3: kubectl: command not found
2026-09-07 03:35:28.750279 | instance | ok: Runtime: 0:00:00.007722
2026-09-07 03:35:28.761490 | 
2026-09-07 03:35:28.761637 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-09-07 03:35:29.300330 | instance | changed:
2026-09-07 03:35:29.300553 | instance | cd+++++++++ pod-logs/
2026-09-07 03:35:29.300605 | instance | cd+++++++++ pod-logs/failed-pods/
2026-09-07 03:35:29.314445 | 
2026-09-07 03:35:29.314579 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-09-07 03:35:29.540517 | instance | changed
2026-09-07 03:35:29.554965 | 
2026-09-07 03:35:29.555227 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-09-07 03:35:29.803080 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-07 03:35:30.103357 | instance | ok: Runtime: 0:00:00.035930
2026-09-07 03:35:30.109921 | 
2026-09-07 03:35:30.110160 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-09-07 03:35:30.344725 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-07 03:35:30.378946 | instance | ceph-mgr endpoints:
2026-09-07 03:35:30.650070 | instance | ok: Runtime: 0:00:00.040412
2026-09-07 03:35:30.658401 | 
2026-09-07 03:35:30.658515 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-09-07 03:35:30.895349 | instance | /bin/bash: line 4: kubectl: command not found
2026-09-07 03:35:31.198144 | instance | ok: Runtime: 0:00:00.055488
2026-09-07 03:35:31.208292 | 
2026-09-07 03:35:31.208536 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-09-07 03:35:31.714996 | instance | changed: cd+++++++++ prometheus/
2026-09-07 03:35:31.729118 | 
2026-09-07 03:35:31.729298 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-09-07 03:35:31.962675 | instance | changed
2026-09-07 03:35:31.970567 | 
2026-09-07 03:35:31.970726 | TASK [gather-selenium-data : Get selenium data]
2026-09-07 03:35:32.256783 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-09-07 03:35:32.257672 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-09-07 03:35:32.510574 | instance | ERROR
2026-09-07 03:35:32.511299 | instance | {
2026-09-07 03:35:32.511368 | instance |   "delta": "0:00:00.004457",
2026-09-07 03:35:32.511411 | instance |   "end": "2026-09-07 03:35:32.257955",
2026-09-07 03:35:32.511455 | instance |   "msg": "non-zero return code",
2026-09-07 03:35:32.511493 | instance |   "rc": 1,
2026-09-07 03:35:32.511530 | instance |   "start": "2026-09-07 03:35:32.253498"
2026-09-07 03:35:32.511566 | instance | }
2026-09-07 03:35:32.511611 | instance | ERROR: Ignoring Errors
2026-09-07 03:35:32.521096 | 
2026-09-07 03:35:32.521228 | TASK [gather-selenium-data : Downloads logs to executor]
2026-09-07 03:35:33.038499 | instance | changed: cd+++++++++ selenium/
2026-09-07 03:35:33.045698 | 
2026-09-07 03:35:33.045796 | PLAY RECAP
2026-09-07 03:35:33.045859 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-09-07 03:35:33.045893 | 
2026-09-07 03:35:33.165095 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-07 03:35:33.167186 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-07 03:35:33.709279 | 
2026-09-07 03:35:33.709396 | PLAY [all]
2026-09-07 03:35:33.720050 | 
2026-09-07 03:35:33.720141 | TASK [fetch-output : Set log path for multiple nodes]
2026-09-07 03:35:33.753913 | instance | skipping: Conditional result was False
2026-09-07 03:35:33.758638 | 
2026-09-07 03:35:33.758719 | TASK [fetch-output : Set log path for single node]
2026-09-07 03:35:33.787763 | instance | ok
2026-09-07 03:35:33.791857 | 
2026-09-07 03:35:33.791926 | LOOP [fetch-output : Ensure local output dirs]
2026-09-07 03:35:34.151919 | instance -> localhost | ok: "/var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/logs"
2026-09-07 03:35:34.368255 | instance -> localhost | changed: "/var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/artifacts"
2026-09-07 03:35:34.596708 | instance -> localhost | changed: "/var/lib/zuul/builds/6932c2ae20d941f7bd7bda6d856c074d/work/docs"
2026-09-07 03:35:34.613329 | 
2026-09-07 03:35:34.613576 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-09-07 03:35:35.276776 | instance | changed: .d..t...... ./
2026-09-07 03:35:35.277017 | instance | changed: All items complete
2026-09-07 03:35:35.277053 | 
2026-09-07 03:35:35.748115 | instance | changed: .d..t...... ./
2026-09-07 03:35:36.234169 | instance | changed: .d..t...... ./
2026-09-07 03:35:36.259882 | 
2026-09-07 03:35:36.260096 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-09-07 03:35:36.657239 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.005953
2026-09-07 03:35:36.886628 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.004138
2026-09-07 03:35:36.900447 | 
2026-09-07 03:35:36.900616 | PLAY [all]
2026-09-07 03:35:36.911205 | 
2026-09-07 03:35:36.911358 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-09-07 03:35:37.320135 | instance | changed
2026-09-07 03:35:37.330520 | 
2026-09-07 03:35:37.330665 | PLAY RECAP
2026-09-07 03:35:37.330798 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-07 03:35:37.330849 | 
2026-09-07 03:35:37.467183 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-07 03:35:37.470033 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-09-07 03:35:38.075073 | 
2026-09-07 03:35:38.075232 | PLAY [localhost]
2026-09-07 03:35:38.086142 | 
2026-09-07 03:35:38.086278 | TASK [Generate Zuul manifest]
2026-09-07 03:35:38.104645 | localhost | ok
2026-09-07 03:35:38.119845 | 
2026-09-07 03:35:38.119991 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-09-07 03:35:38.462344 | localhost | changed
2026-09-07 03:35:38.473142 | 
2026-09-07 03:35:38.473251 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-09-07 03:35:38.499262 | localhost | ok
2026-09-07 03:35:38.505335 | 
2026-09-07 03:35:38.505423 | TASK [Upload logs]
2026-09-07 03:35:38.524186 | localhost | ok
2026-09-07 03:35:38.581959 | 
2026-09-07 03:35:38.582069 | TASK [Set zuul-log-path fact]
2026-09-07 03:35:38.597898 | localhost | ok
2026-09-07 03:35:38.607641 | 
2026-09-07 03:35:38.607742 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-07 03:35:38.634707 | localhost | ok
2026-09-07 03:35:38.643882 | 
2026-09-07 03:35:38.643994 | TASK [upload-logs : Create log directories]
2026-09-07 03:35:39.067851 | localhost | changed
2026-09-07 03:35:39.074193 | 
2026-09-07 03:35:39.074337 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-09-07 03:35:39.471509 | localhost -> localhost | ok: Runtime: 0:00:00.003818
2026-09-07 03:35:39.478242 | 
2026-09-07 03:35:39.478358 | TASK [upload-logs : Upload logs to log server]
2026-09-07 03:35:39.948002 | localhost | Output suppressed because no_log was given
2026-09-07 03:35:39.998204 | 
2026-09-07 03:35:39.998347 | LOOP [upload-logs : Compress console log and json output]
2026-09-07 03:35:40.051993 | localhost | skipping: Conditional result was False
2026-09-07 03:35:40.061325 | localhost | skipping: Conditional result was False
2026-09-07 03:35:40.071581 | 
2026-09-07 03:35:40.071759 | LOOP [upload-logs : Upload compressed console log and json output]
2026-09-07 03:35:40.129489 | localhost | skipping: Conditional result was False
2026-09-07 03:35:40.129848 | 
2026-09-07 03:35:40.135587 | localhost | skipping: Conditional result was False
2026-09-07 03:35:40.144914 | 
2026-09-07 03:35:40.145085 | LOOP [upload-logs : Upload console log and json output]