2026-08-26 04:55:25.265728 | Job console starting
2026-08-26 04:55:25.276768 | Updating git repos
2026-08-26 04:55:30.796035 | Cloning repos into workspace
2026-08-26 04:55:50.306392 | Restoring repo states
2026-08-26 04:56:00.429357 | Merging changes
2026-08-26 04:56:03.106894 | Checking out repos
2026-08-26 04:56:12.370386 | Preparing playbooks
2026-08-26 04:56:29.075498 | Running Ansible setup
2026-08-26 04:56:33.202598 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 04:56:33.857140 | 
2026-08-26 04:56:33.857251 | PLAY [localhost]
2026-08-26 04:56:33.864373 | 
2026-08-26 04:56:33.864440 | TASK [Gathering Facts]
2026-08-26 04:56:34.846431 | localhost | ok
2026-08-26 04:56:34.856105 | 
2026-08-26 04:56:34.856220 | TASK [Setup log path fact]
2026-08-26 04:56:34.881367 | localhost | ok
2026-08-26 04:56:34.893003 | 
2026-08-26 04:56:34.893120 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 04:56:34.924619 | localhost | ok
2026-08-26 04:56:34.930996 | 
2026-08-26 04:56:34.931062 | TASK [emit-job-header : Print job information]
2026-08-26 04:56:34.962308 | # Job Information
2026-08-26 04:56:34.962516 | Ansible Version: 2.16.18
2026-08-26 04:56:34.962562 | Job: atmosphere-molecule-csi-rbd
2026-08-26 04:56:34.962596 | Pipeline: check
2026-08-26 04:56:34.962626 | Executor: 2d72f0692154
2026-08-26 04:56:34.962656 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4090
2026-08-26 04:56:34.962690 | Event ID: ba867e70-a109-11f1-9fc9-274af0591e74
2026-08-26 04:56:34.967030 | 
2026-08-26 04:56:34.967113 | LOOP [emit-job-header : Print node information]
2026-08-26 04:56:35.055133 | localhost | ok:
2026-08-26 04:56:35.055342 | localhost | # Node Information
2026-08-26 04:56:35.055386 | localhost | Inventory Hostname: instance
2026-08-26 04:56:35.055421 | localhost | Hostname: np0000191144
2026-08-26 04:56:35.055454 | localhost | Username: zuul
2026-08-26 04:56:35.055488 | localhost | Distro: Ubuntu 22.04
2026-08-26 04:56:35.055519 | localhost | Provider: yul1
2026-08-26 04:56:35.055549 | localhost | Region: ca-ymq-1
2026-08-26 04:56:35.055579 | localhost | Label: ubuntu-jammy
2026-08-26 04:56:35.055608 | localhost | Product Name: OpenStack Nova
2026-08-26 04:56:35.055635 | localhost | Interface IP: 162.253.55.28
2026-08-26 04:56:35.066659 | 
2026-08-26 04:56:35.066780 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-26 04:56:35.485961 | localhost -> localhost | changed
2026-08-26 04:56:35.495538 | 
2026-08-26 04:56:35.495723 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-26 04:56:36.512706 | localhost -> localhost | changed
2026-08-26 04:56:36.523284 | 
2026-08-26 04:56:36.523336 | PLAY [all]
2026-08-26 04:56:36.531554 | 
2026-08-26 04:56:36.531617 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-26 04:56:36.770081 | instance -> localhost | ok
2026-08-26 04:56:36.776501 | 
2026-08-26 04:56:36.776575 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-26 04:56:36.805350 | instance | ok
2026-08-26 04:56:36.821490 | instance | included: /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 04:56:36.827482 | 
2026-08-26 04:56:36.827544 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-26 04:56:38.343775 | instance -> localhost | Generating public/private rsa key pair.
2026-08-26 04:56:38.343934 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/9baef1b019ef4502ae2dc3e8e19489bf_id_rsa
2026-08-26 04:56:38.343965 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/9baef1b019ef4502ae2dc3e8e19489bf_id_rsa.pub
2026-08-26 04:56:38.343990 | instance -> localhost | The key fingerprint is:
2026-08-26 04:56:38.344012 | instance -> localhost | SHA256:MNKz/ovMsW365uYhXcu4i9VATdqxl4Pmwgml2XNnn8g zuul-build-sshkey
2026-08-26 04:56:38.344045 | instance -> localhost | The key's randomart image is:
2026-08-26 04:56:38.344069 | instance -> localhost | +---[RSA 3072]----+
2026-08-26 04:56:38.344097 | instance -> localhost | |        . o      |
2026-08-26 04:56:38.344120 | instance -> localhost | |     . = = + .   |
2026-08-26 04:56:38.344142 | instance -> localhost | |    . O = B *    |
2026-08-26 04:56:38.344163 | instance -> localhost | |     . O * = + . |
2026-08-26 04:56:38.344183 | instance -> localhost | |      . S o E o  |
2026-08-26 04:56:38.344204 | instance -> localhost | |     . . B .     |
2026-08-26 04:56:38.344223 | instance -> localhost | |      + = +      |
2026-08-26 04:56:38.344243 | instance -> localhost | |     o X+o       |
2026-08-26 04:56:38.344271 | instance -> localhost | |      BOXo       |
2026-08-26 04:56:38.344293 | instance -> localhost | +----[SHA256]-----+
2026-08-26 04:56:38.344341 | instance -> localhost | ok: Runtime: 0:00:01.118592
2026-08-26 04:56:38.350461 | 
2026-08-26 04:56:38.350528 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-26 04:56:38.382646 | instance | ok
2026-08-26 04:56:38.393367 | instance | included: /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 04:56:38.401434 | 
2026-08-26 04:56:38.401533 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-26 04:56:38.425952 | instance | skipping: Conditional result was False
2026-08-26 04:56:38.436617 | 
2026-08-26 04:56:38.436696 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-26 04:56:38.914136 | instance | changed
2026-08-26 04:56:38.921803 | 
2026-08-26 04:56:38.921868 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-26 04:56:39.103915 | instance | ok
2026-08-26 04:56:39.240926 | 
2026-08-26 04:56:39.241044 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-26 04:56:39.734321 | instance | changed
2026-08-26 04:56:39.740353 | 
2026-08-26 04:56:39.740420 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-26 04:56:40.178807 | instance | changed
2026-08-26 04:56:40.189264 | 
2026-08-26 04:56:40.189431 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-26 04:56:40.204663 | instance | skipping: Conditional result was False
2026-08-26 04:56:40.212864 | 
2026-08-26 04:56:40.213063 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-26 04:56:40.572716 | instance -> localhost | changed
2026-08-26 04:56:40.589779 | 
2026-08-26 04:56:40.589935 | TASK [add-build-sshkey : Add back temp key]
2026-08-26 04:56:40.885204 | instance -> localhost | Identity added: /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/9baef1b019ef4502ae2dc3e8e19489bf_id_rsa (zuul-build-sshkey)
2026-08-26 04:56:40.885433 | instance -> localhost | ok: Runtime: 0:00:00.012053
2026-08-26 04:56:40.893006 | 
2026-08-26 04:56:40.893074 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-26 04:56:41.200473 | instance | ok
2026-08-26 04:56:41.204934 | 
2026-08-26 04:56:41.205065 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-26 04:56:41.229809 | instance | skipping: Conditional result was False
2026-08-26 04:56:41.249175 | 
2026-08-26 04:56:41.249309 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-26 04:56:41.610342 | instance | ok
2026-08-26 04:56:41.615752 | 
2026-08-26 04:56:41.615812 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-26 04:56:47.791695 | instance | Output suppressed because no_log was given
2026-08-26 04:56:47.800321 | 
2026-08-26 04:56:47.800400 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-26 04:56:48.009848 | instance | ok: "logs"
2026-08-26 04:56:48.010073 | instance | ok: All items complete
2026-08-26 04:56:48.010102 | 
2026-08-26 04:56:48.159727 | instance | ok: "artifacts"
2026-08-26 04:56:48.308589 | instance | ok: "docs"
2026-08-26 04:56:48.322763 | 
2026-08-26 04:56:48.322910 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-26 04:56:48.510354 | instance | changed: "logs"
2026-08-26 04:56:48.668726 | instance | changed: "artifacts"
2026-08-26 04:56:48.822648 | instance | changed: "docs"
2026-08-26 04:56:48.842375 | 
2026-08-26 04:56:48.842508 | PLAY RECAP
2026-08-26 04:56:48.842570 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 04:56:48.842610 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 04:56:48.842640 | 
2026-08-26 04:56:49.023679 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 04:56:49.028168 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 04:56:49.709659 | 
2026-08-26 04:56:49.709817 | PLAY [all]
2026-08-26 04:56:49.722212 | 
2026-08-26 04:56:49.722296 | TASK [setup-uv : Extract archive]
2026-08-26 04:56:52.064817 | instance | changed
2026-08-26 04:56:52.073750 | 
2026-08-26 04:56:52.073846 | TASK [setup-uv : Print version]
2026-08-26 04:56:52.417600 | instance | uv 0.8.13
2026-08-26 04:56:52.613421 | instance | ok: Runtime: 0:00:00.013853
2026-08-26 04:56:52.623811 | 
2026-08-26 04:56:52.623880 | TASK [Install Ansible collection siblings]
2026-08-26 04:57:01.188442 | instance | changed:
2026-08-26 04:57:01.188606 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-26 04:57:01.188638 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-26 04:57:01.188661 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-26 04:57:01.188682 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-26 04:57:01.188702 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-08-26 04:57:01.188726 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-26 04:57:01.188747 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-26 04:57:01.188769 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-26 04:57:01.188789 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-26 04:57:01.188810 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-26 04:57:01.188830 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-26 04:57:01.188850 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-26 04:57:01.188868 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-08-26 04:57:01.188887 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-08-26 04:57:01.188906 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-08-26 04:57:01.188926 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-08-26 04:57:01.188947 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-08-26 04:57:01.188989 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-08-26 04:57:01.189009 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-08-26 04:57:01.189028 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-08-26 04:57:01.189046 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.1.2
2026-08-26 04:57:01.189064 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-08-26 04:57:01.189084 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-26 04:57:01.189113 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-08-26 04:57:01.189133 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-08-26 04:57:01.189154 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-26 04:57:01.189190 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-26 04:57:01.189223 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-26 04:57:01.189244 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-08-26 04:57:01.189264 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-08-26 04:57:01.189284 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-26 04:57:01.189304 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-26 04:57:01.189324 | instance | Checked out ansible.netcommon to 1.2.0
2026-08-26 04:57:01.189342 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-26 04:57:01.189367 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.189386 | instance | Process install dependency map
2026-08-26 04:57:01.189404 | instance | Starting collection install process
2026-08-26 04:57:01.189422 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-08-26 04:57:01.189440 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-08-26 04:57:01.189459 | instance | ansible.netcommon:* was installed successfully
2026-08-26 04:57:01.189476 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-08-26 04:57:01.189494 | instance | Creating virtual environment at: .venv
2026-08-26 04:57:01.189513 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-26 04:57:01.189531 | instance | Downloading cryptography (4.2MiB)
2026-08-26 04:57:01.189549 | instance | Downloading rjsonnet (1.2MiB)
2026-08-26 04:57:01.189573 | instance | Downloading openstacksdk (1.7MiB)
2026-08-26 04:57:01.189592 | instance | Downloading kubernetes (1.9MiB)
2026-08-26 04:57:01.189610 | instance | Downloading netaddr (2.2MiB)
2026-08-26 04:57:01.189629 | instance | Downloading setuptools (1.1MiB)
2026-08-26 04:57:01.189647 | instance | Downloading ansible-core (2.1MiB)
2026-08-26 04:57:01.189666 | instance | Downloading pygments (1.2MiB)
2026-08-26 04:57:01.189684 | instance |    Building pyperclip==1.9.0
2026-08-26 04:57:01.189701 | instance |  Downloading rjsonnet
2026-08-26 04:57:01.189722 | instance |  Downloading netaddr
2026-08-26 04:57:01.189741 | instance |  Downloading pygments
2026-08-26 04:57:01.189758 | instance |  Downloading cryptography
2026-08-26 04:57:01.189776 | instance |  Downloading setuptools
2026-08-26 04:57:01.189794 | instance |  Downloading kubernetes
2026-08-26 04:57:01.189813 | instance |  Downloading ansible-core
2026-08-26 04:57:01.189830 | instance |  Downloading openstacksdk
2026-08-26 04:57:01.189847 | instance |       Built pyperclip==1.9.0
2026-08-26 04:57:01.189865 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-26 04:57:01.189883 | instance | Installed 79 packages in 31ms
2026-08-26 04:57:01.189902 | instance | Checked out ansible.posix to 1.6.0
2026-08-26 04:57:01.189921 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-26 04:57:01.189940 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.189958 | instance | Process install dependency map
2026-08-26 04:57:01.189976 | instance | Starting collection install process
2026-08-26 04:57:01.189995 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-08-26 04:57:01.190019 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-08-26 04:57:01.190110 | instance | ansible.posix:1.6.0 was installed successfully
2026-08-26 04:57:01.190133 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.190153 | instance | 2.17.12
2026-08-26 04:57:01.190173 | instance | Checked out ansible.utils to v6.1.0
2026-08-26 04:57:01.190191 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-26 04:57:01.190211 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.190229 | instance | Process install dependency map
2026-08-26 04:57:01.190247 | instance | Starting collection install process
2026-08-26 04:57:01.190266 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-08-26 04:57:01.190285 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-08-26 04:57:01.190304 | instance | ansible.utils:6.1.0 was installed successfully
2026-08-26 04:57:01.190323 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.190342 | instance | 2.17.12
2026-08-26 04:57:01.190361 | instance | Checked out atmosphere.common to v0.7.0
2026-08-26 04:57:01.190380 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-26 04:57:01.190399 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.190418 | instance | Process install dependency map
2026-08-26 04:57:01.190436 | instance | Starting collection install process
2026-08-26 04:57:01.190454 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-08-26 04:57:01.190473 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-08-26 04:57:01.190491 | instance | atmosphere.common:0.7.0 was installed successfully
2026-08-26 04:57:01.190509 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.190528 | instance | 2.17.12
2026-08-26 04:57:01.190547 | instance | Checked out community.crypto to 2.2.3
2026-08-26 04:57:01.190565 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-26 04:57:01.190584 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.190623 | instance | Process install dependency map
2026-08-26 04:57:01.190643 | instance | Starting collection install process
2026-08-26 04:57:01.190662 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-08-26 04:57:01.190680 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-08-26 04:57:01.190698 | instance | community.crypto:2.2.3 was installed successfully
2026-08-26 04:57:01.190717 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.190735 | instance | 2.17.12
2026-08-26 04:57:01.190753 | instance | Checked out community.general to 7.3.0
2026-08-26 04:57:01.190772 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-08-26 04:57:01.190790 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.190814 | instance | Process install dependency map
2026-08-26 04:57:01.190833 | instance | Starting collection install process
2026-08-26 04:57:01.190851 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-08-26 04:57:01.190870 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-08-26 04:57:01.190889 | instance | community.general:7.3.0 was installed successfully
2026-08-26 04:57:01.190907 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.190925 | instance | 2.17.12
2026-08-26 04:57:01.190944 | instance | Checked out community.mysql to 3.6.0
2026-08-26 04:57:01.190962 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-26 04:57:01.190981 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191001 | instance | Process install dependency map
2026-08-26 04:57:01.191020 | instance | Starting collection install process
2026-08-26 04:57:01.191039 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-08-26 04:57:01.191058 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-08-26 04:57:01.191077 | instance | community.mysql:3.6.0 was installed successfully
2026-08-26 04:57:01.191095 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.191113 | instance | 2.17.12
2026-08-26 04:57:01.191132 | instance | Checked out kubernetes.core to 2.4.0
2026-08-26 04:57:01.191151 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-26 04:57:01.191169 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191187 | instance | Process install dependency map
2026-08-26 04:57:01.191205 | instance | Starting collection install process
2026-08-26 04:57:01.191223 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-08-26 04:57:01.191243 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-08-26 04:57:01.191261 | instance | kubernetes.core:2.4.0 was installed successfully
2026-08-26 04:57:01.191279 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.191298 | instance | 2.17.12
2026-08-26 04:57:01.191316 | instance | Checked out openstack.cloud to 2.6.0
2026-08-26 04:57:01.191334 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-26 04:57:01.191354 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191373 | instance | Process install dependency map
2026-08-26 04:57:01.191391 | instance | Starting collection install process
2026-08-26 04:57:01.191409 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-08-26 04:57:01.191427 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-08-26 04:57:01.191446 | instance | openstack.cloud:2.6.0 was installed successfully
2026-08-26 04:57:01.191464 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.191482 | instance | 2.17.12
2026-08-26 04:57:01.191500 | instance | Checked out vexxhost.ceph to v4.2.0
2026-08-26 04:57:01.191518 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-26 04:57:01.191541 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191560 | instance | Process install dependency map
2026-08-26 04:57:01.191578 | instance | Starting collection install process
2026-08-26 04:57:01.191596 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-08-26 04:57:01.191615 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-08-26 04:57:01.191634 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-08-26 04:57:01.191652 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.191670 | instance | 2.17.12
2026-08-26 04:57:01.191688 | instance | Checked out vexxhost.containers to v1.6.8
2026-08-26 04:57:01.191706 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-26 04:57:01.191725 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191743 | instance | Process install dependency map
2026-08-26 04:57:01.191761 | instance | Starting collection install process
2026-08-26 04:57:01.191779 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-08-26 04:57:01.191798 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-08-26 04:57:01.191816 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-08-26 04:57:01.191835 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.191853 | instance | 2.17.12
2026-08-26 04:57:01.191872 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-08-26 04:57:01.191890 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-26 04:57:01.191909 | instance | Starting galaxy collection install process
2026-08-26 04:57:01.191927 | instance | Process install dependency map
2026-08-26 04:57:01.191946 | instance | Starting collection install process
2026-08-26 04:57:01.191965 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-08-26 04:57:01.191983 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-08-26 04:57:01.192001 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-08-26 04:57:01.192019 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-26 04:57:01.192038 | instance | 2.17.12
2026-08-26 04:57:01.198677 | 
2026-08-26 04:57:01.198750 | PLAY RECAP
2026-08-26 04:57:01.198801 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 04:57:01.198824 | 
2026-08-26 04:57:01.326128 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 04:57:01.330181 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-26 04:57:01.917511 | 
2026-08-26 04:57:01.917649 | PLAY [all]
2026-08-26 04:57:01.928871 | 
2026-08-26 04:57:01.928987 | TASK [Install "jq" for log collection]
2026-08-26 04:57:11.794386 | instance | changed
2026-08-26 04:57:11.796556 | 
2026-08-26 04:57:11.796629 | PLAY RECAP
2026-08-26 04:57:11.796698 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 04:57:11.796768 | 
2026-08-26 04:57:11.924671 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-26 04:57:11.927256 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-26 04:57:12.556069 | 
2026-08-26 04:57:12.556202 | PLAY [all]
2026-08-26 04:57:12.567641 | 
2026-08-26 04:57:12.567728 | LOOP [Check inventory directories]
2026-08-26 04:57:12.896338 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-08-26 04:57:13.045478 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-08-26 04:57:13.211751 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-08-26 04:57:13.224092 | 
2026-08-26 04:57:13.224271 | LOOP [Copy inventory file for Zuul]
2026-08-26 04:57:14.012242 | instance | changed:
2026-08-26 04:57:14.012469 | instance | {
2026-08-26 04:57:14.012512 | instance |   "ansible_loop_var": "item",
2026-08-26 04:57:14.012549 | instance |   "changed": false,
2026-08-26 04:57:14.012581 | instance |   "failed": false,
2026-08-26 04:57:14.012619 | instance |   "invocation": {
2026-08-26 04:57:14.012650 | instance |     "module_args": {
2026-08-26 04:57:14.012680 | instance |       "checksum_algorithm": "sha1",
2026-08-26 04:57:14.012709 | instance |       "follow": true,
2026-08-26 04:57:14.012738 | instance |       "get_attributes": true,
2026-08-26 04:57:14.012767 | instance |       "get_checksum": true,
2026-08-26 04:57:14.012793 | instance |       "get_mime": true,
2026-08-26 04:57:14.012838 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-08-26 04:57:14.012868 | instance |     }
2026-08-26 04:57:14.012896 | instance |   },
2026-08-26 04:57:14.012937 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-08-26 04:57:14.013165 | instance |   "stat": {
2026-08-26 04:57:14.013209 | instance |     "atime": 1787720214.327384,
2026-08-26 04:57:14.013242 | instance |     "attr_flags": "e",
2026-08-26 04:57:14.013271 | instance |     "attributes": [
2026-08-26 04:57:14.013299 | instance |       "extents"
2026-08-26 04:57:14.013325 | instance |     ],
2026-08-26 04:57:14.013349 | instance |     "block_size": 4096,
2026-08-26 04:57:14.013372 | instance |     "blocks": 8,
2026-08-26 04:57:14.013395 | instance |     "charset": "unknown",
2026-08-26 04:57:14.013420 | instance |     "ctime": 1787720213.3833594,
2026-08-26 04:57:14.013443 | instance |     "dev": 64513,
2026-08-26 04:57:14.013508 | instance |     "device_type": 0,
2026-08-26 04:57:14.013539 | instance |     "executable": true,
2026-08-26 04:57:14.013567 | instance |     "exists": true,
2026-08-26 04:57:14.013596 | instance |     "gid": 1000,
2026-08-26 04:57:14.013623 | instance |     "gr_name": "zuul",
2026-08-26 04:57:14.013651 | instance |     "inode": 1048351,
2026-08-26 04:57:14.013678 | instance |     "isblk": false,
2026-08-26 04:57:14.013707 | instance |     "ischr": false,
2026-08-26 04:57:14.013735 | instance |     "isdir": true,
2026-08-26 04:57:14.013763 | instance |     "isfifo": false,
2026-08-26 04:57:14.013791 | instance |     "isgid": false,
2026-08-26 04:57:14.013819 | instance |     "islnk": false,
2026-08-26 04:57:14.013846 | instance |     "isreg": false,
2026-08-26 04:57:14.013874 | instance |     "issock": false,
2026-08-26 04:57:14.013902 | instance |     "isuid": false,
2026-08-26 04:57:14.013929 | instance |     "mimetype": "unknown",
2026-08-26 04:57:14.013955 | instance |     "mode": "0755",
2026-08-26 04:57:14.013979 | instance |     "mtime": 1787720213.3833594,
2026-08-26 04:57:14.014002 | instance |     "nlink": 21,
2026-08-26 04:57:14.014025 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-08-26 04:57:14.014047 | instance |     "pw_name": "zuul",
2026-08-26 04:57:14.014152 | instance |     "readable": true,
2026-08-26 04:57:14.014188 | instance |     "rgrp": true,
2026-08-26 04:57:14.014212 | instance |     "roth": true,
2026-08-26 04:57:14.014235 | instance |     "rusr": true,
2026-08-26 04:57:14.014258 | instance |     "size": 4096,
2026-08-26 04:57:14.014281 | instance |     "uid": 1000,
2026-08-26 04:57:14.014317 | instance |     "version": "1855425838",
2026-08-26 04:57:14.014342 | instance |     "wgrp": false,
2026-08-26 04:57:14.014367 | instance |     "woth": false,
2026-08-26 04:57:14.014391 | instance |     "writeable": true,
2026-08-26 04:57:14.014414 | instance |     "wusr": true,
2026-08-26 04:57:14.014436 | instance |     "xgrp": true,
2026-08-26 04:57:14.014457 | instance |     "xoth": true,
2026-08-26 04:57:14.014479 | instance |     "xusr": true
2026-08-26 04:57:14.014500 | instance |   }
2026-08-26 04:57:14.014522 | instance | }
2026-08-26 04:57:14.014566 | instance | ok: All items complete
2026-08-26 04:57:14.014593 | 
2026-08-26 04:57:14.016284 | instance | skipping: Conditional result was False
2026-08-26 04:57:14.017134 | instance | skipping: Conditional result was False
2026-08-26 04:57:14.026882 | 
2026-08-26 04:57:14.027007 | LOOP [Switch "ansible_host" to private IP]
2026-08-26 04:57:14.437854 | instance | changed: 1 replacements made
2026-08-26 04:57:14.439332 | instance | skipping: Conditional result was False
2026-08-26 04:57:14.443821 | instance | skipping: Conditional result was False
2026-08-26 04:57:14.473818 | 
2026-08-26 04:57:14.474031 | TASK [Run Molecule scenario]
2026-08-26 04:57:15.349275 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-08-26 04:57:15.710206 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-26 04:57:15.710343 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-08-26 04:57:26.604713 | instance | INFO     [csi > dependency] Executing
2026-08-26 04:57:26.604883 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-08-26 04:57:26.605170 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-08-26 04:57:26.605386 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-26 04:57:26.614210 | instance | INFO     [csi > cleanup] Executing
2026-08-26 04:57:26.614579 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-26 04:57:26.622058 | instance | INFO     [csi > destroy] Executing
2026-08-26 04:57:26.622097 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-08-26 04:57:26.622189 | instance | INFO     [csi > destroy] Executed: Successful
2026-08-26 04:57:26.631554 | instance | INFO     [csi > syntax] Executing
2026-08-26 04:57:28.173364 | instance |
2026-08-26 04:57:28.173625 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-26 04:57:28.229541 | instance | INFO     [csi > syntax] Executed: Successful
2026-08-26 04:57:28.244421 | instance | INFO     [csi > create] Executing
2026-08-26 04:57:28.246295 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-26 04:57:28.253685 | instance | INFO     [csi > prepare] Executing
2026-08-26 04:57:29.005706 | instance |
2026-08-26 04:57:29.005965 | instance | PLAY [Prepare] *****************************************************************
2026-08-26 04:57:29.006244 | instance |
2026-08-26 04:57:29.006559 | instance | TASK [Gathering Facts] *********************************************************
2026-08-26 04:57:29.006908 | instance | Wednesday 26 August 2026  04:57:29 +0000 (0:00:00.023)       0:00:00.023 ******
2026-08-26 04:57:30.239520 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-26 04:57:30.239825 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-26 04:57:30.240146 | instance | interpreter could change the meaning of that path. See
2026-08-26 04:57:30.240448 | instance | https://docs.ansible.com/ansible-
2026-08-26 04:57:30.240767 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-26 04:57:30.247951 | instance | ok: [instance]
2026-08-26 04:57:30.248211 | instance |
2026-08-26 04:57:30.248495 | instance | TASK [Configure short hostname] ************************************************
2026-08-26 04:57:30.248789 | instance | Wednesday 26 August 2026  04:57:30 +0000 (0:00:01.243)       0:00:01.267 ******
2026-08-26 04:57:30.949467 | instance | changed: [instance]
2026-08-26 04:57:30.949636 | instance |
2026-08-26 04:57:30.949909 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-26 04:57:30.950242 | instance | Wednesday 26 August 2026  04:57:30 +0000 (0:00:00.700)       0:00:01.968 ******
2026-08-26 04:57:31.220647 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-26 04:57:31.220830 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-08-26 04:57:31.221107 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-26 04:57:31.228749 | instance | changed: [instance]
2026-08-26 04:57:31.229010 | instance |
2026-08-26 04:57:31.229286 | instance | TASK [Purge "snapd" package] ***************************************************
2026-08-26 04:57:31.229557 | instance | Wednesday 26 August 2026  04:57:31 +0000 (0:00:00.280)       0:00:02.248 ******
2026-08-26 04:57:31.998854 | instance | ok: [instance]
2026-08-26 04:57:31.999061 | instance |
2026-08-26 04:57:31.999340 | instance | PLAY [Create devices for Ceph] *************************************************
2026-08-26 04:57:31.999631 | instance |
2026-08-26 04:57:31.999888 | instance | TASK [Gathering Facts] *********************************************************
2026-08-26 04:57:32.000157 | instance | Wednesday 26 August 2026  04:57:31 +0000 (0:00:00.769)       0:00:03.017 ******
2026-08-26 04:57:32.700607 | instance | ok: [instance]
2026-08-26 04:57:32.700808 | instance |
2026-08-26 04:57:32.701102 | instance | TASK [Install depedencies] *****************************************************
2026-08-26 04:57:32.701382 | instance | Wednesday 26 August 2026  04:57:32 +0000 (0:00:00.702)       0:00:03.719 ******
2026-08-26 04:57:56.265628 | instance | changed: [instance]
2026-08-26 04:57:56.265839 | instance |
2026-08-26 04:57:56.266084 | instance | TASK [Start up service] ********************************************************
2026-08-26 04:57:56.266349 | instance | Wednesday 26 August 2026  04:57:56 +0000 (0:00:23.565)       0:00:27.284 ******
2026-08-26 04:57:56.786702 | instance | ok: [instance]
2026-08-26 04:57:56.786891 | instance |
2026-08-26 04:57:56.787142 | instance | TASK [Generate lvm.conf] *******************************************************
2026-08-26 04:57:56.787364 | instance | Wednesday 26 August 2026  04:57:56 +0000 (0:00:00.521)       0:00:27.806 ******
2026-08-26 04:57:57.064288 | instance | ok: [instance]
2026-08-26 04:57:57.064536 | instance |
2026-08-26 04:57:57.064822 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-26 04:57:57.065100 | instance | Wednesday 26 August 2026  04:57:57 +0000 (0:00:00.277)       0:00:28.083 ******
2026-08-26 04:57:57.686536 | instance | changed: [instance]
2026-08-26 04:57:57.686904 | instance |
2026-08-26 04:57:57.687272 | instance | TASK [Get list of all loopback devices] ****************************************
2026-08-26 04:57:57.687599 | instance | Wednesday 26 August 2026  04:57:57 +0000 (0:00:00.621)       0:00:28.705 ******
2026-08-26 04:57:57.879473 | instance | ok: [instance]
2026-08-26 04:57:57.879657 | instance |
2026-08-26 04:57:57.879943 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-08-26 04:57:57.880168 | instance | Wednesday 26 August 2026  04:57:57 +0000 (0:00:00.193)       0:00:28.898 ******
2026-08-26 04:57:57.908581 | instance | skipping: [instance]
2026-08-26 04:57:57.908677 | instance |
2026-08-26 04:57:57.908844 | instance | TASK [Create devices for Ceph] *************************************************
2026-08-26 04:57:57.908998 | instance | Wednesday 26 August 2026  04:57:57 +0000 (0:00:00.029)       0:00:28.928 ******
2026-08-26 04:57:58.434417 | instance | changed: [instance] => (item=osd0)
2026-08-26 04:57:58.434666 | instance | changed: [instance] => (item=osd1)
2026-08-26 04:57:58.434881 | instance | changed: [instance] => (item=osd2)
2026-08-26 04:57:58.435106 | instance |
2026-08-26 04:57:58.435313 | instance | TASK [Set permissions on loopback devices] *************************************
2026-08-26 04:57:58.435520 | instance | Wednesday 26 August 2026  04:57:58 +0000 (0:00:00.523)       0:00:29.451 ******
2026-08-26 04:57:59.041175 | instance | changed: [instance] => (item=osd0)
2026-08-26 04:57:59.041311 | instance | changed: [instance] => (item=osd1)
2026-08-26 04:57:59.041501 | instance | changed: [instance] => (item=osd2)
2026-08-26 04:57:59.041675 | instance |
2026-08-26 04:57:59.041837 | instance | TASK [Start loop devices] ******************************************************
2026-08-26 04:57:59.041989 | instance | Wednesday 26 August 2026  04:57:59 +0000 (0:00:00.609)       0:00:30.060 ******
2026-08-26 04:57:59.725918 | instance | changed: [instance] => (item=osd0)
2026-08-26 04:57:59.726030 | instance | changed: [instance] => (item=osd1)
2026-08-26 04:57:59.726248 | instance | changed: [instance] => (item=osd2)
2026-08-26 04:57:59.726394 | instance |
2026-08-26 04:57:59.726547 | instance | TASK [Create a volume group for each loop device] ******************************
2026-08-26 04:57:59.726698 | instance | Wednesday 26 August 2026  04:57:59 +0000 (0:00:00.684)       0:00:30.745 ******
2026-08-26 04:58:03.480273 | instance | changed: [instance] => (item=osd0)
2026-08-26 04:58:03.480349 | instance | changed: [instance] => (item=osd1)
2026-08-26 04:58:03.480362 | instance | changed: [instance] => (item=osd2)
2026-08-26 04:58:03.480375 | instance |
2026-08-26 04:58:03.480634 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-08-26 04:58:03.480673 | instance | Wednesday 26 August 2026  04:58:03 +0000 (0:00:03.753)       0:00:34.499 ******
2026-08-26 04:58:05.327003 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-08-26 04:58:05.327100 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-08-26 04:58:05.327136 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-08-26 04:58:05.327148 | instance |
2026-08-26 04:58:05.327159 | instance | PLAY RECAP *********************************************************************
2026-08-26 04:58:05.327179 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-26 04:58:05.330562 | instance |
2026-08-26 04:58:05.330617 | instance | Wednesday 26 August 2026  04:58:05 +0000 (0:00:01.845)       0:00:36.345 ******
2026-08-26 04:58:05.330628 | instance | ===============================================================================
2026-08-26 04:58:05.330634 | instance | Install depedencies ---------------------------------------------------- 23.57s
2026-08-26 04:58:05.330642 | instance | Create a volume group for each loop device ------------------------------ 3.75s
2026-08-26 04:58:05.330648 | instance | Create a logical volume for each loop device ---------------------------- 1.85s
2026-08-26 04:58:05.330657 | instance | Gathering Facts --------------------------------------------------------- 1.24s
2026-08-26 04:58:05.330665 | instance | Purge "snapd" package --------------------------------------------------- 0.77s
2026-08-26 04:58:05.330674 | instance | Gathering Facts --------------------------------------------------------- 0.70s
2026-08-26 04:58:05.330683 | instance | Configure short hostname ------------------------------------------------ 0.70s
2026-08-26 04:58:05.330691 | instance | Start loop devices ------------------------------------------------------ 0.68s
2026-08-26 04:58:05.330698 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s
2026-08-26 04:58:05.330705 | instance | Set permissions on loopback devices ------------------------------------- 0.61s
2026-08-26 04:58:05.330712 | instance | Create devices for Ceph ------------------------------------------------- 0.52s
2026-08-26 04:58:05.330719 | instance | Start up service -------------------------------------------------------- 0.52s
2026-08-26 04:58:05.330725 | instance | Ensure hostname inside hosts file --------------------------------------- 0.28s
2026-08-26 04:58:05.330733 | instance | Generate lvm.conf ------------------------------------------------------- 0.28s
2026-08-26 04:58:05.330740 | instance | Get list of all loopback devices ---------------------------------------- 0.19s
2026-08-26 04:58:05.330746 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-08-26 04:58:05.429210 | instance | INFO     [csi > prepare] Executed: Successful
2026-08-26 04:58:05.441959 | instance | INFO     [csi > converge] Executing
2026-08-26 04:58:06.882771 | instance |
2026-08-26 04:58:06.883117 | instance | PLAY [Debug CSI driver value] **************************************************
2026-08-26 04:58:06.883325 | instance |
2026-08-26 04:58:06.883539 | instance | TASK [Gathering Facts] *********************************************************
2026-08-26 04:58:06.883749 | instance | Wednesday 26 August 2026  04:58:06 +0000 (0:00:00.007)       0:00:00.007 ******
2026-08-26 04:58:07.880645 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-26 04:58:07.881029 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-26 04:58:07.881356 | instance | interpreter could change the meaning of that path. See
2026-08-26 04:58:07.881718 | instance | https://docs.ansible.com/ansible-
2026-08-26 04:58:07.882043 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-26 04:58:07.891320 | instance | ok: [instance]
2026-08-26 04:58:07.891634 | instance |
2026-08-26 04:58:07.891957 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-08-26 04:58:07.892278 | instance | Wednesday 26 August 2026  04:58:07 +0000 (0:00:01.008)       0:00:01.016 ******
2026-08-26 04:58:07.941102 | instance | ok: [instance] => {
2026-08-26 04:58:07.941484 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-08-26 04:58:07.941860 | instance | }
2026-08-26 04:58:07.942195 | instance |
2026-08-26 04:58:07.942518 | instance | PLAY [all] *********************************************************************
2026-08-26 04:58:07.942858 | instance |
2026-08-26 04:58:07.943193 | instance | TASK [Gathering Facts] *********************************************************
2026-08-26 04:58:07.943547 | instance | Wednesday 26 August 2026  04:58:07 +0000 (0:00:00.050)       0:00:01.066 ******
2026-08-26 04:58:08.840552 | instance | ok: [instance]
2026-08-26 04:58:08.840951 | instance |
2026-08-26 04:58:08.841302 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-08-26 04:58:08.841632 | instance | Wednesday 26 August 2026  04:58:08 +0000 (0:00:00.898)       0:00:01.965 ******
2026-08-26 04:58:09.016658 | instance | ok: [instance]
2026-08-26 04:58:09.017046 | instance |
2026-08-26 04:58:09.017378 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-26 04:58:09.017681 | instance |
2026-08-26 04:58:09.017997 | instance | TASK [Gathering Facts] *********************************************************
2026-08-26 04:58:09.018318 | instance | Wednesday 26 August 2026  04:58:09 +0000 (0:00:00.176)       0:00:02.141 ******
2026-08-26 04:58:09.923491 | instance | ok: [instance]
2026-08-26 04:58:09.923597 | instance |
2026-08-26 04:58:09.923604 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-26 04:58:09.923769 | instance | Wednesday 26 August 2026  04:58:09 +0000 (0:00:00.904)       0:00:03.045 ******
2026-08-26 04:58:10.231696 | instance | ok: [instance]
2026-08-26 04:58:10.231922 | instance |
2026-08-26 04:58:10.232089 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-26 04:58:10.232264 | instance | Wednesday 26 August 2026  04:58:10 +0000 (0:00:00.309)       0:00:03.355 ******
2026-08-26 04:58:10.279694 | instance | skipping: [instance]
2026-08-26 04:58:10.279780 | instance |
2026-08-26 04:58:10.279958 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-26 04:58:10.280182 | instance | Wednesday 26 August 2026  04:58:10 +0000 (0:00:00.046)       0:00:03.401 ******
2026-08-26 04:58:10.633095 | instance | changed: [instance]
2026-08-26 04:58:10.633155 | instance |
2026-08-26 04:58:10.633161 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-26 04:58:10.633166 | instance | Wednesday 26 August 2026  04:58:10 +0000 (0:00:00.355)       0:00:03.757 ******
2026-08-26 04:58:10.712453 | instance | ok: [instance] => {
2026-08-26 04:58:10.712512 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-26 04:58:10.712519 | instance | }
2026-08-26 04:58:10.712524 | instance |
2026-08-26 04:58:10.712529 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-26 04:58:10.712535 | instance | Wednesday 26 August 2026  04:58:10 +0000 (0:00:00.079)       0:00:03.836 ******
2026-08-26 04:58:11.441858 | instance | changed: [instance]
2026-08-26 04:58:11.441908 | instance |
2026-08-26 04:58:11.441914 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-26 04:58:11.441920 | instance | Wednesday 26 August 2026  04:58:11 +0000 (0:00:00.729)       0:00:04.566 ******
2026-08-26 04:58:11.495912 | instance | skipping: [instance]
2026-08-26 04:58:11.495952 | instance |
2026-08-26 04:58:11.495959 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-26 04:58:11.495964 | instance | Wednesday 26 August 2026  04:58:11 +0000 (0:00:00.054)       0:00:04.620 ******
2026-08-26 04:58:11.542372 | instance | skipping: [instance]
2026-08-26 04:58:11.542405 | instance |
2026-08-26 04:58:11.542411 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-26 04:58:11.542416 | instance | Wednesday 26 August 2026  04:58:11 +0000 (0:00:00.046)       0:00:04.667 ******
2026-08-26 04:58:11.762889 | instance | ok: [instance]
2026-08-26 04:58:11.762993 | instance |
2026-08-26 04:58:11.763212 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-26 04:58:11.763268 | instance | Wednesday 26 August 2026  04:58:11 +0000 (0:00:00.220)       0:00:04.887 ******
2026-08-26 04:58:12.986508 | instance | ok: [instance]
2026-08-26 04:58:12.986704 | instance |
2026-08-26 04:58:12.986717 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-26 04:58:12.986907 | instance | Wednesday 26 August 2026  04:58:12 +0000 (0:00:01.223)       0:00:06.111 ******
2026-08-26 04:58:13.060744 | instance | ok: [instance] => {
2026-08-26 04:58:13.060812 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-26 04:58:13.061332 | instance | }
2026-08-26 04:58:13.061368 | instance |
2026-08-26 04:58:13.061374 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-26 04:58:13.061379 | instance | Wednesday 26 August 2026  04:58:13 +0000 (0:00:00.074)       0:00:06.185 ******
2026-08-26 04:58:13.831837 | instance | changed: [instance]
2026-08-26 04:58:13.831905 | instance |
2026-08-26 04:58:13.832169 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-26 04:58:13.832210 | instance | Wednesday 26 August 2026  04:58:13 +0000 (0:00:00.771)       0:00:06.956 ******
2026-08-26 04:58:16.704578 | instance | changed: [instance]
2026-08-26 04:58:16.704685 | instance |
2026-08-26 04:58:16.704751 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-26 04:58:16.704932 | instance | Wednesday 26 August 2026  04:58:16 +0000 (0:00:02.872)       0:00:09.829 ******
2026-08-26 04:58:16.738435 | instance | skipping: [instance]
2026-08-26 04:58:16.738842 | instance |
2026-08-26 04:58:16.738887 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-26 04:58:16.738894 | instance | Wednesday 26 August 2026  04:58:16 +0000 (0:00:00.033)       0:00:09.863 ******
2026-08-26 04:58:16.771131 | instance | skipping: [instance]
2026-08-26 04:58:16.771991 | instance |
2026-08-26 04:58:16.772041 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-26 04:58:16.772049 | instance | Wednesday 26 August 2026  04:58:16 +0000 (0:00:00.032)       0:00:09.895 ******
2026-08-26 04:58:16.808468 | instance | skipping: [instance]
2026-08-26 04:58:16.808852 | instance |
2026-08-26 04:58:16.808888 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-26 04:58:16.808894 | instance | Wednesday 26 August 2026  04:58:16 +0000 (0:00:00.037)       0:00:09.933 ******
2026-08-26 04:58:22.109904 | instance | changed: [instance]
2026-08-26 04:58:22.110009 | instance |
2026-08-26 04:58:22.110292 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-26 04:58:22.110325 | instance | Wednesday 26 August 2026  04:58:22 +0000 (0:00:05.301)       0:00:15.234 ******
2026-08-26 04:58:22.665834 | instance | changed: [instance]
2026-08-26 04:58:22.665905 | instance |
2026-08-26 04:58:22.666178 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-26 04:58:22.666212 | instance | Wednesday 26 August 2026  04:58:22 +0000 (0:00:00.556)       0:00:15.790 ******
2026-08-26 04:58:23.543585 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-08-26 04:58:23.543655 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-26 04:58:23.544424 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-26 04:58:23.544459 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-26 04:58:23.544466 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-26 04:58:23.544470 | instance |
2026-08-26 04:58:23.544480 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-26 04:58:23.544484 | instance | Wednesday 26 August 2026  04:58:23 +0000 (0:00:00.877)       0:00:16.668 ******
2026-08-26 04:58:24.107831 | instance | changed: [instance]
2026-08-26 04:58:24.107888 | instance |
2026-08-26 04:58:24.108530 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-26 04:58:24.108570 | instance | Wednesday 26 August 2026  04:58:24 +0000 (0:00:00.539)       0:00:17.208 ******
2026-08-26 04:58:24.108576 | instance |
2026-08-26 04:58:24.108581 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-26 04:58:24.108585 | instance | Wednesday 26 August 2026  04:58:24 +0000 (0:00:00.024)       0:00:17.232 ******
2026-08-26 04:58:24.995071 | instance | ok: [instance]
2026-08-26 04:58:24.995146 | instance |
2026-08-26 04:58:24.995436 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-26 04:58:24.995470 | instance | Wednesday 26 August 2026  04:58:24 +0000 (0:00:00.887)       0:00:18.120 ******
2026-08-26 04:58:25.428273 | instance | changed: [instance]
2026-08-26 04:58:25.428416 | instance |
2026-08-26 04:58:25.428619 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-26 04:58:25.428876 | instance | Wednesday 26 August 2026  04:58:25 +0000 (0:00:00.432)       0:00:18.553 ******
2026-08-26 04:58:25.963190 | instance | changed: [instance]
2026-08-26 04:58:25.963264 | instance |
2026-08-26 04:58:25.963591 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-26 04:58:25.963628 | instance | Wednesday 26 August 2026  04:58:25 +0000 (0:00:00.535)       0:00:19.088 ******
2026-08-26 04:58:26.168496 | instance | ok: [instance]
2026-08-26 04:58:26.168556 | instance |
2026-08-26 04:58:26.168851 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-26 04:58:26.168897 | instance | Wednesday 26 August 2026  04:58:26 +0000 (0:00:00.205)       0:00:19.293 ******
2026-08-26 04:58:26.224437 | instance | ok: [instance] => {
2026-08-26 04:58:26.224520 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-26 04:58:26.225023 | instance | }
2026-08-26 04:58:26.225049 | instance |
2026-08-26 04:58:26.225054 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-26 04:58:26.225060 | instance | Wednesday 26 August 2026  04:58:26 +0000 (0:00:00.055)       0:00:19.349 ******
2026-08-26 04:58:26.941452 | instance | changed: [instance]
2026-08-26 04:58:26.941897 | instance |
2026-08-26 04:58:26.941941 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-26 04:58:26.941947 | instance | Wednesday 26 August 2026  04:58:26 +0000 (0:00:00.716)       0:00:20.066 ******
2026-08-26 04:58:31.219450 | instance | changed: [instance]
2026-08-26 04:58:31.219526 | instance |
2026-08-26 04:58:31.219758 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-26 04:58:31.219917 | instance | Wednesday 26 August 2026  04:58:31 +0000 (0:00:04.277)       0:00:24.344 ******
2026-08-26 04:58:32.211801 | instance | ok: [instance]
2026-08-26 04:58:32.211865 | instance |
2026-08-26 04:58:32.212130 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-26 04:58:32.212168 | instance | Wednesday 26 August 2026  04:58:32 +0000 (0:00:00.992)       0:00:25.336 ******
2026-08-26 04:58:32.589393 | instance | changed: [instance]
2026-08-26 04:58:32.589777 | instance |
2026-08-26 04:58:32.589964 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-26 04:58:32.589971 | instance | Wednesday 26 August 2026  04:58:32 +0000 (0:00:00.377)       0:00:25.714 ******
2026-08-26 04:58:33.022146 | instance | changed: [instance]
2026-08-26 04:58:33.022243 | instance |
2026-08-26 04:58:33.022310 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-26 04:58:33.022494 | instance | Wednesday 26 August 2026  04:58:33 +0000 (0:00:00.433)       0:00:26.147 ******
2026-08-26 04:58:33.586058 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-08-26 04:58:33.586933 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-26 04:58:33.586973 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-26 04:58:33.586986 | instance |
2026-08-26 04:58:33.586996 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-26 04:58:33.587010 | instance | Wednesday 26 August 2026  04:58:33 +0000 (0:00:00.563)       0:00:26.710 ******
2026-08-26 04:58:34.041901 | instance | changed: [instance]
2026-08-26 04:58:34.042305 | instance |
2026-08-26 04:58:34.042365 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-26 04:58:34.042372 | instance | Wednesday 26 August 2026  04:58:34 +0000 (0:00:00.455)       0:00:27.166 ******
2026-08-26 04:58:34.517313 | instance | changed: [instance]
2026-08-26 04:58:34.517411 | instance |
2026-08-26 04:58:34.517473 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-26 04:58:34.518038 | instance | Wednesday 26 August 2026  04:58:34 +0000 (0:00:00.456)       0:00:27.623 ******
2026-08-26 04:58:34.518098 | instance |
2026-08-26 04:58:34.518104 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-26 04:58:34.518108 | instance | Wednesday 26 August 2026  04:58:34 +0000 (0:00:00.018)       0:00:27.642 ******
2026-08-26 04:58:35.276501 | instance | ok: [instance]
2026-08-26 04:58:35.276611 | instance |
2026-08-26 04:58:35.276892 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-26 04:58:35.276937 | instance | Wednesday 26 August 2026  04:58:35 +0000 (0:00:00.759)       0:00:28.401 ******
2026-08-26 04:58:37.474355 | instance | changed: [instance]
2026-08-26 04:58:37.474434 | instance |
2026-08-26 04:58:37.474689 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-26 04:58:37.474727 | instance | Wednesday 26 August 2026  04:58:37 +0000 (0:00:02.197)       0:00:30.599 ******
2026-08-26 04:58:38.041865 | instance | changed: [instance]
2026-08-26 04:58:38.041946 | instance |
2026-08-26 04:58:38.042159 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-26 04:58:38.042191 | instance | Wednesday 26 August 2026  04:58:38 +0000 (0:00:00.567)       0:00:31.166 ******
2026-08-26 04:58:38.108430 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-26 04:58:38.108941 | instance |
2026-08-26 04:58:38.109011 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-26 04:58:38.109020 | instance | Wednesday 26 August 2026  04:58:38 +0000 (0:00:00.065)       0:00:31.232 ******
2026-08-26 04:58:43.617621 | instance | changed: [instance]
2026-08-26 04:58:43.617693 | instance |
2026-08-26 04:58:43.617973 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-26 04:58:43.618029 | instance | Wednesday 26 August 2026  04:58:43 +0000 (0:00:05.510)       0:00:36.742 ******
2026-08-26 04:58:44.281553 | instance | ok: [instance] => (item=chronyd)
2026-08-26 04:58:44.281635 | instance | ok: [instance] => (item=sshd)
2026-08-26 04:58:44.282066 | instance |
2026-08-26 04:58:44.282140 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-26 04:58:44.282147 | instance | Wednesday 26 August 2026  04:58:44 +0000 (0:00:00.663)       0:00:37.406 ******
2026-08-26 04:58:44.621913 | instance | changed: [instance]
2026-08-26 04:58:44.621995 | instance |
2026-08-26 04:58:44.622291 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-26 04:58:44.622467 | instance | Wednesday 26 August 2026  04:58:44 +0000 (0:00:00.340)       0:00:37.746 ******
2026-08-26 04:58:44.844505 | instance | ok: [instance]
2026-08-26 04:58:44.844597 | instance |
2026-08-26 04:58:44.844865 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-26 04:58:44.844930 | instance | Wednesday 26 August 2026  04:58:44 +0000 (0:00:00.222)       0:00:37.968 ******
2026-08-26 04:58:45.370631 | instance | changed: [instance]
2026-08-26 04:58:45.370736 | instance |
2026-08-26 04:58:45.370940 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-26 04:58:45.371022 | instance | Wednesday 26 August 2026  04:58:45 +0000 (0:00:00.526)       0:00:38.495 ******
2026-08-26 04:58:45.757948 | instance | changed: [instance]
2026-08-26 04:58:45.758018 | instance |
2026-08-26 04:58:45.758338 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-26 04:58:45.758407 | instance | Wednesday 26 August 2026  04:58:45 +0000 (0:00:00.386)       0:00:38.882 ******
2026-08-26 04:58:45.869144 | instance | ok: [instance]
2026-08-26 04:58:45.869203 | instance |
2026-08-26 04:58:45.869508 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-26 04:58:45.869555 | instance | Wednesday 26 August 2026  04:58:45 +0000 (0:00:00.111)       0:00:38.993 ******
2026-08-26 04:58:46.105586 | instance | ok: [instance] => (item=instance)
2026-08-26 04:58:46.105657 | instance |
2026-08-26 04:58:46.105927 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-26 04:58:46.105968 | instance | Wednesday 26 August 2026  04:58:46 +0000 (0:00:00.236)       0:00:39.230 ******
2026-08-26 04:58:46.155155 | instance | ok: [instance]
2026-08-26 04:58:46.155246 | instance |
2026-08-26 04:58:46.155521 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-26 04:58:46.155553 | instance | Wednesday 26 August 2026  04:58:46 +0000 (0:00:00.049)       0:00:39.279 ******
2026-08-26 04:58:46.223623 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-08-26 04:58:46.223765 | instance |
2026-08-26 04:58:46.223798 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-26 04:58:46.223813 | instance | Wednesday 26 August 2026  04:58:46 +0000 (0:00:00.068)       0:00:39.348 ******
2026-08-26 04:58:46.528875 | instance | changed: [instance]
2026-08-26 04:58:46.528927 | instance |
2026-08-26 04:58:46.528933 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-26 04:58:46.528939 | instance | Wednesday 26 August 2026  04:58:46 +0000 (0:00:00.304)       0:00:39.653 ******
2026-08-26 04:58:47.234206 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-08-26 04:58:47.234255 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-26 04:58:47.234262 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-26 04:58:47.234267 | instance |
2026-08-26 04:58:47.234273 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-26 04:58:47.234278 | instance | Wednesday 26 August 2026  04:58:47 +0000 (0:00:00.705)       0:00:40.358 ******
2026-08-26 05:00:34.490470 | instance | ok: [instance]
2026-08-26 05:00:34.490548 | instance |
2026-08-26 05:00:34.490554 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-26 05:00:34.490560 | instance | Wednesday 26 August 2026  05:00:34 +0000 (0:01:47.256)       0:02:27.614 ******
2026-08-26 05:00:34.716549 | instance | changed: [instance]
2026-08-26 05:00:34.716642 | instance |
2026-08-26 05:00:34.716652 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-26 05:00:34.716659 | instance | Wednesday 26 August 2026  05:00:34 +0000 (0:00:00.226)       0:02:27.841 ******
2026-08-26 05:00:34.819727 | instance | ok: [instance]
2026-08-26 05:00:34.819790 | instance |
2026-08-26 05:00:34.819797 | instance | TASK [Install Ceph host] *******************************************************
2026-08-26 05:00:34.819802 | instance | Wednesday 26 August 2026  05:00:34 +0000 (0:00:00.103)       0:02:27.944 ******
2026-08-26 05:00:34.906557 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-08-26 05:00:34.906613 | instance |
2026-08-26 05:00:34.906620 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-26 05:00:34.906626 | instance | Wednesday 26 August 2026  05:00:34 +0000 (0:00:00.086)       0:02:28.030 ******
2026-08-26 05:00:36.618120 | instance | ok: [instance]
2026-08-26 05:00:36.618179 | instance |
2026-08-26 05:00:36.618186 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-26 05:00:36.618192 | instance | Wednesday 26 August 2026  05:00:36 +0000 (0:00:01.711)       0:02:29.742 ******
2026-08-26 05:00:36.684356 | instance | ok: [instance] => (item=instance)
2026-08-26 05:00:36.684482 | instance |
2026-08-26 05:00:36.684497 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-26 05:00:36.684672 | instance | Wednesday 26 August 2026  05:00:36 +0000 (0:00:00.066)       0:02:29.808 ******
2026-08-26 05:00:37.070401 | instance | ok: [instance]
2026-08-26 05:00:37.070499 | instance |
2026-08-26 05:00:37.070629 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-26 05:00:37.070754 | instance | Wednesday 26 August 2026  05:00:37 +0000 (0:00:00.386)       0:02:30.195 ******
2026-08-26 05:00:40.241470 | instance | ok: [instance]
2026-08-26 05:00:40.241517 | instance |
2026-08-26 05:00:40.241523 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-26 05:00:40.241528 | instance | Wednesday 26 August 2026  05:00:40 +0000 (0:00:03.170)       0:02:33.365 ******
2026-08-26 05:01:35.704365 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-08-26 05:01:35.705094 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__s3fk6o0/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__s3fk6o0/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__s3fk6o0/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__s3fk6o0/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-08-26T05:01:35.533+0000 7f0cb2226640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgC+co5q0BwTESAA51R8tbED8q4rbxhMMGlN3K1E9e0H5sXPNwj3VF9CeqY=: Malformed input [buffer:3]\n2026-08-26T05:01:35.533+0000 7f0cb2226640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-26T05:01:35.537+0000 7f0cb2226640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgC+co5q0BwTESAA51R8tbED8q4rbxhMMGlN3K1E9e0H5sXPNwj3VF9CeqY=: Malformed input [buffer:3]\n2026-08-26T05:01:35.537+0000 7f0cb2226640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-26T05:01:35.537+0000 7f0cb2226640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgC+co5q0BwTESAA51R8tbED8q4rbxhMMGlN3K1E9e0H5sXPNwj3VF9CeqY=: Malformed input [buffer:3]\n2026-08-26T05:01:35.537+0000 7f0cb2226640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-26T05:01:35.537+0000 7f0cb2226640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-08-26 05:01:35.707319 | instance |
2026-08-26 05:01:35.707523 | instance | PLAY RECAP *********************************************************************
2026-08-26 05:01:35.710939 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-08-26 05:01:35.711016 | instance |
2026-08-26 05:01:35.711023 | instance | Wednesday 26 August 2026  05:01:35 +0000 (0:00:55.467)       0:03:28.832 ******
2026-08-26 05:01:35.711028 | instance | ===============================================================================
2026-08-26 05:01:35.711033 | instance | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 107.26s
2026-08-26 05:01:35.711037 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 55.47s
2026-08-26 05:01:35.711042 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.51s
2026-08-26 05:01:35.711046 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.30s
2026-08-26 05:01:35.711051 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.28s
2026-08-26 05:01:35.711055 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 3.17s
2026-08-26 05:01:35.711059 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.87s
2026-08-26 05:01:35.711064 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 2.20s
2026-08-26 05:01:35.711085 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.71s
2026-08-26 05:01:35.711090 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.65s
2026-08-26 05:01:35.711094 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.22s
2026-08-26 05:01:35.711098 | instance | Gathering Facts --------------------------------------------------------- 1.01s
2026-08-26 05:01:35.711103 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 0.99s
2026-08-26 05:01:35.711113 | instance | Gathering Facts --------------------------------------------------------- 0.90s
2026-08-26 05:01:35.711118 | instance | Gathering Facts --------------------------------------------------------- 0.90s
2026-08-26 05:01:35.712181 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.88s
2026-08-26 05:01:35.712238 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.77s
2026-08-26 05:01:35.712245 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.73s
2026-08-26 05:01:35.712252 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.72s
2026-08-26 05:01:35.712258 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.71s
2026-08-26 05:01:35.892991 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-26 05:01:35.893188 | instance | ERROR    [csi > converge] Executed: Failed
2026-08-26 05:01:35.893355 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-26 05:01:36.365907 | instance | ERROR
2026-08-26 05:01:36.366118 | instance | {
2026-08-26 05:01:36.366160 | instance |   "delta": "0:04:21.133415",
2026-08-26 05:01:36.366181 | instance |   "end": "2026-08-26 05:01:35.947403",
2026-08-26 05:01:36.366199 | instance |   "msg": "non-zero return code",
2026-08-26 05:01:36.366217 | instance |   "rc": 2,
2026-08-26 05:01:36.366234 | instance |   "start": "2026-08-26 04:57:14.813988"
2026-08-26 05:01:36.366252 | instance | }
failure
2026-08-26 05:01:36.370973 | 
2026-08-26 05:01:36.371023 | PLAY RECAP
2026-08-26 05:01:36.371067 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-26 05:01:36.371089 | 
2026-08-26 05:01:36.489427 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-26 05:01:36.493726 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-26 05:01:37.142771 | 
2026-08-26 05:01:37.142926 | PLAY [all]
2026-08-26 05:01:37.157121 | 
2026-08-26 05:01:37.157198 | TASK [gather-host-logs : creating directory for system status]
2026-08-26 05:01:37.483352 | instance | changed
2026-08-26 05:01:37.488417 | 
2026-08-26 05:01:37.488498 | TASK [gather-host-logs : Get logs for each host]
2026-08-26 05:01:37.813678 | instance | + systemd-cgls --full --all --no-pager
2026-08-26 05:01:37.830772 | instance | + ip addr
2026-08-26 05:01:37.832808 | instance | + ip route
2026-08-26 05:01:37.834511 | instance | + lsblk
2026-08-26 05:01:37.838168 | instance | + mount
2026-08-26 05:01:37.840777 | instance | + docker images
2026-08-26 05:01:37.858468 | instance | + brctl show
2026-08-26 05:01:37.858892 | instance | /bin/bash: line 8: brctl: command not found
2026-08-26 05:01:37.859133 | instance | + ps aux --sort=-%mem
2026-08-26 05:01:37.884015 | instance | + dpkg -l
2026-08-26 05:01:37.894526 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-08-26 05:01:37.894999 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-08-26 05:01:37.912667 | instance | + '[' '!' -z '' ']'
2026-08-26 05:01:38.020668 | instance | ok: Runtime: 0:00:00.103990
2026-08-26 05:01:38.027092 | 
2026-08-26 05:01:38.027161 | TASK [gather-host-logs : Downloads logs to executor]
2026-08-26 05:01:38.631847 | instance | changed:
2026-08-26 05:01:38.632060 | instance | created directory /var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/logs/instance
2026-08-26 05:01:38.632102 | instance | cd+++++++++ system/
2026-08-26 05:01:38.632134 | instance | >f+++++++++ system/brctl-show.txt
2026-08-26 05:01:38.632165 | instance | >f+++++++++ system/docker-images.txt
2026-08-26 05:01:38.632194 | instance | >f+++++++++ system/ip-addr.txt
2026-08-26 05:01:38.632226 | instance | >f+++++++++ system/ip-route.txt
2026-08-26 05:01:38.632256 | instance | >f+++++++++ system/lsblk.txt
2026-08-26 05:01:38.632285 | instance | >f+++++++++ system/mount.txt
2026-08-26 05:01:38.632313 | instance | >f+++++++++ system/packages.txt
2026-08-26 05:01:38.632341 | instance | >f+++++++++ system/ps.txt
2026-08-26 05:01:38.632372 | instance | >f+++++++++ system/systemd-cgls.txt
2026-08-26 05:01:38.643765 | 
2026-08-26 05:01:38.643832 | LOOP [helm-release-status : creating directory for helm release status]
2026-08-26 05:01:38.848738 | instance | changed: "values"
2026-08-26 05:01:39.020550 | instance | changed: "releases"
2026-08-26 05:01:39.037612 | 
2026-08-26 05:01:39.037788 | TASK [helm-release-status : Gather get release status for helm charts]
2026-08-26 05:01:39.519282 | instance | /bin/bash: line 3: kubectl: command not found
2026-08-26 05:01:39.586232 | instance | ok: Runtime: 0:00:00.006476
2026-08-26 05:01:39.591874 | 
2026-08-26 05:01:39.591943 | TASK [helm-release-status : Downloads logs to executor]
2026-08-26 05:01:40.744737 | instance | changed:
2026-08-26 05:01:40.884384 | instance | cd+++++++++ helm/
2026-08-26 05:01:40.884547 | instance | cd+++++++++ helm/releases/
2026-08-26 05:01:40.884604 | instance | cd+++++++++ helm/values/
2026-08-26 05:01:40.901940 | 
2026-08-26 05:01:40.902036 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-08-26 05:01:41.097279 | instance | changed
2026-08-26 05:01:41.105948 | 
2026-08-26 05:01:41.106043 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-08-26 05:01:41.357594 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-26 05:01:41.358206 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-26 05:01:41.362755 | instance | environment: line 1: kubectl: command not found
2026-08-26 05:01:41.364408 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-26 05:01:41.366381 | instance | environment: line 1: kubectl: command not found
2026-08-26 05:01:41.367145 | instance | environment: line 1: kubectl: command not found
2026-08-26 05:01:41.367341 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-26 05:01:41.368921 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-26 05:01:41.370242 | instance | environment: line 1: kubectl: command not found
2026-08-26 05:01:41.371905 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-26 05:01:41.371923 | instance | environment: line 1: kubectl: command not found
2026-08-26 05:01:41.373179 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-26 05:01:41.646081 | instance | ok: Runtime: 0:00:00.024559
2026-08-26 05:01:41.651019 | 
2026-08-26 05:01:41.651099 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-08-26 05:01:41.860175 | instance | changed
2026-08-26 05:01:41.865922 | 
2026-08-26 05:01:41.865991 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-08-26 05:01:42.067823 | instance | environment: line 5: kubectl: command not found
2026-08-26 05:01:42.068498 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-26 05:01:42.069066 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-26 05:01:42.069157 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-26 05:01:42.400389 | instance | ok: Runtime: 0:00:00.009148
2026-08-26 05:01:42.407732 | 
2026-08-26 05:01:42.407821 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-08-26 05:01:43.071352 | instance | changed:
2026-08-26 05:01:43.071523 | instance | cd+++++++++ objects/
2026-08-26 05:01:43.071556 | instance | cd+++++++++ objects/cluster/
2026-08-26 05:01:43.071579 | instance | cd+++++++++ objects/namespaced/
2026-08-26 05:01:43.080978 | 
2026-08-26 05:01:43.081079 | TASK [gather-pod-logs : creating directory for pod logs]
2026-08-26 05:01:43.276001 | instance | changed
2026-08-26 05:01:43.280807 | 
2026-08-26 05:01:43.280870 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-08-26 05:01:43.486432 | instance | changed
2026-08-26 05:01:43.523086 | 
2026-08-26 05:01:43.523191 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-08-26 05:01:43.736843 | instance | environment: line 3: kubectl: command not found
2026-08-26 05:01:44.061403 | instance | ok: Runtime: 0:00:00.007476
2026-08-26 05:01:44.068782 | 
2026-08-26 05:01:44.068873 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-08-26 05:01:45.169422 | instance | changed:
2026-08-26 05:01:45.169590 | instance | cd+++++++++ pod-logs/
2026-08-26 05:01:45.169627 | instance | cd+++++++++ pod-logs/failed-pods/
2026-08-26 05:01:45.180371 | 
2026-08-26 05:01:45.180602 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-08-26 05:01:45.386000 | instance | changed
2026-08-26 05:01:45.395181 | 
2026-08-26 05:01:45.395284 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-08-26 05:01:45.608713 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-26 05:01:45.940104 | instance | ok: Runtime: 0:00:00.036012
2026-08-26 05:01:45.946543 | 
2026-08-26 05:01:45.946621 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-08-26 05:01:46.157676 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-26 05:01:46.192213 | instance | ceph-mgr endpoints:
2026-08-26 05:01:46.481482 | instance | ok: Runtime: 0:00:00.042465
2026-08-26 05:01:46.489589 | 
2026-08-26 05:01:46.489658 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-08-26 05:01:46.754781 | instance | /bin/bash: line 4: kubectl: command not found
2026-08-26 05:01:47.024151 | instance | ok: Runtime: 0:00:00.040468
2026-08-26 05:01:47.029109 | 
2026-08-26 05:01:47.029173 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-08-26 05:01:47.730168 | instance | changed: cd+++++++++ prometheus/
2026-08-26 05:01:47.742574 | 
2026-08-26 05:01:47.742639 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-08-26 05:01:47.970387 | instance | changed
2026-08-26 05:01:47.976844 | 
2026-08-26 05:01:47.976932 | TASK [gather-selenium-data : Get selenium data]
2026-08-26 05:01:48.249375 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-08-26 05:01:48.251048 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-08-26 05:01:48.513724 | instance | ERROR
2026-08-26 05:01:48.513901 | instance | {
2026-08-26 05:01:48.513931 | instance |   "delta": "0:00:00.008051",
2026-08-26 05:01:48.513952 | instance |   "end": "2026-08-26 05:01:48.251538",
2026-08-26 05:01:48.513974 | instance |   "msg": "non-zero return code",
2026-08-26 05:01:48.513994 | instance |   "rc": 1,
2026-08-26 05:01:48.514013 | instance |   "start": "2026-08-26 05:01:48.243487"
2026-08-26 05:01:48.514031 | instance | }
2026-08-26 05:01:48.514054 | instance | ERROR: Ignoring Errors
2026-08-26 05:01:48.518674 | 
2026-08-26 05:01:48.518735 | TASK [gather-selenium-data : Downloads logs to executor]
2026-08-26 05:01:48.985548 | instance | changed: cd+++++++++ selenium/
2026-08-26 05:01:48.995664 | 
2026-08-26 05:01:48.995759 | PLAY RECAP
2026-08-26 05:01:48.995835 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-08-26 05:01:48.995863 | 
2026-08-26 05:01:49.126247 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-26 05:01:49.129016 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 05:01:50.748673 | 
2026-08-26 05:01:50.748839 | PLAY [all]
2026-08-26 05:01:50.761630 | 
2026-08-26 05:01:50.761715 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-26 05:01:50.805996 | instance | skipping: Conditional result was False
2026-08-26 05:01:50.814801 | 
2026-08-26 05:01:50.814906 | TASK [fetch-output : Set log path for single node]
2026-08-26 05:01:50.857167 | instance | ok
2026-08-26 05:01:50.863353 | 
2026-08-26 05:01:50.863429 | LOOP [fetch-output : Ensure local output dirs]
2026-08-26 05:01:51.707650 | instance -> localhost | ok: "/var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/logs"
2026-08-26 05:01:51.914345 | instance -> localhost | changed: "/var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/artifacts"
2026-08-26 05:01:52.141905 | instance -> localhost | changed: "/var/lib/zuul/builds/9baef1b019ef4502ae2dc3e8e19489bf/work/docs"
2026-08-26 05:01:52.155553 | 
2026-08-26 05:01:52.155698 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-26 05:01:52.970759 | instance | changed: .d..t...... ./
2026-08-26 05:01:52.971007 | instance | changed: All items complete
2026-08-26 05:01:52.971047 | 
2026-08-26 05:01:53.407873 | instance | changed: .d..t...... ./
2026-08-26 05:01:53.858339 | instance | changed: .d..t...... ./
2026-08-26 05:01:53.881993 | 
2026-08-26 05:01:53.882133 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-26 05:01:54.317566 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007868
2026-08-26 05:01:54.545475 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007013
2026-08-26 05:01:54.563254 | 
2026-08-26 05:01:54.563381 | PLAY [all]
2026-08-26 05:01:54.569777 | 
2026-08-26 05:01:54.569841 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-26 05:01:54.996540 | instance | changed
2026-08-26 05:01:55.004273 | 
2026-08-26 05:01:55.004344 | PLAY RECAP
2026-08-26 05:01:55.004405 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 05:01:55.004437 | 
2026-08-26 05:01:55.118166 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 05:01:55.122612 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-26 05:01:55.927482 | 
2026-08-26 05:01:55.927649 | PLAY [localhost]
2026-08-26 05:01:55.939546 | 
2026-08-26 05:01:55.939623 | TASK [Generate Zuul manifest]
2026-08-26 05:01:55.962289 | localhost | ok
2026-08-26 05:01:56.033970 | 
2026-08-26 05:01:56.034145 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-26 05:01:56.472351 | localhost | changed
2026-08-26 05:01:56.485122 | 
2026-08-26 05:01:56.485205 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-26 05:01:56.741625 | localhost | ok
2026-08-26 05:01:56.750188 | 
2026-08-26 05:01:56.750268 | TASK [Upload logs]
2026-08-26 05:01:56.783555 | localhost | ok
2026-08-26 05:01:57.009341 | 
2026-08-26 05:01:57.009513 | TASK [Set zuul-log-path fact]
2026-08-26 05:01:57.032558 | localhost | ok
2026-08-26 05:01:57.059065 | 
2026-08-26 05:01:57.059138 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 05:01:57.092728 | localhost | ok
2026-08-26 05:01:57.100655 | 
2026-08-26 05:01:57.100725 | TASK [upload-logs : Create log directories]
2026-08-26 05:01:57.488151 | localhost | changed
2026-08-26 05:01:57.494804 | 
2026-08-26 05:01:57.494890 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-26 05:01:57.881650 | localhost -> localhost | ok: Runtime: 0:00:00.005142
2026-08-26 05:01:57.888346 | 
2026-08-26 05:01:57.888437 | TASK [upload-logs : Upload logs to log server]
2026-08-26 05:01:58.387829 | localhost | Output suppressed because no_log was given
2026-08-26 05:01:58.432602 | 
2026-08-26 05:01:58.432765 | LOOP [upload-logs : Compress console log and json output]
2026-08-26 05:01:58.481863 | localhost | skipping: Conditional result was False
2026-08-26 05:01:58.488797 | localhost | skipping: Conditional result was False
2026-08-26 05:01:58.499166 | 
2026-08-26 05:01:58.499397 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-26 05:01:58.544575 | localhost | skipping: Conditional result was False
2026-08-26 05:01:58.545026 | 
2026-08-26 05:01:58.548256 | localhost | skipping: Conditional result was False
2026-08-26 05:01:58.567243 | 
2026-08-26 05:01:58.567542 | LOOP [upload-logs : Upload console log and json output]