2026-04-13 03:19:10.272640 | Job console starting
2026-04-13 03:19:10.284139 | Updating git repos
2026-04-13 03:19:10.336725 | Cloning repos into workspace
2026-04-13 03:19:10.398993 | Restoring repo states
2026-04-13 03:19:10.420268 | Merging changes
2026-04-13 03:19:11.375363 | Checking out repos
2026-04-13 03:19:11.475453 | Preparing playbooks
2026-04-13 03:19:13.431337 | Running Ansible setup
2026-04-13 03:19:16.877236 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:19:17.533504 | 
2026-04-13 03:19:17.533856 | PLAY [localhost]
2026-04-13 03:19:17.543433 | 
2026-04-13 03:19:17.543535 | TASK [Gathering Facts]
2026-04-13 03:19:18.435401 | localhost | ok
2026-04-13 03:19:18.445372 | 
2026-04-13 03:19:18.445470 | TASK [Setup log path fact]
2026-04-13 03:19:18.468586 | localhost | ok
2026-04-13 03:19:18.483267 | 
2026-04-13 03:19:18.483341 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:19:18.515766 | localhost | ok
2026-04-13 03:19:18.524909 | 
2026-04-13 03:19:18.525012 | TASK [emit-job-header : Print job information]
2026-04-13 03:19:18.579168 | # Job Information
2026-04-13 03:19:18.579341 | Ansible Version: 2.16.16
2026-04-13 03:19:18.579380 | Job: atmosphere-molecule-csi-rbd
2026-04-13 03:19:18.579409 | Pipeline: check
2026-04-13 03:19:18.579440 | Executor: 0a8996d2b663
2026-04-13 03:19:18.579465 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:19:18.579490 | Event ID: 72d011e0-36e7-11f1-9d04-92185c998148
2026-04-13 03:19:18.587796 | 
2026-04-13 03:19:18.587882 | LOOP [emit-job-header : Print node information]
2026-04-13 03:19:18.722971 | localhost | ok:
2026-04-13 03:19:18.723381 | localhost | # Node Information
2026-04-13 03:19:18.723436 | localhost | Inventory Hostname: instance
2026-04-13 03:19:18.723477 | localhost | Hostname: np0000165443
2026-04-13 03:19:18.723516 | localhost | Username: zuul
2026-04-13 03:19:18.723575 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:19:18.723657 | localhost | Provider: yul1
2026-04-13 03:19:18.723697 | localhost | Region: ca-ymq-1
2026-04-13 03:19:18.723726 | localhost | Label: ubuntu-jammy
2026-04-13 03:19:18.723759 | localhost | Product Name: OpenStack Nova
2026-04-13 03:19:18.723812 | localhost | Interface IP: 162.253.55.43
2026-04-13 03:19:18.739112 | 
2026-04-13 03:19:18.739351 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:19:19.221562 | localhost -> localhost | changed
2026-04-13 03:19:19.229998 | 
2026-04-13 03:19:19.230109 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:19:20.437567 | localhost -> localhost | changed
2026-04-13 03:19:20.449230 | 
2026-04-13 03:19:20.449287 | PLAY [all]
2026-04-13 03:19:20.459112 | 
2026-04-13 03:19:20.459180 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:19:20.737346 | instance -> localhost | ok
2026-04-13 03:19:20.750054 | 
2026-04-13 03:19:20.750173 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:19:20.781914 | instance | ok
2026-04-13 03:19:20.799374 | instance | included: /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:19:20.806327 | 
2026-04-13 03:19:20.806415 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:19:21.641974 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:19:21.642150 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/f9388ed736874c1dbe8e05b0a7cd2561_id_rsa
2026-04-13 03:19:21.642180 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/f9388ed736874c1dbe8e05b0a7cd2561_id_rsa.pub
2026-04-13 03:19:21.642202 | instance -> localhost | The key fingerprint is:
2026-04-13 03:19:21.642224 | instance -> localhost | SHA256:1enyaNQaU46kWO5CU02S3meZzRAKRTeJ2wPjAdhRHek zuul-build-sshkey
2026-04-13 03:19:21.642258 | instance -> localhost | The key's randomart image is:
2026-04-13 03:19:21.642279 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:19:21.642305 | instance -> localhost | |       o=B=o==   |
2026-04-13 03:19:21.642327 | instance -> localhost | |      . o==+=o   |
2026-04-13 03:19:21.642348 | instance -> localhost | |       .oo=B+*   |
2026-04-13 03:19:21.642369 | instance -> localhost | |       =.++*E o  |
2026-04-13 03:19:21.642389 | instance -> localhost | |      + S *o+.   |
2026-04-13 03:19:21.642409 | instance -> localhost | |     . o . B     |
2026-04-13 03:19:21.642428 | instance -> localhost | |      . . + .    |
2026-04-13 03:19:21.642448 | instance -> localhost | |       . .       |
2026-04-13 03:19:21.642470 | instance -> localhost | |                 |
2026-04-13 03:19:21.642490 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:19:21.642537 | instance -> localhost | ok: Runtime: 0:00:00.303616
2026-04-13 03:19:21.647420 | 
2026-04-13 03:19:21.647480 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:19:21.681694 | instance | ok
2026-04-13 03:19:21.690070 | instance | included: /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:19:21.697304 | 
2026-04-13 03:19:21.697366 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:19:21.721825 | instance | skipping: Conditional result was False
2026-04-13 03:19:21.732032 | 
2026-04-13 03:19:21.732117 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:19:22.149922 | instance | changed
2026-04-13 03:19:22.155204 | 
2026-04-13 03:19:22.155278 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:19:22.336035 | instance | ok
2026-04-13 03:19:22.341003 | 
2026-04-13 03:19:22.341067 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:19:22.805995 | instance | changed
2026-04-13 03:19:22.812241 | 
2026-04-13 03:19:22.812314 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:19:23.258335 | instance | changed
2026-04-13 03:19:23.266022 | 
2026-04-13 03:19:23.266161 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:19:23.290658 | instance | skipping: Conditional result was False
2026-04-13 03:19:23.298063 | 
2026-04-13 03:19:23.298157 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:19:23.676131 | instance -> localhost | changed
2026-04-13 03:19:23.690757 | 
2026-04-13 03:19:23.690934 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:19:23.976287 | instance -> localhost | Identity added: /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/f9388ed736874c1dbe8e05b0a7cd2561_id_rsa (zuul-build-sshkey)
2026-04-13 03:19:23.976497 | instance -> localhost | ok: Runtime: 0:00:00.013609
2026-04-13 03:19:23.983344 | 
2026-04-13 03:19:23.983411 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:19:24.325337 | instance | ok
2026-04-13 03:19:24.330439 | 
2026-04-13 03:19:24.330507 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:19:24.356678 | instance | skipping: Conditional result was False
2026-04-13 03:19:24.374138 | 
2026-04-13 03:19:24.374261 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:19:24.715280 | instance | ok
2026-04-13 03:19:24.724092 | 
2026-04-13 03:19:24.724241 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:19:26.466280 | instance | Output suppressed because no_log was given
2026-04-13 03:19:26.474846 | 
2026-04-13 03:19:26.474909 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:19:26.650199 | instance | ok: "logs"
2026-04-13 03:19:26.650691 | instance | ok: All items complete
2026-04-13 03:19:26.650729 | 
2026-04-13 03:19:26.818388 | instance | ok: "artifacts"
2026-04-13 03:19:26.966959 | instance | ok: "docs"
2026-04-13 03:19:26.983034 | 
2026-04-13 03:19:26.983191 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:19:27.175938 | instance | changed: "logs"
2026-04-13 03:19:27.329065 | instance | changed: "artifacts"
2026-04-13 03:19:27.483113 | instance | changed: "docs"
2026-04-13 03:19:27.490600 | 
2026-04-13 03:19:27.491218 | PLAY RECAP
2026-04-13 03:19:27.491288 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:19:27.491331 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:27.491362 | 
2026-04-13 03:19:27.614782 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:19:27.616792 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:19:28.179160 | 
2026-04-13 03:19:28.179279 | PLAY [all]
2026-04-13 03:19:28.198355 | 
2026-04-13 03:19:28.198588 | TASK [setup-uv : Extract archive]
2026-04-13 03:19:30.509014 | instance | changed
2026-04-13 03:19:30.514803 | 
2026-04-13 03:19:30.514890 | TASK [setup-uv : Print version]
2026-04-13 03:19:30.214071 | instance | uv 0.8.13
2026-04-13 03:19:31.052638 | instance | ok: Runtime: 0:00:00.014330
2026-04-13 03:19:31.059782 | 
2026-04-13 03:19:31.059839 | PLAY RECAP
2026-04-13 03:19:31.059885 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:31.059909 | 
2026-04-13 03:19:31.183566 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:19:31.186307 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:19:31.854343 | 
2026-04-13 03:19:31.854499 | PLAY [all]
2026-04-13 03:19:31.875515 | 
2026-04-13 03:19:31.875743 | TASK [Install "jq" for log collection]
2026-04-13 03:19:42.073280 | instance | changed
2026-04-13 03:19:42.077504 | 
2026-04-13 03:19:42.077597 | PLAY [all]
2026-04-13 03:19:42.085608 | 
2026-04-13 03:19:42.085704 | TASK [ensure-go : Check installed go version]
2026-04-13 03:19:42.627397 | instance | ok: ERROR (ignored)
2026-04-13 03:19:42.627761 | instance | {
2026-04-13 03:19:42.627807 | instance |   "failed_when_result": false,
2026-04-13 03:19:42.627840 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:19:42.627869 | instance |   "rc": 2
2026-04-13 03:19:42.627896 | instance | }
2026-04-13 03:19:42.635039 | 
2026-04-13 03:19:42.635139 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:19:42.688357 | instance | ok
2026-04-13 03:19:42.700897 | instance | included: /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:19:42.705917 | 
2026-04-13 03:19:42.705989 | TASK [ensure-go : Create temp directory]
2026-04-13 03:19:43.008187 | instance | changed
2026-04-13 03:19:43.014556 | 
2026-04-13 03:19:43.014640 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:19:43.597219 | instance | ok: OK (64 bytes)
2026-04-13 03:19:43.604934 | 
2026-04-13 03:19:43.605075 | TASK [ensure-go : Download go archive]
2026-04-13 03:19:44.949804 | instance | changed: OK (78559214 bytes)
2026-04-13 03:19:44.959219 | 
2026-04-13 03:19:44.959400 | TASK [ensure-go : Install go]
2026-04-13 03:19:50.796345 | instance | changed
2026-04-13 03:19:50.803729 | 
2026-04-13 03:19:50.803808 | PLAY RECAP
2026-04-13 03:19:50.803862 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:19:50.803890 | 
2026-04-13 03:19:50.921704 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:19:50.925812 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:19:51.464384 | 
2026-04-13 03:19:51.464501 | PLAY [all]
2026-04-13 03:19:51.475508 | 
2026-04-13 03:19:51.475584 | TASK [Copy inventory file for Zuul]
2026-04-13 03:19:52.329920 | instance | changed
2026-04-13 03:19:52.336561 | 
2026-04-13 03:19:52.336657 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:19:52.603662 | instance | changed: 1 replacements made
2026-04-13 03:19:52.610787 | 
2026-04-13 03:19:52.610875 | TASK [Run Molecule scenario]
2026-04-13 03:19:53.028593 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:19:53.028764 | instance | Creating virtual environment at: .venv
2026-04-13 03:19:53.056454 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:19:53.068209 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:19:53.081915 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:19:53.082111 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:19:53.085126 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:19:53.088531 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:19:53.088859 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:19:53.089202 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:19:53.089528 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:19:53.091658 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:19:53.405742 | instance |    Building pyperclip==1.9.0
2026-04-13 03:19:53.414251 | instance |  Downloading rjsonnet
2026-04-13 03:19:53.504668 | instance |  Downloading pydantic-core
2026-04-13 03:19:53.558013 | instance |  Downloading netaddr
2026-04-13 03:19:53.567790 | instance |  Downloading pygments
2026-04-13 03:19:53.576947 | instance |  Downloading cryptography
2026-04-13 03:19:53.603081 | instance |  Downloading setuptools
2026-04-13 03:19:53.653644 | instance |  Downloading kubernetes
2026-04-13 03:19:53.679321 | instance |  Downloading ansible-core
2026-04-13 03:19:53.707369 | instance |  Downloading openstacksdk
2026-04-13 03:19:54.109795 | instance |       Built pyperclip==1.9.0
2026-04-13 03:19:54.294724 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:19:54.342843 | instance | Installed 83 packages in 46ms
2026-04-13 03:19:54.955496 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:19:55.523956 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:19:55.524055 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:20:38.414021 | instance | INFO     [csi > dependency] Executing
2026-04-13 03:20:38.414199 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:20:38.414396 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:20:38.414512 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:20:38.422033 | instance | INFO     [csi > cleanup] Executing
2026-04-13 03:20:38.422327 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:20:38.429777 | instance | INFO     [csi > destroy] Executing
2026-04-13 03:20:38.429830 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:20:38.429911 | instance | INFO     [csi > destroy] Executed: Successful
2026-04-13 03:20:38.437295 | instance | INFO     [csi > syntax] Executing
2026-04-13 03:20:39.228844 | instance |
2026-04-13 03:20:39.229162 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:20:39.266542 | instance | INFO     [csi > syntax] Executed: Successful
2026-04-13 03:20:39.279126 | instance | INFO     [csi > create] Executing
2026-04-13 03:20:39.284022 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:20:39.294261 | instance | INFO     [csi > prepare] Executing
2026-04-13 03:20:40.053852 | instance |
2026-04-13 03:20:40.054146 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:20:40.054412 | instance |
2026-04-13 03:20:40.054689 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:20:40.054967 | instance | Monday 13 April 2026  03:20:40 +0000 (0:00:00.025)       0:00:00.025 **********
2026-04-13 03:20:41.154681 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:20:41.154803 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:20:41.154965 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:20:41.155124 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:20:41.155294 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:20:41.163107 | instance | ok: [instance]
2026-04-13 03:20:41.163247 | instance |
2026-04-13 03:20:41.163411 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:20:41.163585 | instance | Monday 13 April 2026  03:20:41 +0000 (0:00:01.110)       0:00:01.136 **********
2026-04-13 03:20:41.825273 | instance | changed: [instance]
2026-04-13 03:20:41.825401 | instance |
2026-04-13 03:20:41.825567 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:20:41.825731 | instance | Monday 13 April 2026  03:20:41 +0000 (0:00:00.661)       0:00:01.797 **********
2026-04-13 03:20:42.083166 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:20:42.083457 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:20:42.083740 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:20:42.090604 | instance | changed: [instance]
2026-04-13 03:20:42.090861 | instance |
2026-04-13 03:20:42.091135 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:20:42.091462 | instance | Monday 13 April 2026  03:20:42 +0000 (0:00:00.265)       0:00:02.063 **********
2026-04-13 03:20:42.826968 | instance | ok: [instance]
2026-04-13 03:20:42.827134 | instance |
2026-04-13 03:20:42.827331 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:20:42.827548 | instance |
2026-04-13 03:20:42.827755 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:20:42.827983 | instance | Monday 13 April 2026  03:20:42 +0000 (0:00:00.736)       0:00:02.799 **********
2026-04-13 03:20:43.505380 | instance | ok: [instance]
2026-04-13 03:20:43.505607 | instance |
2026-04-13 03:20:43.505898 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:20:43.506182 | instance | Monday 13 April 2026  03:20:43 +0000 (0:00:00.678)       0:00:03.478 **********
2026-04-13 03:21:05.997761 | instance | changed: [instance]
2026-04-13 03:21:05.998009 | instance |
2026-04-13 03:21:05.998284 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:21:05.998559 | instance | Monday 13 April 2026  03:21:05 +0000 (0:00:22.492)       0:00:25.970 **********
2026-04-13 03:21:06.517682 | instance | ok: [instance]
2026-04-13 03:21:06.517762 | instance |
2026-04-13 03:21:06.517945 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:21:06.518106 | instance | Monday 13 April 2026  03:21:06 +0000 (0:00:00.520)       0:00:26.490 **********
2026-04-13 03:21:06.801535 | instance | ok: [instance]
2026-04-13 03:21:06.801774 | instance |
2026-04-13 03:21:06.802052 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:21:06.802344 | instance | Monday 13 April 2026  03:21:06 +0000 (0:00:00.283)       0:00:26.774 **********
2026-04-13 03:21:07.435296 | instance | changed: [instance]
2026-04-13 03:21:07.435488 | instance |
2026-04-13 03:21:07.435761 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:21:07.436035 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.633)       0:00:27.407 **********
2026-04-13 03:21:07.645757 | instance | ok: [instance]
2026-04-13 03:21:07.645967 | instance |
2026-04-13 03:21:07.646252 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:21:07.646579 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.210)       0:00:27.618 **********
2026-04-13 03:21:07.668024 | instance | skipping: [instance]
2026-04-13 03:21:07.668268 | instance |
2026-04-13 03:21:07.668566 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:21:07.668884 | instance | Monday 13 April 2026  03:21:07 +0000 (0:00:00.022)       0:00:27.640 **********
2026-04-13 03:21:08.204056 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:08.204152 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:08.204164 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:08.204217 | instance |
2026-04-13 03:21:08.204500 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:21:08.204835 | instance | Monday 13 April 2026  03:21:08 +0000 (0:00:00.534)       0:00:28.175 **********
2026-04-13 03:21:08.850321 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:08.850436 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:08.850564 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:08.850720 | instance |
2026-04-13 03:21:08.850912 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:21:08.851083 | instance | Monday 13 April 2026  03:21:08 +0000 (0:00:00.647)       0:00:28.823 **********
2026-04-13 03:21:09.533513 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:09.533792 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:09.534080 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:09.534358 | instance |
2026-04-13 03:21:09.534699 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:21:09.535008 | instance | Monday 13 April 2026  03:21:09 +0000 (0:00:00.682)       0:00:29.506 **********
2026-04-13 03:21:12.724307 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:21:12.724468 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:21:12.724654 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:21:12.724816 | instance |
2026-04-13 03:21:12.724991 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:21:12.725162 | instance | Monday 13 April 2026  03:21:12 +0000 (0:00:03.190)       0:00:32.697 **********
2026-04-13 03:21:14.744670 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:21:14.744941 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:21:14.745210 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:21:14.745462 | instance |
2026-04-13 03:21:14.745721 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:21:14.746040 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:21:14.746370 | instance |
2026-04-13 03:21:14.746648 | instance | Monday 13 April 2026  03:21:14 +0000 (0:00:02.020)       0:00:34.717 **********
2026-04-13 03:21:14.746928 | instance | ===============================================================================
2026-04-13 03:21:14.747262 | instance | Install depedencies ---------------------------------------------------- 22.49s
2026-04-13 03:21:14.747552 | instance | Create a volume group for each loop device ------------------------------ 3.19s
2026-04-13 03:21:14.747840 | instance | Create a logical volume for each loop device ---------------------------- 2.02s
2026-04-13 03:21:14.748098 | instance | Gathering Facts --------------------------------------------------------- 1.11s
2026-04-13 03:21:14.748361 | instance | Purge "snapd" package --------------------------------------------------- 0.74s
2026-04-13 03:21:14.748709 | instance | Start loop devices ------------------------------------------------------ 0.68s
2026-04-13 03:21:14.748973 | instance | Gathering Facts --------------------------------------------------------- 0.68s
2026-04-13 03:21:14.749249 | instance | Configure short hostname ------------------------------------------------ 0.66s
2026-04-13 03:21:14.749585 | instance | Set permissions on loopback devices ------------------------------------- 0.65s
2026-04-13 03:21:14.749864 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.63s
2026-04-13 03:21:14.750145 | instance | Create devices for Ceph ------------------------------------------------- 0.53s
2026-04-13 03:21:14.750385 | instance | Start up service -------------------------------------------------------- 0.52s
2026-04-13 03:21:14.750642 | instance | Generate lvm.conf ------------------------------------------------------- 0.28s
2026-04-13 03:21:14.750903 | instance | Ensure hostname inside hosts file --------------------------------------- 0.27s
2026-04-13 03:21:14.751294 | instance | Get list of all loopback devices ---------------------------------------- 0.21s
2026-04-13 03:21:14.751597 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-13 03:21:14.815638 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-13 03:21:14.829520 | instance | INFO     [csi > converge] Executing
2026-04-13 03:21:15.572097 | instance |
2026-04-13 03:21:15.572294 | instance | PLAY [Debug CSI driver value] **************************************************
2026-04-13 03:21:15.572572 | instance |
2026-04-13 03:21:15.572846 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:21:15.573117 | instance | Monday 13 April 2026  03:21:15 +0000 (0:00:00.007)       0:00:00.007 **********
2026-04-13 03:21:16.469854 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:21:16.470137 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:21:16.470492 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:21:16.470785 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:21:16.471088 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:21:16.479830 | instance | ok: [instance]
2026-04-13 03:21:16.480085 | instance |
2026-04-13 03:21:16.480362 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-04-13 03:21:16.480667 | instance | Monday 13 April 2026  03:21:16 +0000 (0:00:00.908)       0:00:00.915 **********
2026-04-13 03:21:16.511622 | instance | ok: [instance] => {
2026-04-13 03:21:16.511919 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-04-13 03:21:16.512194 | instance | }
2026-04-13 03:21:16.512459 | instance |
2026-04-13 03:21:16.512779 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:21:16.513075 | instance |
2026-04-13 03:21:16.513325 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:21:16.513611 | instance | Monday 13 April 2026  03:21:16 +0000 (0:00:00.031)       0:00:00.947 **********
2026-04-13 03:21:23.126333 | instance | changed: [localhost]
2026-04-13 03:21:23.126518 | instance |
2026-04-13 03:21:23.126798 | instance | TASK [Deploy with parallel orchestrator (with ceph)] ***************************
2026-04-13 03:21:23.127076 | instance | Monday 13 April 2026  03:21:23 +0000 (0:00:06.614)       0:00:07.561 **********
2026-04-13 03:21:23.753631 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../playbooks", "--tags", "ceph,kubernetes,csi"], "delta": "0:00:00.448703", "end": "2026-04-13 03:21:23.731695", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:21:23.282992", "stderr": "Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\ncomponent kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "stderr_lines": ["Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1"], "stdout": "==> Multi-tag mode: ceph, kubernetes, csi\n==> Starting parallel deployment (subgraph)\n==> [kubernetes] Starting deployment\n==> [ceph] Starting deployment\n[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks\n[kubernetes] \n[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may\n[kubernetes] be elsewhere in the file depending on the exact syntax problem.\n[kubernetes] \n[kubernetes] The offending line appears to be:\n[kubernetes] \n[kubernetes]   roles:\n[kubernetes]     - role: defaults\n[kubernetes]       ^ here\n[ceph] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks\n[ceph] \n[ceph] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/ceph.yml': line 27, column 7, but may\n[ceph] be elsewhere in the file depending on the exact syntax problem.\n[ceph] \n[ceph] The offending line appears to be:\n[ceph] \n[ceph]   roles:\n[ceph]     - role: defaults\n[ceph]       ^ here", "stdout_lines": ["==> Multi-tag mode: ceph, kubernetes, csi", "==> Starting parallel deployment (subgraph)", "==> [kubernetes] Starting deployment", "==> [ceph] Starting deployment", "[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks", "[kubernetes] ", "[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may", "[kubernetes] be elsewhere in the file depending on the exact syntax problem.", "[kubernetes] ", "[kubernetes] The offending line appears to be:", "[kubernetes] ", "[kubernetes]   roles:", "[kubernetes]     - role: defaults", "[kubernetes]       ^ here", "[ceph] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks", "[ceph] ", "[ceph] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/ceph.yml': line 27, column 7, but may", "[ceph] be elsewhere in the file depending on the exact syntax problem.", "[ceph] ", "[ceph] The offending line appears to be:", "[ceph] ", "[ceph]   roles:", "[ceph]     - role: defaults", "[ceph]       ^ here"]}
2026-04-13 03:21:23.754423 | instance |
2026-04-13 03:21:23.754743 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:21:23.755081 | instance | instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-13 03:21:23.755389 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-04-13 03:21:23.755666 | instance |
2026-04-13 03:21:23.755961 | instance | Monday 13 April 2026  03:21:23 +0000 (0:00:00.628)       0:00:08.190 **********
2026-04-13 03:21:23.756245 | instance | ===============================================================================
2026-04-13 03:21:23.756565 | instance | Build atmosphere binary ------------------------------------------------- 6.61s
2026-04-13 03:21:23.756857 | instance | Gathering Facts --------------------------------------------------------- 0.91s
2026-04-13 03:21:23.757159 | instance | Deploy with parallel orchestrator (with ceph) --------------------------- 0.63s
2026-04-13 03:21:23.757451 | instance | Display CSI driver value and environment variable ----------------------- 0.03s
2026-04-13 03:21:23.812929 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:21:23.813094 | instance | ERROR    [csi > converge] Executed: Failed
2026-04-13 03:21:23.813232 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:21:24.263468 | instance | ERROR
2026-04-13 03:21:24.263772 | instance | {
2026-04-13 03:21:24.263826 | instance |   "delta": "0:01:30.925542",
2026-04-13 03:21:24.263858 | instance |   "end": "2026-04-13 03:21:23.889327",
2026-04-13 03:21:24.263885 | instance |   "msg": "non-zero return code",
2026-04-13 03:21:24.263910 | instance |   "rc": 2,
2026-04-13 03:21:24.263940 | instance |   "start": "2026-04-13 03:19:52.963785"
2026-04-13 03:21:24.263965 | instance | }
failure
2026-04-13 03:21:24.268144 | 
2026-04-13 03:21:24.268209 | PLAY RECAP
2026-04-13 03:21:24.268274 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:21:24.268304 | 
2026-04-13 03:21:24.439230 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:21:24.441419 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:21:25.139971 | 
2026-04-13 03:21:25.140107 | PLAY [all]
2026-04-13 03:21:25.156778 | 
2026-04-13 03:21:25.156916 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:21:25.525502 | instance | changed
2026-04-13 03:21:25.535253 | 
2026-04-13 03:21:25.535537 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:21:25.943570 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:21:25.955386 | instance | + ip addr
2026-04-13 03:21:25.956748 | instance | + ip route
2026-04-13 03:21:25.957843 | instance | + lsblk
2026-04-13 03:21:25.960292 | instance | + mount
2026-04-13 03:21:25.961604 | instance | + docker images
2026-04-13 03:21:25.961974 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:21:25.962204 | instance | + brctl show
2026-04-13 03:21:25.962592 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:21:25.962806 | instance | + ps aux --sort=-%mem
2026-04-13 03:21:25.970936 | instance | + dpkg -l
2026-04-13 03:21:25.976564 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:21:25.976870 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:21:25.976900 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:21:25.977141 | instance | + '[' '!' -z '' ']'
2026-04-13 03:21:26.091080 | instance | ok: Runtime: 0:00:00.039061
2026-04-13 03:21:26.097743 | 
2026-04-13 03:21:26.097807 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:21:26.766895 | instance | changed:
2026-04-13 03:21:26.767090 | instance | created directory /var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/logs/instance
2026-04-13 03:21:26.767134 | instance | cd+++++++++ system/
2026-04-13 03:21:26.767168 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:21:26.767199 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:21:26.767228 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:21:26.767261 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:21:26.767292 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:21:26.767321 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:21:26.767352 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:21:26.767381 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:21:26.767409 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:21:26.780491 | 
2026-04-13 03:21:26.780579 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:21:26.985265 | instance | changed: "values"
2026-04-13 03:21:27.147019 | instance | changed: "releases"
2026-04-13 03:21:27.155075 | 
2026-04-13 03:21:27.155194 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:21:27.356543 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:21:27.691919 | instance | ok: Runtime: 0:00:00.005977
2026-04-13 03:21:27.697852 | 
2026-04-13 03:21:27.697920 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:21:28.184190 | instance | changed:
2026-04-13 03:21:28.184373 | instance | cd+++++++++ helm/
2026-04-13 03:21:28.184412 | instance | cd+++++++++ helm/releases/
2026-04-13 03:21:28.184456 | instance | cd+++++++++ helm/values/
2026-04-13 03:21:28.195687 | 
2026-04-13 03:21:28.195755 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:21:28.399309 | instance | changed
2026-04-13 03:21:28.407863 | 
2026-04-13 03:21:28.407989 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:21:28.623393 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:28.623596 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:28.629471 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:28.631014 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:28.631595 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.634024 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.636117 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:28.637045 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.637195 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:28.637873 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.639007 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:21:28.639630 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:21:28.948038 | instance | ok: Runtime: 0:00:00.023953
2026-04-13 03:21:28.953632 | 
2026-04-13 03:21:28.953722 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:21:29.147177 | instance | changed
2026-04-13 03:21:29.152878 | 
2026-04-13 03:21:29.152975 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:21:29.386473 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:21:29.387833 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:29.388314 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:29.388343 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:21:29.726729 | instance | ok: Runtime: 0:00:00.007789
2026-04-13 03:21:29.735346 | 
2026-04-13 03:21:29.735497 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:21:30.240889 | instance | changed:
2026-04-13 03:21:30.241127 | instance | cd+++++++++ objects/
2026-04-13 03:21:30.241170 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:21:30.241201 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:21:30.252626 | 
2026-04-13 03:21:30.252700 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:21:30.465643 | instance | changed
2026-04-13 03:21:30.472664 | 
2026-04-13 03:21:30.472754 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:21:30.693897 | instance | changed
2026-04-13 03:21:30.698795 | 
2026-04-13 03:21:30.698865 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:21:30.922386 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:21:31.236489 | instance | ok: Runtime: 0:00:00.007747
2026-04-13 03:21:31.241521 | 
2026-04-13 03:21:31.241589 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:21:31.751042 | instance | changed:
2026-04-13 03:21:31.751290 | instance | cd+++++++++ pod-logs/
2026-04-13 03:21:31.751330 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:21:31.763828 | 
2026-04-13 03:21:31.763909 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:21:31.971679 | instance | changed
2026-04-13 03:21:31.978600 | 
2026-04-13 03:21:31.978723 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:21:32.177417 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:21:32.515806 | instance | ok: Runtime: 0:00:00.040559
2026-04-13 03:21:32.522340 | 
2026-04-13 03:21:32.522428 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:21:32.738073 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:21:32.767432 | instance | ceph-mgr endpoints:
2026-04-13 03:21:33.056677 | instance | ok: Runtime: 0:00:00.036760
2026-04-13 03:21:33.062011 | 
2026-04-13 03:21:33.062138 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:21:33.288174 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:21:33.595748 | instance | ok: Runtime: 0:00:00.037657
2026-04-13 03:21:33.603199 | 
2026-04-13 03:21:33.603304 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:21:34.089795 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:21:34.101306 | 
2026-04-13 03:21:34.101371 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:21:34.316847 | instance | changed
2026-04-13 03:21:34.323781 | 
2026-04-13 03:21:34.323862 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:21:34.533498 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:21:34.534468 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:21:34.860131 | instance | ERROR
2026-04-13 03:21:34.860347 | instance | {
2026-04-13 03:21:34.860392 | instance |   "delta": "0:00:00.004790",
2026-04-13 03:21:34.860422 | instance |   "end": "2026-04-13 03:21:34.534743",
2026-04-13 03:21:34.860450 | instance |   "msg": "non-zero return code",
2026-04-13 03:21:34.860477 | instance |   "rc": 1,
2026-04-13 03:21:34.860502 | instance |   "start": "2026-04-13 03:21:34.529953"
2026-04-13 03:21:34.860528 | instance | }
2026-04-13 03:21:34.860563 | instance | ERROR: Ignoring Errors
2026-04-13 03:21:34.870484 | 
2026-04-13 03:21:34.870631 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:21:35.359072 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:21:35.367477 | 
2026-04-13 03:21:35.367550 | PLAY RECAP
2026-04-13 03:21:35.367613 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:21:35.367644 | 
2026-04-13 03:21:35.486079 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:21:35.491441 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:21:36.081825 | 
2026-04-13 03:21:36.081944 | PLAY [all]
2026-04-13 03:21:36.093625 | 
2026-04-13 03:21:36.093703 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:21:36.138604 | instance | skipping: Conditional result was False
2026-04-13 03:21:36.147744 | 
2026-04-13 03:21:36.147856 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:21:36.192354 | instance | ok
2026-04-13 03:21:36.197484 | 
2026-04-13 03:21:36.197551 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:21:36.626105 | instance -> localhost | ok: "/var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/logs"
2026-04-13 03:21:36.850624 | instance -> localhost | changed: "/var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/artifacts"
2026-04-13 03:21:37.065805 | instance -> localhost | changed: "/var/lib/zuul/builds/f9388ed736874c1dbe8e05b0a7cd2561/work/docs"
2026-04-13 03:21:37.087422 | 
2026-04-13 03:21:37.087604 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:21:37.725852 | instance | changed: .d..t...... ./
2026-04-13 03:21:37.726180 | instance | changed: All items complete
2026-04-13 03:21:37.726219 | 
2026-04-13 03:21:38.164570 | instance | changed: .d..t...... ./
2026-04-13 03:21:38.651926 | instance | changed: .d..t...... ./
2026-04-13 03:21:38.675272 | 
2026-04-13 03:21:38.675511 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:21:39.105246 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.009043
2026-04-13 03:21:39.317759 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006877
2026-04-13 03:21:39.336818 | 
2026-04-13 03:21:39.336997 | PLAY [all]
2026-04-13 03:21:39.343258 | 
2026-04-13 03:21:39.343325 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:21:39.744902 | instance | changed
2026-04-13 03:21:39.753658 | 
2026-04-13 03:21:39.753808 | PLAY RECAP
2026-04-13 03:21:39.753874 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:21:39.753906 | 
2026-04-13 03:21:39.927044 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:21:39.930099 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:21:40.499614 | 
2026-04-13 03:21:40.499934 | PLAY [localhost]
2026-04-13 03:21:40.509706 | 
2026-04-13 03:21:40.509782 | TASK [Generate Zuul manifest]
2026-04-13 03:21:40.533422 | localhost | ok
2026-04-13 03:21:40.548365 | 
2026-04-13 03:21:40.548451 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:21:40.866208 | localhost | changed
2026-04-13 03:21:40.881474 | 
2026-04-13 03:21:40.881674 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:21:40.916096 | localhost | ok
2026-04-13 03:21:40.925965 | 
2026-04-13 03:21:40.926109 | TASK [Upload logs]
2026-04-13 03:21:40.962437 | localhost | ok
2026-04-13 03:21:41.026120 | 
2026-04-13 03:21:41.026266 | TASK [Set zuul-log-path fact]
2026-04-13 03:21:41.050048 | localhost | ok
2026-04-13 03:21:41.062423 | 
2026-04-13 03:21:41.062571 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:21:41.097687 | localhost | ok
2026-04-13 03:21:41.105195 | 
2026-04-13 03:21:41.105294 | TASK [upload-logs : Create log directories]
2026-04-13 03:21:41.526753 | localhost | changed
2026-04-13 03:21:41.532440 | 
2026-04-13 03:21:41.532518 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:21:41.930640 | localhost -> localhost | ok: Runtime: 0:00:00.006402
2026-04-13 03:21:41.938034 | 
2026-04-13 03:21:41.938154 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:21:42.389446 | localhost | Output suppressed because no_log was given
2026-04-13 03:21:42.394983 | 
2026-04-13 03:21:42.395079 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:21:42.440654 | localhost | skipping: Conditional result was False
2026-04-13 03:21:42.447713 | localhost | skipping: Conditional result was False
2026-04-13 03:21:42.462820 | 
2026-04-13 03:21:42.463031 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:21:42.507505 | localhost | skipping: Conditional result was False
2026-04-13 03:21:42.507894 | 
2026-04-13 03:21:42.511350 | localhost | skipping: Conditional result was False
2026-04-13 03:21:42.530556 | 
2026-04-13 03:21:42.530741 | LOOP [upload-logs : Upload console log and json output]