2026-04-13 03:26:00.741616 | Job console starting
2026-04-13 03:26:00.753854 | Updating git repos
2026-04-13 03:26:00.832555 | Cloning repos into workspace
2026-04-13 03:26:00.912143 | Restoring repo states
2026-04-13 03:26:00.932189 | Merging changes
2026-04-13 03:26:02.173514 | Checking out repos
2026-04-13 03:26:02.270397 | Preparing playbooks
2026-04-13 03:26:10.918122 | Running Ansible setup
2026-04-13 03:26:17.212776 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:19.215238 | 
2026-04-13 03:26:19.215431 | PLAY [localhost]
2026-04-13 03:26:19.224866 | 
2026-04-13 03:26:19.224943 | TASK [Gathering Facts]
2026-04-13 03:26:20.088197 | localhost | ok
2026-04-13 03:26:20.100434 | 
2026-04-13 03:26:20.100506 | TASK [Setup log path fact]
2026-04-13 03:26:20.118281 | localhost | ok
2026-04-13 03:26:20.130077 | 
2026-04-13 03:26:20.130168 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:26:20.158600 | localhost | ok
2026-04-13 03:26:20.166741 | 
2026-04-13 03:26:20.166808 | TASK [emit-job-header : Print job information]
2026-04-13 03:26:20.205746 | # Job Information
2026-04-13 03:26:20.205944 | Ansible Version: 2.16.16
2026-04-13 03:26:20.206017 | Job: atmosphere-molecule-csi-local-path-provisioner
2026-04-13 03:26:20.206066 | Pipeline: check
2026-04-13 03:26:20.206111 | Executor: 0a8996d2b663
2026-04-13 03:26:20.206154 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:26:20.206256 | Event ID: 6af5c400-36e8-11f1-9a0c-69c921595019
2026-04-13 03:26:20.211477 | 
2026-04-13 03:26:20.211538 | LOOP [emit-job-header : Print node information]
2026-04-13 03:26:20.295585 | localhost | ok:
2026-04-13 03:26:20.295787 | localhost | # Node Information
2026-04-13 03:26:20.295838 | localhost | Inventory Hostname: instance
2026-04-13 03:26:20.295877 | localhost | Hostname: np0000165447
2026-04-13 03:26:20.295912 | localhost | Username: zuul
2026-04-13 03:26:20.295952 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:26:20.295989 | localhost | Provider: yul1
2026-04-13 03:26:20.296025 | localhost | Region: ca-ymq-1
2026-04-13 03:26:20.296060 | localhost | Label: ubuntu-jammy
2026-04-13 03:26:20.296094 | localhost | Product Name: OpenStack Nova
2026-04-13 03:26:20.296128 | localhost | Interface IP: 162.253.55.110
2026-04-13 03:26:20.308275 | 
2026-04-13 03:26:20.308434 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:26:20.687698 | localhost -> localhost | changed
2026-04-13 03:26:20.697113 | 
2026-04-13 03:26:20.697274 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:26:21.923101 | localhost -> localhost | changed
2026-04-13 03:26:21.930970 | 
2026-04-13 03:26:21.931147 | PLAY [all]
2026-04-13 03:26:21.955225 | 
2026-04-13 03:26:21.955422 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:26:22.171916 | instance -> localhost | ok
2026-04-13 03:26:22.185969 | 
2026-04-13 03:26:22.186037 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:26:22.216499 | instance | ok
2026-04-13 03:26:22.231634 | instance | included: /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:26:22.236920 | 
2026-04-13 03:26:22.236997 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:26:23.645263 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:26:23.645429 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/2c898df8723b40b5860068c640bb2d04_id_rsa
2026-04-13 03:26:23.645460 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/2c898df8723b40b5860068c640bb2d04_id_rsa.pub
2026-04-13 03:26:23.645483 | instance -> localhost | The key fingerprint is:
2026-04-13 03:26:23.645504 | instance -> localhost | SHA256:7qzr72fIEg6F6UupkvT61390HjNP1AZYW4SGkRdpzjU zuul-build-sshkey
2026-04-13 03:26:23.645538 | instance -> localhost | The key's randomart image is:
2026-04-13 03:26:23.645560 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:26:23.645586 | instance -> localhost | |            .*o=o|
2026-04-13 03:26:23.645607 | instance -> localhost | |            + BE.|
2026-04-13 03:26:23.645627 | instance -> localhost | |     o       *.oo|
2026-04-13 03:26:23.645647 | instance -> localhost | |    o .       o.o|
2026-04-13 03:26:23.645667 | instance -> localhost | |   . o  S     .. |
2026-04-13 03:26:23.645687 | instance -> localhost | | .  = ..   . = . |
2026-04-13 03:26:23.645706 | instance -> localhost | |...o +.o... o *  |
2026-04-13 03:26:23.645726 | instance -> localhost | |o ....o+o o. . . |
2026-04-13 03:26:23.645749 | instance -> localhost | | oo...+**+.      |
2026-04-13 03:26:23.645769 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:26:23.645814 | instance -> localhost | ok: Runtime: 0:00:00.973301
2026-04-13 03:26:23.650809 | 
2026-04-13 03:26:23.650874 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:26:23.683075 | instance | ok
2026-04-13 03:26:23.693162 | instance | included: /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:26:23.700392 | 
2026-04-13 03:26:23.700447 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:26:23.724240 | instance | skipping: Conditional result was False
2026-04-13 03:26:23.734518 | 
2026-04-13 03:26:23.734584 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:26:24.193826 | instance | changed
2026-04-13 03:26:24.200634 | 
2026-04-13 03:26:24.200718 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:26:24.383660 | instance | ok
2026-04-13 03:26:24.391086 | 
2026-04-13 03:26:24.391230 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:26:24.871809 | instance | changed
2026-04-13 03:26:24.879243 | 
2026-04-13 03:26:24.879310 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:26:25.331947 | instance | changed
2026-04-13 03:26:25.337915 | 
2026-04-13 03:26:25.337977 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:26:25.361546 | instance | skipping: Conditional result was False
2026-04-13 03:26:25.371908 | 
2026-04-13 03:26:25.490175 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:26:25.873501 | instance -> localhost | changed
2026-04-13 03:26:25.902494 | 
2026-04-13 03:26:25.902650 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:26:26.308044 | instance -> localhost | Identity added: /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/2c898df8723b40b5860068c640bb2d04_id_rsa (zuul-build-sshkey)
2026-04-13 03:26:26.308288 | instance -> localhost | ok: Runtime: 0:00:00.013349
2026-04-13 03:26:26.316573 | 
2026-04-13 03:26:26.316640 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:26:26.643090 | instance | ok
2026-04-13 03:26:26.649724 | 
2026-04-13 03:26:26.649816 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:26:26.673764 | instance | skipping: Conditional result was False
2026-04-13 03:26:26.692869 | 
2026-04-13 03:26:26.692979 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:26:27.055709 | instance | ok
2026-04-13 03:26:27.062371 | 
2026-04-13 03:26:27.062446 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:26:28.813445 | instance | Output suppressed because no_log was given
2026-04-13 03:26:28.824233 | 
2026-04-13 03:26:28.824304 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:26:29.034880 | instance | ok: "logs"
2026-04-13 03:26:29.035286 | instance | ok: All items complete
2026-04-13 03:26:29.035316 | 
2026-04-13 03:26:29.193291 | instance | ok: "artifacts"
2026-04-13 03:26:29.355323 | instance | ok: "docs"
2026-04-13 03:26:29.369677 | 
2026-04-13 03:26:29.369913 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:26:29.557201 | instance | changed: "logs"
2026-04-13 03:26:29.712643 | instance | changed: "artifacts"
2026-04-13 03:26:29.873716 | instance | changed: "docs"
2026-04-13 03:26:29.890625 | 
2026-04-13 03:26:29.890763 | PLAY RECAP
2026-04-13 03:26:29.890815 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:26:29.890843 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:29.890863 | 
2026-04-13 03:26:30.004525 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:30.009135 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:30.603495 | 
2026-04-13 03:26:30.603636 | PLAY [all]
2026-04-13 03:26:30.615415 | 
2026-04-13 03:26:30.615512 | TASK [setup-uv : Extract archive]
2026-04-13 03:26:32.838747 | instance | changed
2026-04-13 03:26:32.844265 | 
2026-04-13 03:26:32.844347 | TASK [setup-uv : Print version]
2026-04-13 03:26:33.197822 | instance | uv 0.8.13
2026-04-13 03:26:33.378641 | instance | ok: Runtime: 0:00:00.012220
2026-04-13 03:26:33.776306 | 
2026-04-13 03:26:33.776372 | PLAY RECAP
2026-04-13 03:26:33.776415 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:33.776440 | 
2026-04-13 03:26:33.876106 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:33.879065 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:34.505480 | 
2026-04-13 03:26:34.505596 | PLAY [all]
2026-04-13 03:26:34.515946 | 
2026-04-13 03:26:34.516016 | TASK [Install "jq" for log collection]
2026-04-13 03:26:44.508490 | instance | changed
2026-04-13 03:26:44.512426 | 
2026-04-13 03:26:44.512507 | PLAY [all]
2026-04-13 03:26:44.519693 | 
2026-04-13 03:26:44.519790 | TASK [ensure-go : Check installed go version]
2026-04-13 03:26:45.053241 | instance | ok: ERROR (ignored)
2026-04-13 03:26:45.053543 | instance | {
2026-04-13 03:26:45.053590 | instance |   "failed_when_result": false,
2026-04-13 03:26:45.053614 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:26:45.053634 | instance |   "rc": 2
2026-04-13 03:26:45.053653 | instance | }
2026-04-13 03:26:45.059131 | 
2026-04-13 03:26:45.059203 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:26:45.114299 | instance | ok
2026-04-13 03:26:45.123636 | instance | included: /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:26:45.128877 | 
2026-04-13 03:26:45.128982 | TASK [ensure-go : Create temp directory]
2026-04-13 03:26:45.487223 | instance | changed
2026-04-13 03:26:45.492675 | 
2026-04-13 03:26:45.492782 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:26:46.054189 | instance | ok: OK (64 bytes)
2026-04-13 03:26:46.061246 | 
2026-04-13 03:26:46.061405 | TASK [ensure-go : Download go archive]
2026-04-13 03:26:47.261314 | instance | changed: OK (78559214 bytes)
2026-04-13 03:26:47.268976 | 
2026-04-13 03:26:47.269081 | TASK [ensure-go : Install go]
2026-04-13 03:26:53.110313 | instance | changed
2026-04-13 03:26:53.118801 | 
2026-04-13 03:26:53.118888 | PLAY RECAP
2026-04-13 03:26:53.118938 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:53.118962 | 
2026-04-13 03:26:53.237624 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:53.239969 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:26:53.787736 | 
2026-04-13 03:26:53.787889 | PLAY [all]
2026-04-13 03:26:53.799867 | 
2026-04-13 03:26:53.799978 | TASK [Copy inventory file for Zuul]
2026-04-13 03:26:54.617428 | instance | changed
2026-04-13 03:26:54.622542 | 
2026-04-13 03:26:54.622622 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:26:54.890131 | instance | changed: 1 replacements made
2026-04-13 03:26:54.899067 | 
2026-04-13 03:26:54.899171 | TASK [Run Molecule scenario]
2026-04-13 03:26:55.278655 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:26:55.278873 | instance | Creating virtual environment at: .venv
2026-04-13 03:26:55.305981 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:26:55.334601 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:26:55.334757 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:26:55.335079 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:26:55.335365 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:26:55.336152 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:26:55.337109 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:26:55.339452 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:26:55.339697 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:26:55.340239 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:26:55.665614 | instance |    Building pyperclip==1.9.0
2026-04-13 03:26:55.687545 | instance |  Downloading rjsonnet
2026-04-13 03:26:55.773620 | instance |  Downloading pydantic-core
2026-04-13 03:26:55.825610 | instance |  Downloading netaddr
2026-04-13 03:26:55.834721 | instance |  Downloading pygments
2026-04-13 03:26:55.852535 | instance |  Downloading cryptography
2026-04-13 03:26:55.882346 | instance |  Downloading setuptools
2026-04-13 03:26:55.933351 | instance |  Downloading kubernetes
2026-04-13 03:26:55.960307 | instance |  Downloading ansible-core
2026-04-13 03:26:55.991850 | instance |  Downloading openstacksdk
2026-04-13 03:26:56.351391 | instance |       Built pyperclip==1.9.0
2026-04-13 03:26:56.530265 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:26:56.565803 | instance | Installed 83 packages in 33ms
2026-04-13 03:26:57.171061 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:26:57.729853 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:26:57.729940 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:27:33.769695 | instance | INFO     [csi > dependency] Executing
2026-04-13 03:27:33.769799 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:27:33.769813 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:27:33.769824 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:27:33.779743 | instance | INFO     [csi > cleanup] Executing
2026-04-13 03:27:33.780181 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:33.790277 | instance | INFO     [csi > destroy] Executing
2026-04-13 03:27:33.790383 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:27:33.790490 | instance | INFO     [csi > destroy] Executed: Successful
2026-04-13 03:27:33.800376 | instance | INFO     [csi > syntax] Executing
2026-04-13 03:27:34.555722 | instance |
2026-04-13 03:27:34.555788 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:27:34.593080 | instance | INFO     [csi > syntax] Executed: Successful
2026-04-13 03:27:34.606222 | instance | INFO     [csi > create] Executing
2026-04-13 03:27:34.608163 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:34.616250 | instance | INFO     [csi > prepare] Executing
2026-04-13 03:27:35.366603 | instance |
2026-04-13 03:27:35.366910 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:27:35.367209 | instance |
2026-04-13 03:27:35.367494 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:35.367772 | instance | Monday 13 April 2026  03:27:35 +0000 (0:00:00.024)       0:00:00.024 **********
2026-04-13 03:27:36.489627 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:27:36.490023 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:27:36.490418 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:27:36.490804 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:27:36.491283 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:27:36.499921 | instance | ok: [instance]
2026-04-13 03:27:36.500153 | instance |
2026-04-13 03:27:36.500394 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:27:36.500635 | instance | Monday 13 April 2026  03:27:36 +0000 (0:00:01.133)       0:00:01.158 **********
2026-04-13 03:27:37.148602 | instance | changed: [instance]
2026-04-13 03:27:37.148741 | instance |
2026-04-13 03:27:37.148924 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:27:37.149101 | instance | Monday 13 April 2026  03:27:37 +0000 (0:00:00.648)       0:00:01.806 **********
2026-04-13 03:27:37.412143 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:27:37.412408 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:27:37.412679 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:27:37.418676 | instance | changed: [instance]
2026-04-13 03:27:37.418957 | instance |
2026-04-13 03:27:37.419241 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:27:37.419516 | instance | Monday 13 April 2026  03:27:37 +0000 (0:00:00.270)       0:00:02.076 **********
2026-04-13 03:27:38.252613 | instance | ok: [instance]
2026-04-13 03:27:38.252687 | instance |
2026-04-13 03:27:38.252827 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:27:38.252931 | instance |
2026-04-13 03:27:38.253049 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:38.253172 | instance | Monday 13 April 2026  03:27:38 +0000 (0:00:00.834)       0:00:02.910 **********
2026-04-13 03:27:38.922127 | instance | ok: [instance]
2026-04-13 03:27:38.922374 | instance |
2026-04-13 03:27:38.922681 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:27:38.922952 | instance | Monday 13 April 2026  03:27:38 +0000 (0:00:00.669)       0:00:03.580 **********
2026-04-13 03:27:59.778583 | instance | changed: [instance]
2026-04-13 03:27:59.778784 | instance |
2026-04-13 03:27:59.778799 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:27:59.778961 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:20.856)       0:00:24.436 **********
2026-04-13 03:28:00.289598 | instance | ok: [instance]
2026-04-13 03:28:00.289690 | instance |
2026-04-13 03:28:00.289815 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:28:00.289961 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.511)       0:00:24.947 **********
2026-04-13 03:28:00.561708 | instance | ok: [instance]
2026-04-13 03:28:00.561968 | instance |
2026-04-13 03:28:00.562314 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:28:00.562605 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.271)       0:00:25.219 **********
2026-04-13 03:28:01.170838 | instance | changed: [instance]
2026-04-13 03:28:01.171099 | instance |
2026-04-13 03:28:01.171399 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:28:01.171693 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.608)       0:00:25.828 **********
2026-04-13 03:28:01.346000 | instance | ok: [instance]
2026-04-13 03:28:01.346338 | instance |
2026-04-13 03:28:01.346853 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:28:01.347258 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.175)       0:00:26.003 **********
2026-04-13 03:28:01.364583 | instance | skipping: [instance]
2026-04-13 03:28:01.364867 | instance |
2026-04-13 03:28:01.365177 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:28:01.365522 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.019)       0:00:26.022 **********
2026-04-13 03:28:01.861260 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:01.861425 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:01.861600 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:01.861759 | instance |
2026-04-13 03:28:01.861928 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:28:01.862095 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.496)       0:00:26.519 **********
2026-04-13 03:28:02.461869 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:02.462160 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:02.462446 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:02.462660 | instance |
2026-04-13 03:28:02.462930 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:28:02.463254 | instance | Monday 13 April 2026  03:28:02 +0000 (0:00:00.600)       0:00:27.119 **********
2026-04-13 03:28:03.134878 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:03.135129 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:03.135430 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:03.135683 | instance |
2026-04-13 03:28:03.135946 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:28:03.136211 | instance | Monday 13 April 2026  03:28:03 +0000 (0:00:00.673)       0:00:27.792 **********
2026-04-13 03:28:06.126916 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:06.127189 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:06.127481 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:06.127758 | instance |
2026-04-13 03:28:06.128056 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:28:06.128350 | instance | Monday 13 April 2026  03:28:06 +0000 (0:00:02.991)       0:00:30.784 **********
2026-04-13 03:28:07.902354 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:28:07.902570 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:28:07.902841 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:28:07.903095 | instance |
2026-04-13 03:28:07.903358 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:07.903648 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:07.903899 | instance |
2026-04-13 03:28:07.904165 | instance | Monday 13 April 2026  03:28:07 +0000 (0:00:01.775)       0:00:32.560 **********
2026-04-13 03:28:07.904419 | instance | ===============================================================================
2026-04-13 03:28:07.904688 | instance | Install depedencies ---------------------------------------------------- 20.86s
2026-04-13 03:28:07.904953 | instance | Create a volume group for each loop device ------------------------------ 2.99s
2026-04-13 03:28:07.905251 | instance | Create a logical volume for each loop device ---------------------------- 1.78s
2026-04-13 03:28:07.905513 | instance | Gathering Facts --------------------------------------------------------- 1.13s
2026-04-13 03:28:07.905784 | instance | Purge "snapd" package --------------------------------------------------- 0.83s
2026-04-13 03:28:07.906088 | instance | Start loop devices ------------------------------------------------------ 0.67s
2026-04-13 03:28:07.906346 | instance | Gathering Facts --------------------------------------------------------- 0.67s
2026-04-13 03:28:07.906608 | instance | Configure short hostname ------------------------------------------------ 0.65s
2026-04-13 03:28:07.906813 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.61s
2026-04-13 03:28:07.906981 | instance | Set permissions on loopback devices ------------------------------------- 0.60s
2026-04-13 03:28:07.907154 | instance | Start up service -------------------------------------------------------- 0.51s
2026-04-13 03:28:07.907327 | instance | Create devices for Ceph ------------------------------------------------- 0.50s
2026-04-13 03:28:07.907500 | instance | Generate lvm.conf ------------------------------------------------------- 0.27s
2026-04-13 03:28:07.907667 | instance | Ensure hostname inside hosts file --------------------------------------- 0.27s
2026-04-13 03:28:07.907837 | instance | Get list of all loopback devices ---------------------------------------- 0.18s
2026-04-13 03:28:07.908010 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-13 03:28:07.963790 | instance | INFO     [csi > prepare] Executed: Successful
2026-04-13 03:28:07.975379 | instance | INFO     [csi > converge] Executing
2026-04-13 03:28:08.668125 | instance |
2026-04-13 03:28:08.668371 | instance | PLAY [Debug CSI driver value] **************************************************
2026-04-13 03:28:08.668627 | instance |
2026-04-13 03:28:08.668897 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:08.669166 | instance | Monday 13 April 2026  03:28:08 +0000 (0:00:00.007)       0:00:00.007 **********
2026-04-13 03:28:09.576558 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:28:09.576809 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:28:09.577091 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:28:09.577402 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:28:09.577675 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:28:09.585118 | instance | ok: [instance]
2026-04-13 03:28:09.585405 | instance |
2026-04-13 03:28:09.585679 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-04-13 03:28:09.585947 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.917)       0:00:00.924 **********
2026-04-13 03:28:09.615695 | instance | ok: [instance] => {
2026-04-13 03:28:09.615947 | instance |     "msg": "csi_driver=local-path-provisioner, MOLECULE_CSI_DRIVER="
2026-04-13 03:28:09.616205 | instance | }
2026-04-13 03:28:09.616455 | instance |
2026-04-13 03:28:09.616737 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:28:09.616969 | instance |
2026-04-13 03:28:09.617270 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:28:09.617542 | instance | Monday 13 April 2026  03:28:09 +0000 (0:00:00.030)       0:00:00.955 **********
2026-04-13 03:28:16.104847 | instance | changed: [localhost]
2026-04-13 03:28:16.105089 | instance |
2026-04-13 03:28:16.105404 | instance | TASK [Deploy with parallel orchestrator (with ceph)] ***************************
2026-04-13 03:28:16.105681 | instance | Monday 13 April 2026  03:28:16 +0000 (0:00:06.488)       0:00:07.443 **********
2026-04-13 03:28:16.127073 | instance | skipping: [localhost]
2026-04-13 03:28:16.127324 | instance |
2026-04-13 03:28:16.127597 | instance | TASK [Deploy with parallel orchestrator (without ceph)] ************************
2026-04-13 03:28:16.127869 | instance | Monday 13 April 2026  03:28:16 +0000 (0:00:00.022)       0:00:07.466 **********
2026-04-13 03:28:16.724653 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/../../playbooks", "--tags", "kubernetes,csi"], "delta": "0:00:00.434512", "end": "2026-04-13 03:28:16.700183", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:28:16.265671", "stderr": "Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\ncomponent kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "stderr_lines": ["Error: component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "component kubernetes failed: ansible-playbook failed for kubernetes: exit status 1"], "stdout": "==> Multi-tag mode: kubernetes, csi\n==> Starting parallel deployment (subgraph)\n==> [kubernetes] Starting deployment\n[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks\n[kubernetes] \n[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may\n[kubernetes] be elsewhere in the file depending on the exact syntax problem.\n[kubernetes] \n[kubernetes] The offending line appears to be:\n[kubernetes] \n[kubernetes]   roles:\n[kubernetes]     - role: defaults\n[kubernetes]       ^ here", "stdout_lines": ["==> Multi-tag mode: kubernetes, csi", "==> Starting parallel deployment (subgraph)", "==> [kubernetes] Starting deployment", "[kubernetes] ERROR! the role 'defaults' was not found in /home/zuul/src/github.com/vexxhost/atmosphere/playbooks/roles:/home/zuul/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zuul/src/github.com/vexxhost/atmosphere/playbooks", "[kubernetes] ", "[kubernetes] The error appears to be in '/home/zuul/src/github.com/vexxhost/atmosphere/playbooks/kubernetes.yml': line 18, column 7, but may", "[kubernetes] be elsewhere in the file depending on the exact syntax problem.", "[kubernetes] ", "[kubernetes] The offending line appears to be:", "[kubernetes] ", "[kubernetes]   roles:", "[kubernetes]     - role: defaults", "[kubernetes]       ^ here"]}
2026-04-13 03:28:16.725423 | instance |
2026-04-13 03:28:16.725701 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:16.725988 | instance | instance                   : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-13 03:28:16.726269 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:16.726548 | instance |
2026-04-13 03:28:16.726869 | instance | Monday 13 April 2026  03:28:16 +0000 (0:00:00.598)       0:00:08.065 **********
2026-04-13 03:28:16.727188 | instance | ===============================================================================
2026-04-13 03:28:16.727358 | instance | Build atmosphere binary ------------------------------------------------- 6.49s
2026-04-13 03:28:16.727522 | instance | Gathering Facts --------------------------------------------------------- 0.92s
2026-04-13 03:28:16.727690 | instance | Deploy with parallel orchestrator (without ceph) ------------------------ 0.60s
2026-04-13 03:28:16.727885 | instance | Display CSI driver value and environment variable ----------------------- 0.03s
2026-04-13 03:28:16.728053 | instance | Deploy with parallel orchestrator (with ceph) --------------------------- 0.02s
2026-04-13 03:28:16.793515 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:28:16.793692 | instance | ERROR    [csi > converge] Executed: Failed
2026-04-13 03:28:16.793834 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-04-13 03:28:17.056290 | instance | ERROR
2026-04-13 03:28:17.056913 | instance | {
2026-04-13 03:28:17.056977 | instance |   "delta": "0:01:21.646902",
2026-04-13 03:28:17.057011 | instance |   "end": "2026-04-13 03:28:16.868778",
2026-04-13 03:28:17.057038 | instance |   "msg": "non-zero return code",
2026-04-13 03:28:17.057063 | instance |   "rc": 2,
2026-04-13 03:28:17.057091 | instance |   "start": "2026-04-13 03:26:55.221876"
2026-04-13 03:28:17.057115 | instance | }
failure
2026-04-13 03:28:17.061043 | 
2026-04-13 03:28:17.061112 | PLAY RECAP
2026-04-13 03:28:17.061176 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:28:17.061205 | 
2026-04-13 03:28:17.164922 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:28:17.167809 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:28:17.791984 | 
2026-04-13 03:28:17.792263 | PLAY [all]
2026-04-13 03:28:17.810955 | 
2026-04-13 03:28:17.811136 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:28:18.183839 | instance | changed
2026-04-13 03:28:18.189784 | 
2026-04-13 03:28:18.189866 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:28:18.526920 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:28:18.539433 | instance | + ip addr
2026-04-13 03:28:18.541660 | instance | + ip route
2026-04-13 03:28:18.543162 | instance | + lsblk
2026-04-13 03:28:18.548408 | instance | + mount
2026-04-13 03:28:18.550404 | instance | + docker images
2026-04-13 03:28:18.550858 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:28:18.551095 | instance | + brctl show
2026-04-13 03:28:18.551451 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:28:18.551643 | instance | + ps aux --sort=-%mem
2026-04-13 03:28:18.562907 | instance | + dpkg -l
2026-04-13 03:28:18.575025 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:28:18.575491 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:28:18.575576 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:28:18.575905 | instance | + '[' '!' -z '' ']'
2026-04-13 03:28:18.727206 | instance | ok: Runtime: 0:00:00.053591
2026-04-13 03:28:18.736107 | 
2026-04-13 03:28:18.736198 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:28:19.390285 | instance | changed:
2026-04-13 03:28:19.390493 | instance | created directory /var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/logs/instance
2026-04-13 03:28:19.390523 | instance | cd+++++++++ system/
2026-04-13 03:28:19.390547 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:28:19.390569 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:28:19.390593 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:28:19.390624 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:28:19.390648 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:28:19.390669 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:28:19.390691 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:28:19.390712 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:28:19.390731 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:28:19.400448 | 
2026-04-13 03:28:19.400517 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:28:19.599128 | instance | changed: "values"
2026-04-13 03:28:19.768595 | instance | changed: "releases"
2026-04-13 03:28:19.781149 | 
2026-04-13 03:28:19.781370 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:28:20.000898 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:28:20.319418 | instance | ok: Runtime: 0:00:00.006125
2026-04-13 03:28:20.335761 | 
2026-04-13 03:28:20.335939 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:28:20.826781 | instance | changed:
2026-04-13 03:28:20.827026 | instance | cd+++++++++ helm/
2026-04-13 03:28:20.827069 | instance | cd+++++++++ helm/releases/
2026-04-13 03:28:20.827100 | instance | cd+++++++++ helm/values/
2026-04-13 03:28:20.838610 | 
2026-04-13 03:28:20.838729 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:28:21.037247 | instance | changed
2026-04-13 03:28:21.043682 | 
2026-04-13 03:28:21.043768 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:28:21.248645 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:21.249136 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:21.254918 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:21.256323 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:21.256534 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:21.257817 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:21.259451 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:21.260904 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:21.262397 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:21.263867 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:21.264071 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:28:21.265486 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:28:21.585117 | instance | ok: Runtime: 0:00:00.024673
2026-04-13 03:28:21.590852 | 
2026-04-13 03:28:21.590972 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:28:21.788656 | instance | changed
2026-04-13 03:28:21.796701 | 
2026-04-13 03:28:21.796830 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:28:22.071035 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:28:22.072102 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:22.072624 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:22.072655 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:28:22.397832 | instance | ok: Runtime: 0:00:00.009092
2026-04-13 03:28:22.405873 | 
2026-04-13 03:28:22.406000 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:28:22.908399 | instance | changed:
2026-04-13 03:28:22.908647 | instance | cd+++++++++ objects/
2026-04-13 03:28:22.908733 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:28:22.908765 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:28:22.920822 | 
2026-04-13 03:28:22.920898 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:28:23.128575 | instance | changed
2026-04-13 03:28:23.133813 | 
2026-04-13 03:28:23.133886 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:28:23.340262 | instance | changed
2026-04-13 03:28:23.345411 | 
2026-04-13 03:28:23.345485 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:28:23.553958 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:28:23.878028 | instance | ok: Runtime: 0:00:00.007847
2026-04-13 03:28:23.884696 | 
2026-04-13 03:28:23.884799 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:28:24.370915 | instance | changed:
2026-04-13 03:28:24.371249 | instance | cd+++++++++ pod-logs/
2026-04-13 03:28:24.371312 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:28:24.381644 | 
2026-04-13 03:28:24.381748 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:28:24.580537 | instance | changed
2026-04-13 03:28:24.585876 | 
2026-04-13 03:28:24.585949 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:28:24.785298 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:28:25.122937 | instance | ok: Runtime: 0:00:00.037110
2026-04-13 03:28:25.130180 | 
2026-04-13 03:28:25.130282 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:28:25.329375 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:28:25.359240 | instance | ceph-mgr endpoints:
2026-04-13 03:28:25.667357 | instance | ok: Runtime: 0:00:00.034887
2026-04-13 03:28:25.674516 | 
2026-04-13 03:28:25.674591 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:28:25.883910 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:28:26.210905 | instance | ok: Runtime: 0:00:00.038482
2026-04-13 03:28:26.217664 | 
2026-04-13 03:28:26.218099 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:28:26.712346 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:28:26.722407 | 
2026-04-13 03:28:26.722474 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:28:26.923672 | instance | changed
2026-04-13 03:28:26.929211 | 
2026-04-13 03:28:26.929292 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:28:27.160139 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:28:27.161665 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:28:27.467694 | instance | ERROR
2026-04-13 03:28:27.467968 | instance | {
2026-04-13 03:28:27.468072 | instance |   "delta": "0:00:00.006242",
2026-04-13 03:28:27.468110 | instance |   "end": "2026-04-13 03:28:27.161977",
2026-04-13 03:28:27.468150 | instance |   "msg": "non-zero return code",
2026-04-13 03:28:27.468178 | instance |   "rc": 1,
2026-04-13 03:28:27.468204 | instance |   "start": "2026-04-13 03:28:27.155735"
2026-04-13 03:28:27.468228 | instance | }
2026-04-13 03:28:27.468264 | instance | ERROR: Ignoring Errors
2026-04-13 03:28:27.475207 | 
2026-04-13 03:28:27.475290 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:28:27.967076 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:28:27.976634 | 
2026-04-13 03:28:27.976692 | PLAY RECAP
2026-04-13 03:28:27.976753 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:28:27.976786 | 
2026-04-13 03:28:28.102416 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:28:28.105335 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:28:28.697391 | 
2026-04-13 03:28:28.697532 | PLAY [all]
2026-04-13 03:28:28.710750 | 
2026-04-13 03:28:28.710853 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:28:28.745912 | instance | skipping: Conditional result was False
2026-04-13 03:28:28.754737 | 
2026-04-13 03:28:28.754851 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:28:28.788001 | instance | ok
2026-04-13 03:28:28.794512 | 
2026-04-13 03:28:28.794604 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:28:29.192506 | instance -> localhost | ok: "/var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/logs"
2026-04-13 03:28:29.391889 | instance -> localhost | changed: "/var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/artifacts"
2026-04-13 03:28:29.615126 | instance -> localhost | changed: "/var/lib/zuul/builds/2c898df8723b40b5860068c640bb2d04/work/docs"
2026-04-13 03:28:29.632202 | 
2026-04-13 03:28:29.632325 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:28:30.257786 | instance | changed: .d..t...... ./
2026-04-13 03:28:30.258093 | instance | changed: All items complete
2026-04-13 03:28:30.258132 | 
2026-04-13 03:28:30.697729 | instance | changed: .d..t...... ./
2026-04-13 03:28:31.131447 | instance | changed: .d..t...... ./
2026-04-13 03:28:31.155405 | 
2026-04-13 03:28:31.155524 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:28:31.583734 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.009404
2026-04-13 03:28:31.812662 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008351
2026-04-13 03:28:31.834501 | 
2026-04-13 03:28:31.834665 | PLAY [all]
2026-04-13 03:28:31.842632 | 
2026-04-13 03:28:31.842725 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:28:32.261316 | instance | changed
2026-04-13 03:28:32.269064 | 
2026-04-13 03:28:32.269151 | PLAY RECAP
2026-04-13 03:28:32.269217 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:28:32.269242 | 
2026-04-13 03:28:32.422545 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:28:32.427324 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:28:33.046935 | 
2026-04-13 03:28:33.047736 | PLAY [localhost]
2026-04-13 03:28:33.059258 | 
2026-04-13 03:28:33.059335 | TASK [Generate Zuul manifest]
2026-04-13 03:28:33.094365 | localhost | ok
2026-04-13 03:28:33.113646 | 
2026-04-13 03:28:33.113939 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:28:33.448927 | localhost | changed
2026-04-13 03:28:33.462597 | 
2026-04-13 03:28:33.462778 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:28:33.495140 | localhost | ok
2026-04-13 03:28:33.504496 | 
2026-04-13 03:28:33.504594 | TASK [Upload logs]
2026-04-13 03:28:33.538225 | localhost | ok
2026-04-13 03:28:33.599988 | 
2026-04-13 03:28:33.600164 | TASK [Set zuul-log-path fact]
2026-04-13 03:28:33.622080 | localhost | ok
2026-04-13 03:28:33.635857 | 
2026-04-13 03:28:33.635949 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:28:33.669859 | localhost | ok
2026-04-13 03:28:33.678746 | 
2026-04-13 03:28:33.678841 | TASK [upload-logs : Create log directories]
2026-04-13 03:28:34.089421 | localhost | changed
2026-04-13 03:28:34.094556 | 
2026-04-13 03:28:34.094636 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:28:34.546788 | localhost -> localhost | ok: Runtime: 0:00:00.006081
2026-04-13 03:28:34.553941 | 
2026-04-13 03:28:34.554011 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:28:35.045892 | localhost | Output suppressed because no_log was given
2026-04-13 03:28:35.049802 | 
2026-04-13 03:28:35.049872 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:28:35.095373 | localhost | skipping: Conditional result was False
2026-04-13 03:28:35.101996 | localhost | skipping: Conditional result was False
2026-04-13 03:28:35.118733 | 
2026-04-13 03:28:35.118867 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:28:35.160400 | localhost | skipping: Conditional result was False
2026-04-13 03:28:35.160867 | 
2026-04-13 03:28:35.164303 | localhost | skipping: Conditional result was False
2026-04-13 03:28:35.175939 | 
2026-04-13 03:28:35.176082 | LOOP [upload-logs : Upload console log and json output]