2026-04-13 03:26:04.082823 | Job console starting
2026-04-13 03:26:04.095152 | Updating git repos
2026-04-13 03:26:04.168467 | Cloning repos into workspace
2026-04-13 03:26:04.337628 | Restoring repo states
2026-04-13 03:26:04.367405 | Merging changes
2026-04-13 03:26:05.815487 | Checking out repos
2026-04-13 03:26:06.495153 | Preparing playbooks
2026-04-13 03:26:21.159825 | Running Ansible setup
2026-04-13 03:26:24.706441 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:25.388227 | 
2026-04-13 03:26:25.490855 | PLAY [localhost]
2026-04-13 03:26:25.505990 | 
2026-04-13 03:26:25.507454 | TASK [Gathering Facts]
2026-04-13 03:26:26.358258 | localhost | ok
2026-04-13 03:26:26.369582 | 
2026-04-13 03:26:26.369670 | TASK [Setup log path fact]
2026-04-13 03:26:26.391853 | localhost | ok
2026-04-13 03:26:26.405101 | 
2026-04-13 03:26:26.405214 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:26:26.436558 | localhost | ok
2026-04-13 03:26:26.446383 | 
2026-04-13 03:26:26.446463 | TASK [emit-job-header : Print job information]
2026-04-13 03:26:26.488060 | # Job Information
2026-04-13 03:26:26.488399 | Ansible Version: 2.16.16
2026-04-13 03:26:26.488444 | Job: atmosphere-molecule-aio-ovn
2026-04-13 03:26:26.488475 | Pipeline: check
2026-04-13 03:26:26.488502 | Executor: 0a8996d2b663
2026-04-13 03:26:26.488529 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:26:26.488561 | Event ID: 6af5c400-36e8-11f1-9a0c-69c921595019
2026-04-13 03:26:26.492697 | 
2026-04-13 03:26:26.492789 | LOOP [emit-job-header : Print node information]
2026-04-13 03:26:26.587209 | localhost | ok:
2026-04-13 03:26:26.587462 | localhost | # Node Information
2026-04-13 03:26:26.587491 | localhost | Inventory Hostname: instance
2026-04-13 03:26:26.587513 | localhost | Hostname: np0000165446
2026-04-13 03:26:26.587533 | localhost | Username: zuul
2026-04-13 03:26:26.587555 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:26:26.587575 | localhost | Provider: yul1
2026-04-13 03:26:26.587593 | localhost | Region: ca-ymq-1
2026-04-13 03:26:26.587652 | localhost | Label: ubuntu-jammy-16
2026-04-13 03:26:26.587679 | localhost | Product Name: OpenStack Nova
2026-04-13 03:26:26.587702 | localhost | Interface IP: 199.204.45.95
2026-04-13 03:26:26.600975 | 
2026-04-13 03:26:26.601141 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:26:27.065282 | localhost -> localhost | changed
2026-04-13 03:26:27.072664 | 
2026-04-13 03:26:27.072773 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:26:27.998075 | localhost -> localhost | changed
2026-04-13 03:26:28.009005 | 
2026-04-13 03:26:28.009090 | PLAY [all]
2026-04-13 03:26:28.018674 | 
2026-04-13 03:26:28.018746 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:26:28.291371 | instance -> localhost | ok
2026-04-13 03:26:28.298596 | 
2026-04-13 03:26:28.298686 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:26:28.334642 | instance | ok
2026-04-13 03:26:28.349744 | instance | included: /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:26:28.356835 | 
2026-04-13 03:26:28.356903 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:26:29.768158 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:26:29.768416 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/53a285d5e7f44e2e87fd6ed07385a404_id_rsa
2026-04-13 03:26:29.768461 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/53a285d5e7f44e2e87fd6ed07385a404_id_rsa.pub
2026-04-13 03:26:29.768497 | instance -> localhost | The key fingerprint is:
2026-04-13 03:26:29.768539 | instance -> localhost | SHA256:34gpN1w9BaR4Cut6a/DCDrpwMGHXBXy/DCY2rAx1zKs zuul-build-sshkey
2026-04-13 03:26:29.768599 | instance -> localhost | The key's randomart image is:
2026-04-13 03:26:29.768632 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:26:29.768772 | instance -> localhost | |    +...   .o    |
2026-04-13 03:26:29.768819 | instance -> localhost | |   ..=.. . . .   |
2026-04-13 03:26:29.768851 | instance -> localhost | |....o.+ o o   .  |
2026-04-13 03:26:29.768939 | instance -> localhost | |.o.  * = + . .   |
2026-04-13 03:26:29.769001 | instance -> localhost | |o o + = S o o    |
2026-04-13 03:26:29.769034 | instance -> localhost | | o E.. . B o .   |
2026-04-13 03:26:29.769063 | instance -> localhost | |. o. oo * o .    |
2026-04-13 03:26:29.769092 | instance -> localhost | |.o .o.+o .       |
2026-04-13 03:26:29.769125 | instance -> localhost | |o. .o+..         |
2026-04-13 03:26:29.769155 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:26:29.769229 | instance -> localhost | ok: Runtime: 0:00:00.863130
2026-04-13 03:26:29.776240 | 
2026-04-13 03:26:29.776314 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:26:29.812065 | instance | ok
2026-04-13 03:26:29.825865 | instance | included: /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:26:29.835572 | 
2026-04-13 03:26:29.835660 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:26:29.860836 | instance | skipping: Conditional result was False
2026-04-13 03:26:29.872112 | 
2026-04-13 03:26:29.872259 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:26:30.330611 | instance | changed
2026-04-13 03:26:30.337712 | 
2026-04-13 03:26:30.337862 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:26:30.521768 | instance | ok
2026-04-13 03:26:30.528262 | 
2026-04-13 03:26:30.528336 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:26:30.986561 | instance | changed
2026-04-13 03:26:30.991795 | 
2026-04-13 03:26:30.991923 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:26:31.444376 | instance | changed
2026-04-13 03:26:31.449810 | 
2026-04-13 03:26:31.449917 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:26:31.473926 | instance | skipping: Conditional result was False
2026-04-13 03:26:31.486219 | 
2026-04-13 03:26:31.486338 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:26:31.888732 | instance -> localhost | changed
2026-04-13 03:26:31.958812 | 
2026-04-13 03:26:31.958929 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:26:32.466472 | instance -> localhost | Identity added: /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/53a285d5e7f44e2e87fd6ed07385a404_id_rsa (zuul-build-sshkey)
2026-04-13 03:26:32.466901 | instance -> localhost | ok: Runtime: 0:00:00.011315
2026-04-13 03:26:32.488423 | 
2026-04-13 03:26:32.488616 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:26:32.763764 | instance | ok
2026-04-13 03:26:32.770084 | 
2026-04-13 03:26:32.770175 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:26:32.793190 | instance | skipping: Conditional result was False
2026-04-13 03:26:32.808851 | 
2026-04-13 03:26:32.808935 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:26:33.105141 | instance | ok
2026-04-13 03:26:33.111523 | 
2026-04-13 03:26:33.111592 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:26:34.708735 | instance | Output suppressed because no_log was given
2026-04-13 03:26:34.718923 | 
2026-04-13 03:26:34.718990 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:26:34.909698 | instance | ok: "logs"
2026-04-13 03:26:34.945265 | instance | ok: All items complete
2026-04-13 03:26:34.945397 | 
2026-04-13 03:26:35.064208 | instance | ok: "artifacts"
2026-04-13 03:26:35.228028 | instance | ok: "docs"
2026-04-13 03:26:35.241714 | 
2026-04-13 03:26:35.241858 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:26:35.417360 | instance | changed: "logs"
2026-04-13 03:26:35.575658 | instance | changed: "artifacts"
2026-04-13 03:26:35.717402 | instance | changed: "docs"
2026-04-13 03:26:35.735955 | 
2026-04-13 03:26:35.736397 | PLAY RECAP
2026-04-13 03:26:35.736446 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:26:35.736475 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:35.736497 | 
2026-04-13 03:26:35.885718 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:35.893545 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:36.531153 | 
2026-04-13 03:26:36.531312 | PLAY [all]
2026-04-13 03:26:36.544778 | 
2026-04-13 03:26:36.544942 | TASK [setup-uv : Extract archive]
2026-04-13 03:26:38.648350 | instance | changed
2026-04-13 03:26:38.654513 | 
2026-04-13 03:26:38.654596 | TASK [setup-uv : Print version]
2026-04-13 03:26:39.000792 | instance | uv 0.8.13
2026-04-13 03:26:39.192000 | instance | ok: Runtime: 0:00:00.013126
2026-04-13 03:26:39.198731 | 
2026-04-13 03:26:39.198786 | PLAY RECAP
2026-04-13 03:26:39.198843 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:39.198869 | 
2026-04-13 03:26:39.335983 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:39.347030 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:39.918666 | 
2026-04-13 03:26:39.918783 | PLAY [all]
2026-04-13 03:26:39.929258 | 
2026-04-13 03:26:39.929335 | TASK [Install "jq" for log collection]
2026-04-13 03:26:56.666834 | instance | changed
2026-04-13 03:26:56.671091 | 
2026-04-13 03:26:56.671163 | PLAY [all]
2026-04-13 03:26:56.678828 | 
2026-04-13 03:26:56.678930 | TASK [ensure-go : Check installed go version]
2026-04-13 03:26:57.214768 | instance | ok: ERROR (ignored)
2026-04-13 03:26:57.215070 | instance | {
2026-04-13 03:26:57.215114 | instance |   "failed_when_result": false,
2026-04-13 03:26:57.215203 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:26:57.215233 | instance |   "rc": 2
2026-04-13 03:26:57.215260 | instance | }
2026-04-13 03:26:57.221800 | 
2026-04-13 03:26:57.221871 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:26:57.277674 | instance | ok
2026-04-13 03:26:57.286541 | instance | included: /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:26:57.291845 | 
2026-04-13 03:26:57.291912 | TASK [ensure-go : Create temp directory]
2026-04-13 03:26:57.632537 | instance | changed
2026-04-13 03:26:57.638980 | 
2026-04-13 03:26:57.639269 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:26:58.308329 | instance | ok: OK (64 bytes)
2026-04-13 03:26:58.315058 | 
2026-04-13 03:26:58.315134 | TASK [ensure-go : Download go archive]
2026-04-13 03:26:59.574233 | instance | changed: OK (78559214 bytes)
2026-04-13 03:26:59.581448 | 
2026-04-13 03:26:59.581561 | TASK [ensure-go : Install go]
2026-04-13 03:27:05.323542 | instance | changed
2026-04-13 03:27:05.331229 | 
2026-04-13 03:27:05.331296 | PLAY RECAP
2026-04-13 03:27:05.331341 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:27:05.331365 | 
2026-04-13 03:27:05.479504 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:27:05.489966 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:27:06.078193 | 
2026-04-13 03:27:06.078314 | PLAY [all]
2026-04-13 03:27:06.089628 | 
2026-04-13 03:27:06.089699 | TASK [Copy inventory file for Zuul]
2026-04-13 03:27:06.945090 | instance | changed
2026-04-13 03:27:06.950147 | 
2026-04-13 03:27:06.950227 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:27:07.269233 | instance | changed: 1 replacements made
2026-04-13 03:27:07.274530 | 
2026-04-13 03:27:07.274598 | TASK [Run Molecule scenario]
2026-04-13 03:27:07.663319 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:27:07.663494 | instance | Creating virtual environment at: .venv
2026-04-13 03:27:07.687361 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:07.708962 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:27:07.709193 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:27:07.709420 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:27:07.711441 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:27:07.712057 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:27:07.712420 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:27:07.712636 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:27:07.712850 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:27:07.764033 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:27:08.004547 | instance |  Downloading rjsonnet
2026-04-13 03:27:08.011258 | instance |    Building pyperclip==1.9.0
2026-04-13 03:27:08.119103 | instance |  Downloading pydantic-core
2026-04-13 03:27:08.169842 | instance |  Downloading netaddr
2026-04-13 03:27:08.178768 | instance |  Downloading pygments
2026-04-13 03:27:08.192874 | instance |  Downloading cryptography
2026-04-13 03:27:08.225604 | instance |  Downloading setuptools
2026-04-13 03:27:08.279526 | instance |  Downloading kubernetes
2026-04-13 03:27:08.311979 | instance |  Downloading ansible-core
2026-04-13 03:27:08.345005 | instance |  Downloading openstacksdk
2026-04-13 03:27:08.716275 | instance |       Built pyperclip==1.9.0
2026-04-13 03:27:08.882931 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:09.016908 | instance | Installed 83 packages in 131ms
2026-04-13 03:27:09.633067 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:27:10.230563 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:27:10.230643 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:27:46.931571 | instance | INFO     [aio > dependency] Executing
2026-04-13 03:27:46.931672 | instance | WARNING  [aio > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:27:46.931886 | instance | WARNING  [aio > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:27:46.932051 | instance | WARNING  [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:27:46.940764 | instance | INFO     [aio > cleanup] Executing
2026-04-13 03:27:46.941080 | instance | WARNING  [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:46.948647 | instance | INFO     [aio > destroy] Executing
2026-04-13 03:27:46.948699 | instance | WARNING  [aio > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:27:46.948799 | instance | INFO     [aio > destroy] Executed: Successful
2026-04-13 03:27:46.956245 | instance | INFO     [aio > syntax] Executing
2026-04-13 03:27:47.731943 | instance |
2026-04-13 03:27:47.732203 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:27:47.770982 | instance | INFO     [aio > syntax] Executed: Successful
2026-04-13 03:27:47.784405 | instance | INFO     [aio > create] Executing
2026-04-13 03:27:47.786190 | instance | WARNING  [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:47.793493 | instance | INFO     [aio > prepare] Executing
2026-04-13 03:27:48.613028 | instance |
2026-04-13 03:27:48.613239 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:27:48.613549 | instance |
2026-04-13 03:27:48.613841 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:48.614113 | instance | Monday 13 April 2026  03:27:48 +0000 (0:00:00.024)       0:00:00.024 **********
2026-04-13 03:27:49.772616 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:27:49.772849 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:27:49.773163 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:27:49.773433 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:27:49.773721 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:27:49.781600 | instance | ok: [instance]
2026-04-13 03:27:49.781837 | instance |
2026-04-13 03:27:49.782125 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:27:49.782440 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:01.169)       0:00:01.193 **********
2026-04-13 03:27:50.432120 | instance | changed: [instance]
2026-04-13 03:27:50.432355 | instance |
2026-04-13 03:27:50.432622 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:27:50.432886 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.650)       0:00:01.843 **********
2026-04-13 03:27:50.691831 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:27:50.692097 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:27:50.692366 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:27:50.699782 | instance | changed: [instance]
2026-04-13 03:27:50.700048 | instance |
2026-04-13 03:27:50.700329 | instance | TASK [Install "dirmngr" for GPG keyserver operations] **************************
2026-04-13 03:27:50.700598 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.267)       0:00:02.111 **********
2026-04-13 03:27:51.701086 | instance | ok: [instance]
2026-04-13 03:27:51.701208 | instance |
2026-04-13 03:27:51.701494 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:27:51.701758 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:01.000)       0:00:03.112 **********
2026-04-13 03:27:52.315191 | instance | ok: [instance]
2026-04-13 03:27:52.315311 | instance |
2026-04-13 03:27:52.315594 | instance | PLAY [Generate workspace for Atmosphere] ***************************************
2026-04-13 03:27:52.315832 | instance |
2026-04-13 03:27:52.316093 | instance | TASK [Create folders for workspace] ********************************************
2026-04-13 03:27:52.316358 | instance | Monday 13 April 2026  03:27:52 +0000 (0:00:00.614)       0:00:03.726 **********
2026-04-13 03:27:53.316446 | instance | changed: [localhost] => (item=group_vars)
2026-04-13 03:27:53.316535 | instance | changed: [localhost] => (item=group_vars/all)
2026-04-13 03:27:53.316547 | instance | changed: [localhost] => (item=group_vars/controllers)
2026-04-13 03:27:53.316651 | instance | changed: [localhost] => (item=group_vars/cephs)
2026-04-13 03:27:53.316765 | instance | changed: [localhost] => (item=group_vars/computes)
2026-04-13 03:27:53.316889 | instance | changed: [localhost] => (item=host_vars)
2026-04-13 03:27:53.317024 | instance |
2026-04-13 03:27:53.317187 | instance | PLAY [Generate Ceph control plane configuration for workspace] *****************
2026-04-13 03:27:53.317330 | instance |
2026-04-13 03:27:53.317496 | instance | TASK [Ensure the Ceph control plane configuration file exists] *****************
2026-04-13 03:27:53.317662 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:01.001)       0:00:04.727 **********
2026-04-13 03:27:53.490049 | instance | changed: [localhost]
2026-04-13 03:27:53.490213 | instance |
2026-04-13 03:27:53.490482 | instance | TASK [Load the current Ceph control plane configuration into a variable] *******
2026-04-13 03:27:53.490781 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.173)       0:00:04.901 **********
2026-04-13 03:27:53.511988 | instance | ok: [localhost]
2026-04-13 03:27:53.512220 | instance |
2026-04-13 03:27:53.512499 | instance | TASK [Generate Ceph control plane values for missing variables] ****************
2026-04-13 03:27:53.512769 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.021)       0:00:04.923 **********
2026-04-13 03:27:53.565482 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': 'e5ff981f-c9c9-50d7-903d-deb119b7d5e9'})
2026-04-13 03:27:53.565705 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'})
2026-04-13 03:27:53.565949 | instance |
2026-04-13 03:27:53.566213 | instance | TASK [Write new Ceph control plane configuration file to disk] *****************
2026-04-13 03:27:53.566477 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.054)       0:00:04.977 **********
2026-04-13 03:27:54.123201 | instance | changed: [localhost]
2026-04-13 03:27:54.123462 | instance |
2026-04-13 03:27:54.123716 | instance | PLAY [Generate Ceph OSD configuration for workspace] ***************************
2026-04-13 03:27:54.123924 | instance |
2026-04-13 03:27:54.124237 | instance | TASK [Ensure the Ceph OSDs configuration file exists] **************************
2026-04-13 03:27:54.124507 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.557)       0:00:05.534 **********
2026-04-13 03:27:54.293341 | instance | changed: [localhost]
2026-04-13 03:27:54.293558 | instance |
2026-04-13 03:27:54.293830 | instance | TASK [Load the current Ceph OSDs configuration into a variable] ****************
2026-04-13 03:27:54.294097 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.170)       0:00:05.704 **********
2026-04-13 03:27:54.319248 | instance | ok: [localhost]
2026-04-13 03:27:54.319552 | instance |
2026-04-13 03:27:54.319832 | instance | TASK [Generate Ceph OSDs values for missing variables] *************************
2026-04-13 03:27:54.320102 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.025)       0:00:05.730 **********
2026-04-13 03:27:54.350228 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']})
2026-04-13 03:27:54.350490 | instance |
2026-04-13 03:27:54.350767 | instance | TASK [Write new Ceph OSDs configuration file to disk] **************************
2026-04-13 03:27:54.351062 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.030)       0:00:05.761 **********
2026-04-13 03:27:54.692401 | instance | changed: [localhost]
2026-04-13 03:27:54.692675 | instance |
2026-04-13 03:27:54.692899 | instance | PLAY [Generate Kubernetes configuration for workspace] *************************
2026-04-13 03:27:54.693154 | instance |
2026-04-13 03:27:54.693427 | instance | TASK [Ensure the Kubernetes configuration file exists] *************************
2026-04-13 03:27:54.693701 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.342)       0:00:06.103 **********
2026-04-13 03:27:54.865797 | instance | changed: [localhost]
2026-04-13 03:27:54.866064 | instance |
2026-04-13 03:27:54.866342 | instance | TASK [Load the current Kubernetes configuration into a variable] ***************
2026-04-13 03:27:54.866610 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.173)       0:00:06.277 **********
2026-04-13 03:27:54.891416 | instance | ok: [localhost]
2026-04-13 03:27:54.891700 | instance |
2026-04-13 03:27:54.891990 | instance | TASK [Generate Kubernetes values for missing variables] ************************
2026-04-13 03:27:54.892268 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.025)       0:00:06.302 **********
2026-04-13 03:27:54.932832 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'})
2026-04-13 03:27:54.933122 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42})
2026-04-13 03:27:54.933411 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'})
2026-04-13 03:27:54.933669 | instance |
2026-04-13 03:27:54.933898 | instance | TASK [Write new Kubernetes configuration file to disk] *************************
2026-04-13 03:27:54.934169 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.041)       0:00:06.344 **********
2026-04-13 03:27:55.260728 | instance | changed: [localhost]
2026-04-13 03:27:55.260814 | instance |
2026-04-13 03:27:55.260946 | instance | PLAY [Generate Keepalived configuration for workspace] *************************
2026-04-13 03:27:55.261181 | instance |
2026-04-13 03:27:55.261467 | instance | TASK [Ensure the Keeaplived configuration file exists] *************************
2026-04-13 03:27:55.261754 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.328)       0:00:06.672 **********
2026-04-13 03:27:55.429397 | instance | changed: [localhost]
2026-04-13 03:27:55.429614 | instance |
2026-04-13 03:27:55.429907 | instance | TASK [Load the current Keepalived configuration into a variable] ***************
2026-04-13 03:27:55.430220 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.168)       0:00:06.840 **********
2026-04-13 03:27:55.454666 | instance | ok: [localhost]
2026-04-13 03:27:55.455012 | instance |
2026-04-13 03:27:55.455344 | instance | TASK [Generate Keepalived values for missing variables] ************************
2026-04-13 03:27:55.455654 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.025)       0:00:06.865 **********
2026-04-13 03:27:55.486157 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'})
2026-04-13 03:27:55.486208 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'})
2026-04-13 03:27:55.486342 | instance |
2026-04-13 03:27:55.486458 | instance | TASK [Write new Keepalived configuration file to disk] *************************
2026-04-13 03:27:55.486577 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.031)       0:00:06.897 **********
2026-04-13 03:27:55.848878 | instance | changed: [localhost]
2026-04-13 03:27:55.849077 | instance |
2026-04-13 03:27:55.849347 | instance | PLAY [Generate endpoints for workspace] ****************************************
2026-04-13 03:27:55.849620 | instance |
2026-04-13 03:27:55.849866 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:55.850130 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.362)       0:00:07.260 **********
2026-04-13 03:27:56.524066 | instance | ok: [localhost]
2026-04-13 03:27:56.524299 | instance |
2026-04-13 03:27:56.524631 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-13 03:27:56.524917 | instance | Monday 13 April 2026  03:27:56 +0000 (0:00:00.675)       0:00:07.935 **********
2026-04-13 03:27:56.706813 | instance | changed: [localhost]
2026-04-13 03:27:56.707150 | instance |
2026-04-13 03:27:56.707378 | instance | TASK [Load the current endpoints into a variable] ******************************
2026-04-13 03:27:56.707639 | instance | Monday 13 April 2026  03:27:56 +0000 (0:00:00.183)       0:00:08.118 **********
2026-04-13 03:27:56.733010 | instance | ok: [localhost]
2026-04-13 03:27:56.733282 | instance |
2026-04-13 03:27:56.733562 | instance | TASK [Generate endpoint skeleton for missing variables] ************************
2026-04-13 03:27:56.733830 | instance | Monday 13 April 2026  03:27:56 +0000 (0:00:00.026)       0:00:08.144 **********
2026-04-13 03:27:57.489579 | instance | ok: [localhost] => (item=keycloak_host)
2026-04-13 03:27:57.489790 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host)
2026-04-13 03:27:57.490092 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host)
2026-04-13 03:27:57.490357 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host)
2026-04-13 03:27:57.490622 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name)
2026-04-13 03:27:57.490927 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host)
2026-04-13 03:27:57.491192 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host)
2026-04-13 03:27:57.491455 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host)
2026-04-13 03:27:57.491715 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host)
2026-04-13 03:27:57.491924 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host)
2026-04-13 03:27:57.492177 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host)
2026-04-13 03:27:57.492432 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host)
2026-04-13 03:27:57.492689 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host)
2026-04-13 03:27:57.493000 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host)
2026-04-13 03:27:57.493283 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host)
2026-04-13 03:27:57.493546 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host)
2026-04-13 03:27:57.493818 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host)
2026-04-13 03:27:57.494080 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host)
2026-04-13 03:27:57.494340 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host)
2026-04-13 03:27:57.494539 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host)
2026-04-13 03:27:57.494881 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host)
2026-04-13 03:27:57.495101 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host)
2026-04-13 03:27:57.495359 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host)
2026-04-13 03:27:57.495590 | instance |
2026-04-13 03:27:57.495898 | instance | TASK [Write new endpoints file to disk] ****************************************
2026-04-13 03:27:57.496162 | instance | Monday 13 April 2026  03:27:57 +0000 (0:00:00.756)       0:00:08.901 **********
2026-04-13 03:27:57.828232 | instance | changed: [localhost]
2026-04-13 03:27:57.828602 | instance |
2026-04-13 03:27:57.829026 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-13 03:27:57.829487 | instance | Monday 13 April 2026  03:27:57 +0000 (0:00:00.338)       0:00:09.239 **********
2026-04-13 03:27:58.010492 | instance | changed: [localhost]
2026-04-13 03:27:58.010846 | instance |
2026-04-13 03:27:58.011127 | instance | PLAY [Generate Neutron configuration for workspace] ****************************
2026-04-13 03:27:58.011372 | instance |
2026-04-13 03:27:58.011640 | instance | TASK [Ensure the Neutron configuration file exists] ****************************
2026-04-13 03:27:58.011909 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.182)       0:00:09.421 **********
2026-04-13 03:27:58.189815 | instance | changed: [localhost]
2026-04-13 03:27:58.190090 | instance |
2026-04-13 03:27:58.190375 | instance | TASK [Load the current Neutron configuration into a variable] ******************
2026-04-13 03:27:58.190655 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.179)       0:00:09.601 **********
2026-04-13 03:27:58.219823 | instance | ok: [localhost]
2026-04-13 03:27:58.220135 | instance |
2026-04-13 03:27:58.220396 | instance | TASK [Generate Neutron values for missing variables] ***************************
2026-04-13 03:27:58.220667 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.030)       0:00:09.631 **********
2026-04-13 03:27:58.262512 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]})
2026-04-13 03:27:58.262807 | instance |
2026-04-13 03:27:58.263097 | instance | TASK [Write new Neutron configuration file to disk] ****************************
2026-04-13 03:27:58.263378 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.042)       0:00:09.674 **********
2026-04-13 03:27:58.618801 | instance | changed: [localhost]
2026-04-13 03:27:58.619150 | instance |
2026-04-13 03:27:58.619490 | instance | PLAY [Generate Nova configuration for workspace] *******************************
2026-04-13 03:27:58.619796 | instance |
2026-04-13 03:27:58.620137 | instance | TASK [Ensure the Nova configuration file exists] *******************************
2026-04-13 03:27:58.620456 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.356)       0:00:10.030 **********
2026-04-13 03:27:58.792745 | instance | changed: [localhost]
2026-04-13 03:27:58.793067 | instance |
2026-04-13 03:27:58.793404 | instance | TASK [Load the current Nova configuration into a variable] *********************
2026-04-13 03:27:58.793753 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.174)       0:00:10.204 **********
2026-04-13 03:27:58.822896 | instance | ok: [localhost]
2026-04-13 03:27:58.823205 | instance |
2026-04-13 03:27:58.823539 | instance | TASK [Generate Nova values for missing variables] ******************************
2026-04-13 03:27:58.823862 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.030)       0:00:10.234 **********
2026-04-13 03:27:58.865705 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]})
2026-04-13 03:27:58.866080 | instance |
2026-04-13 03:27:58.866413 | instance | TASK [Write new Nova configuration file to disk] *******************************
2026-04-13 03:27:58.866784 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.042)       0:00:10.277 **********
2026-04-13 03:27:59.218395 | instance | changed: [localhost]
2026-04-13 03:27:59.218627 | instance |
2026-04-13 03:27:59.218950 | instance | PLAY [Generate secrets for workspace] ******************************************
2026-04-13 03:27:59.219204 | instance |
2026-04-13 03:27:59.219484 | instance | TASK [Ensure the secrets file exists] ******************************************
2026-04-13 03:27:59.219745 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.352)       0:00:10.629 **********
2026-04-13 03:27:59.399172 | instance | changed: [localhost]
2026-04-13 03:27:59.399442 | instance |
2026-04-13 03:27:59.399738 | instance | TASK [Load the current secrets into a variable] ********************************
2026-04-13 03:27:59.400031 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.180)       0:00:10.810 **********
2026-04-13 03:27:59.429165 | instance | ok: [localhost]
2026-04-13 03:27:59.429431 | instance |
2026-04-13 03:27:59.429731 | instance | TASK [Generate secrets for missing variables] **********************************
2026-04-13 03:27:59.430012 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.030)       0:00:10.840 **********
2026-04-13 03:27:59.825743 | instance | ok: [localhost] => (item=heat_auth_encryption_key)
2026-04-13 03:27:59.825934 | instance | ok: [localhost] => (item=keepalived_password)
2026-04-13 03:27:59.826204 | instance | ok: [localhost] => (item=keycloak_admin_password)
2026-04-13 03:27:59.826566 | instance | ok: [localhost] => (item=keycloak_database_password)
2026-04-13 03:27:59.826875 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret)
2026-04-13 03:27:59.827144 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase)
2026-04-13 03:27:59.827414 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password)
2026-04-13 03:27:59.827622 | instance | ok: [localhost] => (item=octavia_heartbeat_key)
2026-04-13 03:27:59.827886 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password)
2026-04-13 03:27:59.828211 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key)
2026-04-13 03:27:59.828478 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password)
2026-04-13 03:27:59.828687 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password)
2026-04-13 03:27:59.828947 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password)
2026-04-13 03:27:59.829497 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password)
2026-04-13 03:27:59.829780 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password)
2026-04-13 03:27:59.830056 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password)
2026-04-13 03:27:59.830327 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password)
2026-04-13 03:27:59.830638 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password)
2026-04-13 03:27:59.830882 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password)
2026-04-13 03:27:59.831210 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password)
2026-04-13 03:27:59.831490 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password)
2026-04-13 03:27:59.831704 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password)
2026-04-13 03:27:59.831962 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password)
2026-04-13 03:27:59.832292 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password)
2026-04-13 03:27:59.832559 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password)
2026-04-13 03:27:59.832826 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password)
2026-04-13 03:27:59.833099 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret)
2026-04-13 03:27:59.833365 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password)
2026-04-13 03:27:59.833634 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password)
2026-04-13 03:27:59.833834 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password)
2026-04-13 03:27:59.834174 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password)
2026-04-13 03:27:59.834500 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password)
2026-04-13 03:27:59.834838 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password)
2026-04-13 03:27:59.835119 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password)
2026-04-13 03:27:59.835214 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password)
2026-04-13 03:27:59.835366 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password)
2026-04-13 03:27:59.835455 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password)
2026-04-13 03:27:59.835611 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password)
2026-04-13 03:27:59.835688 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password)
2026-04-13 03:27:59.835811 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password)
2026-04-13 03:27:59.835923 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password)
2026-04-13 03:27:59.836039 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password)
2026-04-13 03:27:59.836157 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password)
2026-04-13 03:27:59.836285 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password)
2026-04-13 03:27:59.836401 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password)
2026-04-13 03:27:59.836519 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password)
2026-04-13 03:27:59.836637 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password)
2026-04-13 03:27:59.836755 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password)
2026-04-13 03:27:59.836872 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password)
2026-04-13 03:27:59.836993 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password)
2026-04-13 03:27:59.837110 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password)
2026-04-13 03:27:59.837227 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password)
2026-04-13 03:27:59.837344 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password)
2026-04-13 03:27:59.837461 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password)
2026-04-13 03:27:59.837571 | instance |
2026-04-13 03:27:59.837689 | instance | TASK [Generate base64 encoded secrets] *****************************************
2026-04-13 03:27:59.837811 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.396)       0:00:11.237 **********
2026-04-13 03:27:59.879199 | instance | ok: [localhost] => (item=barbican_kek)
2026-04-13 03:27:59.879350 | instance |
2026-04-13 03:27:59.879499 | instance | TASK [Generate temporary files for generating keys for missing variables] ******
2026-04-13 03:27:59.879645 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.054)       0:00:11.291 **********
2026-04-13 03:28:00.267469 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:28:00.267859 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:28:00.268169 | instance |
2026-04-13 03:28:00.268492 | instance | TASK [Generate SSH keys for missing variables] *********************************
2026-04-13 03:28:00.268811 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.386)       0:00:11.677 **********
2026-04-13 03:28:03.447512 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:28:03.447969 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:28:03.448355 | instance |
2026-04-13 03:28:03.448747 | instance | TASK [Set values for SSH keys] *************************************************
2026-04-13 03:28:03.449106 | instance | Monday 13 April 2026  03:28:03 +0000 (0:00:03.180)       0:00:14.858 **********
2026-04-13 03:28:03.499148 | instance | ok: [localhost] => (item=manila_ssh_key)
2026-04-13 03:28:03.499411 | instance | ok: [localhost] => (item=nova_ssh_key)
2026-04-13 03:28:03.499629 | instance |
2026-04-13 03:28:03.499842 | instance | TASK [Delete the temporary files generated for SSH keys] ***********************
2026-04-13 03:28:03.500048 | instance | Monday 13 April 2026  03:28:03 +0000 (0:00:00.050)       0:00:14.908 **********
2026-04-13 03:28:03.820558 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:28:03.820611 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:28:03.820623 | instance |
2026-04-13 03:28:03.820633 | instance | TASK [Write new secrets file to disk] ******************************************
2026-04-13 03:28:03.820643 | instance | Monday 13 April 2026  03:28:03 +0000 (0:00:00.321)       0:00:15.230 **********
2026-04-13 03:28:04.151630 | instance | changed: [localhost]
2026-04-13 03:28:04.151672 | instance |
2026-04-13 03:28:04.151682 | instance | TASK [Encrypt secrets file with Vault password] ********************************
2026-04-13 03:28:04.151689 | instance | Monday 13 April 2026  03:28:04 +0000 (0:00:00.332)       0:00:15.562 **********
2026-04-13 03:28:04.188412 | instance | skipping: [localhost]
2026-04-13 03:28:04.188445 | instance |
2026-04-13 03:28:04.188453 | instance | PLAY [Setup networking] ********************************************************
2026-04-13 03:28:04.188459 | instance |
2026-04-13 03:28:04.188465 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:04.188471 | instance | Monday 13 April 2026  03:28:04 +0000 (0:00:00.036)       0:00:15.599 **********
2026-04-13 03:28:04.855474 | instance | ok: [instance]
2026-04-13 03:28:04.855509 | instance |
2026-04-13 03:28:04.855517 | instance | TASK [Create bridge for management network] ************************************
2026-04-13 03:28:04.855524 | instance | Monday 13 April 2026  03:28:04 +0000 (0:00:00.667)       0:00:16.266 **********
2026-04-13 03:28:05.162468 | instance | ok: [instance]
2026-04-13 03:28:05.162503 | instance |
2026-04-13 03:28:05.162509 | instance | TASK [Create fake interface for management bridge] *****************************
2026-04-13 03:28:05.162513 | instance | Monday 13 April 2026  03:28:05 +0000 (0:00:00.306)       0:00:16.573 **********
2026-04-13 03:28:05.366772 | instance | ok: [instance]
2026-04-13 03:28:05.366814 | instance |
2026-04-13 03:28:05.366821 | instance | TASK [Assign dummy interface to management bridge] *****************************
2026-04-13 03:28:05.366887 | instance | Monday 13 April 2026  03:28:05 +0000 (0:00:00.204)       0:00:16.777 **********
2026-04-13 03:28:05.554761 | instance | ok: [instance]
2026-04-13 03:28:05.554893 | instance |
2026-04-13 03:28:05.555185 | instance | TASK [Assign IP address for management bridge] *********************************
2026-04-13 03:28:05.555459 | instance | Monday 13 April 2026  03:28:05 +0000 (0:00:00.188)       0:00:16.966 **********
2026-04-13 03:28:05.731652 | instance | ok: [instance]
2026-04-13 03:28:05.731891 | instance |
2026-04-13 03:28:05.732164 | instance | TASK [Bring up interfaces] *****************************************************
2026-04-13 03:28:05.732434 | instance | Monday 13 April 2026  03:28:05 +0000 (0:00:00.177)       0:00:17.143 **********
2026-04-13 03:28:06.095621 | instance | ok: [instance] => (item=br-mgmt)
2026-04-13 03:28:06.096277 | instance | ok: [instance] => (item=dummy0)
2026-04-13 03:28:06.096606 | instance |
2026-04-13 03:28:06.096944 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:28:06.097259 | instance |
2026-04-13 03:28:06.097653 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:06.097995 | instance | Monday 13 April 2026  03:28:06 +0000 (0:00:00.364)       0:00:17.507 **********
2026-04-13 03:28:06.782531 | instance | ok: [instance]
2026-04-13 03:28:06.782610 | instance |
2026-04-13 03:28:06.782832 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:28:06.783074 | instance | Monday 13 April 2026  03:28:06 +0000 (0:00:00.686)       0:00:18.194 **********
2026-04-13 03:28:25.712597 | instance | changed: [instance]
2026-04-13 03:28:25.712725 | instance |
2026-04-13 03:28:25.712972 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:28:25.713213 | instance | Monday 13 April 2026  03:28:25 +0000 (0:00:18.929)       0:00:37.124 **********
2026-04-13 03:28:26.215382 | instance | ok: [instance]
2026-04-13 03:28:26.215484 | instance |
2026-04-13 03:28:26.215660 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:28:26.215909 | instance | Monday 13 April 2026  03:28:26 +0000 (0:00:00.501)       0:00:37.625 **********
2026-04-13 03:28:26.419585 | instance | ok: [instance]
2026-04-13 03:28:26.420115 | instance |
2026-04-13 03:28:26.420519 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:28:26.420848 | instance | Monday 13 April 2026  03:28:26 +0000 (0:00:00.203)       0:00:37.829 **********
2026-04-13 03:28:26.845234 | instance | changed: [instance]
2026-04-13 03:28:26.845416 | instance |
2026-04-13 03:28:26.845566 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:28:26.845726 | instance | Monday 13 April 2026  03:28:26 +0000 (0:00:00.426)       0:00:38.255 **********
2026-04-13 03:28:27.026139 | instance | ok: [instance]
2026-04-13 03:28:27.026164 | instance |
2026-04-13 03:28:27.026172 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:28:27.026179 | instance | Monday 13 April 2026  03:28:27 +0000 (0:00:00.181)       0:00:38.437 **********
2026-04-13 03:28:27.047805 | instance | skipping: [instance]
2026-04-13 03:28:27.047828 | instance |
2026-04-13 03:28:27.047836 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:28:27.047843 | instance | Monday 13 April 2026  03:28:27 +0000 (0:00:00.021)       0:00:38.459 **********
2026-04-13 03:28:27.550834 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:27.551083 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:27.551103 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:27.551114 | instance |
2026-04-13 03:28:27.551124 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:28:27.551226 | instance | Monday 13 April 2026  03:28:27 +0000 (0:00:00.502)       0:00:38.962 **********
2026-04-13 03:28:28.063299 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:28.064108 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:28.064150 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:28.064157 | instance |
2026-04-13 03:28:28.064164 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:28:28.064170 | instance | Monday 13 April 2026  03:28:28 +0000 (0:00:00.512)       0:00:39.474 **********
2026-04-13 03:28:28.794579 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:28.794769 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:28.795408 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:28.795453 | instance |
2026-04-13 03:28:28.795461 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:28:28.795468 | instance | Monday 13 April 2026  03:28:28 +0000 (0:00:00.731)       0:00:40.206 **********
2026-04-13 03:28:32.014135 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:32.014811 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:32.014850 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:32.014862 | instance |
2026-04-13 03:28:32.014872 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:28:32.015018 | instance | Monday 13 April 2026  03:28:32 +0000 (0:00:03.219)       0:00:43.425 **********
2026-04-13 03:28:33.829340 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:28:33.830450 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:28:33.830497 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:28:33.830505 | instance |
2026-04-13 03:28:33.830512 | instance | PLAY [controllers] *************************************************************
2026-04-13 03:28:33.830518 | instance |
2026-04-13 03:28:33.830524 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:33.830530 | instance | Monday 13 April 2026  03:28:33 +0000 (0:00:01.815)       0:00:45.241 **********
2026-04-13 03:28:34.703250 | instance | ok: [instance]
2026-04-13 03:28:34.703318 | instance |
2026-04-13 03:28:34.703607 | instance | TASK [Set masquerade rule] *****************************************************
2026-04-13 03:28:34.703669 | instance | Monday 13 April 2026  03:28:34 +0000 (0:00:00.873)       0:00:46.114 **********
2026-04-13 03:28:35.177545 | instance | changed: [instance]
2026-04-13 03:28:35.177888 | instance |
2026-04-13 03:28:35.178739 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:35.178757 | instance | instance                   : ok=24   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:35.178768 | instance | localhost                  : ok=40   changed=21   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:35.179099 | instance |
2026-04-13 03:28:35.179500 | instance | Monday 13 April 2026  03:28:35 +0000 (0:00:00.474)       0:00:46.589 **********
2026-04-13 03:28:35.179845 | instance | ===============================================================================
2026-04-13 03:28:35.180225 | instance | Install depedencies ---------------------------------------------------- 18.93s
2026-04-13 03:28:35.180582 | instance | Create a volume group for each loop device ------------------------------ 3.22s
2026-04-13 03:28:35.180975 | instance | Generate SSH keys for missing variables --------------------------------- 3.18s
2026-04-13 03:28:35.181337 | instance | Create a logical volume for each loop device ---------------------------- 1.82s
2026-04-13 03:28:35.181686 | instance | Gathering Facts --------------------------------------------------------- 1.17s
2026-04-13 03:28:35.182030 | instance | Create folders for workspace -------------------------------------------- 1.00s
2026-04-13 03:28:35.182380 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.00s
2026-04-13 03:28:35.182765 | instance | Gathering Facts --------------------------------------------------------- 0.87s
2026-04-13 03:28:35.183141 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.76s
2026-04-13 03:28:35.183487 | instance | Start loop devices ------------------------------------------------------ 0.73s
2026-04-13 03:28:35.183830 | instance | Gathering Facts --------------------------------------------------------- 0.69s
2026-04-13 03:28:35.184174 | instance | Gathering Facts --------------------------------------------------------- 0.68s
2026-04-13 03:28:35.184517 | instance | Gathering Facts --------------------------------------------------------- 0.67s
2026-04-13 03:28:35.184860 | instance | Configure short hostname ------------------------------------------------ 0.65s
2026-04-13 03:28:35.185273 | instance | Purge "snapd" package --------------------------------------------------- 0.61s
2026-04-13 03:28:35.185627 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.56s
2026-04-13 03:28:35.185971 | instance | Set permissions on loopback devices ------------------------------------- 0.51s
2026-04-13 03:28:35.186149 | instance | Create devices for Ceph ------------------------------------------------- 0.50s
2026-04-13 03:28:35.186300 | instance | Start up service -------------------------------------------------------- 0.50s
2026-04-13 03:28:35.186446 | instance | Set masquerade rule ----------------------------------------------------- 0.47s
2026-04-13 03:28:35.310846 | instance | INFO     [aio > prepare] Executed: Successful
2026-04-13 03:28:35.322752 | instance | INFO     [aio > converge] Executing
2026-04-13 03:28:36.034588 | instance |
2026-04-13 03:28:36.035000 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:28:36.035302 | instance |
2026-04-13 03:28:36.035613 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:28:36.035928 | instance | Monday 13 April 2026  03:28:36 +0000 (0:00:00.010)       0:00:00.010 **********
2026-04-13 03:28:42.029665 | instance | changed: [localhost]
2026-04-13 03:28:42.029722 | instance |
2026-04-13 03:28:42.029733 | instance | TASK [Deploy with parallel orchestrator] ***************************************
2026-04-13 03:28:42.029743 | instance | Monday 13 April 2026  03:28:42 +0000 (0:00:05.993)       0:00:06.004 **********
2026-04-13 03:28:59.956438 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../playbooks"], "delta": "0:00:17.769925", "end": "2026-04-13 03:28:59.933475", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:28:42.163550", "stderr": "Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\nprerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2", "stderr_lines": ["Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2"], "stdout": "==> Running prerequisite: openstacksdk\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] PLAY [controllers[0]] **********************************************************\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] TASK [Gathering Facts] *********************************************************\n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:42 +0000 (0:00:00.010)       0:00:00.010 ********** \n[prerequisite-openstacksdk] [WARNING]: Platform linux on host instance is using the discovered Python\n[prerequisite-openstacksdk] interpreter at /usr/bin/python3.10, but future installation of another Python\n[prerequisite-openstacksdk] interpreter could change the meaning of that path. See\n[prerequisite-openstacksdk] https://docs.ansible.com/ansible-\n[prerequisite-openstacksdk] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[prerequisite-openstacksdk] ok: [instance]\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] TASK [vexxhost.atmosphere.openstacksdk : Install openstacksdk] *****************\n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:43 +0000 (0:00:01.092)       0:00:01.103 ********** \n[prerequisite-openstacksdk] fatal: [instance]: FAILED! => {\"attempts\": 3, \"changed\": false, \"msg\": \"Unable to find any of pip3 to use.  pip needs to be installed.\"}\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (3 retries left).\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (2 retries left).\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (1 retries left).\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] PLAY RECAP *********************************************************************\n[prerequisite-openstacksdk] instance                   : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   \n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:59 +0000 (0:00:16.149)       0:00:17.252 ********** \n[prerequisite-openstacksdk] =============================================================================== \n[prerequisite-openstacksdk] vexxhost.atmosphere.openstacksdk : Install openstacksdk ---------------- 16.15s\n[prerequisite-openstacksdk] Gathering Facts --------------------------------------------------------- 1.09s", "stdout_lines": ["==> Running prerequisite: openstacksdk", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] PLAY [controllers[0]] **********************************************************", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] TASK [Gathering Facts] *********************************************************", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:42 +0000 (0:00:00.010)       0:00:00.010 ********** ", "[prerequisite-openstacksdk] [WARNING]: Platform linux on host instance is using the discovered Python", "[prerequisite-openstacksdk] interpreter at /usr/bin/python3.10, but future installation of another Python", "[prerequisite-openstacksdk] interpreter could change the meaning of that path. See", "[prerequisite-openstacksdk] https://docs.ansible.com/ansible-", "[prerequisite-openstacksdk] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[prerequisite-openstacksdk] ok: [instance]", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] TASK [vexxhost.atmosphere.openstacksdk : Install openstacksdk] *****************", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:43 +0000 (0:00:01.092)       0:00:01.103 ********** ", "[prerequisite-openstacksdk] fatal: [instance]: FAILED! => {\"attempts\": 3, \"changed\": false, \"msg\": \"Unable to find any of pip3 to use.  pip needs to be installed.\"}", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (3 retries left).", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (2 retries left).", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (1 retries left).", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] PLAY RECAP *********************************************************************", "[prerequisite-openstacksdk] instance                   : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   ", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:59 +0000 (0:00:16.149)       0:00:17.252 ********** ", "[prerequisite-openstacksdk] =============================================================================== ", "[prerequisite-openstacksdk] vexxhost.atmosphere.openstacksdk : Install openstacksdk ---------------- 16.15s", "[prerequisite-openstacksdk] Gathering Facts --------------------------------------------------------- 1.09s"]}
2026-04-13 03:28:59.958289 | instance |
2026-04-13 03:28:59.958309 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:59.958318 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-04-13 03:28:59.958324 | instance |
2026-04-13 03:28:59.958330 | instance | Monday 13 April 2026  03:28:59 +0000 (0:00:17.929)       0:00:23.933 **********
2026-04-13 03:28:59.958337 | instance | ===============================================================================
2026-04-13 03:28:59.958343 | instance | Deploy with parallel orchestrator -------------------------------------- 17.93s
2026-04-13 03:28:59.958348 | instance | Build atmosphere binary ------------------------------------------------- 5.99s
2026-04-13 03:29:00.018843 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:29:00.019212 | instance | ERROR    [aio > converge] Executed: Failed
2026-04-13 03:29:00.019239 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:29:00.590033 | instance | ERROR
2026-04-13 03:29:00.590321 | instance | {
2026-04-13 03:29:00.590365 | instance |   "delta": "0:01:52.505472",
2026-04-13 03:29:00.590395 | instance |   "end": "2026-04-13 03:29:00.093807",
2026-04-13 03:29:00.590423 | instance |   "msg": "non-zero return code",
2026-04-13 03:29:00.590450 | instance |   "rc": 2,
2026-04-13 03:29:00.590480 | instance |   "start": "2026-04-13 03:27:07.588335"
2026-04-13 03:29:00.590507 | instance | }
failure
2026-04-13 03:29:00.601045 | 
2026-04-13 03:29:00.601152 | PLAY RECAP
2026-04-13 03:29:00.601249 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:29:00.601300 | 
2026-04-13 03:29:00.755176 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:29:00.766794 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:29:01.478270 | 
2026-04-13 03:29:01.478430 | PLAY [all]
2026-04-13 03:29:01.497528 | 
2026-04-13 03:29:01.497698 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:29:01.878028 | instance | changed
2026-04-13 03:29:01.884690 | 
2026-04-13 03:29:01.884784 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:29:02.212313 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:29:02.225664 | instance | + ip addr
2026-04-13 03:29:02.227640 | instance | + ip route
2026-04-13 03:29:02.228832 | instance | + lsblk
2026-04-13 03:29:02.231636 | instance | + mount
2026-04-13 03:29:02.232846 | instance | + docker images
2026-04-13 03:29:02.233176 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:29:02.233273 | instance | + brctl show
2026-04-13 03:29:02.233591 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:29:02.233679 | instance | + ps aux --sort=-%mem
2026-04-13 03:29:02.249028 | instance | + dpkg -l
2026-04-13 03:29:02.257626 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:29:02.258208 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:29:02.258243 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:29:02.258593 | instance | + '[' '!' -z '' ']'
2026-04-13 03:29:02.427715 | instance | ok: Runtime: 0:00:00.052216
2026-04-13 03:29:02.443458 | 
2026-04-13 03:29:02.443668 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:29:03.100853 | instance | changed:
2026-04-13 03:29:03.101119 | instance | created directory /var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/logs/instance
2026-04-13 03:29:03.101165 | instance | cd+++++++++ system/
2026-04-13 03:29:03.101199 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:29:03.101230 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:29:03.101260 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:29:03.101294 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:29:03.101331 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:29:03.101373 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:29:03.101408 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:29:03.101438 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:29:03.101467 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:29:03.112805 | 
2026-04-13 03:29:03.112888 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:29:03.305800 | instance | changed: "values"
2026-04-13 03:29:03.464428 | instance | changed: "releases"
2026-04-13 03:29:03.477707 | 
2026-04-13 03:29:03.477925 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:29:03.685655 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:29:04.013828 | instance | ok: Runtime: 0:00:00.006088
2026-04-13 03:29:04.019269 | 
2026-04-13 03:29:04.019350 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:29:04.510815 | instance | changed:
2026-04-13 03:29:04.511101 | instance | cd+++++++++ helm/
2026-04-13 03:29:04.511144 | instance | cd+++++++++ helm/releases/
2026-04-13 03:29:04.511173 | instance | cd+++++++++ helm/values/
2026-04-13 03:29:04.523159 | 
2026-04-13 03:29:04.523247 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:29:04.723105 | instance | changed
2026-04-13 03:29:04.763420 | 
2026-04-13 03:29:04.763578 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:29:04.967002 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:04.967692 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:04.973377 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:04.973656 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:04.974513 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:04.974551 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:04.977849 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:04.979106 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:04.979553 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:04.980948 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:04.981316 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:04.982931 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:05.299093 | instance | ok: Runtime: 0:00:00.023648
2026-04-13 03:29:05.306369 | 
2026-04-13 03:29:05.306441 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:29:05.501365 | instance | changed
2026-04-13 03:29:05.508700 | 
2026-04-13 03:29:05.508860 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:29:05.709527 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:29:05.709917 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:05.710352 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:05.711063 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:06.051491 | instance | ok: Runtime: 0:00:00.008102
2026-04-13 03:29:06.057891 | 
2026-04-13 03:29:06.057966 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:29:06.544540 | instance | changed:
2026-04-13 03:29:06.544753 | instance | cd+++++++++ objects/
2026-04-13 03:29:06.544793 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:29:06.544825 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:29:06.555289 | 
2026-04-13 03:29:06.555354 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:29:06.751466 | instance | changed
2026-04-13 03:29:06.756439 | 
2026-04-13 03:29:06.756505 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:29:06.958921 | instance | changed
2026-04-13 03:29:06.963664 | 
2026-04-13 03:29:06.963730 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:29:07.161370 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:29:07.498638 | instance | ok: Runtime: 0:00:00.008063
2026-04-13 03:29:07.504101 | 
2026-04-13 03:29:07.504167 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:29:08.009491 | instance | changed:
2026-04-13 03:29:08.009668 | instance | cd+++++++++ pod-logs/
2026-04-13 03:29:08.009695 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:29:08.019358 | 
2026-04-13 03:29:08.019422 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:29:08.215351 | instance | changed
2026-04-13 03:29:08.221681 | 
2026-04-13 03:29:08.221750 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:29:08.433210 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:29:08.758944 | instance | ok: Runtime: 0:00:00.035587
2026-04-13 03:29:08.766420 | 
2026-04-13 03:29:08.766513 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:29:08.971080 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:29:09.001513 | instance | ceph-mgr endpoints:
2026-04-13 03:29:09.303708 | instance | ok: Runtime: 0:00:00.036870
2026-04-13 03:29:09.312150 | 
2026-04-13 03:29:09.312223 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:29:09.524276 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:29:09.848489 | instance | ok: Runtime: 0:00:00.040718
2026-04-13 03:29:09.855537 | 
2026-04-13 03:29:09.855611 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:29:10.388791 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:29:10.399329 | 
2026-04-13 03:29:10.399477 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:29:10.679520 | instance | changed
2026-04-13 03:29:10.685344 | 
2026-04-13 03:29:10.685445 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:29:10.902281 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:29:10.903884 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:29:11.233169 | instance | ERROR
2026-04-13 03:29:11.233450 | instance | {
2026-04-13 03:29:11.233500 | instance |   "delta": "0:00:00.007368",
2026-04-13 03:29:11.233532 | instance |   "end": "2026-04-13 03:29:10.904271",
2026-04-13 03:29:11.233561 | instance |   "msg": "non-zero return code",
2026-04-13 03:29:11.233588 | instance |   "rc": 1,
2026-04-13 03:29:11.233615 | instance |   "start": "2026-04-13 03:29:10.896903"
2026-04-13 03:29:11.233642 | instance | }
2026-04-13 03:29:11.233675 | instance | ERROR: Ignoring Errors
2026-04-13 03:29:11.241045 | 
2026-04-13 03:29:11.241143 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:29:11.743066 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:29:11.751344 | 
2026-04-13 03:29:11.751463 | PLAY RECAP
2026-04-13 03:29:11.751537 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:29:11.751579 | 
2026-04-13 03:29:11.881397 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:29:11.890875 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:29:12.502775 | 
2026-04-13 03:29:12.502942 | PLAY [all]
2026-04-13 03:29:12.514716 | 
2026-04-13 03:29:12.514803 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:29:12.562132 | instance | skipping: Conditional result was False
2026-04-13 03:29:12.573288 | 
2026-04-13 03:29:12.573383 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:29:12.617900 | instance | ok
2026-04-13 03:29:12.624843 | 
2026-04-13 03:29:12.624947 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:29:13.000646 | instance -> localhost | ok: "/var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/logs"
2026-04-13 03:29:13.208243 | instance -> localhost | changed: "/var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/artifacts"
2026-04-13 03:29:13.411124 | instance -> localhost | changed: "/var/lib/zuul/builds/53a285d5e7f44e2e87fd6ed07385a404/work/docs"
2026-04-13 03:29:13.424725 | 
2026-04-13 03:29:13.424872 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:29:14.067135 | instance | changed: .d..t...... ./
2026-04-13 03:29:14.067388 | instance | changed: All items complete
2026-04-13 03:29:14.067433 | 
2026-04-13 03:29:14.530515 | instance | changed: .d..t...... ./
2026-04-13 03:29:14.983954 | instance | changed: .d..t...... ./
2026-04-13 03:29:15.011926 | 
2026-04-13 03:29:15.012048 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:29:15.440722 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.008432
2026-04-13 03:29:15.663891 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007442
2026-04-13 03:29:15.683186 | 
2026-04-13 03:29:15.683331 | PLAY [all]
2026-04-13 03:29:15.692653 | 
2026-04-13 03:29:15.692744 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:29:16.112162 | instance | changed
2026-04-13 03:29:16.119829 | 
2026-04-13 03:29:16.119890 | PLAY RECAP
2026-04-13 03:29:16.119944 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:29:16.119972 | 
2026-04-13 03:29:16.245636 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:29:16.259336 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:29:16.831465 | 
2026-04-13 03:29:16.831779 | PLAY [localhost]
2026-04-13 03:29:16.841346 | 
2026-04-13 03:29:16.841418 | TASK [Generate Zuul manifest]
2026-04-13 03:29:16.865622 | localhost | ok
2026-04-13 03:29:16.883815 | 
2026-04-13 03:29:16.883925 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:29:17.258476 | localhost | changed
2026-04-13 03:29:17.270499 | 
2026-04-13 03:29:17.270582 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:29:17.304917 | localhost | ok
2026-04-13 03:29:17.315016 | 
2026-04-13 03:29:17.315113 | TASK [Upload logs]
2026-04-13 03:29:17.337832 | localhost | ok
2026-04-13 03:29:17.476939 | 
2026-04-13 03:29:17.477113 | TASK [Set zuul-log-path fact]
2026-04-13 03:29:17.500047 | localhost | ok
2026-04-13 03:29:17.513753 | 
2026-04-13 03:29:17.513825 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:29:17.546104 | localhost | ok
2026-04-13 03:29:17.555438 | 
2026-04-13 03:29:17.555507 | TASK [upload-logs : Create log directories]
2026-04-13 03:29:17.967555 | localhost | changed
2026-04-13 03:29:17.974550 | 
2026-04-13 03:29:17.974650 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:29:18.369133 | localhost -> localhost | ok: Runtime: 0:00:00.007456
2026-04-13 03:29:18.376734 | 
2026-04-13 03:29:18.376829 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:29:18.811263 | localhost | Output suppressed because no_log was given
2026-04-13 03:29:18.816196 | 
2026-04-13 03:29:18.816287 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:29:18.866196 | localhost | skipping: Conditional result was False
2026-04-13 03:29:18.873004 | localhost | skipping: Conditional result was False
2026-04-13 03:29:18.891830 | 
2026-04-13 03:29:18.892052 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:29:18.947115 | localhost | skipping: Conditional result was False
2026-04-13 03:29:18.947666 | 
2026-04-13 03:29:18.952184 | localhost | skipping: Conditional result was False
2026-04-13 03:29:18.976140 | 
2026-04-13 03:29:18.976609 | LOOP [upload-logs : Upload console log and json output]