2026-04-13 03:26:03.865515 | Job console starting
2026-04-13 03:26:03.882776 | Updating git repos
2026-04-13 03:26:04.014164 | Cloning repos into workspace
2026-04-13 03:26:04.287175 | Restoring repo states
2026-04-13 03:26:04.305327 | Merging changes
2026-04-13 03:26:05.898865 | Checking out repos
2026-04-13 03:26:06.498336 | Preparing playbooks
2026-04-13 03:26:21.536789 | Running Ansible setup
2026-04-13 03:26:25.125036 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:25.765957 | 
2026-04-13 03:26:25.766138 | PLAY [localhost]
2026-04-13 03:26:25.773563 | 
2026-04-13 03:26:25.773632 | TASK [Gathering Facts]
2026-04-13 03:26:26.681099 | localhost | ok
2026-04-13 03:26:26.692655 | 
2026-04-13 03:26:26.692772 | TASK [Setup log path fact]
2026-04-13 03:26:26.713466 | localhost | ok
2026-04-13 03:26:26.727522 | 
2026-04-13 03:26:26.727680 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:26:26.757318 | localhost | ok
2026-04-13 03:26:26.766168 | 
2026-04-13 03:26:26.766279 | TASK [emit-job-header : Print job information]
2026-04-13 03:26:26.806153 | # Job Information
2026-04-13 03:26:26.846070 | Ansible Version: 2.16.16
2026-04-13 03:26:26.846274 | Job: atmosphere-molecule-aio-openvswitch
2026-04-13 03:26:26.846356 | Pipeline: check
2026-04-13 03:26:26.846426 | Executor: 0a8996d2b663
2026-04-13 03:26:26.846490 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818
2026-04-13 03:26:26.846567 | Event ID: 6af5c400-36e8-11f1-9a0c-69c921595019
2026-04-13 03:26:26.852353 | 
2026-04-13 03:26:26.852453 | LOOP [emit-job-header : Print node information]
2026-04-13 03:26:26.943713 | localhost | ok:
2026-04-13 03:26:26.943886 | localhost | # Node Information
2026-04-13 03:26:26.943914 | localhost | Inventory Hostname: instance
2026-04-13 03:26:26.943936 | localhost | Hostname: np0000165445
2026-04-13 03:26:26.943956 | localhost | Username: zuul
2026-04-13 03:26:26.943979 | localhost | Distro: Ubuntu 22.04
2026-04-13 03:26:26.943999 | localhost | Provider: yul1
2026-04-13 03:26:26.944018 | localhost | Region: ca-ymq-1
2026-04-13 03:26:26.944037 | localhost | Label: ubuntu-jammy-16
2026-04-13 03:26:26.944054 | localhost | Product Name: OpenStack Nova
2026-04-13 03:26:26.944072 | localhost | Interface IP: 162.253.55.204
2026-04-13 03:26:26.960977 | 
2026-04-13 03:26:26.961103 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-13 03:26:27.349014 | localhost -> localhost | changed
2026-04-13 03:26:27.355271 | 
2026-04-13 03:26:27.355345 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-13 03:26:28.252650 | localhost -> localhost | changed
2026-04-13 03:26:28.261811 | 
2026-04-13 03:26:28.261892 | PLAY [all]
2026-04-13 03:26:28.270339 | 
2026-04-13 03:26:28.270402 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-13 03:26:28.505855 | instance -> localhost | ok
2026-04-13 03:26:28.513990 | 
2026-04-13 03:26:28.514077 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-13 03:26:28.545223 | instance | ok
2026-04-13 03:26:28.558708 | instance | included: /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-13 03:26:28.564560 | 
2026-04-13 03:26:28.564805 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-13 03:26:29.591834 | instance -> localhost | Generating public/private rsa key pair.
2026-04-13 03:26:29.591983 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/999123a665dc406bbe97e766f7cc5ac9_id_rsa
2026-04-13 03:26:29.592013 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/999123a665dc406bbe97e766f7cc5ac9_id_rsa.pub
2026-04-13 03:26:29.592036 | instance -> localhost | The key fingerprint is:
2026-04-13 03:26:29.592058 | instance -> localhost | SHA256:DLsgl3wBbP2a3Mv5G1/OnVjFrBPe9VJvsn331zw1u/M zuul-build-sshkey
2026-04-13 03:26:29.592090 | instance -> localhost | The key's randomart image is:
2026-04-13 03:26:29.592112 | instance -> localhost | +---[RSA 3072]----+
2026-04-13 03:26:29.592139 | instance -> localhost | |   ...           |
2026-04-13 03:26:29.592161 | instance -> localhost | |    o..          |
2026-04-13 03:26:29.592182 | instance -> localhost | |   .  o.         |
2026-04-13 03:26:29.592202 | instance -> localhost | |   . . =.      o |
2026-04-13 03:26:29.592222 | instance -> localhost | |  . =.o+S     . *|
2026-04-13 03:26:29.592242 | instance -> localhost | |   o o+..    . **|
2026-04-13 03:26:29.592262 | instance -> localhost | |      .. o.   BoX|
2026-04-13 03:26:29.592282 | instance -> localhost | |        +  o +o%B|
2026-04-13 03:26:29.592304 | instance -> localhost | |         .o...+oE|
2026-04-13 03:26:29.592324 | instance -> localhost | +----[SHA256]-----+
2026-04-13 03:26:29.592368 | instance -> localhost | ok: Runtime: 0:00:00.652639
2026-04-13 03:26:29.598382 | 
2026-04-13 03:26:29.598447 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-13 03:26:29.629746 | instance | ok
2026-04-13 03:26:29.644451 | instance | included: /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-13 03:26:29.662444 | 
2026-04-13 03:26:29.662695 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-13 03:26:29.688587 | instance | skipping: Conditional result was False
2026-04-13 03:26:29.698031 | 
2026-04-13 03:26:29.698222 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-13 03:26:30.141044 | instance | changed
2026-04-13 03:26:30.147132 | 
2026-04-13 03:26:30.147201 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-13 03:26:30.323621 | instance | ok
2026-04-13 03:26:30.328750 | 
2026-04-13 03:26:30.328816 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-13 03:26:30.763946 | instance | changed
2026-04-13 03:26:30.768994 | 
2026-04-13 03:26:30.769058 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-13 03:26:31.234368 | instance | changed
2026-04-13 03:26:31.239925 | 
2026-04-13 03:26:31.240012 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-13 03:26:31.265447 | instance | skipping: Conditional result was False
2026-04-13 03:26:31.275980 | 
2026-04-13 03:26:31.276094 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-13 03:26:31.643990 | instance -> localhost | changed
2026-04-13 03:26:31.686018 | 
2026-04-13 03:26:31.686143 | TASK [add-build-sshkey : Add back temp key]
2026-04-13 03:26:31.963124 | instance -> localhost | Identity added: /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/999123a665dc406bbe97e766f7cc5ac9_id_rsa (zuul-build-sshkey)
2026-04-13 03:26:31.963296 | instance -> localhost | ok: Runtime: 0:00:00.011652
2026-04-13 03:26:31.968429 | 
2026-04-13 03:26:31.968511 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-13 03:26:32.234542 | instance | ok
2026-04-13 03:26:32.446984 | 
2026-04-13 03:26:32.447143 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-13 03:26:32.480864 | instance | skipping: Conditional result was False
2026-04-13 03:26:32.496674 | 
2026-04-13 03:26:32.496749 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-13 03:26:32.770246 | instance | ok
2026-04-13 03:26:32.777153 | 
2026-04-13 03:26:32.777228 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-13 03:26:34.466888 | instance | Output suppressed because no_log was given
2026-04-13 03:26:34.492408 | 
2026-04-13 03:26:34.492525 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-13 03:26:34.677670 | instance | ok: "logs"
2026-04-13 03:26:34.677891 | instance | ok: All items complete
2026-04-13 03:26:34.677920 | 
2026-04-13 03:26:34.827952 | instance | ok: "artifacts"
2026-04-13 03:26:34.995023 | instance | ok: "docs"
2026-04-13 03:26:35.020032 | 
2026-04-13 03:26:35.020192 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-13 03:26:35.199862 | instance | changed: "logs"
2026-04-13 03:26:35.361921 | instance | changed: "artifacts"
2026-04-13 03:26:35.519121 | instance | changed: "docs"
2026-04-13 03:26:35.533110 | 
2026-04-13 03:26:35.533181 | PLAY RECAP
2026-04-13 03:26:35.533236 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-13 03:26:35.533275 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:35.533305 | 
2026-04-13 03:26:35.637176 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-13 03:26:35.648876 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:36.344588 | 
2026-04-13 03:26:36.344765 | PLAY [all]
2026-04-13 03:26:36.359338 | 
2026-04-13 03:26:36.359453 | TASK [setup-uv : Extract archive]
2026-04-13 03:26:38.584609 | instance | changed
2026-04-13 03:26:38.590645 | 
2026-04-13 03:26:38.590726 | TASK [setup-uv : Print version]
2026-04-13 03:26:38.930115 | instance | uv 0.8.13
2026-04-13 03:26:39.126504 | instance | ok: Runtime: 0:00:00.012927
2026-04-13 03:26:39.134344 | 
2026-04-13 03:26:39.134393 | PLAY RECAP
2026-04-13 03:26:39.134438 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:39.134461 | 
2026-04-13 03:26:39.231319 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-13 03:26:39.242624 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:39.832087 | 
2026-04-13 03:26:39.832733 | PLAY [all]
2026-04-13 03:26:39.847152 | 
2026-04-13 03:26:39.847240 | TASK [Install "jq" for log collection]
2026-04-13 03:26:49.921811 | instance | changed
2026-04-13 03:26:49.925866 | 
2026-04-13 03:26:49.925934 | PLAY [all]
2026-04-13 03:26:49.934061 | 
2026-04-13 03:26:49.934169 | TASK [ensure-go : Check installed go version]
2026-04-13 03:26:50.472829 | instance | ok: ERROR (ignored)
2026-04-13 03:26:50.473197 | instance | {
2026-04-13 03:26:50.473231 | instance |   "failed_when_result": false,
2026-04-13 03:26:50.473256 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-13 03:26:50.473276 | instance |   "rc": 2
2026-04-13 03:26:50.473296 | instance | }
2026-04-13 03:26:50.478555 | 
2026-04-13 03:26:50.478630 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-13 03:26:50.545752 | instance | ok
2026-04-13 03:26:50.554898 | instance | included: /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-13 03:26:50.560086 | 
2026-04-13 03:26:50.560165 | TASK [ensure-go : Create temp directory]
2026-04-13 03:26:50.888800 | instance | changed
2026-04-13 03:26:50.894413 | 
2026-04-13 03:26:50.894486 | TASK [ensure-go : Get archive checksum]
2026-04-13 03:26:51.497800 | instance | ok: OK (64 bytes)
2026-04-13 03:26:51.505632 | 
2026-04-13 03:26:51.505727 | TASK [ensure-go : Download go archive]
2026-04-13 03:26:52.891486 | instance | changed: OK (78559214 bytes)
2026-04-13 03:26:52.897422 | 
2026-04-13 03:26:52.897499 | TASK [ensure-go : Install go]
2026-04-13 03:26:58.727227 | instance | changed
2026-04-13 03:26:58.736350 | 
2026-04-13 03:26:58.736400 | PLAY RECAP
2026-04-13 03:26:58.736441 | instance | ok: 7 changed: 4 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:26:58.736466 | 
2026-04-13 03:26:58.835517 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-13 03:26:58.849437 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:26:59.521652 | 
2026-04-13 03:26:59.521826 | PLAY [all]
2026-04-13 03:26:59.533969 | 
2026-04-13 03:26:59.534048 | TASK [Copy inventory file for Zuul]
2026-04-13 03:27:00.409048 | instance | changed
2026-04-13 03:27:00.414742 | 
2026-04-13 03:27:00.414818 | TASK [Switch "ansible_host" to private IP]
2026-04-13 03:27:00.711879 | instance | changed: 1 replacements made
2026-04-13 03:27:00.719427 | 
2026-04-13 03:27:00.719520 | TASK [Run Molecule scenario]
2026-04-13 03:27:01.158134 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-13 03:27:01.158348 | instance | Creating virtual environment at: .venv
2026-04-13 03:27:01.182428 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:01.210134 | instance | Downloading pygments (1.2MiB)
2026-04-13 03:27:01.211441 | instance | Downloading openstacksdk (1.7MiB)
2026-04-13 03:27:01.211672 | instance | Downloading ansible-core (2.1MiB)
2026-04-13 03:27:01.212591 | instance | Downloading rjsonnet (1.2MiB)
2026-04-13 03:27:01.212823 | instance | Downloading setuptools (1.1MiB)
2026-04-13 03:27:01.213315 | instance | Downloading cryptography (4.2MiB)
2026-04-13 03:27:01.213841 | instance | Downloading kubernetes (1.9MiB)
2026-04-13 03:27:01.215326 | instance | Downloading netaddr (2.2MiB)
2026-04-13 03:27:01.216756 | instance | Downloading pydantic-core (2.0MiB)
2026-04-13 03:27:01.539423 | instance |    Building pyperclip==1.9.0
2026-04-13 03:27:01.550599 | instance |  Downloading rjsonnet
2026-04-13 03:27:01.654448 | instance |  Downloading pydantic-core
2026-04-13 03:27:01.705010 | instance |  Downloading netaddr
2026-04-13 03:27:01.714648 | instance |  Downloading pygments
2026-04-13 03:27:01.726987 | instance |  Downloading cryptography
2026-04-13 03:27:01.763539 | instance |  Downloading setuptools
2026-04-13 03:27:01.822077 | instance |  Downloading kubernetes
2026-04-13 03:27:01.856031 | instance |  Downloading ansible-core
2026-04-13 03:27:01.892275 | instance |  Downloading openstacksdk
2026-04-13 03:27:02.240870 | instance |       Built pyperclip==1.9.0
2026-04-13 03:27:02.450535 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-13 03:27:02.492020 | instance | Installed 83 packages in 39ms
2026-04-13 03:27:03.142479 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-13 03:27:03.781743 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-13 03:27:03.781886 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-04-13 03:27:42.087199 | instance | INFO     [aio > dependency] Executing
2026-04-13 03:27:42.087420 | instance | WARNING  [aio > dependency] Missing roles requirements file: requirements.yml
2026-04-13 03:27:42.087634 | instance | WARNING  [aio > dependency] Missing collections requirements file: collections.yml
2026-04-13 03:27:42.087747 | instance | WARNING  [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-13 03:27:42.095417 | instance | INFO     [aio > cleanup] Executing
2026-04-13 03:27:42.095755 | instance | WARNING  [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:42.106530 | instance | INFO     [aio > destroy] Executing
2026-04-13 03:27:42.106653 | instance | WARNING  [aio > destroy] Skipping, '--destroy=never' requested.
2026-04-13 03:27:42.106736 | instance | INFO     [aio > destroy] Executed: Successful
2026-04-13 03:27:42.114935 | instance | INFO     [aio > syntax] Executing
2026-04-13 03:27:42.922527 | instance |
2026-04-13 03:27:42.922822 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:27:42.964017 | instance | INFO     [aio > syntax] Executed: Successful
2026-04-13 03:27:42.976539 | instance | INFO     [aio > create] Executing
2026-04-13 03:27:42.978356 | instance | WARNING  [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-13 03:27:42.985815 | instance | INFO     [aio > prepare] Executing
2026-04-13 03:27:43.857999 | instance |
2026-04-13 03:27:43.858256 | instance | PLAY [Prepare] *****************************************************************
2026-04-13 03:27:43.858511 | instance |
2026-04-13 03:27:43.858784 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:43.859060 | instance | Monday 13 April 2026  03:27:43 +0000 (0:00:00.025)       0:00:00.025 **********
2026-04-13 03:27:44.990610 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-13 03:27:44.990734 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-13 03:27:44.990946 | instance | interpreter could change the meaning of that path. See
2026-04-13 03:27:44.991075 | instance | https://docs.ansible.com/ansible-
2026-04-13 03:27:44.991280 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-13 03:27:45.000450 | instance | ok: [instance]
2026-04-13 03:27:45.000608 | instance |
2026-04-13 03:27:45.000779 | instance | TASK [Configure short hostname] ************************************************
2026-04-13 03:27:45.000992 | instance | Monday 13 April 2026  03:27:44 +0000 (0:00:01.142)       0:00:01.168 **********
2026-04-13 03:27:45.699542 | instance | changed: [instance]
2026-04-13 03:27:45.699777 | instance |
2026-04-13 03:27:45.700159 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-13 03:27:45.700453 | instance | Monday 13 April 2026  03:27:45 +0000 (0:00:00.698)       0:00:01.867 **********
2026-04-13 03:27:45.960278 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-13 03:27:45.960526 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-13 03:27:45.960800 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-13 03:27:45.968968 | instance | changed: [instance]
2026-04-13 03:27:45.969282 | instance |
2026-04-13 03:27:45.969609 | instance | TASK [Install "dirmngr" for GPG keyserver operations] **************************
2026-04-13 03:27:45.969882 | instance | Monday 13 April 2026  03:27:45 +0000 (0:00:00.269)       0:00:02.136 **********
2026-04-13 03:27:47.266627 | instance | ok: [instance]
2026-04-13 03:27:47.266811 | instance |
2026-04-13 03:27:47.267032 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-13 03:27:47.267118 | instance | Monday 13 April 2026  03:27:47 +0000 (0:00:01.297)       0:00:03.434 **********
2026-04-13 03:27:48.078975 | instance | ok: [instance]
2026-04-13 03:27:48.079208 | instance |
2026-04-13 03:27:48.079490 | instance | PLAY [Generate workspace for Atmosphere] ***************************************
2026-04-13 03:27:48.079775 | instance |
2026-04-13 03:27:48.080053 | instance | TASK [Create folders for workspace] ********************************************
2026-04-13 03:27:48.080332 | instance | Monday 13 April 2026  03:27:48 +0000 (0:00:00.812)       0:00:04.246 **********
2026-04-13 03:27:49.090482 | instance | changed: [localhost] => (item=group_vars)
2026-04-13 03:27:49.090631 | instance | changed: [localhost] => (item=group_vars/all)
2026-04-13 03:27:49.090815 | instance | changed: [localhost] => (item=group_vars/controllers)
2026-04-13 03:27:49.090996 | instance | changed: [localhost] => (item=group_vars/cephs)
2026-04-13 03:27:49.091177 | instance | changed: [localhost] => (item=group_vars/computes)
2026-04-13 03:27:49.091375 | instance | changed: [localhost] => (item=host_vars)
2026-04-13 03:27:49.091543 | instance |
2026-04-13 03:27:49.091727 | instance | PLAY [Generate Ceph control plane configuration for workspace] *****************
2026-04-13 03:27:49.091894 | instance |
2026-04-13 03:27:49.092077 | instance | TASK [Ensure the Ceph control plane configuration file exists] *****************
2026-04-13 03:27:49.092258 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:01.011)       0:00:05.258 **********
2026-04-13 03:27:49.282224 | instance | changed: [localhost]
2026-04-13 03:27:49.282409 | instance |
2026-04-13 03:27:49.282686 | instance | TASK [Load the current Ceph control plane configuration into a variable] *******
2026-04-13 03:27:49.282954 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:00.191)       0:00:05.450 **********
2026-04-13 03:27:49.310313 | instance | ok: [localhost]
2026-04-13 03:27:49.310573 | instance |
2026-04-13 03:27:49.310852 | instance | TASK [Generate Ceph control plane values for missing variables] ****************
2026-04-13 03:27:49.311122 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:00.027)       0:00:05.477 **********
2026-04-13 03:27:49.359451 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': 'bc991d85-352c-5c86-8a48-297d93e16720'})
2026-04-13 03:27:49.360307 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'})
2026-04-13 03:27:49.360606 | instance |
2026-04-13 03:27:49.360884 | instance | TASK [Write new Ceph control plane configuration file to disk] *****************
2026-04-13 03:27:49.361157 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:00.049)       0:00:05.527 **********
2026-04-13 03:27:49.920578 | instance | changed: [localhost]
2026-04-13 03:27:49.920710 | instance |
2026-04-13 03:27:49.920902 | instance | PLAY [Generate Ceph OSD configuration for workspace] ***************************
2026-04-13 03:27:49.921082 | instance |
2026-04-13 03:27:49.921294 | instance | TASK [Ensure the Ceph OSDs configuration file exists] **************************
2026-04-13 03:27:49.921496 | instance | Monday 13 April 2026  03:27:49 +0000 (0:00:00.560)       0:00:06.087 **********
2026-04-13 03:27:50.099061 | instance | changed: [localhost]
2026-04-13 03:27:50.099289 | instance |
2026-04-13 03:27:50.099582 | instance | TASK [Load the current Ceph OSDs configuration into a variable] ****************
2026-04-13 03:27:50.099865 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.178)       0:00:06.266 **********
2026-04-13 03:27:50.125836 | instance | ok: [localhost]
2026-04-13 03:27:50.126005 | instance |
2026-04-13 03:27:50.126199 | instance | TASK [Generate Ceph OSDs values for missing variables] *************************
2026-04-13 03:27:50.126386 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.026)       0:00:06.292 **********
2026-04-13 03:27:50.160567 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']})
2026-04-13 03:27:50.160815 | instance |
2026-04-13 03:27:50.161090 | instance | TASK [Write new Ceph OSDs configuration file to disk] **************************
2026-04-13 03:27:50.161393 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.035)       0:00:06.327 **********
2026-04-13 03:27:50.509536 | instance | changed: [localhost]
2026-04-13 03:27:50.509768 | instance |
2026-04-13 03:27:50.510049 | instance | PLAY [Generate Kubernetes configuration for workspace] *************************
2026-04-13 03:27:50.510305 | instance |
2026-04-13 03:27:50.510579 | instance | TASK [Ensure the Kubernetes configuration file exists] *************************
2026-04-13 03:27:50.510862 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.349)       0:00:06.677 **********
2026-04-13 03:27:50.687052 | instance | changed: [localhost]
2026-04-13 03:27:50.687183 | instance |
2026-04-13 03:27:50.687370 | instance | TASK [Load the current Kubernetes configuration into a variable] ***************
2026-04-13 03:27:50.687557 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.176)       0:00:06.853 **********
2026-04-13 03:27:50.714137 | instance | ok: [localhost]
2026-04-13 03:27:50.714406 | instance |
2026-04-13 03:27:50.714683 | instance | TASK [Generate Kubernetes values for missing variables] ************************
2026-04-13 03:27:50.715001 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.027)       0:00:06.881 **********
2026-04-13 03:27:50.758065 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'})
2026-04-13 03:27:50.758373 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42})
2026-04-13 03:27:50.758671 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'})
2026-04-13 03:27:50.758933 | instance |
2026-04-13 03:27:50.759211 | instance | TASK [Write new Kubernetes configuration file to disk] *************************
2026-04-13 03:27:50.759477 | instance | Monday 13 April 2026  03:27:50 +0000 (0:00:00.044)       0:00:06.925 **********
2026-04-13 03:27:51.117734 | instance | changed: [localhost]
2026-04-13 03:27:51.117934 | instance |
2026-04-13 03:27:51.118187 | instance | PLAY [Generate Keepalived configuration for workspace] *************************
2026-04-13 03:27:51.118413 | instance |
2026-04-13 03:27:51.118672 | instance | TASK [Ensure the Keeaplived configuration file exists] *************************
2026-04-13 03:27:51.118927 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:00.359)       0:00:07.284 **********
2026-04-13 03:27:51.296826 | instance | changed: [localhost]
2026-04-13 03:27:51.297058 | instance |
2026-04-13 03:27:51.297360 | instance | TASK [Load the current Keepalived configuration into a variable] ***************
2026-04-13 03:27:51.297616 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:00.179)       0:00:07.463 **********
2026-04-13 03:27:51.323794 | instance | ok: [localhost]
2026-04-13 03:27:51.324035 | instance |
2026-04-13 03:27:51.324322 | instance | TASK [Generate Keepalived values for missing variables] ************************
2026-04-13 03:27:51.324677 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:00.027)       0:00:07.491 **********
2026-04-13 03:27:51.359991 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'})
2026-04-13 03:27:51.360241 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'})
2026-04-13 03:27:51.360505 | instance |
2026-04-13 03:27:51.360807 | instance | TASK [Write new Keepalived configuration file to disk] *************************
2026-04-13 03:27:51.361088 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:00.036)       0:00:07.527 **********
2026-04-13 03:27:51.730961 | instance | changed: [localhost]
2026-04-13 03:27:51.731174 | instance |
2026-04-13 03:27:51.731443 | instance | PLAY [Generate endpoints for workspace] ****************************************
2026-04-13 03:27:51.731690 | instance |
2026-04-13 03:27:51.731958 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:51.732226 | instance | Monday 13 April 2026  03:27:51 +0000 (0:00:00.370)       0:00:07.898 **********
2026-04-13 03:27:52.410545 | instance | ok: [localhost]
2026-04-13 03:27:52.410770 | instance |
2026-04-13 03:27:52.411093 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-13 03:27:52.411378 | instance | Monday 13 April 2026  03:27:52 +0000 (0:00:00.679)       0:00:08.577 **********
2026-04-13 03:27:52.582209 | instance | changed: [localhost]
2026-04-13 03:27:52.582455 | instance |
2026-04-13 03:27:52.582769 | instance | TASK [Load the current endpoints into a variable] ******************************
2026-04-13 03:27:52.583051 | instance | Monday 13 April 2026  03:27:52 +0000 (0:00:00.171)       0:00:08.749 **********
2026-04-13 03:27:52.607408 | instance | ok: [localhost]
2026-04-13 03:27:52.607679 | instance |
2026-04-13 03:27:52.607962 | instance | TASK [Generate endpoint skeleton for missing variables] ************************
2026-04-13 03:27:52.608244 | instance | Monday 13 April 2026  03:27:52 +0000 (0:00:00.025)       0:00:08.775 **********
2026-04-13 03:27:53.354827 | instance | ok: [localhost] => (item=keycloak_host)
2026-04-13 03:27:53.355067 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host)
2026-04-13 03:27:53.355323 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host)
2026-04-13 03:27:53.355584 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host)
2026-04-13 03:27:53.355852 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name)
2026-04-13 03:27:53.356116 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host)
2026-04-13 03:27:53.356372 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host)
2026-04-13 03:27:53.356624 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host)
2026-04-13 03:27:53.356887 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host)
2026-04-13 03:27:53.357198 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host)
2026-04-13 03:27:53.357458 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host)
2026-04-13 03:27:53.357721 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host)
2026-04-13 03:27:53.358023 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host)
2026-04-13 03:27:53.358268 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host)
2026-04-13 03:27:53.358525 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host)
2026-04-13 03:27:53.358887 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host)
2026-04-13 03:27:53.359198 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host)
2026-04-13 03:27:53.359486 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host)
2026-04-13 03:27:53.359768 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host)
2026-04-13 03:27:53.360069 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host)
2026-04-13 03:27:53.360340 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host)
2026-04-13 03:27:53.360621 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host)
2026-04-13 03:27:53.360939 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host)
2026-04-13 03:27:53.361237 | instance |
2026-04-13 03:27:53.361531 | instance | TASK [Write new endpoints file to disk] ****************************************
2026-04-13 03:27:53.361804 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.746)       0:00:09.521 **********
2026-04-13 03:27:53.714582 | instance | changed: [localhost]
2026-04-13 03:27:53.714702 | instance |
2026-04-13 03:27:53.714877 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-13 03:27:53.715050 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.360)       0:00:09.881 **********
2026-04-13 03:27:53.895014 | instance | changed: [localhost]
2026-04-13 03:27:53.895236 | instance |
2026-04-13 03:27:53.895507 | instance | PLAY [Generate Neutron configuration for workspace] ****************************
2026-04-13 03:27:53.895799 | instance |
2026-04-13 03:27:53.896073 | instance | TASK [Ensure the Neutron configuration file exists] ****************************
2026-04-13 03:27:53.896348 | instance | Monday 13 April 2026  03:27:53 +0000 (0:00:00.180)       0:00:10.062 **********
2026-04-13 03:27:54.068036 | instance | changed: [localhost]
2026-04-13 03:27:54.068223 | instance |
2026-04-13 03:27:54.068495 | instance | TASK [Load the current Neutron configuration into a variable] ******************
2026-04-13 03:27:54.068764 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.173)       0:00:10.235 **********
2026-04-13 03:27:54.096979 | instance | ok: [localhost]
2026-04-13 03:27:54.097292 | instance |
2026-04-13 03:27:54.097567 | instance | TASK [Generate Neutron values for missing variables] ***************************
2026-04-13 03:27:54.097835 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.029)       0:00:10.264 **********
2026-04-13 03:27:54.136599 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]})
2026-04-13 03:27:54.136864 | instance |
2026-04-13 03:27:54.137167 | instance | TASK [Write new Neutron configuration file to disk] ****************************
2026-04-13 03:27:54.137448 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.039)       0:00:10.304 **********
2026-04-13 03:27:54.470974 | instance | changed: [localhost]
2026-04-13 03:27:54.471213 | instance |
2026-04-13 03:27:54.471491 | instance | PLAY [Generate Nova configuration for workspace] *******************************
2026-04-13 03:27:54.471735 | instance |
2026-04-13 03:27:54.472018 | instance | TASK [Ensure the Nova configuration file exists] *******************************
2026-04-13 03:27:54.472283 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.333)       0:00:10.638 **********
2026-04-13 03:27:54.642680 | instance | changed: [localhost]
2026-04-13 03:27:54.642879 | instance |
2026-04-13 03:27:54.643149 | instance | TASK [Load the current Nova configuration into a variable] *********************
2026-04-13 03:27:54.643416 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.172)       0:00:10.810 **********
2026-04-13 03:27:54.669810 | instance | ok: [localhost]
2026-04-13 03:27:54.670027 | instance |
2026-04-13 03:27:54.670295 | instance | TASK [Generate Nova values for missing variables] ******************************
2026-04-13 03:27:54.670565 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.027)       0:00:10.837 **********
2026-04-13 03:27:54.711330 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]})
2026-04-13 03:27:54.711553 | instance |
2026-04-13 03:27:54.711826 | instance | TASK [Write new Nova configuration file to disk] *******************************
2026-04-13 03:27:54.712119 | instance | Monday 13 April 2026  03:27:54 +0000 (0:00:00.041)       0:00:10.879 **********
2026-04-13 03:27:55.064296 | instance | changed: [localhost]
2026-04-13 03:27:55.064493 | instance |
2026-04-13 03:27:55.064764 | instance | PLAY [Generate secrets for workspace] ******************************************
2026-04-13 03:27:55.065035 | instance |
2026-04-13 03:27:55.065349 | instance | TASK [Ensure the secrets file exists] ******************************************
2026-04-13 03:27:55.065604 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.352)       0:00:11.232 **********
2026-04-13 03:27:55.245715 | instance | changed: [localhost]
2026-04-13 03:27:55.245890 | instance |
2026-04-13 03:27:55.246167 | instance | TASK [Load the current secrets into a variable] ********************************
2026-04-13 03:27:55.246442 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.181)       0:00:11.413 **********
2026-04-13 03:27:55.275620 | instance | ok: [localhost]
2026-04-13 03:27:55.275860 | instance |
2026-04-13 03:27:55.276154 | instance | TASK [Generate secrets for missing variables] **********************************
2026-04-13 03:27:55.276426 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.030)       0:00:11.443 **********
2026-04-13 03:27:55.677987 | instance | ok: [localhost] => (item=heat_auth_encryption_key)
2026-04-13 03:27:55.678213 | instance | ok: [localhost] => (item=keepalived_password)
2026-04-13 03:27:55.678488 | instance | ok: [localhost] => (item=keycloak_admin_password)
2026-04-13 03:27:55.678752 | instance | ok: [localhost] => (item=keycloak_database_password)
2026-04-13 03:27:55.679016 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret)
2026-04-13 03:27:55.679315 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase)
2026-04-13 03:27:55.679586 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password)
2026-04-13 03:27:55.679848 | instance | ok: [localhost] => (item=octavia_heartbeat_key)
2026-04-13 03:27:55.680121 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password)
2026-04-13 03:27:55.680587 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key)
2026-04-13 03:27:55.680870 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password)
2026-04-13 03:27:55.681180 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password)
2026-04-13 03:27:55.681494 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password)
2026-04-13 03:27:55.682121 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password)
2026-04-13 03:27:55.682426 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password)
2026-04-13 03:27:55.682716 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password)
2026-04-13 03:27:55.683001 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password)
2026-04-13 03:27:55.683310 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password)
2026-04-13 03:27:55.683596 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password)
2026-04-13 03:27:55.683877 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password)
2026-04-13 03:27:55.684180 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password)
2026-04-13 03:27:55.684468 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password)
2026-04-13 03:27:55.684754 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password)
2026-04-13 03:27:55.685038 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password)
2026-04-13 03:27:55.685356 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password)
2026-04-13 03:27:55.685643 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password)
2026-04-13 03:27:55.685932 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret)
2026-04-13 03:27:55.686217 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password)
2026-04-13 03:27:55.686501 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password)
2026-04-13 03:27:55.686783 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password)
2026-04-13 03:27:55.687072 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password)
2026-04-13 03:27:55.687465 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password)
2026-04-13 03:27:55.687759 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password)
2026-04-13 03:27:55.688045 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password)
2026-04-13 03:27:55.688176 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password)
2026-04-13 03:27:55.688316 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password)
2026-04-13 03:27:55.688458 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password)
2026-04-13 03:27:55.688581 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password)
2026-04-13 03:27:55.688708 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password)
2026-04-13 03:27:55.688845 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password)
2026-04-13 03:27:55.688987 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password)
2026-04-13 03:27:55.689114 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password)
2026-04-13 03:27:55.689251 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password)
2026-04-13 03:27:55.689392 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password)
2026-04-13 03:27:55.689507 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password)
2026-04-13 03:27:55.689627 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password)
2026-04-13 03:27:55.689749 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password)
2026-04-13 03:27:55.689870 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password)
2026-04-13 03:27:55.689989 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password)
2026-04-13 03:27:55.690125 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password)
2026-04-13 03:27:55.690245 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password)
2026-04-13 03:27:55.690375 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password)
2026-04-13 03:27:55.690486 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password)
2026-04-13 03:27:55.690602 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password)
2026-04-13 03:27:55.690721 | instance |
2026-04-13 03:27:55.690845 | instance | TASK [Generate base64 encoded secrets] *****************************************
2026-04-13 03:27:55.690974 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.401)       0:00:11.845 **********
2026-04-13 03:27:55.737608 | instance | ok: [localhost] => (item=barbican_kek)
2026-04-13 03:27:55.737926 | instance |
2026-04-13 03:27:55.738245 | instance | TASK [Generate temporary files for generating keys for missing variables] ******
2026-04-13 03:27:55.738536 | instance | Monday 13 April 2026  03:27:55 +0000 (0:00:00.059)       0:00:11.904 **********
2026-04-13 03:27:56.150784 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:27:56.150863 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:27:56.150875 | instance |
2026-04-13 03:27:56.150886 | instance | TASK [Generate SSH keys for missing variables] *********************************
2026-04-13 03:27:56.150896 | instance | Monday 13 April 2026  03:27:56 +0000 (0:00:00.412)       0:00:12.316 **********
2026-04-13 03:27:58.596219 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:27:58.597238 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:27:58.597418 | instance |
2026-04-13 03:27:58.597431 | instance | TASK [Set values for SSH keys] *************************************************
2026-04-13 03:27:58.597451 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:02.446)       0:00:14.763 **********
2026-04-13 03:27:58.653771 | instance | ok: [localhost] => (item=manila_ssh_key)
2026-04-13 03:27:58.654085 | instance | ok: [localhost] => (item=nova_ssh_key)
2026-04-13 03:27:58.654346 | instance |
2026-04-13 03:27:58.654626 | instance | TASK [Delete the temporary files generated for SSH keys] ***********************
2026-04-13 03:27:58.654905 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.057)       0:00:14.821 **********
2026-04-13 03:27:58.977803 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-13 03:27:58.977845 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-13 03:27:58.978037 | instance |
2026-04-13 03:27:58.978192 | instance | TASK [Write new secrets file to disk] ******************************************
2026-04-13 03:27:58.978625 | instance | Monday 13 April 2026  03:27:58 +0000 (0:00:00.324)       0:00:15.145 **********
2026-04-13 03:27:59.349989 | instance | changed: [localhost]
2026-04-13 03:27:59.350267 | instance |
2026-04-13 03:27:59.350560 | instance | TASK [Encrypt secrets file with Vault password] ********************************
2026-04-13 03:27:59.350842 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.371)       0:00:15.516 **********
2026-04-13 03:27:59.399629 | instance | skipping: [localhost]
2026-04-13 03:27:59.399793 | instance |
2026-04-13 03:27:59.400067 | instance | PLAY [Setup networking] ********************************************************
2026-04-13 03:27:59.400349 | instance |
2026-04-13 03:27:59.400643 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:27:59.400923 | instance | Monday 13 April 2026  03:27:59 +0000 (0:00:00.050)       0:00:15.566 **********
2026-04-13 03:28:00.134738 | instance | ok: [instance]
2026-04-13 03:28:00.134915 | instance |
2026-04-13 03:28:00.135256 | instance | TASK [Create bridge for management network] ************************************
2026-04-13 03:28:00.135544 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.735)       0:00:16.302 **********
2026-04-13 03:28:00.464219 | instance | ok: [instance]
2026-04-13 03:28:00.464432 | instance |
2026-04-13 03:28:00.464721 | instance | TASK [Create fake interface for management bridge] *****************************
2026-04-13 03:28:00.465003 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.329)       0:00:16.631 **********
2026-04-13 03:28:00.668577 | instance | ok: [instance]
2026-04-13 03:28:00.668801 | instance |
2026-04-13 03:28:00.669104 | instance | TASK [Assign dummy interface to management bridge] *****************************
2026-04-13 03:28:00.669439 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.204)       0:00:16.836 **********
2026-04-13 03:28:00.864759 | instance | ok: [instance]
2026-04-13 03:28:00.864979 | instance |
2026-04-13 03:28:00.865329 | instance | TASK [Assign IP address for management bridge] *********************************
2026-04-13 03:28:00.865608 | instance | Monday 13 April 2026  03:28:00 +0000 (0:00:00.195)       0:00:17.032 **********
2026-04-13 03:28:01.060704 | instance | ok: [instance]
2026-04-13 03:28:01.060998 | instance |
2026-04-13 03:28:01.061445 | instance | TASK [Bring up interfaces] *****************************************************
2026-04-13 03:28:01.061822 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.195)       0:00:17.228 **********
2026-04-13 03:28:01.435282 | instance | ok: [instance] => (item=br-mgmt)
2026-04-13 03:28:01.435534 | instance | ok: [instance] => (item=dummy0)
2026-04-13 03:28:01.435788 | instance |
2026-04-13 03:28:01.436061 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-13 03:28:01.436306 | instance |
2026-04-13 03:28:01.436580 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:01.436848 | instance | Monday 13 April 2026  03:28:01 +0000 (0:00:00.374)       0:00:17.602 **********
2026-04-13 03:28:02.157315 | instance | ok: [instance]
2026-04-13 03:28:02.157462 | instance |
2026-04-13 03:28:02.157586 | instance | TASK [Install depedencies] *****************************************************
2026-04-13 03:28:02.157715 | instance | Monday 13 April 2026  03:28:02 +0000 (0:00:00.722)       0:00:18.325 **********
2026-04-13 03:28:22.046530 | instance | changed: [instance]
2026-04-13 03:28:22.047686 | instance |
2026-04-13 03:28:22.047978 | instance | TASK [Start up service] ********************************************************
2026-04-13 03:28:22.048274 | instance | Monday 13 April 2026  03:28:22 +0000 (0:00:19.886)       0:00:38.211 **********
2026-04-13 03:28:22.692354 | instance | ok: [instance]
2026-04-13 03:28:22.692444 | instance |
2026-04-13 03:28:22.692453 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-13 03:28:22.692460 | instance | Monday 13 April 2026  03:28:22 +0000 (0:00:00.648)       0:00:38.859 **********
2026-04-13 03:28:22.923469 | instance | ok: [instance]
2026-04-13 03:28:22.923520 | instance |
2026-04-13 03:28:22.923527 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-13 03:28:22.923532 | instance | Monday 13 April 2026  03:28:22 +0000 (0:00:00.231)       0:00:39.091 **********
2026-04-13 03:28:23.392970 | instance | changed: [instance]
2026-04-13 03:28:23.393044 | instance |
2026-04-13 03:28:23.393057 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-13 03:28:23.393163 | instance | Monday 13 April 2026  03:28:23 +0000 (0:00:00.468)       0:00:39.559 **********
2026-04-13 03:28:23.598313 | instance | ok: [instance]
2026-04-13 03:28:23.598415 | instance |
2026-04-13 03:28:23.598428 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-13 03:28:23.598439 | instance | Monday 13 April 2026  03:28:23 +0000 (0:00:00.205)       0:00:39.765 **********
2026-04-13 03:28:23.622993 | instance | skipping: [instance]
2026-04-13 03:28:23.623019 | instance |
2026-04-13 03:28:23.623028 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-13 03:28:23.623036 | instance | Monday 13 April 2026  03:28:23 +0000 (0:00:00.025)       0:00:39.790 **********
2026-04-13 03:28:24.172868 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:24.173299 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:24.173627 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:24.173930 | instance |
2026-04-13 03:28:24.174272 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-13 03:28:24.174607 | instance | Monday 13 April 2026  03:28:24 +0000 (0:00:00.549)       0:00:40.340 **********
2026-04-13 03:28:24.716245 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:24.716543 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:24.716766 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:24.716988 | instance |
2026-04-13 03:28:24.717247 | instance | TASK [Start loop devices] ******************************************************
2026-04-13 03:28:24.717471 | instance | Monday 13 April 2026  03:28:24 +0000 (0:00:00.543)       0:00:40.883 **********
2026-04-13 03:28:25.473086 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:25.473317 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:25.473472 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:25.473622 | instance |
2026-04-13 03:28:25.473836 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-13 03:28:25.473997 | instance | Monday 13 April 2026  03:28:25 +0000 (0:00:00.755)       0:00:41.639 **********
2026-04-13 03:28:28.583158 | instance | changed: [instance] => (item=osd0)
2026-04-13 03:28:28.583220 | instance | changed: [instance] => (item=osd1)
2026-04-13 03:28:28.583232 | instance | changed: [instance] => (item=osd2)
2026-04-13 03:28:28.583242 | instance |
2026-04-13 03:28:28.583252 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-13 03:28:28.583262 | instance | Monday 13 April 2026  03:28:28 +0000 (0:00:03.110)       0:00:44.749 **********
2026-04-13 03:28:30.481081 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-13 03:28:30.481377 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-13 03:28:30.481385 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-13 03:28:30.481389 | instance |
2026-04-13 03:28:30.481394 | instance | PLAY [controllers] *************************************************************
2026-04-13 03:28:30.481399 | instance |
2026-04-13 03:28:30.481403 | instance | TASK [Gathering Facts] *********************************************************
2026-04-13 03:28:30.481411 | instance | Monday 13 April 2026  03:28:30 +0000 (0:00:01.897)       0:00:46.646 **********
2026-04-13 03:28:31.386164 | instance | ok: [instance]
2026-04-13 03:28:31.386287 | instance |
2026-04-13 03:28:31.386301 | instance | TASK [Set masquerade rule] *****************************************************
2026-04-13 03:28:31.386473 | instance | Monday 13 April 2026  03:28:31 +0000 (0:00:00.906)       0:00:47.553 **********
2026-04-13 03:28:31.855790 | instance | changed: [instance]
2026-04-13 03:28:31.855987 | instance |
2026-04-13 03:28:31.856353 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:31.856701 | instance | instance                   : ok=24   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:31.857040 | instance | localhost                  : ok=40   changed=21   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-13 03:28:31.857374 | instance |
2026-04-13 03:28:31.857699 | instance | Monday 13 April 2026  03:28:31 +0000 (0:00:00.469)       0:00:48.023 **********
2026-04-13 03:28:31.858011 | instance | ===============================================================================
2026-04-13 03:28:31.858354 | instance | Install depedencies ---------------------------------------------------- 19.89s
2026-04-13 03:28:31.858678 | instance | Create a volume group for each loop device ------------------------------ 3.11s
2026-04-13 03:28:31.859059 | instance | Generate SSH keys for missing variables --------------------------------- 2.45s
2026-04-13 03:28:31.859379 | instance | Create a logical volume for each loop device ---------------------------- 1.90s
2026-04-13 03:28:31.859552 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.30s
2026-04-13 03:28:31.859698 | instance | Gathering Facts --------------------------------------------------------- 1.14s
2026-04-13 03:28:31.859843 | instance | Create folders for workspace -------------------------------------------- 1.01s
2026-04-13 03:28:31.859987 | instance | Gathering Facts --------------------------------------------------------- 0.91s
2026-04-13 03:28:31.860131 | instance | Purge "snapd" package --------------------------------------------------- 0.81s
2026-04-13 03:28:31.860274 | instance | Start loop devices ------------------------------------------------------ 0.76s
2026-04-13 03:28:31.860421 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.75s
2026-04-13 03:28:31.860580 | instance | Gathering Facts --------------------------------------------------------- 0.74s
2026-04-13 03:28:31.860738 | instance | Gathering Facts --------------------------------------------------------- 0.72s
2026-04-13 03:28:31.860884 | instance | Configure short hostname ------------------------------------------------ 0.70s
2026-04-13 03:28:31.861028 | instance | Gathering Facts --------------------------------------------------------- 0.68s
2026-04-13 03:28:31.861188 | instance | Start up service -------------------------------------------------------- 0.65s
2026-04-13 03:28:31.861338 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.56s
2026-04-13 03:28:31.861488 | instance | Create devices for Ceph ------------------------------------------------- 0.55s
2026-04-13 03:28:31.861637 | instance | Set permissions on loopback devices ------------------------------------- 0.54s
2026-04-13 03:28:31.861782 | instance | Set masquerade rule ----------------------------------------------------- 0.47s
2026-04-13 03:28:31.974470 | instance | INFO     [aio > prepare] Executed: Successful
2026-04-13 03:28:31.985651 | instance | INFO     [aio > converge] Executing
2026-04-13 03:28:32.727231 | instance |
2026-04-13 03:28:32.727661 | instance | PLAY [localhost] ***************************************************************
2026-04-13 03:28:32.727968 | instance |
2026-04-13 03:28:32.728292 | instance | TASK [Build atmosphere binary] *************************************************
2026-04-13 03:28:32.728614 | instance | Monday 13 April 2026  03:28:32 +0000 (0:00:00.010)       0:00:00.010 **********
2026-04-13 03:28:39.859723 | instance | changed: [localhost]
2026-04-13 03:28:39.859973 | instance |
2026-04-13 03:28:39.859985 | instance | TASK [Deploy with parallel orchestrator] ***************************************
2026-04-13 03:28:39.859994 | instance | Monday 13 April 2026  03:28:39 +0000 (0:00:07.131)       0:00:07.142 **********
2026-04-13 03:28:58.040557 | instance | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../bin/atmosphere", "deploy", "--inventory", "/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml", "--playbook-dir", "/home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/../../playbooks"], "delta": "0:00:18.013875", "end": "2026-04-13 03:28:58.017481", "msg": "non-zero return code", "rc": 1, "start": "2026-04-13 03:28:40.003606", "stderr": "Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2\nUsage:\n  atmosphere deploy [flags]\n\nFlags:\n      --concurrency int       Max concurrent deployments per wave (0 = unlimited)\n  -h, --help                  help for deploy\n  -i, --inventory string      Path to Ansible inventory file (required)\n      --playbook-dir string   Directory containing playbook files (default: playbooks)\n  -t, --tags string           Comma-separated list of component tags to deploy\n\nprerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2", "stderr_lines": ["Error: prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2", "Usage:", "  atmosphere deploy [flags]", "", "Flags:", "      --concurrency int       Max concurrent deployments per wave (0 = unlimited)", "  -h, --help                  help for deploy", "  -i, --inventory string      Path to Ansible inventory file (required)", "      --playbook-dir string   Directory containing playbook files (default: playbooks)", "  -t, --tags string           Comma-separated list of component tags to deploy", "", "prerequisite openstacksdk failed: ansible-playbook failed for prerequisite-openstacksdk: exit status 2"], "stdout": "==> Running prerequisite: openstacksdk\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] PLAY [controllers[0]] **********************************************************\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] TASK [Gathering Facts] *********************************************************\n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:40 +0000 (0:00:00.012)       0:00:00.012 ********** \n[prerequisite-openstacksdk] [WARNING]: Platform linux on host instance is using the discovered Python\n[prerequisite-openstacksdk] interpreter at /usr/bin/python3.10, but future installation of another Python\n[prerequisite-openstacksdk] interpreter could change the meaning of that path. See\n[prerequisite-openstacksdk] https://docs.ansible.com/ansible-\n[prerequisite-openstacksdk] core/2.17/reference_appendices/interpreter_discovery.html for more information.\n[prerequisite-openstacksdk] ok: [instance]\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] TASK [vexxhost.atmosphere.openstacksdk : Install openstacksdk] *****************\n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:41 +0000 (0:00:01.191)       0:00:01.204 ********** \n[prerequisite-openstacksdk] fatal: [instance]: FAILED! => {\"attempts\": 3, \"changed\": false, \"msg\": \"Unable to find any of pip3 to use.  pip needs to be installed.\"}\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (3 retries left).\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (2 retries left).\n[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (1 retries left).\n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] PLAY RECAP *********************************************************************\n[prerequisite-openstacksdk] instance                   : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   \n[prerequisite-openstacksdk] \n[prerequisite-openstacksdk] Monday 13 April 2026  03:28:57 +0000 (0:00:16.183)       0:00:17.387 ********** \n[prerequisite-openstacksdk] =============================================================================== \n[prerequisite-openstacksdk] vexxhost.atmosphere.openstacksdk : Install openstacksdk ---------------- 16.18s\n[prerequisite-openstacksdk] Gathering Facts --------------------------------------------------------- 1.19s", "stdout_lines": ["==> Running prerequisite: openstacksdk", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] PLAY [controllers[0]] **********************************************************", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] TASK [Gathering Facts] *********************************************************", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:40 +0000 (0:00:00.012)       0:00:00.012 ********** ", "[prerequisite-openstacksdk] [WARNING]: Platform linux on host instance is using the discovered Python", "[prerequisite-openstacksdk] interpreter at /usr/bin/python3.10, but future installation of another Python", "[prerequisite-openstacksdk] interpreter could change the meaning of that path. See", "[prerequisite-openstacksdk] https://docs.ansible.com/ansible-", "[prerequisite-openstacksdk] core/2.17/reference_appendices/interpreter_discovery.html for more information.", "[prerequisite-openstacksdk] ok: [instance]", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] TASK [vexxhost.atmosphere.openstacksdk : Install openstacksdk] *****************", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:41 +0000 (0:00:01.191)       0:00:01.204 ********** ", "[prerequisite-openstacksdk] fatal: [instance]: FAILED! => {\"attempts\": 3, \"changed\": false, \"msg\": \"Unable to find any of pip3 to use.  pip needs to be installed.\"}", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (3 retries left).", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (2 retries left).", "[prerequisite-openstacksdk] FAILED - RETRYING: [instance]: Install openstacksdk (1 retries left).", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] PLAY RECAP *********************************************************************", "[prerequisite-openstacksdk] instance                   : ok=1    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   ", "[prerequisite-openstacksdk] ", "[prerequisite-openstacksdk] Monday 13 April 2026  03:28:57 +0000 (0:00:16.183)       0:00:17.387 ********** ", "[prerequisite-openstacksdk] =============================================================================== ", "[prerequisite-openstacksdk] vexxhost.atmosphere.openstacksdk : Install openstacksdk ---------------- 16.18s", "[prerequisite-openstacksdk] Gathering Facts --------------------------------------------------------- 1.19s"]}
2026-04-13 03:28:58.041264 | instance |
2026-04-13 03:28:58.041550 | instance | PLAY RECAP *********************************************************************
2026-04-13 03:28:58.041560 | instance | localhost                  : ok=1    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-04-13 03:28:58.041685 | instance |
2026-04-13 03:28:58.041838 | instance | Monday 13 April 2026  03:28:58 +0000 (0:00:18.183)       0:00:25.326 **********
2026-04-13 03:28:58.041999 | instance | ===============================================================================
2026-04-13 03:28:58.042204 | instance | Deploy with parallel orchestrator -------------------------------------- 18.18s
2026-04-13 03:28:58.042387 | instance | Build atmosphere binary ------------------------------------------------- 7.13s
2026-04-13 03:28:58.110592 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:28:58.110773 | instance | ERROR    [aio > converge] Executed: Failed
2026-04-13 03:28:58.110918 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-13 03:28:58.597882 | instance | ERROR
2026-04-13 03:28:58.598150 | instance | {
2026-04-13 03:28:58.598209 | instance |   "delta": "0:01:57.127816",
2026-04-13 03:28:58.598244 | instance |   "end": "2026-04-13 03:28:58.208933",
2026-04-13 03:28:58.598272 | instance |   "msg": "non-zero return code",
2026-04-13 03:28:58.598299 | instance |   "rc": 2,
2026-04-13 03:28:58.598328 | instance |   "start": "2026-04-13 03:27:01.081117"
2026-04-13 03:28:58.598355 | instance | }
failure
2026-04-13 03:28:58.604935 | 
2026-04-13 03:28:58.604997 | PLAY RECAP
2026-04-13 03:28:58.605413 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-13 03:28:58.605437 | 
2026-04-13 03:28:58.713500 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-13 03:28:58.725304 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:28:59.354101 | 
2026-04-13 03:28:59.354289 | PLAY [all]
2026-04-13 03:28:59.374418 | 
2026-04-13 03:28:59.374561 | TASK [gather-host-logs : creating directory for system status]
2026-04-13 03:28:59.723643 | instance | changed
2026-04-13 03:28:59.729355 | 
2026-04-13 03:28:59.729444 | TASK [gather-host-logs : Get logs for each host]
2026-04-13 03:29:00.059077 | instance | + systemd-cgls --full --all --no-pager
2026-04-13 03:29:00.074208 | instance | + ip addr
2026-04-13 03:29:00.076162 | instance | + ip route
2026-04-13 03:29:00.077367 | instance | + lsblk
2026-04-13 03:29:00.080009 | instance | + mount
2026-04-13 03:29:00.081300 | instance | + docker images
2026-04-13 03:29:00.081648 | instance | /bin/bash: line 7: docker: command not found
2026-04-13 03:29:00.081840 | instance | + brctl show
2026-04-13 03:29:00.082159 | instance | /bin/bash: line 8: brctl: command not found
2026-04-13 03:29:00.082288 | instance | + ps aux --sort=-%mem
2026-04-13 03:29:00.097893 | instance | + dpkg -l
2026-04-13 03:29:00.110245 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-13 03:29:00.110697 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-13 03:29:00.110730 | instance | /bin/bash: line 11: docker: command not found
2026-04-13 03:29:00.111024 | instance | + '[' '!' -z '' ']'
2026-04-13 03:29:00.270053 | instance | ok: Runtime: 0:00:00.057495
2026-04-13 03:29:00.278517 | 
2026-04-13 03:29:00.278592 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-13 03:29:00.923062 | instance | changed:
2026-04-13 03:29:00.924609 | instance | created directory /var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/logs/instance
2026-04-13 03:29:00.924658 | instance | cd+++++++++ system/
2026-04-13 03:29:00.924690 | instance | >f+++++++++ system/brctl-show.txt
2026-04-13 03:29:00.924718 | instance | >f+++++++++ system/docker-images.txt
2026-04-13 03:29:00.924745 | instance | >f+++++++++ system/ip-addr.txt
2026-04-13 03:29:00.924776 | instance | >f+++++++++ system/ip-route.txt
2026-04-13 03:29:00.924806 | instance | >f+++++++++ system/lsblk.txt
2026-04-13 03:29:00.924834 | instance | >f+++++++++ system/mount.txt
2026-04-13 03:29:00.924864 | instance | >f+++++++++ system/packages.txt
2026-04-13 03:29:00.924890 | instance | >f+++++++++ system/ps.txt
2026-04-13 03:29:00.924917 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-13 03:29:00.936519 | 
2026-04-13 03:29:00.936589 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-13 03:29:01.156061 | instance | changed: "values"
2026-04-13 03:29:01.327495 | instance | changed: "releases"
2026-04-13 03:29:01.342864 | 
2026-04-13 03:29:01.343008 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-13 03:29:01.555659 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-13 03:29:01.882696 | instance | ok: Runtime: 0:00:00.006823
2026-04-13 03:29:01.888565 | 
2026-04-13 03:29:01.888633 | TASK [helm-release-status : Downloads logs to executor]
2026-04-13 03:29:02.358512 | instance | changed:
2026-04-13 03:29:02.358675 | instance | cd+++++++++ helm/
2026-04-13 03:29:02.358702 | instance | cd+++++++++ helm/releases/
2026-04-13 03:29:02.358722 | instance | cd+++++++++ helm/values/
2026-04-13 03:29:02.367974 | 
2026-04-13 03:29:02.368048 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-13 03:29:02.565915 | instance | changed
2026-04-13 03:29:02.597864 | 
2026-04-13 03:29:02.597998 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-13 03:29:02.808026 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:02.808318 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:02.813370 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:02.814677 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:02.816574 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:02.818122 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:02.818961 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:02.820868 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:02.822290 | instance | environment: line 1: kubectl: command not found
2026-04-13 03:29:02.823707 | instance | xargs: environment: line 1: kubectl: command not found
2026-04-13 03:29:02.823740 | instance | warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:02.825106 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-13 03:29:03.131850 | instance | ok: Runtime: 0:00:00.026709
2026-04-13 03:29:03.137781 | 
2026-04-13 03:29:03.137846 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-13 03:29:03.333745 | instance | changed
2026-04-13 03:29:03.338529 | 
2026-04-13 03:29:03.338598 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-13 03:29:03.547043 | instance | environment: line 5: kubectl: command not found
2026-04-13 03:29:03.548050 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:03.548183 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:03.548716 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-13 03:29:03.875681 | instance | ok: Runtime: 0:00:00.008492
2026-04-13 03:29:03.881974 | 
2026-04-13 03:29:03.882038 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-13 03:29:04.384591 | instance | changed:
2026-04-13 03:29:04.384838 | instance | cd+++++++++ objects/
2026-04-13 03:29:04.384932 | instance | cd+++++++++ objects/cluster/
2026-04-13 03:29:04.384995 | instance | cd+++++++++ objects/namespaced/
2026-04-13 03:29:04.395311 | 
2026-04-13 03:29:04.395382 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-13 03:29:04.594606 | instance | changed
2026-04-13 03:29:04.601051 | 
2026-04-13 03:29:04.601121 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-13 03:29:04.807980 | instance | changed
2026-04-13 03:29:04.814075 | 
2026-04-13 03:29:04.814150 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-13 03:29:05.023493 | instance | environment: line 3: kubectl: command not found
2026-04-13 03:29:05.352988 | instance | ok: Runtime: 0:00:00.008132
2026-04-13 03:29:05.359358 | 
2026-04-13 03:29:05.359467 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-13 03:29:05.861968 | instance | changed:
2026-04-13 03:29:05.862215 | instance | cd+++++++++ pod-logs/
2026-04-13 03:29:05.862246 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-13 03:29:05.873401 | 
2026-04-13 03:29:05.873473 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-13 03:29:06.081103 | instance | changed
2026-04-13 03:29:06.086424 | 
2026-04-13 03:29:06.086497 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-13 03:29:06.297812 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:29:06.628576 | instance | ok: Runtime: 0:00:00.039956
2026-04-13 03:29:06.635573 | 
2026-04-13 03:29:06.635662 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-13 03:29:06.836476 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-13 03:29:06.863953 | instance | ceph-mgr endpoints:
2026-04-13 03:29:07.176949 | instance | ok: Runtime: 0:00:00.035371
2026-04-13 03:29:07.184889 | 
2026-04-13 03:29:07.185010 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-13 03:29:07.389182 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-13 03:29:07.721360 | instance | ok: Runtime: 0:00:00.031838
2026-04-13 03:29:07.727374 | 
2026-04-13 03:29:07.727442 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-13 03:29:08.227476 | instance | changed: cd+++++++++ prometheus/
2026-04-13 03:29:08.238109 | 
2026-04-13 03:29:08.238184 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-13 03:29:08.477557 | instance | changed
2026-04-13 03:29:08.482565 | 
2026-04-13 03:29:08.482630 | TASK [gather-selenium-data : Get selenium data]
2026-04-13 03:29:08.694838 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-13 03:29:08.696243 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-13 03:29:09.016632 | instance | ERROR
2026-04-13 03:29:09.016803 | instance | {
2026-04-13 03:29:09.016852 | instance |   "delta": "0:00:00.006853",
2026-04-13 03:29:09.016884 | instance |   "end": "2026-04-13 03:29:08.696659",
2026-04-13 03:29:09.016912 | instance |   "msg": "non-zero return code",
2026-04-13 03:29:09.016939 | instance |   "rc": 1,
2026-04-13 03:29:09.016989 | instance |   "start": "2026-04-13 03:29:08.689806"
2026-04-13 03:29:09.017017 | instance | }
2026-04-13 03:29:09.017064 | instance | ERROR: Ignoring Errors
2026-04-13 03:29:09.024212 | 
2026-04-13 03:29:09.024305 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-13 03:29:09.495078 | instance | changed: cd+++++++++ selenium/
2026-04-13 03:29:09.500774 | 
2026-04-13 03:29:09.500825 | PLAY RECAP
2026-04-13 03:29:09.500874 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-13 03:29:09.500896 | 
2026-04-13 03:29:09.616197 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-13 03:29:09.629529 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:29:10.217542 | 
2026-04-13 03:29:10.217662 | PLAY [all]
2026-04-13 03:29:10.228352 | 
2026-04-13 03:29:10.228427 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-13 03:29:10.273607 | instance | skipping: Conditional result was False
2026-04-13 03:29:10.285131 | 
2026-04-13 03:29:10.285217 | TASK [fetch-output : Set log path for single node]
2026-04-13 03:29:10.329267 | instance | ok
2026-04-13 03:29:10.335542 | 
2026-04-13 03:29:10.335625 | LOOP [fetch-output : Ensure local output dirs]
2026-04-13 03:29:10.722751 | instance -> localhost | ok: "/var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/logs"
2026-04-13 03:29:10.918534 | instance -> localhost | changed: "/var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/artifacts"
2026-04-13 03:29:11.141453 | instance -> localhost | changed: "/var/lib/zuul/builds/999123a665dc406bbe97e766f7cc5ac9/work/docs"
2026-04-13 03:29:11.163821 | 
2026-04-13 03:29:11.164003 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-13 03:29:11.818139 | instance | changed: .d..t...... ./
2026-04-13 03:29:11.818346 | instance | changed: All items complete
2026-04-13 03:29:11.818381 | 
2026-04-13 03:29:12.265676 | instance | changed: .d..t...... ./
2026-04-13 03:29:12.711010 | instance | changed: .d..t...... ./
2026-04-13 03:29:12.734072 | 
2026-04-13 03:29:12.734241 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-13 03:29:13.189644 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.009167
2026-04-13 03:29:13.420386 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007562
2026-04-13 03:29:13.430287 | 
2026-04-13 03:29:13.430415 | PLAY [all]
2026-04-13 03:29:13.439343 | 
2026-04-13 03:29:13.439432 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-13 03:29:13.858507 | instance | changed
2026-04-13 03:29:13.866037 | 
2026-04-13 03:29:13.866104 | PLAY RECAP
2026-04-13 03:29:13.866165 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-13 03:29:13.866196 | 
2026-04-13 03:29:13.975806 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-13 03:29:13.987608 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-13 03:29:14.569410 | 
2026-04-13 03:29:14.569538 | PLAY [localhost]
2026-04-13 03:29:14.579042 | 
2026-04-13 03:29:14.579113 | TASK [Generate Zuul manifest]
2026-04-13 03:29:14.602981 | localhost | ok
2026-04-13 03:29:14.617182 | 
2026-04-13 03:29:14.617261 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-13 03:29:15.004399 | localhost | changed
2026-04-13 03:29:15.016918 | 
2026-04-13 03:29:15.017023 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-13 03:29:15.049762 | localhost | ok
2026-04-13 03:29:15.057051 | 
2026-04-13 03:29:15.057114 | TASK [Upload logs]
2026-04-13 03:29:15.088570 | localhost | ok
2026-04-13 03:29:15.187312 | 
2026-04-13 03:29:15.187450 | TASK [Set zuul-log-path fact]
2026-04-13 03:29:15.209077 | localhost | ok
2026-04-13 03:29:15.220866 | 
2026-04-13 03:29:15.220931 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-13 03:29:15.251982 | localhost | ok
2026-04-13 03:29:15.261143 | 
2026-04-13 03:29:15.261209 | TASK [upload-logs : Create log directories]
2026-04-13 03:29:15.626705 | localhost | changed
2026-04-13 03:29:15.631898 | 
2026-04-13 03:29:15.631965 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-13 03:29:15.998959 | localhost -> localhost | ok: Runtime: 0:00:00.008434
2026-04-13 03:29:16.005802 | 
2026-04-13 03:29:16.006076 | TASK [upload-logs : Upload logs to log server]
2026-04-13 03:29:16.444218 | localhost | Output suppressed because no_log was given
2026-04-13 03:29:16.449711 | 
2026-04-13 03:29:16.449851 | LOOP [upload-logs : Compress console log and json output]
2026-04-13 03:29:16.498701 | localhost | skipping: Conditional result was False
2026-04-13 03:29:16.505756 | localhost | skipping: Conditional result was False
2026-04-13 03:29:16.518276 | 
2026-04-13 03:29:16.518466 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-13 03:29:16.562653 | localhost | skipping: Conditional result was False
2026-04-13 03:29:16.563115 | 
2026-04-13 03:29:16.566887 | localhost | skipping: Conditional result was False
2026-04-13 03:29:16.585133 | 
2026-04-13 03:29:16.585367 | LOOP [upload-logs : Upload console log and json output]