2026-04-16 17:21:06.489916 | Job console starting
2026-04-16 17:21:06.501018 | Updating git repos
2026-04-16 17:21:06.561937 | Cloning repos into workspace
2026-04-16 17:21:06.859833 | Restoring repo states
2026-04-16 17:21:06.880096 | Merging changes
2026-04-16 17:21:07.742771 | Checking out repos
2026-04-16 17:21:08.160264 | Preparing playbooks
2026-04-16 17:21:10.993096 | Running Ansible setup
2026-04-16 17:21:14.411347 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-16 17:21:15.053409 | 
2026-04-16 17:21:15.053527 | PLAY [localhost]
2026-04-16 17:21:15.060825 | 
2026-04-16 17:21:15.060894 | TASK [Gathering Facts]
2026-04-16 17:21:15.953006 | localhost | ok
2026-04-16 17:21:15.964239 | 
2026-04-16 17:21:15.964322 | TASK [Setup log path fact]
2026-04-16 17:21:15.985786 | localhost | ok
2026-04-16 17:21:16.000548 | 
2026-04-16 17:21:16.000613 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-16 17:21:16.031229 | localhost | ok
2026-04-16 17:21:16.039316 | 
2026-04-16 17:21:16.039409 | TASK [emit-job-header : Print job information]
2026-04-16 17:21:16.081106 | # Job Information
2026-04-16 17:21:16.081418 | Ansible Version: 2.16.16
2026-04-16 17:21:16.081486 | Job: atmosphere-molecule-aio-openvswitch
2026-04-16 17:21:16.081520 | Pipeline: check
2026-04-16 17:21:16.081550 | Executor: 0a8996d2b663
2026-04-16 17:21:16.081579 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3839
2026-04-16 17:21:16.081613 | Event ID: 8525d1d0-39b8-11f1-83af-fc2625070b44
2026-04-16 17:21:16.085775 | 
2026-04-16 17:21:16.085847 | LOOP [emit-job-header : Print node information]
2026-04-16 17:21:16.187622 | localhost | ok:
2026-04-16 17:21:16.187871 | localhost | # Node Information
2026-04-16 17:21:16.187910 | localhost | Inventory Hostname: instance
2026-04-16 17:21:16.187940 | localhost | Hostname: np0000166763
2026-04-16 17:21:16.187967 | localhost | Username: zuul
2026-04-16 17:21:16.187997 | localhost | Distro: Ubuntu 22.04
2026-04-16 17:21:16.188024 | localhost | Provider: yul1
2026-04-16 17:21:16.188051 | localhost | Region: ca-ymq-1
2026-04-16 17:21:16.188076 | localhost | Label: ubuntu-jammy-16
2026-04-16 17:21:16.188102 | localhost | Product Name: OpenStack Nova
2026-04-16 17:21:16.188128 | localhost | Interface IP: 199.204.45.132
2026-04-16 17:21:16.196244 | 
2026-04-16 17:21:16.196325 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-16 17:21:16.655691 | localhost -> localhost | changed
2026-04-16 17:21:16.661106 | 
2026-04-16 17:21:16.661189 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-16 17:21:18.038455 | localhost -> localhost | changed
2026-04-16 17:21:18.049266 | 
2026-04-16 17:21:18.049348 | PLAY [all]
2026-04-16 17:21:18.058538 | 
2026-04-16 17:21:18.058601 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-16 17:21:18.286822 | instance -> localhost | ok
2026-04-16 17:21:18.298991 | 
2026-04-16 17:21:18.299061 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-16 17:21:18.335113 | instance | ok
2026-04-16 17:21:18.348349 | instance | included: /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-16 17:21:18.353820 | 
2026-04-16 17:21:18.353880 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-16 17:21:19.200743 | instance -> localhost | Generating public/private rsa key pair.
2026-04-16 17:21:19.200959 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/86f11c139d9342c59c6219f08e70739e_id_rsa
2026-04-16 17:21:19.201010 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/86f11c139d9342c59c6219f08e70739e_id_rsa.pub
2026-04-16 17:21:19.201035 | instance -> localhost | The key fingerprint is:
2026-04-16 17:21:19.201057 | instance -> localhost | SHA256:lBZv+Ke3t0yINFyi3PrIUvh/NVtf1me1VEwKD7ETTLw zuul-build-sshkey
2026-04-16 17:21:19.201096 | instance -> localhost | The key's randomart image is:
2026-04-16 17:21:19.201119 | instance -> localhost | +---[RSA 3072]----+
2026-04-16 17:21:19.201147 | instance -> localhost | |        .  +*. o.|
2026-04-16 17:21:19.201169 | instance -> localhost | |         =  o* .o|
2026-04-16 17:21:19.201189 | instance -> localhost | |        = + +.o .|
2026-04-16 17:21:19.201209 | instance -> localhost | |       + * oE. ..|
2026-04-16 17:21:19.201229 | instance -> localhost | |       .S * . . +|
2026-04-16 17:21:19.201249 | instance -> localhost | |      . .o = .o.B|
2026-04-16 17:21:19.201268 | instance -> localhost | |       o. o o..*+|
2026-04-16 17:21:19.201287 | instance -> localhost | |      ...o ..+o .|
2026-04-16 17:21:19.201356 | instance -> localhost | |       .o.o...o. |
2026-04-16 17:21:19.201418 | instance -> localhost | +----[SHA256]-----+
2026-04-16 17:21:19.201507 | instance -> localhost | ok: Runtime: 0:00:00.435551
2026-04-16 17:21:19.206653 | 
2026-04-16 17:21:19.206759 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-16 17:21:19.241705 | instance | ok
2026-04-16 17:21:19.250378 | instance | included: /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-16 17:21:19.258919 | 
2026-04-16 17:21:19.259000 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-16 17:21:19.284609 | instance | skipping: Conditional result was False
2026-04-16 17:21:19.294163 | 
2026-04-16 17:21:19.294262 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-16 17:21:19.765582 | instance | changed
2026-04-16 17:21:19.772757 | 
2026-04-16 17:21:19.772841 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-16 17:21:19.972205 | instance | ok
2026-04-16 17:21:19.978335 | 
2026-04-16 17:21:19.978413 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-16 17:21:20.449394 | instance | changed
2026-04-16 17:21:20.455742 | 
2026-04-16 17:21:20.455807 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-16 17:21:20.917836 | instance | changed
2026-04-16 17:21:20.923280 | 
2026-04-16 17:21:20.923400 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-16 17:21:20.949683 | instance | skipping: Conditional result was False
2026-04-16 17:21:20.960846 | 
2026-04-16 17:21:20.960927 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-16 17:21:21.404688 | instance -> localhost | changed
2026-04-16 17:21:21.462540 | 
2026-04-16 17:21:21.462694 | TASK [add-build-sshkey : Add back temp key]
2026-04-16 17:21:21.760220 | instance -> localhost | Identity added: /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/86f11c139d9342c59c6219f08e70739e_id_rsa (zuul-build-sshkey)
2026-04-16 17:21:21.760474 | instance -> localhost | ok: Runtime: 0:00:00.015420
2026-04-16 17:21:21.766549 | 
2026-04-16 17:21:21.766617 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-16 17:21:22.034963 | instance | ok
2026-04-16 17:21:22.039947 | 
2026-04-16 17:21:22.040018 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-16 17:21:22.066328 | instance | skipping: Conditional result was False
2026-04-16 17:21:22.083015 | 
2026-04-16 17:21:22.083083 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-16 17:21:22.379784 | instance | ok
2026-04-16 17:21:22.386435 | 
2026-04-16 17:21:22.386505 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-16 17:21:23.922403 | instance | Output suppressed because no_log was given
2026-04-16 17:21:23.931559 | 
2026-04-16 17:21:23.931630 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-16 17:21:24.125290 | instance | ok: "logs"
2026-04-16 17:21:24.125625 | instance | ok: All items complete
2026-04-16 17:21:24.125653 | 
2026-04-16 17:21:24.281669 | instance | ok: "artifacts"
2026-04-16 17:21:24.433606 | instance | ok: "docs"
2026-04-16 17:21:24.454326 | 
2026-04-16 17:21:24.454510 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-16 17:21:24.661432 | instance | changed: "logs"
2026-04-16 17:21:24.822657 | instance | changed: "artifacts"
2026-04-16 17:21:24.985488 | instance | changed: "docs"
2026-04-16 17:21:25.005128 | 
2026-04-16 17:21:25.005272 | PLAY RECAP
2026-04-16 17:21:25.005334 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-16 17:21:25.005373 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-16 17:21:25.005402 | 
2026-04-16 17:21:25.154125 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-16 17:21:25.165213 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-16 17:21:25.726209 | 
2026-04-16 17:21:25.726320 | PLAY [all]
2026-04-16 17:21:25.737864 | 
2026-04-16 17:21:25.737937 | TASK [setup-uv : Extract archive]
2026-04-16 17:21:27.949530 | instance | changed
2026-04-16 17:21:27.958045 | 
2026-04-16 17:21:27.958169 | TASK [setup-uv : Print version]
2026-04-16 17:21:26.757007 | instance | uv 0.8.13
2026-04-16 17:21:28.497836 | instance | ok: Runtime: 0:00:00.011912
2026-04-16 17:21:28.505053 | 
2026-04-16 17:21:28.505114 | PLAY RECAP
2026-04-16 17:21:28.505169 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-16 17:21:28.505193 | 
2026-04-16 17:21:28.651348 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-16 17:21:28.660022 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-16 17:21:29.306801 | 
2026-04-16 17:21:29.306950 | PLAY [all]
2026-04-16 17:21:29.318444 | 
2026-04-16 17:21:29.318516 | TASK [Install "jq" for log collection]
2026-04-16 17:22:21.668445 | instance | changed
2026-04-16 17:22:21.671313 | 
2026-04-16 17:22:21.671388 | PLAY RECAP
2026-04-16 17:22:21.671459 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-16 17:22:21.671523 | 
2026-04-16 17:22:21.824025 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-16 17:22:21.836385 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-16 17:22:22.429861 | 
2026-04-16 17:22:22.430008 | PLAY [all]
2026-04-16 17:22:22.441679 | 
2026-04-16 17:22:22.441751 | TASK [Copy inventory file for Zuul]
2026-04-16 17:22:23.288685 | instance | changed
2026-04-16 17:22:23.293985 | 
2026-04-16 17:22:23.294066 | TASK [Switch "ansible_host" to private IP]
2026-04-16 17:22:23.592188 | instance | changed: 1 replacements made
2026-04-16 17:22:23.598878 | 
2026-04-16 17:22:23.598946 | TASK [Run Molecule scenario]
2026-04-16 17:22:23.982831 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-16 17:22:23.982965 | instance | Creating virtual environment at: .venv
2026-04-16 17:22:24.008299 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-16 17:22:24.030333 | instance | Downloading setuptools (1.1MiB)
2026-04-16 17:22:24.030989 | instance | Downloading ansible-core (2.1MiB)
2026-04-16 17:22:24.032030 | instance | Downloading netaddr (2.2MiB)
2026-04-16 17:22:24.032664 | instance | Downloading pydantic-core (2.0MiB)
2026-04-16 17:22:24.040993 | instance | Downloading pygments (1.2MiB)
2026-04-16 17:22:24.041958 | instance | Downloading openstacksdk (1.7MiB)
2026-04-16 17:22:24.043239 | instance | Downloading rjsonnet (1.2MiB)
2026-04-16 17:22:24.044084 | instance | Downloading kubernetes (1.9MiB)
2026-04-16 17:22:24.044936 | instance | Downloading cryptography (4.2MiB)
2026-04-16 17:22:24.348433 | instance |    Building pyperclip==1.9.0
2026-04-16 17:22:24.371359 | instance |  Downloading rjsonnet
2026-04-16 17:22:24.476852 | instance |  Downloading pydantic-core
2026-04-16 17:22:24.525806 | instance |  Downloading netaddr
2026-04-16 17:22:24.539295 | instance |  Downloading pygments
2026-04-16 17:22:24.552451 | instance |  Downloading cryptography
2026-04-16 17:22:24.592587 | instance |  Downloading setuptools
2026-04-16 17:22:24.654972 | instance |  Downloading kubernetes
2026-04-16 17:22:24.688688 | instance |  Downloading ansible-core
2026-04-16 17:22:24.723629 | instance |  Downloading openstacksdk
2026-04-16 17:22:25.094854 | instance |       Built pyperclip==1.9.0
2026-04-16 17:22:25.263748 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-16 17:22:25.307812 | instance | Installed 83 packages in 41ms
2026-04-16 17:22:25.914479 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-16 17:22:26.599339 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-16 17:22:26.599471 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-04-16 17:23:05.776142 | instance | INFO     [aio > dependency] Executing
2026-04-16 17:23:05.776535 | instance | WARNING  [aio > dependency] Missing roles requirements file: requirements.yml
2026-04-16 17:23:05.776852 | instance | WARNING  [aio > dependency] Missing collections requirements file: collections.yml
2026-04-16 17:23:05.776986 | instance | WARNING  [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-16 17:23:05.785563 | instance | INFO     [aio > cleanup] Executing
2026-04-16 17:23:05.785905 | instance | WARNING  [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-16 17:23:05.793520 | instance | INFO     [aio > destroy] Executing
2026-04-16 17:23:05.793559 | instance | WARNING  [aio > destroy] Skipping, '--destroy=never' requested.
2026-04-16 17:23:05.793624 | instance | INFO     [aio > destroy] Executed: Successful
2026-04-16 17:23:05.801186 | instance | INFO     [aio > syntax] Executing
2026-04-16 17:23:08.672719 | instance |
2026-04-16 17:23:08.673229 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-16 17:23:08.933774 | instance | INFO     [aio > syntax] Executed: Successful
2026-04-16 17:23:08.942705 | instance | INFO     [aio > create] Executing
2026-04-16 17:23:08.944735 | instance | WARNING  [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-16 17:23:08.954065 | instance | INFO     [aio > prepare] Executing
2026-04-16 17:23:09.779469 | instance |
2026-04-16 17:23:09.779752 | instance | PLAY [Prepare] *****************************************************************
2026-04-16 17:23:09.780015 | instance |
2026-04-16 17:23:09.780330 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:23:09.780610 | instance | Thursday 16 April 2026  17:23:09 +0000 (0:00:00.024)       0:00:00.024 ********
2026-04-16 17:23:10.943828 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-16 17:23:10.944114 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-16 17:23:10.944492 | instance | interpreter could change the meaning of that path. See
2026-04-16 17:23:10.944800 | instance | https://docs.ansible.com/ansible-
2026-04-16 17:23:10.945163 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-16 17:23:10.953022 | instance | ok: [instance]
2026-04-16 17:23:10.953280 | instance |
2026-04-16 17:23:10.953744 | instance | TASK [Configure short hostname] ************************************************
2026-04-16 17:23:10.954029 | instance | Thursday 16 April 2026  17:23:10 +0000 (0:00:01.173)       0:00:01.197 ********
2026-04-16 17:23:11.678229 | instance | changed: [instance]
2026-04-16 17:23:11.678322 | instance |
2026-04-16 17:23:11.678336 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-16 17:23:11.678473 | instance | Thursday 16 April 2026  17:23:11 +0000 (0:00:00.725)       0:00:01.923 ********
2026-04-16 17:23:11.960380 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-16 17:23:11.960646 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-16 17:23:11.960926 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-16 17:23:11.970539 | instance | changed: [instance]
2026-04-16 17:23:11.970808 | instance |
2026-04-16 17:23:11.971130 | instance | TASK [Install "dirmngr" for GPG keyserver operations] **************************
2026-04-16 17:23:11.971408 | instance | Thursday 16 April 2026  17:23:11 +0000 (0:00:00.292)       0:00:02.215 ********
2026-04-16 17:23:13.202962 | instance | ok: [instance]
2026-04-16 17:23:13.203241 | instance |
2026-04-16 17:23:13.203550 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-16 17:23:13.203853 | instance | Thursday 16 April 2026  17:23:13 +0000 (0:00:01.231)       0:00:03.447 ********
2026-04-16 17:23:13.888757 | instance | ok: [instance]
2026-04-16 17:23:13.889010 | instance |
2026-04-16 17:23:13.889298 | instance | PLAY [Generate workspace for Atmosphere] ***************************************
2026-04-16 17:23:13.889559 | instance |
2026-04-16 17:23:13.889838 | instance | TASK [Create folders for workspace] ********************************************
2026-04-16 17:23:13.890119 | instance | Thursday 16 April 2026  17:23:13 +0000 (0:00:00.685)       0:00:04.133 ********
2026-04-16 17:23:14.924471 | instance | changed: [localhost] => (item=group_vars)
2026-04-16 17:23:14.924746 | instance | changed: [localhost] => (item=group_vars/all)
2026-04-16 17:23:14.925028 | instance | changed: [localhost] => (item=group_vars/controllers)
2026-04-16 17:23:14.925305 | instance | changed: [localhost] => (item=group_vars/cephs)
2026-04-16 17:23:14.925579 | instance | changed: [localhost] => (item=group_vars/computes)
2026-04-16 17:23:14.925854 | instance | changed: [localhost] => (item=host_vars)
2026-04-16 17:23:14.926111 | instance |
2026-04-16 17:23:14.926395 | instance | PLAY [Generate Ceph control plane configuration for workspace] *****************
2026-04-16 17:23:14.926644 | instance |
2026-04-16 17:23:14.926915 | instance | TASK [Ensure the Ceph control plane configuration file exists] *****************
2026-04-16 17:23:14.927187 | instance | Thursday 16 April 2026  17:23:14 +0000 (0:00:01.035)       0:00:05.169 ********
2026-04-16 17:23:15.100005 | instance | changed: [localhost]
2026-04-16 17:23:15.100277 | instance |
2026-04-16 17:23:15.100562 | instance | TASK [Load the current Ceph control plane configuration into a variable] *******
2026-04-16 17:23:15.100834 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.175)       0:00:05.344 ********
2026-04-16 17:23:15.128957 | instance | ok: [localhost]
2026-04-16 17:23:15.129206 | instance |
2026-04-16 17:23:15.129474 | instance | TASK [Generate Ceph control plane values for missing variables] ****************
2026-04-16 17:23:15.129741 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.029)       0:00:05.374 ********
2026-04-16 17:23:15.177814 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': 'bea45350-be6b-57ea-ad58-c5458630d4f3'})
2026-04-16 17:23:15.178076 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'})
2026-04-16 17:23:15.178329 | instance |
2026-04-16 17:23:15.178598 | instance | TASK [Write new Ceph control plane configuration file to disk] *****************
2026-04-16 17:23:15.178868 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.049)       0:00:05.423 ********
2026-04-16 17:23:15.755864 | instance | changed: [localhost]
2026-04-16 17:23:15.756155 | instance |
2026-04-16 17:23:15.756499 | instance | PLAY [Generate Ceph OSD configuration for workspace] ***************************
2026-04-16 17:23:15.756785 | instance |
2026-04-16 17:23:15.757077 | instance | TASK [Ensure the Ceph OSDs configuration file exists] **************************
2026-04-16 17:23:15.757372 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.577)       0:00:06.000 ********
2026-04-16 17:23:15.928449 | instance | changed: [localhost]
2026-04-16 17:23:15.928690 | instance |
2026-04-16 17:23:15.928973 | instance | TASK [Load the current Ceph OSDs configuration into a variable] ****************
2026-04-16 17:23:15.929242 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.172)       0:00:06.173 ********
2026-04-16 17:23:15.954706 | instance | ok: [localhost]
2026-04-16 17:23:15.954976 | instance |
2026-04-16 17:23:15.955267 | instance | TASK [Generate Ceph OSDs values for missing variables] *************************
2026-04-16 17:23:15.955560 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.026)       0:00:06.199 ********
2026-04-16 17:23:15.989341 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']})
2026-04-16 17:23:15.989590 | instance |
2026-04-16 17:23:15.989861 | instance | TASK [Write new Ceph OSDs configuration file to disk] **************************
2026-04-16 17:23:15.990128 | instance | Thursday 16 April 2026  17:23:15 +0000 (0:00:00.034)       0:00:06.234 ********
2026-04-16 17:23:16.354373 | instance | changed: [localhost]
2026-04-16 17:23:16.354538 | instance |
2026-04-16 17:23:16.354733 | instance | PLAY [Generate Kubernetes configuration for workspace] *************************
2026-04-16 17:23:16.354968 | instance |
2026-04-16 17:23:16.355178 | instance | TASK [Ensure the Kubernetes configuration file exists] *************************
2026-04-16 17:23:16.355413 | instance | Thursday 16 April 2026  17:23:16 +0000 (0:00:00.364)       0:00:06.599 ********
2026-04-16 17:23:16.551338 | instance | changed: [localhost]
2026-04-16 17:23:16.552023 | instance |
2026-04-16 17:23:16.552036 | instance | TASK [Load the current Kubernetes configuration into a variable] ***************
2026-04-16 17:23:16.552303 | instance | Thursday 16 April 2026  17:23:16 +0000 (0:00:00.196)       0:00:06.795 ********
2026-04-16 17:23:16.576689 | instance | ok: [localhost]
2026-04-16 17:23:16.576943 | instance |
2026-04-16 17:23:16.577219 | instance | TASK [Generate Kubernetes values for missing variables] ************************
2026-04-16 17:23:16.577527 | instance | Thursday 16 April 2026  17:23:16 +0000 (0:00:00.026)       0:00:06.821 ********
2026-04-16 17:23:16.616676 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'})
2026-04-16 17:23:16.617038 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42})
2026-04-16 17:23:16.617328 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'})
2026-04-16 17:23:16.617582 | instance |
2026-04-16 17:23:16.617904 | instance | TASK [Write new Kubernetes configuration file to disk] *************************
2026-04-16 17:23:16.618178 | instance | Thursday 16 April 2026  17:23:16 +0000 (0:00:00.039)       0:00:06.861 ********
2026-04-16 17:23:16.989656 | instance | changed: [localhost]
2026-04-16 17:23:16.989731 | instance |
2026-04-16 17:23:16.989739 | instance | PLAY [Generate Keepalived configuration for workspace] *************************
2026-04-16 17:23:16.989745 | instance |
2026-04-16 17:23:16.989750 | instance | TASK [Ensure the Keeaplived configuration file exists] *************************
2026-04-16 17:23:16.989898 | instance | Thursday 16 April 2026  17:23:16 +0000 (0:00:00.371)       0:00:07.233 ********
2026-04-16 17:23:17.161706 | instance | changed: [localhost]
2026-04-16 17:23:17.161925 | instance |
2026-04-16 17:23:17.162231 | instance | TASK [Load the current Keepalived configuration into a variable] ***************
2026-04-16 17:23:17.162547 | instance | Thursday 16 April 2026  17:23:17 +0000 (0:00:00.171)       0:00:07.404 ********
2026-04-16 17:23:17.184917 | instance | ok: [localhost]
2026-04-16 17:23:17.185145 | instance |
2026-04-16 17:23:17.185457 | instance | TASK [Generate Keepalived values for missing variables] ************************
2026-04-16 17:23:17.185727 | instance | Thursday 16 April 2026  17:23:17 +0000 (0:00:00.025)       0:00:07.429 ********
2026-04-16 17:23:17.220060 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'})
2026-04-16 17:23:17.220329 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'})
2026-04-16 17:23:17.220581 | instance |
2026-04-16 17:23:17.220850 | instance | TASK [Write new Keepalived configuration file to disk] *************************
2026-04-16 17:23:17.221121 | instance | Thursday 16 April 2026  17:23:17 +0000 (0:00:00.035)       0:00:07.465 ********
2026-04-16 17:23:17.589057 | instance | changed: [localhost]
2026-04-16 17:23:17.589276 | instance |
2026-04-16 17:23:17.589546 | instance | PLAY [Generate endpoints for workspace] ****************************************
2026-04-16 17:23:17.589790 | instance |
2026-04-16 17:23:17.590058 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:23:17.590327 | instance | Thursday 16 April 2026  17:23:17 +0000 (0:00:00.368)       0:00:07.833 ********
2026-04-16 17:23:18.287502 | instance | ok: [localhost]
2026-04-16 17:23:18.287778 | instance |
2026-04-16 17:23:18.288068 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-16 17:23:18.288428 | instance | Thursday 16 April 2026  17:23:18 +0000 (0:00:00.698)       0:00:08.532 ********
2026-04-16 17:23:18.467142 | instance | changed: [localhost]
2026-04-16 17:23:18.467401 | instance |
2026-04-16 17:23:18.467689 | instance | TASK [Load the current endpoints into a variable] ******************************
2026-04-16 17:23:18.467969 | instance | Thursday 16 April 2026  17:23:18 +0000 (0:00:00.179)       0:00:08.712 ********
2026-04-16 17:23:18.490595 | instance | ok: [localhost]
2026-04-16 17:23:18.490845 | instance |
2026-04-16 17:23:18.491126 | instance | TASK [Generate endpoint skeleton for missing variables] ************************
2026-04-16 17:23:18.491407 | instance | Thursday 16 April 2026  17:23:18 +0000 (0:00:00.023)       0:00:08.736 ********
2026-04-16 17:23:19.252547 | instance | ok: [localhost] => (item=keycloak_host)
2026-04-16 17:23:19.252872 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host)
2026-04-16 17:23:19.253147 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host)
2026-04-16 17:23:19.253427 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host)
2026-04-16 17:23:19.253702 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name)
2026-04-16 17:23:19.253992 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host)
2026-04-16 17:23:19.254254 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host)
2026-04-16 17:23:19.254580 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host)
2026-04-16 17:23:19.254870 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host)
2026-04-16 17:23:19.255137 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host)
2026-04-16 17:23:19.255408 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host)
2026-04-16 17:23:19.255678 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host)
2026-04-16 17:23:19.255953 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host)
2026-04-16 17:23:19.256224 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host)
2026-04-16 17:23:19.256548 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host)
2026-04-16 17:23:19.256924 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host)
2026-04-16 17:23:19.257224 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host)
2026-04-16 17:23:19.257498 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host)
2026-04-16 17:23:19.257764 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host)
2026-04-16 17:23:19.257935 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host)
2026-04-16 17:23:19.258107 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host)
2026-04-16 17:23:19.258275 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host)
2026-04-16 17:23:19.258462 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host)
2026-04-16 17:23:19.258628 | instance |
2026-04-16 17:23:19.258801 | instance | TASK [Write new endpoints file to disk] ****************************************
2026-04-16 17:23:19.258972 | instance | Thursday 16 April 2026  17:23:19 +0000 (0:00:00.761)       0:00:09.497 ********
2026-04-16 17:23:19.611787 | instance | changed: [localhost]
2026-04-16 17:23:19.612029 | instance |
2026-04-16 17:23:19.612359 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-16 17:23:19.612621 | instance | Thursday 16 April 2026  17:23:19 +0000 (0:00:00.359)       0:00:09.856 ********
2026-04-16 17:23:19.792930 | instance | changed: [localhost]
2026-04-16 17:23:19.793163 | instance |
2026-04-16 17:23:19.793441 | instance | PLAY [Generate Neutron configuration for workspace] ****************************
2026-04-16 17:23:19.793691 | instance |
2026-04-16 17:23:19.793966 | instance | TASK [Ensure the Neutron configuration file exists] ****************************
2026-04-16 17:23:19.794242 | instance | Thursday 16 April 2026  17:23:19 +0000 (0:00:00.181)       0:00:10.037 ********
2026-04-16 17:23:19.973520 | instance | changed: [localhost]
2026-04-16 17:23:19.973771 | instance |
2026-04-16 17:23:19.974059 | instance | TASK [Load the current Neutron configuration into a variable] ******************
2026-04-16 17:23:19.974335 | instance | Thursday 16 April 2026  17:23:19 +0000 (0:00:00.180)       0:00:10.218 ********
2026-04-16 17:23:20.002059 | instance | ok: [localhost]
2026-04-16 17:23:20.002317 | instance |
2026-04-16 17:23:20.002592 | instance | TASK [Generate Neutron values for missing variables] ***************************
2026-04-16 17:23:20.002866 | instance | Thursday 16 April 2026  17:23:19 +0000 (0:00:00.029)       0:00:10.247 ********
2026-04-16 17:23:20.044783 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]})
2026-04-16 17:23:20.045008 | instance |
2026-04-16 17:23:20.045285 | instance | TASK [Write new Neutron configuration file to disk] ****************************
2026-04-16 17:23:20.045685 | instance | Thursday 16 April 2026  17:23:20 +0000 (0:00:00.042)       0:00:10.289 ********
2026-04-16 17:23:20.388703 | instance | changed: [localhost]
2026-04-16 17:23:20.388936 | instance |
2026-04-16 17:23:20.389372 | instance | PLAY [Generate Nova configuration for workspace] *******************************
2026-04-16 17:23:20.389630 | instance |
2026-04-16 17:23:20.389910 | instance | TASK [Ensure the Nova configuration file exists] *******************************
2026-04-16 17:23:20.390189 | instance | Thursday 16 April 2026  17:23:20 +0000 (0:00:00.343)       0:00:10.633 ********
2026-04-16 17:23:20.560707 | instance | changed: [localhost]
2026-04-16 17:23:20.560962 | instance |
2026-04-16 17:23:20.561255 | instance | TASK [Load the current Nova configuration into a variable] *********************
2026-04-16 17:23:20.561543 | instance | Thursday 16 April 2026  17:23:20 +0000 (0:00:00.172)       0:00:10.805 ********
2026-04-16 17:23:20.593087 | instance | ok: [localhost]
2026-04-16 17:23:20.593294 | instance |
2026-04-16 17:23:20.593542 | instance | TASK [Generate Nova values for missing variables] ******************************
2026-04-16 17:23:20.593739 | instance | Thursday 16 April 2026  17:23:20 +0000 (0:00:00.032)       0:00:10.837 ********
2026-04-16 17:23:20.638691 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]})
2026-04-16 17:23:20.638939 | instance |
2026-04-16 17:23:20.639215 | instance | TASK [Write new Nova configuration file to disk] *******************************
2026-04-16 17:23:20.639531 | instance | Thursday 16 April 2026  17:23:20 +0000 (0:00:00.045)       0:00:10.883 ********
2026-04-16 17:23:21.013955 | instance | changed: [localhost]
2026-04-16 17:23:21.014209 | instance |
2026-04-16 17:23:21.014495 | instance | PLAY [Generate secrets for workspace] ******************************************
2026-04-16 17:23:21.014840 | instance |
2026-04-16 17:23:21.015140 | instance | TASK [Ensure the secrets file exists] ******************************************
2026-04-16 17:23:21.015412 | instance | Thursday 16 April 2026  17:23:21 +0000 (0:00:00.374)       0:00:11.258 ********
2026-04-16 17:23:21.179385 | instance | changed: [localhost]
2026-04-16 17:23:21.179656 | instance |
2026-04-16 17:23:21.179945 | instance | TASK [Load the current secrets into a variable] ********************************
2026-04-16 17:23:21.180234 | instance | Thursday 16 April 2026  17:23:21 +0000 (0:00:00.166)       0:00:11.424 ********
2026-04-16 17:23:21.209968 | instance | ok: [localhost]
2026-04-16 17:23:21.210221 | instance |
2026-04-16 17:23:21.210509 | instance | TASK [Generate secrets for missing variables] **********************************
2026-04-16 17:23:21.210783 | instance | Thursday 16 April 2026  17:23:21 +0000 (0:00:00.030)       0:00:11.455 ********
2026-04-16 17:23:21.620668 | instance | ok: [localhost] => (item=heat_auth_encryption_key)
2026-04-16 17:23:21.620907 | instance | ok: [localhost] => (item=keepalived_password)
2026-04-16 17:23:21.621187 | instance | ok: [localhost] => (item=keycloak_admin_password)
2026-04-16 17:23:21.621454 | instance | ok: [localhost] => (item=keycloak_database_password)
2026-04-16 17:23:21.621736 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret)
2026-04-16 17:23:21.622048 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase)
2026-04-16 17:23:21.622327 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password)
2026-04-16 17:23:21.622599 | instance | ok: [localhost] => (item=octavia_heartbeat_key)
2026-04-16 17:23:21.622868 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password)
2026-04-16 17:23:21.623139 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key)
2026-04-16 17:23:21.623407 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password)
2026-04-16 17:23:21.623691 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password)
2026-04-16 17:23:21.623960 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password)
2026-04-16 17:23:21.624541 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password)
2026-04-16 17:23:21.624833 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password)
2026-04-16 17:23:21.625112 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password)
2026-04-16 17:23:21.625387 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password)
2026-04-16 17:23:21.625662 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password)
2026-04-16 17:23:21.625993 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password)
2026-04-16 17:23:21.626272 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password)
2026-04-16 17:23:21.626560 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password)
2026-04-16 17:23:21.626828 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password)
2026-04-16 17:23:21.627067 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password)
2026-04-16 17:23:21.627231 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password)
2026-04-16 17:23:21.627400 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password)
2026-04-16 17:23:21.627566 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password)
2026-04-16 17:23:21.627729 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret)
2026-04-16 17:23:21.627894 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password)
2026-04-16 17:23:21.628063 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password)
2026-04-16 17:23:21.628251 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password)
2026-04-16 17:23:21.628417 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password)
2026-04-16 17:23:21.628585 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password)
2026-04-16 17:23:21.628751 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password)
2026-04-16 17:23:21.628918 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password)
2026-04-16 17:23:21.629093 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password)
2026-04-16 17:23:21.629253 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password)
2026-04-16 17:23:21.629421 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password)
2026-04-16 17:23:21.629587 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password)
2026-04-16 17:23:21.629753 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password)
2026-04-16 17:23:21.629920 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password)
2026-04-16 17:23:21.630116 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password)
2026-04-16 17:23:21.630279 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password)
2026-04-16 17:23:21.630442 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password)
2026-04-16 17:23:21.630624 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password)
2026-04-16 17:23:21.630789 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password)
2026-04-16 17:23:21.630955 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password)
2026-04-16 17:23:21.631127 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password)
2026-04-16 17:23:21.631297 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password)
2026-04-16 17:23:21.631465 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password)
2026-04-16 17:23:21.631641 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password)
2026-04-16 17:23:21.631810 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password)
2026-04-16 17:23:21.631979 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password)
2026-04-16 17:23:21.632145 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password)
2026-04-16 17:23:21.632332 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password)
2026-04-16 17:23:21.632498 | instance |
2026-04-16 17:23:21.632667 | instance | TASK [Generate base64 encoded secrets] *****************************************
2026-04-16 17:23:21.632846 | instance | Thursday 16 April 2026  17:23:21 +0000 (0:00:00.410)       0:00:11.865 ********
2026-04-16 17:23:21.671956 | instance | ok: [localhost] => (item=barbican_kek)
2026-04-16 17:23:21.672193 | instance |
2026-04-16 17:23:21.672521 | instance | TASK [Generate temporary files for generating keys for missing variables] ******
2026-04-16 17:23:21.672798 | instance | Thursday 16 April 2026  17:23:21 +0000 (0:00:00.051)       0:00:11.916 ********
2026-04-16 17:23:22.064827 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-16 17:23:22.065188 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-16 17:23:22.065538 | instance |
2026-04-16 17:23:22.065869 | instance | TASK [Generate SSH keys for missing variables] *********************************
2026-04-16 17:23:22.066207 | instance | Thursday 16 April 2026  17:23:22 +0000 (0:00:00.392)       0:00:12.309 ********
2026-04-16 17:23:25.356532 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-16 17:23:25.356798 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-16 17:23:25.357053 | instance |
2026-04-16 17:23:25.357352 | instance | TASK [Set values for SSH keys] *************************************************
2026-04-16 17:23:25.357665 | instance | Thursday 16 April 2026  17:23:25 +0000 (0:00:03.291)       0:00:15.601 ********
2026-04-16 17:23:25.409006 | instance | ok: [localhost] => (item=manila_ssh_key)
2026-04-16 17:23:25.409254 | instance | ok: [localhost] => (item=nova_ssh_key)
2026-04-16 17:23:25.409503 | instance |
2026-04-16 17:23:25.409771 | instance | TASK [Delete the temporary files generated for SSH keys] ***********************
2026-04-16 17:23:25.410037 | instance | Thursday 16 April 2026  17:23:25 +0000 (0:00:00.053)       0:00:15.654 ********
2026-04-16 17:23:25.783431 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-16 17:23:25.783690 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-16 17:23:25.783948 | instance |
2026-04-16 17:23:25.784221 | instance | TASK [Write new secrets file to disk] ******************************************
2026-04-16 17:23:25.784529 | instance | Thursday 16 April 2026  17:23:25 +0000 (0:00:00.373)       0:00:16.028 ********
2026-04-16 17:23:26.149645 | instance | changed: [localhost]
2026-04-16 17:23:26.149896 | instance |
2026-04-16 17:23:26.150195 | instance | TASK [Encrypt secrets file with Vault password] ********************************
2026-04-16 17:23:26.150493 | instance | Thursday 16 April 2026  17:23:26 +0000 (0:00:00.366)       0:00:16.394 ********
2026-04-16 17:23:26.189497 | instance | skipping: [localhost]
2026-04-16 17:23:26.189775 | instance |
2026-04-16 17:23:26.190138 | instance | PLAY [Setup networking] ********************************************************
2026-04-16 17:23:26.190489 | instance |
2026-04-16 17:23:26.190804 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:23:26.191080 | instance | Thursday 16 April 2026  17:23:26 +0000 (0:00:00.040)       0:00:16.435 ********
2026-04-16 17:23:26.899129 | instance | ok: [instance]
2026-04-16 17:23:26.899549 | instance |
2026-04-16 17:23:26.899906 | instance | TASK [Create bridge for management network] ************************************
2026-04-16 17:23:26.900309 | instance | Thursday 16 April 2026  17:23:26 +0000 (0:00:00.708)       0:00:17.144 ********
2026-04-16 17:23:27.253308 | instance | ok: [instance]
2026-04-16 17:23:27.254118 | instance |
2026-04-16 17:23:27.254475 | instance | TASK [Create fake interface for management bridge] *****************************
2026-04-16 17:23:27.254820 | instance | Thursday 16 April 2026  17:23:27 +0000 (0:00:00.351)       0:00:17.495 ********
2026-04-16 17:23:27.468999 | instance | ok: [instance]
2026-04-16 17:23:27.469098 | instance |
2026-04-16 17:23:27.469184 | instance | TASK [Assign dummy interface to management bridge] *****************************
2026-04-16 17:23:27.469297 | instance | Thursday 16 April 2026  17:23:27 +0000 (0:00:00.215)       0:00:17.711 ********
2026-04-16 17:23:27.685051 | instance | ok: [instance]
2026-04-16 17:23:27.685149 | instance |
2026-04-16 17:23:27.685330 | instance | TASK [Assign IP address for management bridge] *********************************
2026-04-16 17:23:27.685591 | instance | Thursday 16 April 2026  17:23:27 +0000 (0:00:00.216)       0:00:17.927 ********
2026-04-16 17:23:27.888991 | instance | ok: [instance]
2026-04-16 17:23:27.889093 | instance |
2026-04-16 17:23:27.889106 | instance | TASK [Bring up interfaces] *****************************************************
2026-04-16 17:23:27.889244 | instance | Thursday 16 April 2026  17:23:27 +0000 (0:00:00.206)       0:00:18.134 ********
2026-04-16 17:23:28.297288 | instance | ok: [instance] => (item=br-mgmt)
2026-04-16 17:23:28.297714 | instance | ok: [instance] => (item=dummy0)
2026-04-16 17:23:28.298030 | instance |
2026-04-16 17:23:28.298379 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-16 17:23:28.298738 | instance |
2026-04-16 17:23:28.299165 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:23:28.299799 | instance | Thursday 16 April 2026  17:23:28 +0000 (0:00:00.405)       0:00:18.539 ********
2026-04-16 17:23:29.049088 | instance | ok: [instance]
2026-04-16 17:23:29.049205 | instance |
2026-04-16 17:23:29.049218 | instance | TASK [Install depedencies] *****************************************************
2026-04-16 17:23:29.049343 | instance | Thursday 16 April 2026  17:23:29 +0000 (0:00:00.754)       0:00:19.293 ********
2026-04-16 17:24:09.979938 | instance | changed: [instance]
2026-04-16 17:24:09.980037 | instance |
2026-04-16 17:24:09.980128 | instance | TASK [Start up service] ********************************************************
2026-04-16 17:24:09.980400 | instance | Thursday 16 April 2026  17:24:09 +0000 (0:00:40.927)       0:01:00.220 ********
2026-04-16 17:24:10.556312 | instance | ok: [instance]
2026-04-16 17:24:10.556586 | instance |
2026-04-16 17:24:10.556834 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-16 17:24:10.557104 | instance | Thursday 16 April 2026  17:24:10 +0000 (0:00:00.578)       0:01:00.799 ********
2026-04-16 17:24:10.773245 | instance | ok: [instance]
2026-04-16 17:24:10.773308 | instance |
2026-04-16 17:24:10.773317 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-16 17:24:10.773326 | instance | Thursday 16 April 2026  17:24:10 +0000 (0:00:00.217)       0:01:01.017 ********
2026-04-16 17:24:11.242044 | instance | changed: [instance]
2026-04-16 17:24:11.242096 | instance |
2026-04-16 17:24:11.242103 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-16 17:24:11.242123 | instance | Thursday 16 April 2026  17:24:11 +0000 (0:00:00.469)       0:01:01.486 ********
2026-04-16 17:24:11.438185 | instance | ok: [instance]
2026-04-16 17:24:11.438224 | instance |
2026-04-16 17:24:11.438230 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-16 17:24:11.438235 | instance | Thursday 16 April 2026  17:24:11 +0000 (0:00:00.196)       0:01:01.683 ********
2026-04-16 17:24:11.464299 | instance | skipping: [instance]
2026-04-16 17:24:11.464342 | instance |
2026-04-16 17:24:11.464347 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-16 17:24:11.464352 | instance | Thursday 16 April 2026  17:24:11 +0000 (0:00:00.025)       0:01:01.709 ********
2026-04-16 17:24:12.060341 | instance | changed: [instance] => (item=osd0)
2026-04-16 17:24:12.060430 | instance | changed: [instance] => (item=osd1)
2026-04-16 17:24:12.060441 | instance | changed: [instance] => (item=osd2)
2026-04-16 17:24:12.060451 | instance |
2026-04-16 17:24:12.060460 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-16 17:24:12.060479 | instance | Thursday 16 April 2026  17:24:12 +0000 (0:00:00.594)       0:01:02.304 ********
2026-04-16 17:24:12.614471 | instance | changed: [instance] => (item=osd0)
2026-04-16 17:24:12.614613 | instance | changed: [instance] => (item=osd1)
2026-04-16 17:24:12.615306 | instance | changed: [instance] => (item=osd2)
2026-04-16 17:24:12.615536 | instance |
2026-04-16 17:24:12.615545 | instance | TASK [Start loop devices] ******************************************************
2026-04-16 17:24:12.615552 | instance | Thursday 16 April 2026  17:24:12 +0000 (0:00:00.555)       0:01:02.859 ********
2026-04-16 17:24:13.393417 | instance | changed: [instance] => (item=osd0)
2026-04-16 17:24:13.393527 | instance | changed: [instance] => (item=osd1)
2026-04-16 17:24:13.393745 | instance | changed: [instance] => (item=osd2)
2026-04-16 17:24:13.393981 | instance |
2026-04-16 17:24:13.394190 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-16 17:24:13.394395 | instance | Thursday 16 April 2026  17:24:13 +0000 (0:00:00.778)       0:01:03.638 ********
2026-04-16 17:24:16.488471 | instance | changed: [instance] => (item=osd0)
2026-04-16 17:24:16.488754 | instance | changed: [instance] => (item=osd1)
2026-04-16 17:24:16.488987 | instance | changed: [instance] => (item=osd2)
2026-04-16 17:24:16.489197 | instance |
2026-04-16 17:24:16.489411 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-16 17:24:16.489641 | instance | Thursday 16 April 2026  17:24:16 +0000 (0:00:03.094)       0:01:06.733 ********
2026-04-16 17:24:18.459377 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-16 17:24:18.459462 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-16 17:24:18.460168 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-16 17:24:18.460216 | instance |
2026-04-16 17:24:18.460242 | instance | PLAY [controllers] *************************************************************
2026-04-16 17:24:18.460249 | instance |
2026-04-16 17:24:18.460254 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:24:18.460258 | instance | Thursday 16 April 2026  17:24:18 +0000 (0:00:01.971)       0:01:08.704 ********
2026-04-16 17:24:19.382182 | instance | ok: [instance]
2026-04-16 17:24:19.382307 | instance |
2026-04-16 17:24:19.382329 | instance | TASK [Set masquerade rule] *****************************************************
2026-04-16 17:24:19.382494 | instance | Thursday 16 April 2026  17:24:19 +0000 (0:00:00.922)       0:01:09.627 ********
2026-04-16 17:24:19.851891 | instance | changed: [instance]
2026-04-16 17:24:19.852285 | instance |
2026-04-16 17:24:19.856312 | instance | PLAY RECAP *********************************************************************
2026-04-16 17:24:19.856372 | instance | instance                   : ok=24   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-16 17:24:19.856380 | instance | localhost                  : ok=40   changed=21   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-16 17:24:19.856387 | instance |
2026-04-16 17:24:19.856393 | instance | Thursday 16 April 2026  17:24:19 +0000 (0:00:00.469)       0:01:10.096 ********
2026-04-16 17:24:19.856399 | instance | ===============================================================================
2026-04-16 17:24:19.856427 | instance | Install depedencies ---------------------------------------------------- 40.93s
2026-04-16 17:24:19.856433 | instance | Generate SSH keys for missing variables --------------------------------- 3.29s
2026-04-16 17:24:19.856439 | instance | Create a volume group for each loop device ------------------------------ 3.09s
2026-04-16 17:24:19.856444 | instance | Create a logical volume for each loop device ---------------------------- 1.97s
2026-04-16 17:24:19.856450 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.23s
2026-04-16 17:24:19.856455 | instance | Gathering Facts --------------------------------------------------------- 1.17s
2026-04-16 17:24:19.856460 | instance | Create folders for workspace -------------------------------------------- 1.04s
2026-04-16 17:24:19.856466 | instance | Gathering Facts --------------------------------------------------------- 0.92s
2026-04-16 17:24:19.856471 | instance | Start loop devices ------------------------------------------------------ 0.78s
2026-04-16 17:24:19.856477 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.76s
2026-04-16 17:24:19.856482 | instance | Gathering Facts --------------------------------------------------------- 0.75s
2026-04-16 17:24:19.856487 | instance | Configure short hostname ------------------------------------------------ 0.73s
2026-04-16 17:24:19.856493 | instance | Gathering Facts --------------------------------------------------------- 0.71s
2026-04-16 17:24:19.856498 | instance | Gathering Facts --------------------------------------------------------- 0.70s
2026-04-16 17:24:19.856504 | instance | Purge "snapd" package --------------------------------------------------- 0.69s
2026-04-16 17:24:19.856516 | instance | Create devices for Ceph ------------------------------------------------- 0.59s
2026-04-16 17:24:19.856522 | instance | Start up service -------------------------------------------------------- 0.58s
2026-04-16 17:24:19.856632 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.58s
2026-04-16 17:24:19.856760 | instance | Set permissions on loopback devices ------------------------------------- 0.56s
2026-04-16 17:24:19.856881 | instance | Set masquerade rule ----------------------------------------------------- 0.47s
2026-04-16 17:24:19.949416 | instance | INFO     [aio > prepare] Executed: Successful
2026-04-16 17:24:19.962914 | instance | INFO     [aio > converge] Executing
2026-04-16 17:24:22.723729 | instance |
2026-04-16 17:24:22.724010 | instance | PLAY [all] *********************************************************************
2026-04-16 17:24:22.724322 | instance |
2026-04-16 17:24:22.724601 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:24:22.724870 | instance | Thursday 16 April 2026  17:24:22 +0000 (0:00:00.018)       0:00:00.018 ********
2026-04-16 17:24:23.924213 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-16 17:24:23.924523 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-16 17:24:23.924810 | instance | interpreter could change the meaning of that path. See
2026-04-16 17:24:23.925092 | instance | https://docs.ansible.com/ansible-
2026-04-16 17:24:23.925374 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-16 17:24:23.931060 | instance | ok: [instance]
2026-04-16 17:24:23.931216 | instance |
2026-04-16 17:24:23.931383 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-04-16 17:24:23.931555 | instance | Thursday 16 April 2026  17:24:23 +0000 (0:00:01.207)       0:00:01.225 ********
2026-04-16 17:24:23.973390 | instance | skipping: [instance]
2026-04-16 17:24:23.973737 | instance |
2026-04-16 17:24:23.974097 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-16 17:24:23.974451 | instance | Thursday 16 April 2026  17:24:23 +0000 (0:00:00.041)       0:00:01.267 ********
2026-04-16 17:24:24.157318 | instance | ok: [instance]
2026-04-16 17:24:24.157427 | instance |
2026-04-16 17:24:24.157549 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-16 17:24:24.157660 | instance |
2026-04-16 17:24:24.157780 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:24:24.157900 | instance | Thursday 16 April 2026  17:24:24 +0000 (0:00:00.184)       0:00:01.452 ********
2026-04-16 17:24:25.072347 | instance | ok: [instance]
2026-04-16 17:24:25.072602 | instance |
2026-04-16 17:24:25.072761 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:24:25.072912 | instance | Thursday 16 April 2026  17:24:25 +0000 (0:00:00.914)       0:00:02.366 ********
2026-04-16 17:24:25.366382 | instance | ok: [instance]
2026-04-16 17:24:25.366815 | instance |
2026-04-16 17:24:25.367324 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:24:25.367839 | instance | Thursday 16 April 2026  17:24:25 +0000 (0:00:00.290)       0:00:02.657 ********
2026-04-16 17:24:25.413168 | instance | skipping: [instance]
2026-04-16 17:24:25.413357 | instance |
2026-04-16 17:24:25.413377 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-16 17:24:25.413506 | instance | Thursday 16 April 2026  17:24:25 +0000 (0:00:00.046)       0:00:02.704 ********
2026-04-16 17:24:25.717037 | instance | changed: [instance]
2026-04-16 17:24:25.717118 | instance |
2026-04-16 17:24:25.717239 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:24:25.717438 | instance | Thursday 16 April 2026  17:24:25 +0000 (0:00:00.304)       0:00:03.008 ********
2026-04-16 17:24:25.805072 | instance | ok: [instance] => {
2026-04-16 17:24:25.805199 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-16 17:24:25.805395 | instance | }
2026-04-16 17:24:25.805540 | instance |
2026-04-16 17:24:25.805694 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:24:25.805844 | instance | Thursday 16 April 2026  17:24:25 +0000 (0:00:00.087)       0:00:03.096 ********
2026-04-16 17:24:26.613022 | instance | changed: [instance]
2026-04-16 17:24:26.613660 | instance |
2026-04-16 17:24:26.613676 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:24:26.613686 | instance | Thursday 16 April 2026  17:24:26 +0000 (0:00:00.810)       0:00:03.906 ********
2026-04-16 17:24:26.675164 | instance | skipping: [instance]
2026-04-16 17:24:26.675261 | instance |
2026-04-16 17:24:26.675526 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:24:26.675582 | instance | Thursday 16 April 2026  17:24:26 +0000 (0:00:00.062)       0:00:03.969 ********
2026-04-16 17:24:26.728801 | instance | skipping: [instance]
2026-04-16 17:24:26.728900 | instance |
2026-04-16 17:24:26.728977 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:24:26.729116 | instance | Thursday 16 April 2026  17:24:26 +0000 (0:00:00.053)       0:00:04.023 ********
2026-04-16 17:24:26.944477 | instance | ok: [instance]
2026-04-16 17:24:26.944553 | instance |
2026-04-16 17:24:26.944800 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:24:26.944856 | instance | Thursday 16 April 2026  17:24:26 +0000 (0:00:00.215)       0:00:04.239 ********
2026-04-16 17:24:28.336103 | instance | ok: [instance]
2026-04-16 17:24:28.336177 | instance |
2026-04-16 17:24:28.336185 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:24:28.336191 | instance | Thursday 16 April 2026  17:24:28 +0000 (0:00:01.391)       0:00:05.630 ********
2026-04-16 17:24:28.419067 | instance | ok: [instance] => {
2026-04-16 17:24:28.419107 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz"
2026-04-16 17:24:28.419113 | instance | }
2026-04-16 17:24:28.419117 | instance |
2026-04-16 17:24:28.419122 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:24:28.419127 | instance | Thursday 16 April 2026  17:24:28 +0000 (0:00:00.082)       0:00:05.713 ********
2026-04-16 17:24:29.161631 | instance | changed: [instance]
2026-04-16 17:24:29.161678 | instance |
2026-04-16 17:24:29.161684 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:24:29.161689 | instance | Thursday 16 April 2026  17:24:29 +0000 (0:00:00.742)       0:00:06.456 ********
2026-04-16 17:24:33.227867 | instance | changed: [instance]
2026-04-16 17:24:33.227925 | instance |
2026-04-16 17:24:33.227930 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-16 17:24:33.227948 | instance | Thursday 16 April 2026  17:24:33 +0000 (0:00:04.066)       0:00:10.522 ********
2026-04-16 17:24:33.261773 | instance | skipping: [instance]
2026-04-16 17:24:33.261865 | instance |
2026-04-16 17:24:33.262095 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-16 17:24:33.262142 | instance | Thursday 16 April 2026  17:24:33 +0000 (0:00:00.034)       0:00:10.556 ********
2026-04-16 17:24:33.304880 | instance | skipping: [instance]
2026-04-16 17:24:33.304975 | instance |
2026-04-16 17:24:33.305231 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-16 17:24:33.305287 | instance | Thursday 16 April 2026  17:24:33 +0000 (0:00:00.042)       0:00:10.599 ********
2026-04-16 17:24:33.340433 | instance | skipping: [instance]
2026-04-16 17:24:33.340534 | instance |
2026-04-16 17:24:33.340614 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-16 17:24:33.340739 | instance | Thursday 16 April 2026  17:24:33 +0000 (0:00:00.035)       0:00:10.635 ********
2026-04-16 17:24:39.592161 | instance | changed: [instance]
2026-04-16 17:24:39.592292 | instance |
2026-04-16 17:24:39.592369 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-16 17:24:39.592493 | instance | Thursday 16 April 2026  17:24:39 +0000 (0:00:06.251)       0:00:16.886 ********
2026-04-16 17:24:40.268931 | instance | changed: [instance]
2026-04-16 17:24:40.269177 | instance |
2026-04-16 17:24:40.269491 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-16 17:24:40.269851 | instance | Thursday 16 April 2026  17:24:40 +0000 (0:00:00.676)       0:00:17.562 ********
2026-04-16 17:24:41.256887 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-04-16 17:24:41.257138 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-16 17:24:41.257160 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-16 17:24:41.257166 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-16 17:24:41.257173 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-16 17:24:41.257179 | instance |
2026-04-16 17:24:41.257194 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-16 17:24:41.257200 | instance | Thursday 16 April 2026  17:24:41 +0000 (0:00:00.986)       0:00:18.548 ********
2026-04-16 17:24:41.851020 | instance | changed: [instance]
2026-04-16 17:24:41.851114 | instance |
2026-04-16 17:24:41.852097 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-16 17:24:41.852393 | instance | Thursday 16 April 2026  17:24:41 +0000 (0:00:00.586)       0:00:19.135 ********
2026-04-16 17:24:41.852579 | instance |
2026-04-16 17:24:41.852774 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-16 17:24:41.852965 | instance | Thursday 16 April 2026  17:24:41 +0000 (0:00:00.009)       0:00:19.145 ********
2026-04-16 17:24:42.809321 | instance | ok: [instance]
2026-04-16 17:24:42.809717 | instance |
2026-04-16 17:24:42.810063 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-16 17:24:42.810397 | instance | Thursday 16 April 2026  17:24:42 +0000 (0:00:00.956)       0:00:20.102 ********
2026-04-16 17:24:43.272918 | instance | changed: [instance]
2026-04-16 17:24:43.273032 | instance |
2026-04-16 17:24:43.273095 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-16 17:24:43.273242 | instance | Thursday 16 April 2026  17:24:43 +0000 (0:00:00.464)       0:00:20.566 ********
2026-04-16 17:24:43.835973 | instance | changed: [instance]
2026-04-16 17:24:43.836081 | instance |
2026-04-16 17:24:43.836096 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:24:43.836299 | instance | Thursday 16 April 2026  17:24:43 +0000 (0:00:00.564)       0:00:21.130 ********
2026-04-16 17:24:44.050513 | instance | ok: [instance]
2026-04-16 17:24:44.050619 | instance |
2026-04-16 17:24:44.050634 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:24:44.051348 | instance | Thursday 16 April 2026  17:24:44 +0000 (0:00:00.214)       0:00:21.344 ********
2026-04-16 17:24:44.106852 | instance | ok: [instance] => {
2026-04-16 17:24:44.107472 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-16 17:24:44.107532 | instance | }
2026-04-16 17:24:44.107539 | instance |
2026-04-16 17:24:44.107544 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:24:44.107549 | instance | Thursday 16 April 2026  17:24:44 +0000 (0:00:00.056)       0:00:21.401 ********
2026-04-16 17:24:45.042325 | instance | changed: [instance]
2026-04-16 17:24:45.042432 | instance |
2026-04-16 17:24:45.042446 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:24:45.042606 | instance | Thursday 16 April 2026  17:24:45 +0000 (0:00:00.935)       0:00:22.337 ********
2026-04-16 17:24:49.519021 | instance | changed: [instance]
2026-04-16 17:24:49.519115 | instance |
2026-04-16 17:24:49.519179 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-16 17:24:49.519332 | instance | Thursday 16 April 2026  17:24:49 +0000 (0:00:04.476)       0:00:26.813 ********
2026-04-16 17:24:50.664056 | instance | ok: [instance]
2026-04-16 17:24:50.664154 | instance |
2026-04-16 17:24:50.664220 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-16 17:24:50.664415 | instance | Thursday 16 April 2026  17:24:50 +0000 (0:00:01.144)       0:00:27.958 ********
2026-04-16 17:24:51.084928 | instance | changed: [instance]
2026-04-16 17:24:51.085002 | instance |
2026-04-16 17:24:51.085239 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-16 17:24:51.085255 | instance | Thursday 16 April 2026  17:24:51 +0000 (0:00:00.420)       0:00:28.379 ********
2026-04-16 17:24:51.590105 | instance | changed: [instance]
2026-04-16 17:24:51.590201 | instance |
2026-04-16 17:24:51.590448 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-16 17:24:51.590501 | instance | Thursday 16 April 2026  17:24:51 +0000 (0:00:00.505)       0:00:28.884 ********
2026-04-16 17:24:52.147421 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-04-16 17:24:52.147484 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-16 17:24:52.147994 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-16 17:24:52.148042 | instance |
2026-04-16 17:24:52.148048 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-16 17:24:52.148053 | instance | Thursday 16 April 2026  17:24:52 +0000 (0:00:00.557)       0:00:29.442 ********
2026-04-16 17:24:52.615275 | instance | changed: [instance]
2026-04-16 17:24:52.615339 | instance |
2026-04-16 17:24:52.615620 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-16 17:24:52.615678 | instance | Thursday 16 April 2026  17:24:52 +0000 (0:00:00.467)       0:00:29.909 ********
2026-04-16 17:24:53.104850 | instance | changed: [instance]
2026-04-16 17:24:53.104957 | instance |
2026-04-16 17:24:53.105026 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-16 17:24:53.105506 | instance | Thursday 16 April 2026  17:24:53 +0000 (0:00:00.480)       0:00:30.390 ********
2026-04-16 17:24:53.105559 | instance |
2026-04-16 17:24:53.105565 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-16 17:24:53.105570 | instance | Thursday 16 April 2026  17:24:53 +0000 (0:00:00.009)       0:00:30.399 ********
2026-04-16 17:24:53.794718 | instance | ok: [instance]
2026-04-16 17:24:53.794794 | instance |
2026-04-16 17:24:53.795057 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-16 17:24:53.795108 | instance | Thursday 16 April 2026  17:24:53 +0000 (0:00:00.689)       0:00:31.089 ********
2026-04-16 17:24:54.623247 | instance | changed: [instance]
2026-04-16 17:24:54.623342 | instance |
2026-04-16 17:24:54.623590 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-16 17:24:54.623655 | instance | Thursday 16 April 2026  17:24:54 +0000 (0:00:00.828)       0:00:31.917 ********
2026-04-16 17:24:56.199896 | instance | changed: [instance]
2026-04-16 17:24:56.200034 | instance |
2026-04-16 17:24:56.200050 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-16 17:24:56.200222 | instance | Thursday 16 April 2026  17:24:56 +0000 (0:00:01.576)       0:00:33.494 ********
2026-04-16 17:24:56.266203 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-16 17:24:56.266292 | instance |
2026-04-16 17:24:56.266352 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-16 17:24:56.266563 | instance | Thursday 16 April 2026  17:24:56 +0000 (0:00:00.065)       0:00:33.560 ********
2026-04-16 17:25:05.431008 | instance | changed: [instance]
2026-04-16 17:25:05.431103 | instance |
2026-04-16 17:25:05.431410 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-16 17:25:05.431479 | instance | Thursday 16 April 2026  17:25:05 +0000 (0:00:09.163)       0:00:42.723 ********
2026-04-16 17:25:06.112025 | instance | ok: [instance] => (item=chronyd)
2026-04-16 17:25:06.112101 | instance | ok: [instance] => (item=sshd)
2026-04-16 17:25:06.112270 | instance |
2026-04-16 17:25:06.112533 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-16 17:25:06.112548 | instance | Thursday 16 April 2026  17:25:06 +0000 (0:00:00.682)       0:00:43.406 ********
2026-04-16 17:25:06.432195 | instance | changed: [instance]
2026-04-16 17:25:06.432331 | instance |
2026-04-16 17:25:06.432685 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-16 17:25:06.432759 | instance | Thursday 16 April 2026  17:25:06 +0000 (0:00:00.320)       0:00:43.726 ********
2026-04-16 17:25:06.647695 | instance | ok: [instance]
2026-04-16 17:25:06.647776 | instance |
2026-04-16 17:25:06.648026 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-16 17:25:06.648076 | instance | Thursday 16 April 2026  17:25:06 +0000 (0:00:00.215)       0:00:43.942 ********
2026-04-16 17:25:07.193799 | instance | changed: [instance]
2026-04-16 17:25:07.193907 | instance |
2026-04-16 17:25:07.194147 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-16 17:25:07.194212 | instance | Thursday 16 April 2026  17:25:07 +0000 (0:00:00.546)       0:00:44.488 ********
2026-04-16 17:25:07.618173 | instance | changed: [instance]
2026-04-16 17:25:07.618280 | instance |
2026-04-16 17:25:07.618533 | instance | TASK [vexxhost.ceph.mon : Get `cephadm ls` status] *****************************
2026-04-16 17:25:07.618598 | instance | Thursday 16 April 2026  17:25:07 +0000 (0:00:00.424)       0:00:44.912 ********
2026-04-16 17:25:09.352811 | instance | ok: [instance]
2026-04-16 17:25:09.352907 | instance |
2026-04-16 17:25:09.353142 | instance | TASK [vexxhost.ceph.mon : Parse the `cephadm ls` output] ***********************
2026-04-16 17:25:09.353389 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:01.734)       0:00:46.647 ********
2026-04-16 17:25:09.409751 | instance | ok: [instance]
2026-04-16 17:25:09.410158 | instance |
2026-04-16 17:25:09.410218 | instance | TASK [vexxhost.ceph.mon : Assimilate existing configs in `ceph.conf`] **********
2026-04-16 17:25:09.410224 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.056)       0:00:46.704 ********
2026-04-16 17:25:09.449293 | instance | skipping: [instance]
2026-04-16 17:25:09.449843 | instance |
2026-04-16 17:25:09.449866 | instance | TASK [vexxhost.ceph.mon : Adopt monitor to cluster] ****************************
2026-04-16 17:25:09.449875 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.039)       0:00:46.743 ********
2026-04-16 17:25:09.492971 | instance | skipping: [instance]
2026-04-16 17:25:09.493062 | instance |
2026-04-16 17:25:09.493307 | instance | TASK [vexxhost.ceph.mon : Adopt manager to cluster] ****************************
2026-04-16 17:25:09.493322 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.044)       0:00:46.787 ********
2026-04-16 17:25:09.537430 | instance | skipping: [instance]
2026-04-16 17:25:09.537487 | instance |
2026-04-16 17:25:09.537782 | instance | TASK [vexxhost.ceph.mon : Enable "cephadm" mgr module] *************************
2026-04-16 17:25:09.537797 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.044)       0:00:46.832 ********
2026-04-16 17:25:09.579948 | instance | skipping: [instance]
2026-04-16 17:25:09.580037 | instance |
2026-04-16 17:25:09.580139 | instance | TASK [vexxhost.ceph.mon : Set orchestrator backend to "cephadm"] ***************
2026-04-16 17:25:09.580336 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.042)       0:00:46.874 ********
2026-04-16 17:25:09.624549 | instance | skipping: [instance]
2026-04-16 17:25:09.624652 | instance |
2026-04-16 17:25:09.624774 | instance | TASK [vexxhost.ceph.mon : Use `cephadm` user for cephadm] **********************
2026-04-16 17:25:09.624890 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.044)       0:00:46.919 ********
2026-04-16 17:25:09.667094 | instance | skipping: [instance]
2026-04-16 17:25:09.667207 | instance |
2026-04-16 17:25:09.667435 | instance | TASK [vexxhost.ceph.mon : Generate "cephadm" key] ******************************
2026-04-16 17:25:09.667645 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.042)       0:00:46.961 ********
2026-04-16 17:25:09.710399 | instance | skipping: [instance]
2026-04-16 17:25:09.710556 | instance |
2026-04-16 17:25:09.710817 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-16 17:25:09.711095 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.042)       0:00:47.004 ********
2026-04-16 17:25:09.844912 | instance | ok: [instance]
2026-04-16 17:25:09.844999 | instance |
2026-04-16 17:25:09.845053 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-16 17:25:09.845215 | instance | Thursday 16 April 2026  17:25:09 +0000 (0:00:00.133)       0:00:47.138 ********
2026-04-16 17:25:10.077110 | instance | ok: [instance] => (item=instance)
2026-04-16 17:25:10.077204 | instance |
2026-04-16 17:25:10.077456 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-16 17:25:10.077518 | instance | Thursday 16 April 2026  17:25:10 +0000 (0:00:00.233)       0:00:47.371 ********
2026-04-16 17:25:10.140333 | instance | ok: [instance]
2026-04-16 17:25:10.140417 | instance |
2026-04-16 17:25:10.140688 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-16 17:25:10.140747 | instance | Thursday 16 April 2026  17:25:10 +0000 (0:00:00.062)       0:00:47.434 ********
2026-04-16 17:25:10.246807 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-04-16 17:25:10.246937 | instance |
2026-04-16 17:25:10.247368 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-04-16 17:25:10.247448 | instance | Thursday 16 April 2026  17:25:10 +0000 (0:00:00.106)       0:00:47.540 ********
2026-04-16 17:25:10.626422 | instance | changed: [instance]
2026-04-16 17:25:10.626525 | instance |
2026-04-16 17:25:10.626599 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-04-16 17:25:10.626764 | instance | Thursday 16 April 2026  17:25:10 +0000 (0:00:00.380)       0:00:47.921 ********
2026-04-16 17:25:11.420325 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-04-16 17:25:11.421773 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-04-16 17:25:11.421853 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-04-16 17:25:11.421887 | instance |
2026-04-16 17:25:11.421903 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap coomand] *******************************
2026-04-16 17:25:11.421916 | instance | Thursday 16 April 2026  17:25:11 +0000 (0:00:00.793)       0:00:48.714 ********
2026-04-16 17:27:19.265440 | instance | ok: [instance]
2026-04-16 17:27:19.265542 | instance |
2026-04-16 17:27:19.265556 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-04-16 17:27:19.265567 | instance | Thursday 16 April 2026  17:27:19 +0000 (0:02:07.842)       0:02:56.556 ********
2026-04-16 17:27:19.491117 | instance | changed: [instance]
2026-04-16 17:27:19.491217 | instance |
2026-04-16 17:27:19.491462 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-04-16 17:27:19.491719 | instance | Thursday 16 April 2026  17:27:19 +0000 (0:00:00.229)       0:02:56.785 ********
2026-04-16 17:27:19.542157 | instance | ok: [instance]
2026-04-16 17:27:19.542208 | instance |
2026-04-16 17:27:19.542497 | instance | TASK [Install Ceph host] *******************************************************
2026-04-16 17:27:19.542556 | instance | Thursday 16 April 2026  17:27:19 +0000 (0:00:00.050)       0:02:56.836 ********
2026-04-16 17:27:19.621587 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-16 17:27:19.621965 | instance |
2026-04-16 17:27:19.622010 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-16 17:27:19.622016 | instance | Thursday 16 April 2026  17:27:19 +0000 (0:00:00.079)       0:02:56.916 ********
2026-04-16 17:27:21.276537 | instance | ok: [instance]
2026-04-16 17:27:21.276643 | instance |
2026-04-16 17:27:21.276928 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-16 17:27:21.276981 | instance | Thursday 16 April 2026  17:27:21 +0000 (0:00:01.654)       0:02:58.571 ********
2026-04-16 17:27:21.349220 | instance | ok: [instance] => (item=instance)
2026-04-16 17:27:21.349281 | instance |
2026-04-16 17:27:21.349290 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-16 17:27:21.349297 | instance | Thursday 16 April 2026  17:27:21 +0000 (0:00:00.071)       0:02:58.642 ********
2026-04-16 17:27:21.783900 | instance | ok: [instance]
2026-04-16 17:27:21.783967 | instance |
2026-04-16 17:27:21.784311 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-16 17:27:21.784358 | instance | Thursday 16 April 2026  17:27:21 +0000 (0:00:00.435)       0:02:59.078 ********
2026-04-16 17:27:23.769901 | instance | ok: [instance]
2026-04-16 17:27:23.769990 | instance |
2026-04-16 17:27:23.770053 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-16 17:27:23.770198 | instance | Thursday 16 April 2026  17:27:23 +0000 (0:00:01.985)       0:03:01.064 ********
2026-04-16 17:27:25.501648 | instance | ok: [instance]
2026-04-16 17:27:25.501770 | instance |
2026-04-16 17:27:25.502042 | instance | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-16 17:27:25.502088 | instance | Thursday 16 April 2026  17:27:25 +0000 (0:00:01.731)       0:03:02.796 ********
2026-04-16 17:27:35.796254 | instance | ok: [instance]
2026-04-16 17:27:35.796348 | instance |
2026-04-16 17:27:35.796565 | instance | TASK [Install Ceph host] *******************************************************
2026-04-16 17:27:35.796624 | instance | Thursday 16 April 2026  17:27:35 +0000 (0:00:10.294)       0:03:13.090 ********
2026-04-16 17:27:35.877868 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-16 17:27:35.878003 | instance |
2026-04-16 17:27:35.878067 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-16 17:27:35.878233 | instance | Thursday 16 April 2026  17:27:35 +0000 (0:00:00.081)       0:03:13.172 ********
2026-04-16 17:27:35.936620 | instance | skipping: [instance]
2026-04-16 17:27:35.936708 | instance |
2026-04-16 17:27:35.936992 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-16 17:27:35.937018 | instance | Thursday 16 April 2026  17:27:35 +0000 (0:00:00.058)       0:03:13.231 ********
2026-04-16 17:27:35.993400 | instance | skipping: [instance] => (item=instance)
2026-04-16 17:27:35.993502 | instance | skipping: [instance]
2026-04-16 17:27:35.993613 | instance |
2026-04-16 17:27:35.993735 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-16 17:27:35.993877 | instance | Thursday 16 April 2026  17:27:35 +0000 (0:00:00.057)       0:03:13.288 ********
2026-04-16 17:27:36.254864 | instance | ok: [instance]
2026-04-16 17:27:36.254927 | instance |
2026-04-16 17:27:36.255179 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-16 17:27:36.255196 | instance | Thursday 16 April 2026  17:27:36 +0000 (0:00:00.260)       0:03:13.549 ********
2026-04-16 17:27:38.328722 | instance | ok: [instance]
2026-04-16 17:27:38.328836 | instance |
2026-04-16 17:27:38.328921 | instance | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-16 17:27:38.329078 | instance | Thursday 16 April 2026  17:27:38 +0000 (0:00:02.074)       0:03:15.623 ********
2026-04-16 17:27:40.096624 | instance | ok: [instance]
2026-04-16 17:27:40.096733 | instance |
2026-04-16 17:27:40.096965 | instance | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-16 17:27:40.097009 | instance | Thursday 16 April 2026  17:27:40 +0000 (0:00:01.767)       0:03:17.391 ********
2026-04-16 17:27:41.676440 | instance | ok: [instance]
2026-04-16 17:27:41.676975 | instance |
2026-04-16 17:27:41.676988 | instance | TASK [vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module] ***********
2026-04-16 17:27:41.676998 | instance | Thursday 16 April 2026  17:27:41 +0000 (0:00:01.579)       0:03:18.970 ********
2026-04-16 17:27:44.202424 | instance | ok: [instance]
2026-04-16 17:27:44.202515 | instance |
2026-04-16 17:27:44.202667 | instance | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-16 17:27:44.202825 | instance |
2026-04-16 17:27:44.202992 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:27:44.203162 | instance | Thursday 16 April 2026  17:27:44 +0000 (0:00:02.526)       0:03:21.497 ********
2026-04-16 17:27:45.115240 | instance | ok: [instance]
2026-04-16 17:27:45.115308 | instance |
2026-04-16 17:27:45.115450 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:27:45.115575 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.912)       0:03:22.409 ********
2026-04-16 17:27:45.323065 | instance | ok: [instance]
2026-04-16 17:27:45.323137 | instance |
2026-04-16 17:27:45.323260 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:27:45.323404 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.207)       0:03:22.617 ********
2026-04-16 17:27:45.367413 | instance | skipping: [instance]
2026-04-16 17:27:45.367492 | instance |
2026-04-16 17:27:45.367578 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-16 17:27:45.367699 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.044)       0:03:22.662 ********
2026-04-16 17:27:45.578284 | instance | ok: [instance]
2026-04-16 17:27:45.578354 | instance |
2026-04-16 17:27:45.578481 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:27:45.578610 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.210)       0:03:22.873 ********
2026-04-16 17:27:45.634498 | instance | ok: [instance] => {
2026-04-16 17:27:45.634560 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-16 17:27:45.634697 | instance | }
2026-04-16 17:27:45.634804 | instance |
2026-04-16 17:27:45.634928 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:27:45.635085 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.056)       0:03:22.929 ********
2026-04-16 17:27:45.936309 | instance | ok: [instance]
2026-04-16 17:27:45.936401 | instance |
2026-04-16 17:27:45.936599 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:27:45.936744 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.301)       0:03:23.230 ********
2026-04-16 17:27:45.986311 | instance | skipping: [instance]
2026-04-16 17:27:45.986405 | instance |
2026-04-16 17:27:45.986524 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:27:45.986648 | instance | Thursday 16 April 2026  17:27:45 +0000 (0:00:00.050)       0:03:23.281 ********
2026-04-16 17:27:46.031071 | instance | skipping: [instance]
2026-04-16 17:27:46.031163 | instance |
2026-04-16 17:27:46.031287 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:27:46.031412 | instance | Thursday 16 April 2026  17:27:46 +0000 (0:00:00.044)       0:03:23.326 ********
2026-04-16 17:27:46.232605 | instance | ok: [instance]
2026-04-16 17:27:46.232681 | instance |
2026-04-16 17:27:46.232820 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:27:46.232945 | instance | Thursday 16 April 2026  17:27:46 +0000 (0:00:00.201)       0:03:23.527 ********
2026-04-16 17:27:47.263695 | instance | ok: [instance]
2026-04-16 17:27:47.263798 | instance |
2026-04-16 17:27:47.263861 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:27:47.263999 | instance | Thursday 16 April 2026  17:27:47 +0000 (0:00:01.030)       0:03:24.558 ********
2026-04-16 17:27:47.332504 | instance | ok: [instance] => {
2026-04-16 17:27:47.332567 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz"
2026-04-16 17:27:47.332703 | instance | }
2026-04-16 17:27:47.332817 | instance |
2026-04-16 17:27:47.332945 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:27:47.333078 | instance | Thursday 16 April 2026  17:27:47 +0000 (0:00:00.068)       0:03:24.627 ********
2026-04-16 17:27:47.677777 | instance | ok: [instance]
2026-04-16 17:27:47.677854 | instance |
2026-04-16 17:27:47.678032 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:27:47.678187 | instance | Thursday 16 April 2026  17:27:47 +0000 (0:00:00.345)       0:03:24.972 ********
2026-04-16 17:27:50.669228 | instance | ok: [instance]
2026-04-16 17:27:50.669311 | instance |
2026-04-16 17:27:50.669410 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-16 17:27:50.669532 | instance | Thursday 16 April 2026  17:27:50 +0000 (0:00:02.991)       0:03:27.963 ********
2026-04-16 17:27:50.703767 | instance | skipping: [instance]
2026-04-16 17:27:50.703874 | instance |
2026-04-16 17:27:50.703998 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-16 17:27:50.704122 | instance | Thursday 16 April 2026  17:27:50 +0000 (0:00:00.035)       0:03:27.998 ********
2026-04-16 17:27:50.739000 | instance | skipping: [instance]
2026-04-16 17:27:50.739107 | instance |
2026-04-16 17:27:50.739229 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-16 17:27:50.739349 | instance | Thursday 16 April 2026  17:27:50 +0000 (0:00:00.035)       0:03:28.034 ********
2026-04-16 17:27:50.775205 | instance | skipping: [instance]
2026-04-16 17:27:50.775255 | instance |
2026-04-16 17:27:50.775403 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-16 17:27:50.775524 | instance | Thursday 16 April 2026  17:27:50 +0000 (0:00:00.036)       0:03:28.070 ********
2026-04-16 17:27:51.830185 | instance | ok: [instance]
2026-04-16 17:27:51.830315 | instance |
2026-04-16 17:27:51.830511 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-16 17:27:51.830752 | instance | Thursday 16 April 2026  17:27:51 +0000 (0:00:01.054)       0:03:29.124 ********
2026-04-16 17:27:52.264330 | instance | ok: [instance]
2026-04-16 17:27:52.264451 | instance |
2026-04-16 17:27:52.264702 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-16 17:27:52.264890 | instance | Thursday 16 April 2026  17:27:52 +0000 (0:00:00.434)       0:03:29.558 ********
2026-04-16 17:27:53.157583 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-16 17:27:53.157676 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-16 17:27:53.157747 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-16 17:27:53.157886 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-16 17:27:53.158027 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-16 17:27:53.158143 | instance |
2026-04-16 17:27:53.158272 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-16 17:27:53.158391 | instance | Thursday 16 April 2026  17:27:53 +0000 (0:00:00.893)       0:03:30.452 ********
2026-04-16 17:27:53.659347 | instance | ok: [instance]
2026-04-16 17:27:53.659423 | instance |
2026-04-16 17:27:53.659534 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-16 17:27:53.659660 | instance | Thursday 16 April 2026  17:27:53 +0000 (0:00:00.495)       0:03:30.947 ********
2026-04-16 17:27:53.659777 | instance |
2026-04-16 17:27:53.659944 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-16 17:27:53.660029 | instance | Thursday 16 April 2026  17:27:53 +0000 (0:00:00.006)       0:03:30.954 ********
2026-04-16 17:27:54.007779 | instance | ok: [instance]
2026-04-16 17:27:54.007857 | instance |
2026-04-16 17:27:54.007959 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:27:54.008080 | instance | Thursday 16 April 2026  17:27:54 +0000 (0:00:00.348)       0:03:31.302 ********
2026-04-16 17:27:54.209941 | instance | ok: [instance]
2026-04-16 17:27:54.210012 | instance |
2026-04-16 17:27:54.210125 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:27:54.210253 | instance | Thursday 16 April 2026  17:27:54 +0000 (0:00:00.202)       0:03:31.504 ********
2026-04-16 17:27:54.263523 | instance | ok: [instance] => {
2026-04-16 17:27:54.263630 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-16 17:27:54.263801 | instance | }
2026-04-16 17:27:54.263950 | instance |
2026-04-16 17:27:54.264119 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:27:54.264310 | instance | Thursday 16 April 2026  17:27:54 +0000 (0:00:00.053)       0:03:31.558 ********
2026-04-16 17:27:54.611335 | instance | ok: [instance]
2026-04-16 17:27:54.611395 | instance |
2026-04-16 17:27:54.611535 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:27:54.611656 | instance | Thursday 16 April 2026  17:27:54 +0000 (0:00:00.347)       0:03:31.906 ********
2026-04-16 17:27:57.670717 | instance | ok: [instance]
2026-04-16 17:27:57.670812 | instance |
2026-04-16 17:27:57.670891 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-16 17:27:57.671014 | instance | Thursday 16 April 2026  17:27:57 +0000 (0:00:03.059)       0:03:34.965 ********
2026-04-16 17:27:58.704229 | instance | ok: [instance]
2026-04-16 17:27:58.704295 | instance |
2026-04-16 17:27:58.704300 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-16 17:27:58.704305 | instance | Thursday 16 April 2026  17:27:58 +0000 (0:00:01.033)       0:03:35.998 ********
2026-04-16 17:27:58.898634 | instance | ok: [instance]
2026-04-16 17:27:58.898689 | instance |
2026-04-16 17:27:58.898839 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-16 17:27:58.898964 | instance | Thursday 16 April 2026  17:27:58 +0000 (0:00:00.194)       0:03:36.193 ********
2026-04-16 17:27:59.324591 | instance | ok: [instance]
2026-04-16 17:27:59.324668 | instance |
2026-04-16 17:27:59.324792 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-16 17:27:59.324917 | instance | Thursday 16 April 2026  17:27:59 +0000 (0:00:00.425)       0:03:36.619 ********
2026-04-16 17:27:59.872885 | instance | ok: [instance] => (item={'path': '/etc/docker'})
2026-04-16 17:27:59.872994 | instance | ok: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-16 17:27:59.873074 | instance | ok: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-16 17:27:59.873441 | instance |
2026-04-16 17:27:59.873493 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-16 17:27:59.873500 | instance | Thursday 16 April 2026  17:27:59 +0000 (0:00:00.548)       0:03:37.167 ********
2026-04-16 17:28:00.299808 | instance | ok: [instance]
2026-04-16 17:28:00.299902 | instance |
2026-04-16 17:28:00.300135 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-16 17:28:00.300181 | instance | Thursday 16 April 2026  17:28:00 +0000 (0:00:00.426)       0:03:37.594 ********
2026-04-16 17:28:00.731310 | instance | ok: [instance]
2026-04-16 17:28:00.731380 | instance |
2026-04-16 17:28:00.732214 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-16 17:28:00.732302 | instance | Thursday 16 April 2026  17:28:00 +0000 (0:00:00.424)       0:03:38.019 ********
2026-04-16 17:28:00.732312 | instance |
2026-04-16 17:28:00.732318 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-16 17:28:00.732323 | instance | Thursday 16 April 2026  17:28:00 +0000 (0:00:00.007)       0:03:38.026 ********
2026-04-16 17:28:01.090451 | instance | ok: [instance]
2026-04-16 17:28:01.090909 | instance |
2026-04-16 17:28:01.090929 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-16 17:28:01.090937 | instance | Thursday 16 April 2026  17:28:01 +0000 (0:00:00.359)       0:03:38.385 ********
2026-04-16 17:28:01.145811 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-16 17:28:01.145896 | instance |
2026-04-16 17:28:01.146247 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-16 17:28:01.146296 | instance | Thursday 16 April 2026  17:28:01 +0000 (0:00:00.055)       0:03:38.440 ********
2026-04-16 17:28:02.186106 | instance | ok: [instance]
2026-04-16 17:28:02.186192 | instance |
2026-04-16 17:28:02.186448 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-16 17:28:02.186553 | instance | Thursday 16 April 2026  17:28:02 +0000 (0:00:01.040)       0:03:39.480 ********
2026-04-16 17:28:02.839962 | instance | ok: [instance] => (item=chronyd)
2026-04-16 17:28:02.840074 | instance | ok: [instance] => (item=sshd)
2026-04-16 17:28:02.840087 | instance |
2026-04-16 17:28:02.840166 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-16 17:28:02.840342 | instance | Thursday 16 April 2026  17:28:02 +0000 (0:00:00.653)       0:03:40.134 ********
2026-04-16 17:28:03.464297 | instance | ok: [instance]
2026-04-16 17:28:03.464377 | instance |
2026-04-16 17:28:03.464635 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-16 17:28:03.464713 | instance | Thursday 16 April 2026  17:28:03 +0000 (0:00:00.623)       0:03:40.758 ********
2026-04-16 17:28:03.681269 | instance | ok: [instance]
2026-04-16 17:28:03.681908 | instance |
2026-04-16 17:28:03.681964 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-16 17:28:03.681973 | instance | Thursday 16 April 2026  17:28:03 +0000 (0:00:00.217)       0:03:40.975 ********
2026-04-16 17:28:03.939956 | instance | ok: [instance]
2026-04-16 17:28:03.940456 | instance |
2026-04-16 17:28:03.940537 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-16 17:28:03.940557 | instance | Thursday 16 April 2026  17:28:03 +0000 (0:00:00.258)       0:03:41.234 ********
2026-04-16 17:28:04.141310 | instance | ok: [instance]
2026-04-16 17:28:04.141402 | instance |
2026-04-16 17:28:04.141511 | instance | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-16 17:28:04.141646 | instance | Thursday 16 April 2026  17:28:04 +0000 (0:00:00.201)       0:03:41.436 ********
2026-04-16 17:28:04.370345 | instance | ok: [instance] => (item=instance)
2026-04-16 17:28:04.370681 | instance |
2026-04-16 17:28:04.370696 | instance | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-16 17:28:04.370701 | instance | Thursday 16 April 2026  17:28:04 +0000 (0:00:00.229)       0:03:41.665 ********
2026-04-16 17:28:04.422574 | instance | ok: [instance]
2026-04-16 17:28:04.422983 | instance |
2026-04-16 17:28:04.422998 | instance | TASK [vexxhost.ceph.osd : Get `cephadm ls` status] *****************************
2026-04-16 17:28:04.423004 | instance | Thursday 16 April 2026  17:28:04 +0000 (0:00:00.052)       0:03:41.717 ********
2026-04-16 17:28:09.761958 | instance | ok: [instance]
2026-04-16 17:28:09.762078 | instance |
2026-04-16 17:28:09.762091 | instance | TASK [vexxhost.ceph.osd : Parse the `cephadm ls` output] ***********************
2026-04-16 17:28:09.762252 | instance | Thursday 16 April 2026  17:28:09 +0000 (0:00:05.339)       0:03:47.056 ********
2026-04-16 17:28:09.816099 | instance | ok: [instance]
2026-04-16 17:28:09.816192 | instance |
2026-04-16 17:28:09.816466 | instance | TASK [Install Ceph host] *******************************************************
2026-04-16 17:28:09.816527 | instance | Thursday 16 April 2026  17:28:09 +0000 (0:00:00.053)       0:03:47.110 ********
2026-04-16 17:28:09.887896 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-16 17:28:09.887955 | instance |
2026-04-16 17:28:09.888250 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-16 17:28:09.888293 | instance | Thursday 16 April 2026  17:28:09 +0000 (0:00:00.072)       0:03:47.182 ********
2026-04-16 17:28:09.947467 | instance | skipping: [instance]
2026-04-16 17:28:09.947618 | instance |
2026-04-16 17:28:09.947963 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-16 17:28:09.948405 | instance | Thursday 16 April 2026  17:28:09 +0000 (0:00:00.059)       0:03:47.241 ********
2026-04-16 17:28:10.016747 | instance | skipping: [instance] => (item=instance)
2026-04-16 17:28:10.016824 | instance | skipping: [instance]
2026-04-16 17:28:10.017204 | instance |
2026-04-16 17:28:10.017270 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-16 17:28:10.017277 | instance | Thursday 16 April 2026  17:28:10 +0000 (0:00:00.069)       0:03:47.311 ********
2026-04-16 17:28:10.277751 | instance | ok: [instance]
2026-04-16 17:28:10.277877 | instance |
2026-04-16 17:28:10.278242 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-16 17:28:10.278500 | instance | Thursday 16 April 2026  17:28:10 +0000 (0:00:00.261)       0:03:47.572 ********
2026-04-16 17:28:12.333787 | instance | ok: [instance]
2026-04-16 17:28:12.333861 | instance |
2026-04-16 17:28:12.334109 | instance | TASK [vexxhost.ceph.osd : Adopt OSDs to cluster] *******************************
2026-04-16 17:28:12.334153 | instance | Thursday 16 April 2026  17:28:12 +0000 (0:00:02.056)       0:03:49.628 ********
2026-04-16 17:28:12.368294 | instance | skipping: [instance]
2026-04-16 17:28:12.368681 | instance |
2026-04-16 17:28:12.368722 | instance | TASK [vexxhost.ceph.osd : Wait until OSD added to cephadm] *********************
2026-04-16 17:28:12.368728 | instance | Thursday 16 April 2026  17:28:12 +0000 (0:00:00.034)       0:03:49.663 ********
2026-04-16 17:28:12.398287 | instance | skipping: [instance]
2026-04-16 17:28:12.398380 | instance |
2026-04-16 17:28:12.398634 | instance | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-16 17:28:12.398932 | instance | Thursday 16 April 2026  17:28:12 +0000 (0:00:00.030)       0:03:49.693 ********
2026-04-16 17:28:17.804888 | instance | ok: [instance]
2026-04-16 17:28:17.804989 | instance |
2026-04-16 17:28:17.805119 | instance | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-16 17:28:17.805236 | instance | Thursday 16 April 2026  17:28:17 +0000 (0:00:05.406)       0:03:55.099 ********
2026-04-16 17:28:28.185168 | instance | ok: [instance]
2026-04-16 17:28:28.185248 | instance |
2026-04-16 17:28:28.185554 | instance | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-16 17:28:28.185621 | instance | Thursday 16 April 2026  17:28:28 +0000 (0:00:10.379)       0:04:05.479 ********
2026-04-16 17:29:56.834554 | instance | ok: [instance] => (item=/dev/ceph-instance-osd0/data)
2026-04-16 17:29:56.834698 | instance | ok: [instance] => (item=/dev/ceph-instance-osd1/data)
2026-04-16 17:29:56.834710 | instance | ok: [instance] => (item=/dev/ceph-instance-osd2/data)
2026-04-16 17:29:56.834765 | instance |
2026-04-16 17:29:56.834897 | instance | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-16 17:29:56.835001 | instance | Thursday 16 April 2026  17:29:56 +0000 (0:01:28.649)       0:05:34.128 ********
2026-04-16 17:29:58.561161 | instance | ok: [instance]
2026-04-16 17:29:58.561279 | instance |
2026-04-16 17:29:58.561348 | instance | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-16 17:29:58.561489 | instance | Thursday 16 April 2026  17:29:58 +0000 (0:00:01.726)       0:05:35.855 ********
2026-04-16 17:30:00.372943 | instance | ok: [instance]
2026-04-16 17:30:00.373044 | instance |
2026-04-16 17:30:00.373485 | instance | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-16 17:30:00.373542 | instance | Thursday 16 April 2026  17:30:00 +0000 (0:00:01.811)       0:05:37.667 ********
2026-04-16 17:30:00.449859 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for instance
2026-04-16 17:30:00.449943 | instance |
2026-04-16 17:30:00.450396 | instance | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-16 17:30:00.450448 | instance | Thursday 16 April 2026  17:30:00 +0000 (0:00:00.076)       0:05:37.744 ********
2026-04-16 17:30:00.500972 | instance | ok: [instance]
2026-04-16 17:30:00.501038 | instance |
2026-04-16 17:30:00.501044 | instance | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-16 17:30:00.501050 | instance | Thursday 16 April 2026  17:30:00 +0000 (0:00:00.050)       0:05:37.794 ********
2026-04-16 17:30:02.333272 | instance | ok: [instance]
2026-04-16 17:30:02.333378 | instance |
2026-04-16 17:30:02.333432 | instance | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-16 17:30:02.333604 | instance | Thursday 16 April 2026  17:30:02 +0000 (0:00:01.832)       0:05:39.627 ********
2026-04-16 17:30:02.376674 | instance | ok: [instance]
2026-04-16 17:30:02.376825 | instance |
2026-04-16 17:30:02.376958 | instance | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-16 17:30:02.377083 | instance | Thursday 16 April 2026  17:30:02 +0000 (0:00:00.043)       0:05:39.671 ********
2026-04-16 17:30:02.427025 | instance | skipping: [instance] => (item=1)
2026-04-16 17:30:02.427184 | instance | skipping: [instance] => (item=1)
2026-04-16 17:30:02.427362 | instance | skipping: [instance] => (item=1)
2026-04-16 17:30:02.427537 | instance | skipping: [instance]
2026-04-16 17:30:02.427710 | instance |
2026-04-16 17:30:02.427898 | instance | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-16 17:30:02.428067 | instance | Thursday 16 April 2026  17:30:02 +0000 (0:00:00.050)       0:05:39.721 ********
2026-04-16 17:30:02.486048 | instance | skipping: [instance]
2026-04-16 17:30:02.486134 | instance |
2026-04-16 17:30:02.486313 | instance | PLAY [all] *********************************************************************
2026-04-16 17:30:02.486476 | instance |
2026-04-16 17:30:02.486678 | instance | TASK [Ensure RBD kernel module is loaded] **************************************
2026-04-16 17:30:02.486868 | instance | Thursday 16 April 2026  17:30:02 +0000 (0:00:00.059)       0:05:39.780 ********
2026-04-16 17:30:02.938574 | instance | changed: [instance]
2026-04-16 17:30:02.938649 | instance |
2026-04-16 17:30:02.939142 | instance | PLAY [all] *********************************************************************
2026-04-16 17:30:02.939184 | instance |
2026-04-16 17:30:02.939189 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:30:02.939194 | instance | Thursday 16 April 2026  17:30:02 +0000 (0:00:00.452)       0:05:40.233 ********
2026-04-16 17:30:04.172306 | instance | ok: [instance]
2026-04-16 17:30:04.172441 | instance |
2026-04-16 17:30:04.172673 | instance | TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************
2026-04-16 17:30:04.172742 | instance | Thursday 16 April 2026  17:30:04 +0000 (0:00:01.233)       0:05:41.466 ********
2026-04-16 17:30:08.982797 | instance | changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})
2026-04-16 17:30:08.982898 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})
2026-04-16 17:30:08.983608 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})
2026-04-16 17:30:08.983680 | instance | changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})
2026-04-16 17:30:08.983713 | instance | changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})
2026-04-16 17:30:08.983720 | instance | changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})
2026-04-16 17:30:08.983726 | instance | changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})
2026-04-16 17:30:08.983739 | instance | changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})
2026-04-16 17:30:08.983745 | instance | changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})
2026-04-16 17:30:08.984361 | instance | changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})
2026-04-16 17:30:08.984436 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})
2026-04-16 17:30:08.984448 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})
2026-04-16 17:30:08.984457 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})
2026-04-16 17:30:08.984475 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})
2026-04-16 17:30:08.984485 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})
2026-04-16 17:30:08.985437 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})
2026-04-16 17:30:08.985477 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})
2026-04-16 17:30:08.985482 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})
2026-04-16 17:30:08.985486 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})
2026-04-16 17:30:08.985490 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})
2026-04-16 17:30:08.985495 | instance |
2026-04-16 17:30:08.985500 | instance | TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***
2026-04-16 17:30:08.985504 | instance | Thursday 16 April 2026  17:30:08 +0000 (0:00:04.811)       0:05:46.277 ********
2026-04-16 17:30:09.207717 | instance | changed: [instance]
2026-04-16 17:30:09.208333 | instance |
2026-04-16 17:30:09.208407 | instance | TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] *******
2026-04-16 17:30:09.208416 | instance | Thursday 16 April 2026  17:30:09 +0000 (0:00:00.224)       0:05:46.501 ********
2026-04-16 17:30:09.692652 | instance | changed: [instance]
2026-04-16 17:30:09.692730 | instance |
2026-04-16 17:30:09.692869 | instance | TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] **********************
2026-04-16 17:30:09.693045 | instance | Thursday 16 April 2026  17:30:09 +0000 (0:00:00.485)       0:05:46.987 ********
2026-04-16 17:30:09.939875 | instance | ok: [instance]
2026-04-16 17:30:09.939975 | instance |
2026-04-16 17:30:09.940376 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-16 17:30:09.940458 | instance | Thursday 16 April 2026  17:30:09 +0000 (0:00:00.247)       0:05:47.234 ********
2026-04-16 17:30:09.987960 | instance | ok: [instance]
2026-04-16 17:30:09.988382 | instance |
2026-04-16 17:30:09.988431 | instance | PLAY [Configure Kubernetes VIP] ************************************************
2026-04-16 17:30:09.988439 | instance |
2026-04-16 17:30:09.988623 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:30:09.988639 | instance | Thursday 16 April 2026  17:30:09 +0000 (0:00:00.048)       0:05:47.282 ********
2026-04-16 17:30:10.911431 | instance | ok: [instance]
2026-04-16 17:30:10.911558 | instance |
2026-04-16 17:30:10.911964 | instance | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-04-16 17:30:10.912009 | instance | Thursday 16 April 2026  17:30:10 +0000 (0:00:00.923)       0:05:48.206 ********
2026-04-16 17:30:11.125664 | instance | changed: [instance]
2026-04-16 17:30:11.125769 | instance |
2026-04-16 17:30:11.126012 | instance | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-04-16 17:30:11.126027 | instance | Thursday 16 April 2026  17:30:11 +0000 (0:00:00.214)       0:05:48.420 ********
2026-04-16 17:30:12.012469 | instance | ok: [instance] => (item=/etc/keepalived/keepalived.conf)
2026-04-16 17:30:12.012544 | instance | ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)
2026-04-16 17:30:12.013535 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-04-16 17:30:12.013583 | instance | ok: [instance] => (item=/etc/haproxy/haproxy.cfg)
2026-04-16 17:30:12.013590 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-04-16 17:30:12.013596 | instance |
2026-04-16 17:30:12.013602 | instance | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-04-16 17:30:12.013608 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.886)       0:05:49.306 ********
2026-04-16 17:30:12.189841 | instance | failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-04-16 17:30:12.349105 | instance | failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-04-16 17:30:12.508423 | instance | failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-04-16 17:30:12.520946 | instance | ...ignoring
2026-04-16 17:30:12.521114 | instance |
2026-04-16 17:30:12.521311 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-04-16 17:30:12.521494 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.508)       0:05:49.815 ********
2026-04-16 17:30:12.707430 | instance | ok: [instance]
2026-04-16 17:30:12.707684 | instance |
2026-04-16 17:30:12.707994 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-04-16 17:30:12.708342 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.186)       0:05:50.001 ********
2026-04-16 17:30:12.902826 | instance | ok: [instance]
2026-04-16 17:30:12.903029 | instance |
2026-04-16 17:30:12.903304 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-04-16 17:30:12.903613 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.195)       0:05:50.197 ********
2026-04-16 17:30:12.933024 | instance | ok: [instance]
2026-04-16 17:30:12.933255 | instance |
2026-04-16 17:30:12.933545 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-04-16 17:30:12.933812 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.030)       0:05:50.227 ********
2026-04-16 17:30:12.974812 | instance | ok: [instance]
2026-04-16 17:30:12.974900 | instance |
2026-04-16 17:30:12.975116 | instance | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-04-16 17:30:12.975293 | instance | Thursday 16 April 2026  17:30:12 +0000 (0:00:00.041)       0:05:50.269 ********
2026-04-16 17:30:13.501229 | instance | ok: [instance]
2026-04-16 17:30:13.501350 | instance |
2026-04-16 17:30:13.501517 | instance | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-04-16 17:30:13.501669 | instance | Thursday 16 April 2026  17:30:13 +0000 (0:00:00.526)       0:05:50.795 ********
2026-04-16 17:30:13.751069 | instance | ok: [instance]
2026-04-16 17:30:13.751298 | instance |
2026-04-16 17:30:13.751585 | instance | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-04-16 17:30:13.751863 | instance | Thursday 16 April 2026  17:30:13 +0000 (0:00:00.191)       0:05:50.987 ********
2026-04-16 17:30:13.752144 | instance |
2026-04-16 17:30:13.752466 | instance | PLAY [Install Kubernetes] ******************************************************
2026-04-16 17:30:13.752796 | instance |
2026-04-16 17:30:13.753078 | instance | TASK [Gathering Facts] *********************************************************
2026-04-16 17:30:13.753349 | instance | Thursday 16 April 2026  17:30:13 +0000 (0:00:00.058)       0:05:51.045 ********
2026-04-16 17:30:14.684159 | instance | ok: [instance]
2026-04-16 17:30:14.684220 | instance |
2026-04-16 17:30:14.684259 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:30:14.684269 | instance | Thursday 16 April 2026  17:30:14 +0000 (0:00:00.932)       0:05:51.977 ********
2026-04-16 17:30:14.881168 | instance | ok: [instance]
2026-04-16 17:30:14.881237 | instance |
2026-04-16 17:30:14.881478 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:30:14.881517 | instance | Thursday 16 April 2026  17:30:14 +0000 (0:00:00.198)       0:05:52.176 ********
2026-04-16 17:30:14.922460 | instance | skipping: [instance]
2026-04-16 17:30:14.922854 | instance |
2026-04-16 17:30:14.922896 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-16 17:30:14.922902 | instance | Thursday 16 April 2026  17:30:14 +0000 (0:00:00.041)       0:05:52.217 ********
2026-04-16 17:30:15.126776 | instance | ok: [instance]
2026-04-16 17:30:15.126868 | instance |
2026-04-16 17:30:15.126950 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:30:15.127082 | instance | Thursday 16 April 2026  17:30:15 +0000 (0:00:00.204)       0:05:52.421 ********
2026-04-16 17:30:15.182192 | instance | ok: [instance] => {
2026-04-16 17:30:15.182958 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-16 17:30:15.182997 | instance | }
2026-04-16 17:30:15.183002 | instance |
2026-04-16 17:30:15.183007 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:30:15.183011 | instance | Thursday 16 April 2026  17:30:15 +0000 (0:00:00.055)       0:05:52.476 ********
2026-04-16 17:30:15.485768 | instance | ok: [instance]
2026-04-16 17:30:15.485855 | instance |
2026-04-16 17:30:15.485930 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:30:15.486121 | instance | Thursday 16 April 2026  17:30:15 +0000 (0:00:00.303)       0:05:52.780 ********
2026-04-16 17:30:15.532806 | instance | skipping: [instance]
2026-04-16 17:30:15.532956 | instance |
2026-04-16 17:30:15.533201 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:30:15.533401 | instance | Thursday 16 April 2026  17:30:15 +0000 (0:00:00.046)       0:05:52.827 ********
2026-04-16 17:30:15.742363 | instance | ok: [instance]
2026-04-16 17:30:15.742460 | instance |
2026-04-16 17:30:15.742586 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-16 17:30:15.742802 | instance | Thursday 16 April 2026  17:30:15 +0000 (0:00:00.209)       0:05:53.036 ********
2026-04-16 17:30:16.780853 | instance | ok: [instance]
2026-04-16 17:30:16.780950 | instance |
2026-04-16 17:30:16.780962 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:30:16.780975 | instance | Thursday 16 April 2026  17:30:16 +0000 (0:00:01.035)       0:05:54.072 ********
2026-04-16 17:30:16.836581 | instance | ok: [instance] => {
2026-04-16 17:30:16.836663 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz"
2026-04-16 17:30:16.837157 | instance | }
2026-04-16 17:30:16.837195 | instance |
2026-04-16 17:30:16.837200 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:30:16.837205 | instance | Thursday 16 April 2026  17:30:16 +0000 (0:00:00.059)       0:05:54.131 ********
2026-04-16 17:30:17.167044 | instance | ok: [instance]
2026-04-16 17:30:17.167136 | instance |
2026-04-16 17:30:17.167449 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:30:17.167731 | instance | Thursday 16 April 2026  17:30:17 +0000 (0:00:00.330)       0:05:54.461 ********
2026-04-16 17:30:19.136401 | instance | ok: [instance]
2026-04-16 17:30:19.136473 | instance |
2026-04-16 17:30:19.136785 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-16 17:30:19.136825 | instance | Thursday 16 April 2026  17:30:19 +0000 (0:00:01.969)       0:05:56.431 ********
2026-04-16 17:30:19.168591 | instance | skipping: [instance]
2026-04-16 17:30:19.168980 | instance |
2026-04-16 17:30:19.169023 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-16 17:30:19.169029 | instance | Thursday 16 April 2026  17:30:19 +0000 (0:00:00.032)       0:05:56.463 ********
2026-04-16 17:30:19.204520 | instance | skipping: [instance]
2026-04-16 17:30:19.205008 | instance |
2026-04-16 17:30:19.205053 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-16 17:30:19.205061 | instance | Thursday 16 April 2026  17:30:19 +0000 (0:00:00.035)       0:05:56.498 ********
2026-04-16 17:30:19.241790 | instance | skipping: [instance]
2026-04-16 17:30:19.241904 | instance |
2026-04-16 17:30:19.242156 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-16 17:30:19.242188 | instance | Thursday 16 April 2026  17:30:19 +0000 (0:00:00.037)       0:05:56.536 ********
2026-04-16 17:30:20.316406 | instance | ok: [instance]
2026-04-16 17:30:20.316478 | instance |
2026-04-16 17:30:20.316742 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-16 17:30:20.316790 | instance | Thursday 16 April 2026  17:30:20 +0000 (0:00:01.074)       0:05:57.611 ********
2026-04-16 17:30:20.766056 | instance | ok: [instance]
2026-04-16 17:30:20.766598 | instance |
2026-04-16 17:30:20.766647 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-16 17:30:20.766656 | instance | Thursday 16 April 2026  17:30:20 +0000 (0:00:00.449)       0:05:58.060 ********
2026-04-16 17:30:21.704210 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-16 17:30:21.705098 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-16 17:30:21.705139 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-16 17:30:21.705144 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-16 17:30:21.705149 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-16 17:30:21.705154 | instance |
2026-04-16 17:30:21.705158 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-16 17:30:21.705162 | instance | Thursday 16 April 2026  17:30:21 +0000 (0:00:00.938)       0:05:58.998 ********
2026-04-16 17:30:22.240307 | instance | ok: [instance]
2026-04-16 17:30:22.240395 | instance |
2026-04-16 17:30:22.240511 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-16 17:30:22.240644 | instance | Thursday 16 April 2026  17:30:22 +0000 (0:00:00.527)       0:05:59.526 ********
2026-04-16 17:30:22.240759 | instance |
2026-04-16 17:30:22.241699 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-16 17:30:22.241733 | instance | Thursday 16 April 2026  17:30:22 +0000 (0:00:00.008)       0:05:59.535 ********
2026-04-16 17:30:22.621290 | instance | ok: [instance]
2026-04-16 17:30:22.621408 | instance |
2026-04-16 17:30:22.621519 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-04-16 17:30:22.621681 | instance | Thursday 16 April 2026  17:30:22 +0000 (0:00:00.380)       0:05:59.915 ********
2026-04-16 17:30:23.240504 | instance | fatal: [instance]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on instance's Python /usr/bin/python3.10. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"}
2026-04-16 17:30:23.255217 | instance | ...ignoring
2026-04-16 17:30:23.255488 | instance |
2026-04-16 17:30:23.255777 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-04-16 17:30:23.256056 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.634)       0:06:00.549 ********
2026-04-16 17:30:23.294630 | instance | skipping: [instance]
2026-04-16 17:30:23.294825 | instance |
2026-04-16 17:30:23.295135 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-04-16 17:30:23.295396 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.039)       0:06:00.589 ********
2026-04-16 17:30:23.335025 | instance | skipping: [instance]
2026-04-16 17:30:23.335255 | instance |
2026-04-16 17:30:23.335516 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-04-16 17:30:23.335787 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.040)       0:06:00.629 ********
2026-04-16 17:30:23.373789 | instance | skipping: [instance]
2026-04-16 17:30:23.374018 | instance |
2026-04-16 17:30:23.374295 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-04-16 17:30:23.374582 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.038)       0:06:00.668 ********
2026-04-16 17:30:23.417452 | instance | skipping: [instance]
2026-04-16 17:30:23.417680 | instance |
2026-04-16 17:30:23.418028 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-04-16 17:30:23.418319 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.043)       0:06:00.712 ********
2026-04-16 17:30:23.462109 | instance | skipping: [instance]
2026-04-16 17:30:23.462382 | instance |
2026-04-16 17:30:23.462755 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:30:23.463047 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.044)       0:06:00.756 ********
2026-04-16 17:30:23.675513 | instance | ok: [instance]
2026-04-16 17:30:23.675708 | instance |
2026-04-16 17:30:23.676129 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:30:23.676475 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.213)       0:06:00.969 ********
2026-04-16 17:30:23.722484 | instance | ok: [instance] => {
2026-04-16 17:30:23.722607 | instance |     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm"
2026-04-16 17:30:23.722709 | instance | }
2026-04-16 17:30:23.722862 | instance |
2026-04-16 17:30:23.723030 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:30:23.723194 | instance | Thursday 16 April 2026  17:30:23 +0000 (0:00:00.047)       0:06:01.017 ********
2026-04-16 17:30:24.551449 | instance | changed: [instance]
2026-04-16 17:30:24.551666 | instance |
2026-04-16 17:30:24.552007 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:30:24.552331 | instance | Thursday 16 April 2026  17:30:24 +0000 (0:00:00.828)       0:06:01.845 ********
2026-04-16 17:30:24.607350 | instance | skipping: [instance]
2026-04-16 17:30:24.607549 | instance |
2026-04-16 17:30:24.607899 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:30:24.608160 | instance | Thursday 16 April 2026  17:30:24 +0000 (0:00:00.055)       0:06:01.901 ********
2026-04-16 17:30:24.823345 | instance | ok: [instance]
2026-04-16 17:30:24.823541 | instance |
2026-04-16 17:30:24.823813 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:30:24.824080 | instance | Thursday 16 April 2026  17:30:24 +0000 (0:00:00.216)       0:06:02.117 ********
2026-04-16 17:30:24.886122 | instance | ok: [instance] => {
2026-04-16 17:30:24.886366 | instance |     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl"
2026-04-16 17:30:24.886621 | instance | }
2026-04-16 17:30:24.886873 | instance |
2026-04-16 17:30:24.887134 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:30:24.887402 | instance | Thursday 16 April 2026  17:30:24 +0000 (0:00:00.063)       0:06:02.180 ********
2026-04-16 17:30:25.603469 | instance | changed: [instance]
2026-04-16 17:30:25.603858 | instance |
2026-04-16 17:30:25.604283 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-16 17:30:25.604721 | instance | Thursday 16 April 2026  17:30:25 +0000 (0:00:00.716)       0:06:02.897 ********
2026-04-16 17:30:25.661207 | instance | skipping: [instance]
2026-04-16 17:30:25.661620 | instance |
2026-04-16 17:30:25.661959 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-16 17:30:25.662288 | instance | Thursday 16 April 2026  17:30:25 +0000 (0:00:00.057)       0:06:02.955 ********
2026-04-16 17:30:25.697361 | instance | skipping: [instance]
2026-04-16 17:30:25.697778 | instance |
2026-04-16 17:30:25.698195 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-16 17:30:25.698555 | instance | Thursday 16 April 2026  17:30:25 +0000 (0:00:00.036)       0:06:02.991 ********
2026-04-16 17:30:25.731706 | instance | skipping: [instance]
2026-04-16 17:30:25.732090 | instance |
2026-04-16 17:30:25.732482 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-16 17:30:25.732824 | instance | Thursday 16 April 2026  17:30:25 +0000 (0:00:00.033)       0:06:03.025 ********
2026-04-16 17:30:25.769411 | instance | skipping: [instance]
2026-04-16 17:30:25.769839 | instance |
2026-04-16 17:30:25.770257 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-16 17:30:25.770648 | instance | Thursday 16 April 2026  17:30:25 +0000 (0:00:00.034)       0:06:03.059 ********
2026-04-16 17:30:26.927838 | instance | ok: [instance]
2026-04-16 17:30:26.928265 | instance |
2026-04-16 17:30:26.928634 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-16 17:30:26.929035 | instance | Thursday 16 April 2026  17:30:26 +0000 (0:00:01.161)       0:06:04.221 ********
2026-04-16 17:30:27.384605 | instance | ok: [instance]
2026-04-16 17:30:27.384712 | instance |
2026-04-16 17:30:27.385121 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-16 17:30:27.385404 | instance | Thursday 16 April 2026  17:30:27 +0000 (0:00:00.457)       0:06:04.678 ********
2026-04-16 17:30:28.325784 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-16 17:30:28.325845 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-16 17:30:28.326573 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-16 17:30:28.326610 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-16 17:30:28.326615 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-16 17:30:28.326620 | instance |
2026-04-16 17:30:28.326625 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-16 17:30:28.326629 | instance | Thursday 16 April 2026  17:30:28 +0000 (0:00:00.941)       0:06:05.620 ********
2026-04-16 17:30:28.859523 | instance | ok: [instance]
2026-04-16 17:30:28.859598 | instance |
2026-04-16 17:30:28.859904 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-16 17:30:28.859965 | instance | Thursday 16 April 2026  17:30:28 +0000 (0:00:00.527)       0:06:06.147 ********
2026-04-16 17:30:28.859983 | instance |
2026-04-16 17:30:28.860156 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-16 17:30:28.860287 | instance | Thursday 16 April 2026  17:30:28 +0000 (0:00:00.006)       0:06:06.154 ********
2026-04-16 17:30:29.215775 | instance | ok: [instance]
2026-04-16 17:30:29.215859 | instance |
2026-04-16 17:30:29.216128 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-16 17:30:29.216166 | instance | Thursday 16 April 2026  17:30:29 +0000 (0:00:00.356)       0:06:06.510 ********
2026-04-16 17:30:29.429246 | instance | ok: [instance]
2026-04-16 17:30:29.429316 | instance |
2026-04-16 17:30:29.429322 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-16 17:30:29.429327 | instance | Thursday 16 April 2026  17:30:29 +0000 (0:00:00.212)       0:06:06.723 ********
2026-04-16 17:30:29.488049 | instance | ok: [instance] => {
2026-04-16 17:30:29.488380 | instance |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz"
2026-04-16 17:30:29.488448 | instance | }
2026-04-16 17:30:29.488466 | instance |
2026-04-16 17:30:29.488683 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-16 17:30:29.488704 | instance | Thursday 16 April 2026  17:30:29 +0000 (0:00:00.059)       0:06:06.782 ********
2026-04-16 17:30:51.164465 | instance | fatal: [instance]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-04-16 17:30:51.169395 | instance | FAILED - RETRYING: [instance]: Download item (4 retries left).
2026-04-16 17:30:51.170412 | instance | FAILED - RETRYING: [instance]: Download item (3 retries left).
2026-04-16 17:30:51.170484 | instance | FAILED - RETRYING: [instance]: Download item (2 retries left).
2026-04-16 17:30:51.170490 | instance | FAILED - RETRYING: [instance]: Download item (1 retries left).
2026-04-16 17:30:51.170499 | instance |
2026-04-16 17:30:51.172362 | instance | PLAY RECAP *********************************************************************
2026-04-16 17:30:51.172382 | instance | instance                   : ok=158  changed=33   unreachable=0    failed=1    skipped=43   rescued=0    ignored=2
2026-04-16 17:30:51.172389 | instance |
2026-04-16 17:30:51.172395 | instance | Thursday 16 April 2026  17:30:51 +0000 (0:00:21.681)       0:06:28.463 ********
2026-04-16 17:30:51.172401 | instance | ===============================================================================
2026-04-16 17:30:51.172405 | instance | vexxhost.ceph.mon : Run Bootstrap coomand ----------------------------- 127.84s
2026-04-16 17:30:51.172410 | instance | vexxhost.ceph.osd : Install OSDs --------------------------------------- 88.65s
2026-04-16 17:30:51.172595 | instance | vexxhost.containers.download_artifact : Download item ------------------ 21.68s
2026-04-16 17:30:51.172968 | instance | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 10.38s
2026-04-16 17:30:51.173284 | instance | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 10.29s
2026-04-16 17:30:51.173596 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 9.16s
2026-04-16 17:30:51.173910 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.25s
2026-04-16 17:30:51.174223 | instance | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.41s
2026-04-16 17:30:51.174532 | instance | vexxhost.ceph.osd : Get `cephadm ls` status ----------------------------- 5.34s
2026-04-16 17:30:51.174843 | instance | vexxhost.atmosphere.sysctl : Configure sysctl values -------------------- 4.81s
2026-04-16 17:30:51.175153 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.48s
2026-04-16 17:30:51.175464 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.07s
2026-04-16 17:30:51.175798 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s
2026-04-16 17:30:51.176201 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.99s
2026-04-16 17:30:51.176562 | instance | vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module ----------- 2.53s
2026-04-16 17:30:51.176880 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.07s
2026-04-16 17:30:51.177052 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.06s
2026-04-16 17:30:51.177195 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 1.99s
2026-04-16 17:30:51.177338 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 1.97s
2026-04-16 17:30:51.177480 | instance | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.83s
2026-04-16 17:30:51.378997 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-16 17:30:51.379294 | instance | ERROR    [aio > converge] Executed: Failed
2026-04-16 17:30:51.379486 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-16 17:30:51.771421 | instance | ERROR
2026-04-16 17:30:51.771870 | instance | {
2026-04-16 17:30:51.771917 | instance |   "delta": "0:08:27.537088",
2026-04-16 17:30:51.771947 | instance |   "end": "2026-04-16 17:30:51.458461",
2026-04-16 17:30:51.771973 | instance |   "msg": "non-zero return code",
2026-04-16 17:30:51.771998 | instance |   "rc": 2,
2026-04-16 17:30:51.772025 | instance |   "start": "2026-04-16 17:22:23.921373"
2026-04-16 17:30:51.772050 | instance | }
failure
2026-04-16 17:30:51.792303 | 
2026-04-16 17:30:51.792475 | PLAY RECAP
2026-04-16 17:30:51.792530 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-16 17:30:51.792553 | 
2026-04-16 17:30:52.023696 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-16 17:30:52.035257 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-16 17:30:52.644795 | 
2026-04-16 17:30:52.644925 | PLAY [all]
2026-04-16 17:30:52.659578 | 
2026-04-16 17:30:52.659658 | TASK [gather-host-logs : creating directory for system status]
2026-04-16 17:30:52.991061 | instance | changed
2026-04-16 17:30:52.996545 | 
2026-04-16 17:30:52.996629 | TASK [gather-host-logs : Get logs for each host]
2026-04-16 17:30:53.350482 | instance | + systemd-cgls --full --all --no-pager
2026-04-16 17:30:53.366992 | instance | + ip addr
2026-04-16 17:30:53.370162 | instance | + ip route
2026-04-16 17:30:53.373698 | instance | + lsblk
2026-04-16 17:30:53.378201 | instance | + mount
2026-04-16 17:30:53.381922 | instance | + docker images
2026-04-16 17:30:53.402259 | instance | + brctl show
2026-04-16 17:30:53.403054 | instance | /bin/bash: line 8: brctl: command not found
2026-04-16 17:30:53.403404 | instance | + ps aux --sort=-%mem
2026-04-16 17:30:53.424691 | instance | + dpkg -l
2026-04-16 17:30:53.437663 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-16 17:30:53.438234 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-16 17:30:53.459262 | instance | + '[' '!' -z '' ']'
2026-04-16 17:30:53.534355 | instance | ok: Runtime: 0:00:00.115481
2026-04-16 17:30:53.543083 | 
2026-04-16 17:30:53.543157 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-16 17:30:54.169944 | instance | changed:
2026-04-16 17:30:54.170120 | instance | created directory /var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/logs/instance
2026-04-16 17:30:54.170148 | instance | cd+++++++++ system/
2026-04-16 17:30:54.170171 | instance | >f+++++++++ system/brctl-show.txt
2026-04-16 17:30:54.170200 | instance | >f+++++++++ system/docker-images.txt
2026-04-16 17:30:54.170225 | instance | >f+++++++++ system/ip-addr.txt
2026-04-16 17:30:54.170250 | instance | >f+++++++++ system/ip-route.txt
2026-04-16 17:30:54.170271 | instance | >f+++++++++ system/lsblk.txt
2026-04-16 17:30:54.170291 | instance | >f+++++++++ system/mount.txt
2026-04-16 17:30:54.170317 | instance | >f+++++++++ system/packages.txt
2026-04-16 17:30:54.170339 | instance | >f+++++++++ system/ps.txt
2026-04-16 17:30:54.170360 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-16 17:30:54.179642 | 
2026-04-16 17:30:54.179719 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-16 17:30:54.370321 | instance | changed: "values"
2026-04-16 17:30:54.538169 | instance | changed: "releases"
2026-04-16 17:30:54.558233 | 
2026-04-16 17:30:54.558421 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-16 17:30:54.830303 | instance | E0416 17:30:54.830133   38116 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:54.831230 | instance | E0416 17:30:54.831157   38116 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:54.833303 | instance | E0416 17:30:54.833228   38116 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:54.833900 | instance | E0416 17:30:54.833848   38116 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:54.835000 | instance | E0416 17:30:54.834936   38116 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:54.835062 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:55.098839 | instance | ok: Runtime: 0:00:00.072779
2026-04-16 17:30:55.105490 | 
2026-04-16 17:30:55.105566 | TASK [helm-release-status : Downloads logs to executor]
2026-04-16 17:30:55.576007 | instance | changed:
2026-04-16 17:30:55.576221 | instance | cd+++++++++ helm/
2026-04-16 17:30:55.576259 | instance | cd+++++++++ helm/releases/
2026-04-16 17:30:55.576288 | instance | cd+++++++++ helm/values/
2026-04-16 17:30:55.588182 | 
2026-04-16 17:30:55.588250 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-16 17:30:55.816476 | instance | changed
2026-04-16 17:30:55.852641 | 
2026-04-16 17:30:55.852795 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-16 17:30:56.064089 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 17:30:56.064575 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 17:30:56.072098 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 17:30:56.073293 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 17:30:56.121559 | instance | E0416 17:30:56.121401   38173 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.122505 | instance | E0416 17:30:56.122456   38173 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.123490 | instance | E0416 17:30:56.123446   38173 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.125321 | instance | E0416 17:30:56.125265   38173 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.125878 | instance | E0416 17:30:56.125842   38173 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.127053 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:56.129295 | instance | E0416 17:30:56.129226   38169 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.129861 | instance | E0416 17:30:56.129830   38169 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.131803 | instance | E0416 17:30:56.131766   38169 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.132555 | instance | E0416 17:30:56.132505   38169 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.134401 | instance | E0416 17:30:56.134359   38169 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.134423 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:56.138818 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 17:30:56.144721 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 17:30:56.193043 | instance | E0416 17:30:56.192934   38209 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.194135 | instance | E0416 17:30:56.194064   38209 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.194972 | instance | E0416 17:30:56.194927   38209 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.196908 | instance | E0416 17:30:56.196850   38209 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.197459 | instance | E0416 17:30:56.197406   38209 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.198121 | instance | E0416 17:30:56.198035   38216 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.198856 | instance | E0416 17:30:56.198814   38216 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.199020 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:56.201236 | instance | E0416 17:30:56.201184   38216 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.202322 | instance | E0416 17:30:56.202298   38216 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.203149 | instance | E0416 17:30:56.203088   38216 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.204383 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:56.210112 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 17:30:56.265455 | instance | E0416 17:30:56.265114   38246 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.266485 | instance | E0416 17:30:56.266435   38246 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.267513 | instance | E0416 17:30:56.267460   38246 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.268169 | instance | E0416 17:30:56.268129   38246 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.270176 | instance | E0416 17:30:56.270104   38246 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.270205 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:56.391118 | instance | ok: Runtime: 0:00:00.222177
2026-04-16 17:30:56.397115 | 
2026-04-16 17:30:56.397187 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-16 17:30:56.605066 | instance | changed
2026-04-16 17:30:56.610943 | 
2026-04-16 17:30:56.611011 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-16 17:30:56.827198 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 17:30:56.827753 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 17:30:56.827771 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 17:30:56.879091 | instance | E0416 17:30:56.878923   38285 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.880135 | instance | E0416 17:30:56.880083   38285 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.881058 | instance | E0416 17:30:56.881000   38285 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.882996 | instance | E0416 17:30:56.882949   38285 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.883601 | instance | E0416 17:30:56.883565   38285 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:56.884487 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:57.147292 | instance | ok: Runtime: 0:00:00.072718
2026-04-16 17:30:57.152786 | 
2026-04-16 17:30:57.152852 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-16 17:30:57.624346 | instance | changed:
2026-04-16 17:30:57.624579 | instance | cd+++++++++ objects/
2026-04-16 17:30:57.624615 | instance | cd+++++++++ objects/cluster/
2026-04-16 17:30:57.624644 | instance | cd+++++++++ objects/namespaced/
2026-04-16 17:30:57.635089 | 
2026-04-16 17:30:57.635152 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-16 17:30:57.840077 | instance | changed
2026-04-16 17:30:57.851495 | 
2026-04-16 17:30:57.851577 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-16 17:30:58.058296 | instance | changed
2026-04-16 17:30:58.063281 | 
2026-04-16 17:30:58.063351 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-16 17:30:58.331446 | instance | E0416 17:30:58.331191   38345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:58.332138 | instance | E0416 17:30:58.332071   38345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:58.336268 | instance | E0416 17:30:58.336178   38345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:58.337190 | instance | E0416 17:30:58.337146   38345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:58.338997 | instance | E0416 17:30:58.338931   38345 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:58.339041 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:58.599992 | instance | ok: Runtime: 0:00:00.077284
2026-04-16 17:30:58.606391 | 
2026-04-16 17:30:58.606459 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-16 17:30:59.076160 | instance | changed:
2026-04-16 17:30:59.076366 | instance | cd+++++++++ pod-logs/
2026-04-16 17:30:59.076392 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-16 17:30:59.086244 | 
2026-04-16 17:30:59.086323 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-16 17:30:59.282791 | instance | changed
2026-04-16 17:30:59.289338 | 
2026-04-16 17:30:59.289409 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-16 17:30:59.568426 | instance | E0416 17:30:59.568236   38395 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:59.569477 | instance | E0416 17:30:59.569411   38395 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:59.570364 | instance | E0416 17:30:59.570323   38395 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:59.572458 | instance | E0416 17:30:59.572421   38395 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:59.573428 | instance | E0416 17:30:59.573392   38395 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:30:59.574591 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:30:59.824702 | instance | ok: Runtime: 0:00:00.082612
2026-04-16 17:30:59.831411 | 
2026-04-16 17:30:59.831479 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-16 17:31:00.104627 | instance | E0416 17:31:00.104423   38422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.105243 | instance | E0416 17:31:00.105166   38422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.107206 | instance | E0416 17:31:00.107115   38422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.108334 | instance | E0416 17:31:00.108231   38422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.108958 | instance | E0416 17:31:00.108895   38422 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.110265 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:31:00.116204 | instance | ceph-mgr endpoints:
2026-04-16 17:31:00.369770 | instance | ok: Runtime: 0:00:00.074281
2026-04-16 17:31:00.377534 | 
2026-04-16 17:31:00.377609 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-16 17:31:00.633666 | instance | E0416 17:31:00.633479   38449 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.634026 | instance | E0416 17:31:00.633970   38449 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.635936 | instance | E0416 17:31:00.635872   38449 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.636480 | instance | E0416 17:31:00.636420   38449 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.638174 | instance | E0416 17:31:00.638125   38449 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused
2026-04-16 17:31:00.638235 | instance | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-04-16 17:31:00.914696 | instance | ok: Runtime: 0:00:00.069296
2026-04-16 17:31:00.920942 | 
2026-04-16 17:31:00.921074 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-16 17:31:01.401510 | instance | changed: cd+++++++++ prometheus/
2026-04-16 17:31:01.411384 | 
2026-04-16 17:31:01.411461 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-16 17:31:01.666078 | instance | changed
2026-04-16 17:31:01.671281 | 
2026-04-16 17:31:01.671347 | TASK [gather-selenium-data : Get selenium data]
2026-04-16 17:31:01.869337 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-16 17:31:01.870729 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-16 17:31:02.215827 | instance | ERROR
2026-04-16 17:31:02.216130 | instance | {
2026-04-16 17:31:02.216199 | instance |   "delta": "0:00:00.005400",
2026-04-16 17:31:02.216244 | instance |   "end": "2026-04-16 17:31:01.871028",
2026-04-16 17:31:02.216285 | instance |   "msg": "non-zero return code",
2026-04-16 17:31:02.216325 | instance |   "rc": 1,
2026-04-16 17:31:02.216364 | instance |   "start": "2026-04-16 17:31:01.865628"
2026-04-16 17:31:02.216402 | instance | }
2026-04-16 17:31:02.216452 | instance | ERROR: Ignoring Errors
2026-04-16 17:31:02.222267 | 
2026-04-16 17:31:02.222332 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-16 17:31:02.693045 | instance | changed: cd+++++++++ selenium/
2026-04-16 17:31:02.699107 | 
2026-04-16 17:31:02.699181 | PLAY RECAP
2026-04-16 17:31:02.699228 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-16 17:31:02.699252 | 
2026-04-16 17:31:02.823916 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-16 17:31:02.836393 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-16 17:31:03.438056 | 
2026-04-16 17:31:03.438179 | PLAY [all]
2026-04-16 17:31:03.449366 | 
2026-04-16 17:31:03.449459 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-16 17:31:03.495331 | instance | skipping: Conditional result was False
2026-04-16 17:31:03.506540 | 
2026-04-16 17:31:03.506671 | TASK [fetch-output : Set log path for single node]
2026-04-16 17:31:03.551939 | instance | ok
2026-04-16 17:31:03.556606 | 
2026-04-16 17:31:03.556672 | LOOP [fetch-output : Ensure local output dirs]
2026-04-16 17:31:03.925483 | instance -> localhost | ok: "/var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/logs"
2026-04-16 17:31:04.134517 | instance -> localhost | changed: "/var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/artifacts"
2026-04-16 17:31:04.346305 | instance -> localhost | changed: "/var/lib/zuul/builds/86f11c139d9342c59c6219f08e70739e/work/docs"
2026-04-16 17:31:04.366363 | 
2026-04-16 17:31:04.366520 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-16 17:31:04.990260 | instance | changed: .d..t...... ./
2026-04-16 17:31:04.990470 | instance | changed: All items complete
2026-04-16 17:31:04.990498 | 
2026-04-16 17:31:05.417623 | instance | changed: .d..t...... ./
2026-04-16 17:31:05.841351 | instance | changed: .d..t...... ./
2026-04-16 17:31:05.867512 | 
2026-04-16 17:31:05.867655 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-16 17:31:06.292177 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007812
2026-04-16 17:31:06.515063 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006942
2026-04-16 17:31:06.529636 | 
2026-04-16 17:31:06.529760 | PLAY [all]
2026-04-16 17:31:06.536772 | 
2026-04-16 17:31:06.536837 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-16 17:31:06.947889 | instance | changed
2026-04-16 17:31:06.953769 | 
2026-04-16 17:31:06.953820 | PLAY RECAP
2026-04-16 17:31:06.953866 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-16 17:31:06.953888 | 
2026-04-16 17:31:07.091433 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-16 17:31:07.104276 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-16 17:31:07.731490 | 
2026-04-16 17:31:07.731644 | PLAY [localhost]
2026-04-16 17:31:07.741957 | 
2026-04-16 17:31:07.742028 | TASK [Generate Zuul manifest]
2026-04-16 17:31:07.760853 | localhost | ok
2026-04-16 17:31:07.775079 | 
2026-04-16 17:31:07.775158 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-16 17:31:08.135128 | localhost | changed
2026-04-16 17:31:08.145829 | 
2026-04-16 17:31:08.145903 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-16 17:31:08.177089 | localhost | ok
2026-04-16 17:31:08.185016 | 
2026-04-16 17:31:08.185078 | TASK [Upload logs]
2026-04-16 17:31:08.207110 | localhost | ok
2026-04-16 17:31:08.324835 | 
2026-04-16 17:31:08.325023 | TASK [Set zuul-log-path fact]
2026-04-16 17:31:08.345588 | localhost | ok
2026-04-16 17:31:08.358796 | 
2026-04-16 17:31:08.358861 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-16 17:31:08.389624 | localhost | ok
2026-04-16 17:31:08.398431 | 
2026-04-16 17:31:08.398492 | TASK [upload-logs : Create log directories]
2026-04-16 17:31:08.744861 | localhost | changed
2026-04-16 17:31:08.751414 | 
2026-04-16 17:31:08.751489 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-16 17:31:09.115236 | localhost -> localhost | ok: Runtime: 0:00:00.005985
2026-04-16 17:31:09.121352 | 
2026-04-16 17:31:09.121417 | TASK [upload-logs : Upload logs to log server]
2026-04-16 17:31:09.539768 | localhost | Output suppressed because no_log was given
2026-04-16 17:31:09.545058 | 
2026-04-16 17:31:09.545171 | LOOP [upload-logs : Compress console log and json output]
2026-04-16 17:31:09.592363 | localhost | skipping: Conditional result was False
2026-04-16 17:31:09.599243 | localhost | skipping: Conditional result was False
2026-04-16 17:31:09.614329 | 
2026-04-16 17:31:09.614489 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-16 17:31:09.662053 | localhost | skipping: Conditional result was False
2026-04-16 17:31:09.662453 | 
2026-04-16 17:31:09.666512 | localhost | skipping: Conditional result was False
2026-04-16 17:31:09.683227 | 
2026-04-16 17:31:09.683386 | LOOP [upload-logs : Upload console log and json output]