2026-04-03 02:22:03.309974 | Job console starting
2026-04-03 02:22:03.323089 | Updating git repos
2026-04-03 02:22:03.375805 | Cloning repos into workspace
2026-04-03 02:22:03.438958 | Restoring repo states
2026-04-03 02:22:03.460100 | Merging changes
2026-04-03 02:22:04.442107 | Checking out repos
2026-04-03 02:22:04.547362 | Preparing playbooks
2026-04-03 02:22:06.523791 | Running Ansible setup
2026-04-03 02:22:09.939380 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-03 02:22:10.546808 | 
2026-04-03 02:22:10.546931 | PLAY [localhost]
2026-04-03 02:22:10.554155 | 
2026-04-03 02:22:10.554227 | TASK [Gathering Facts]
2026-04-03 02:22:11.412673 | localhost | ok
2026-04-03 02:22:11.424166 | 
2026-04-03 02:22:11.424240 | TASK [Setup log path fact]
2026-04-03 02:22:11.443683 | localhost | ok
2026-04-03 02:22:11.457078 | 
2026-04-03 02:22:11.457148 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-03 02:22:11.485821 | localhost | ok
2026-04-03 02:22:11.494109 | 
2026-04-03 02:22:11.494206 | TASK [emit-job-header : Print job information]
2026-04-03 02:22:11.535502 | # Job Information
2026-04-03 02:22:11.535758 | Ansible Version: 2.16.16
2026-04-03 02:22:11.535841 | Job: atmosphere-molecule-aio-ovn
2026-04-03 02:22:11.535891 | Pipeline: check
2026-04-03 02:22:11.535938 | Executor: 0a8996d2b663
2026-04-03 02:22:11.535981 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3782
2026-04-03 02:22:11.536031 | Event ID: bfeacec0-2f03-11f1-82ba-6fcab35ce650
2026-04-03 02:22:11.540307 | 
2026-04-03 02:22:11.540399 | LOOP [emit-job-header : Print node information]
2026-04-03 02:22:11.631107 | localhost | ok:
2026-04-03 02:22:11.631303 | localhost | # Node Information
2026-04-03 02:22:11.631355 | localhost | Inventory Hostname: instance
2026-04-03 02:22:11.631389 | localhost | Hostname: np0000163362
2026-04-03 02:22:11.631418 | localhost | Username: zuul
2026-04-03 02:22:11.631451 | localhost | Distro: Ubuntu 22.04
2026-04-03 02:22:11.631480 | localhost | Provider: yul1
2026-04-03 02:22:11.631507 | localhost | Region: ca-ymq-1
2026-04-03 02:22:11.631534 | localhost | Label: ubuntu-jammy-16
2026-04-03 02:22:11.631560 | localhost | Product Name: OpenStack Nova
2026-04-03 02:22:11.631587 | localhost | Interface IP: 162.253.55.70
2026-04-03 02:22:11.649350 | 
2026-04-03 02:22:11.649443 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-03 02:22:12.008184 | localhost -> localhost | changed
2026-04-03 02:22:12.017544 | 
2026-04-03 02:22:12.017693 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-03 02:22:12.852379 | localhost -> localhost | changed
2026-04-03 02:22:12.870958 | 
2026-04-03 02:22:12.871041 | PLAY [all]
2026-04-03 02:22:12.878754 | 
2026-04-03 02:22:12.878820 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-03 02:22:13.315737 | instance -> localhost | ok
2026-04-03 02:22:13.326680 | 
2026-04-03 02:22:13.326771 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-03 02:22:13.358994 | instance | ok
2026-04-03 02:22:13.372801 | instance | included: /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-03 02:22:13.378334 | 
2026-04-03 02:22:13.378403 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-03 02:22:14.824411 | instance -> localhost | Generating public/private rsa key pair.
2026-04-03 02:22:14.824560 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/79dd88b30ea6476990f385ecd9e7346f_id_rsa
2026-04-03 02:22:14.824591 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/79dd88b30ea6476990f385ecd9e7346f_id_rsa.pub
2026-04-03 02:22:14.824614 | instance -> localhost | The key fingerprint is:
2026-04-03 02:22:14.824637 | instance -> localhost | SHA256:r+t2ux1XjLpbjR+pH/c45rxmvuuFDVMzWN8g2dk16aE zuul-build-sshkey
2026-04-03 02:22:14.824669 | instance -> localhost | The key's randomart image is:
2026-04-03 02:22:14.824692 | instance -> localhost | +---[RSA 3072]----+
2026-04-03 02:22:14.824719 | instance -> localhost | |            .o.=+|
2026-04-03 02:22:14.824740 | instance -> localhost | |            ..=+=|
2026-04-03 02:22:14.824760 | instance -> localhost | |             .oo=|
2026-04-03 02:22:14.824781 | instance -> localhost | |             E =o|
2026-04-03 02:22:14.824801 | instance -> localhost | |        S     + o|
2026-04-03 02:22:14.824821 | instance -> localhost | |         .   . O.|
2026-04-03 02:22:14.824841 | instance -> localhost | |          . o =+=|
2026-04-03 02:22:14.824861 | instance -> localhost | |        .... **+=|
2026-04-03 02:22:14.824884 | instance -> localhost | |       o+ooo+X@*o|
2026-04-03 02:22:14.824904 | instance -> localhost | +----[SHA256]-----+
2026-04-03 02:22:14.824948 | instance -> localhost | ok: Runtime: 0:00:01.074247
2026-04-03 02:22:14.829893 | 
2026-04-03 02:22:14.829954 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-03 02:22:14.861064 | instance | ok
2026-04-03 02:22:14.869905 | instance | included: /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-03 02:22:14.877244 | 
2026-04-03 02:22:14.877304 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-03 02:22:14.900742 | instance | skipping: Conditional result was False
2026-04-03 02:22:14.909296 | 
2026-04-03 02:22:14.909383 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-03 02:22:15.336241 | instance | changed
2026-04-03 02:22:15.343141 | 
2026-04-03 02:22:15.343209 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-03 02:22:15.548810 | instance | ok
2026-04-03 02:22:15.591227 | 
2026-04-03 02:22:15.591331 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-03 02:22:16.055478 | instance | changed
2026-04-03 02:22:16.060661 | 
2026-04-03 02:22:16.060792 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-03 02:22:16.526714 | instance | changed
2026-04-03 02:22:16.533061 | 
2026-04-03 02:22:16.533152 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-03 02:22:16.559215 | instance | skipping: Conditional result was False
2026-04-03 02:22:16.571007 | 
2026-04-03 02:22:16.571108 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-03 02:22:16.921210 | instance -> localhost | changed
2026-04-03 02:22:16.997015 | 
2026-04-03 02:22:16.997138 | TASK [add-build-sshkey : Add back temp key]
2026-04-03 02:22:17.284392 | instance -> localhost | Identity added: /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/79dd88b30ea6476990f385ecd9e7346f_id_rsa (zuul-build-sshkey)
2026-04-03 02:22:17.284811 | instance -> localhost | ok: Runtime: 0:00:00.012554
2026-04-03 02:22:17.292435 | 
2026-04-03 02:22:17.292642 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-03 02:22:17.559860 | instance | ok
2026-04-03 02:22:17.565168 | 
2026-04-03 02:22:17.565282 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-03 02:22:17.589600 | instance | skipping: Conditional result was False
2026-04-03 02:22:17.610126 | 
2026-04-03 02:22:17.610236 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-03 02:22:17.887305 | instance | ok
2026-04-03 02:22:17.893967 | 
2026-04-03 02:22:17.894033 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-03 02:22:19.435198 | instance | Output suppressed because no_log was given
2026-04-03 02:22:19.527576 | 
2026-04-03 02:22:19.527722 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-03 02:22:19.720802 | instance | ok: "logs"
2026-04-03 02:22:21.753440 | instance | ok: All items complete
2026-04-03 02:22:21.753599 | 
2026-04-03 02:22:21.763604 | instance | ok: "artifacts"
2026-04-03 02:22:21.767845 | instance | ok: "docs"
2026-04-03 02:22:21.788094 | 
2026-04-03 02:22:21.788221 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-03 02:22:21.970462 | instance | changed: "logs"
2026-04-03 02:22:22.969734 | instance | changed: "artifacts"
2026-04-03 02:22:22.975670 | instance | changed: "docs"
2026-04-03 02:22:22.988869 | 
2026-04-03 02:22:22.988919 | PLAY RECAP
2026-04-03 02:22:22.988975 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-03 02:22:22.989006 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-03 02:22:22.989028 | 
2026-04-03 02:22:23.090756 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-03 02:22:23.101539 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-03 02:22:23.699904 | 
2026-04-03 02:22:23.700040 | PLAY [all]
2026-04-03 02:22:23.711866 | 
2026-04-03 02:22:23.711959 | TASK [setup-uv : Extract archive]
2026-04-03 02:22:26.012129 | instance | changed
2026-04-03 02:22:26.020129 | 
2026-04-03 02:22:26.020240 | TASK [setup-uv : Print version]
2026-04-03 02:22:26.343381 | instance | uv 0.8.13
2026-04-03 02:22:26.563051 | instance | ok: Runtime: 0:00:00.010780
2026-04-03 02:22:26.570606 | 
2026-04-03 02:22:26.570670 | PLAY RECAP
2026-04-03 02:22:26.570718 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-03 02:22:26.570742 | 
2026-04-03 02:22:26.676638 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-03 02:22:26.689037 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-03 02:22:27.299379 | 
2026-04-03 02:22:27.299497 | PLAY [all]
2026-04-03 02:22:27.311045 | 
2026-04-03 02:22:27.311141 | TASK [Install "jq" for log collection]
2026-04-03 02:22:38.052832 | instance | changed
2026-04-03 02:22:38.057566 | 
2026-04-03 02:22:38.057630 | PLAY RECAP
2026-04-03 02:22:38.057680 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-03 02:22:38.057729 | 
2026-04-03 02:22:38.156020 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-03 02:22:38.168020 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-03 02:22:38.759305 | 
2026-04-03 02:22:38.759414 | PLAY [all]
2026-04-03 02:22:38.770608 | 
2026-04-03 02:22:38.770683 | TASK [Copy inventory file for Zuul]
2026-04-03 02:22:39.603353 | instance | changed
2026-04-03 02:22:39.609658 | 
2026-04-03 02:22:39.609736 | TASK [Switch "ansible_host" to private IP]
2026-04-03 02:22:39.946956 | instance | changed: 1 replacements made
2026-04-03 02:22:39.953876 | 
2026-04-03 02:22:39.953959 | TASK [Run Molecule scenario]
2026-04-03 02:22:40.335104 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-03 02:22:40.335274 | instance | Creating virtual environment at: .venv
2026-04-03 02:22:40.360293 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-03 02:22:40.652481 | instance | Downloading setuptools (1.1MiB)
2026-04-03 02:22:40.662732 | instance | Downloading openstacksdk (1.7MiB)
2026-04-03 02:22:40.664396 | instance | Downloading pydantic-core (2.0MiB)
2026-04-03 02:22:40.669090 | instance | Downloading pygments (1.2MiB)
2026-04-03 02:22:40.669386 | instance | Downloading cryptography (4.2MiB)
2026-04-03 02:22:40.669731 | instance | Downloading ansible-core (2.1MiB)
2026-04-03 02:22:40.670232 | instance | Downloading rjsonnet (1.2MiB)
2026-04-03 02:22:40.670580 | instance | Downloading netaddr (2.2MiB)
2026-04-03 02:22:40.671358 | instance | Downloading kubernetes (1.9MiB)
2026-04-03 02:22:41.274717 | instance |    Building pyperclip==1.9.0
2026-04-03 02:22:41.407026 | instance |  Downloading rjsonnet
2026-04-03 02:22:41.423682 | instance |  Downloading pygments
2026-04-03 02:22:41.426452 | instance |  Downloading setuptools
2026-04-03 02:22:41.551987 | instance |  Downloading pydantic-core
2026-04-03 02:22:41.579706 | instance |  Downloading kubernetes
2026-04-03 02:22:41.581772 | instance |  Downloading netaddr
2026-04-03 02:22:41.606127 | instance |  Downloading openstacksdk
2026-04-03 02:22:41.630036 | instance |  Downloading ansible-core
2026-04-03 02:22:41.693121 | instance |  Downloading cryptography
2026-04-03 02:22:42.069670 | instance |       Built pyperclip==1.9.0
2026-04-03 02:22:42.461287 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-03 02:22:42.574928 | instance | Installed 83 packages in 111ms
2026-04-03 02:22:43.199143 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-03 02:22:43.785323 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-03 02:22:43.785467 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-04-03 02:23:28.968222 | instance | INFO     [aio > dependency] Executing
2026-04-03 02:23:28.968549 | instance | WARNING  [aio > dependency] Missing roles requirements file: requirements.yml
2026-04-03 02:23:28.968788 | instance | WARNING  [aio > dependency] Missing collections requirements file: collections.yml
2026-04-03 02:23:28.968932 | instance | WARNING  [aio > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-03 02:23:28.976508 | instance | INFO     [aio > cleanup] Executing
2026-04-03 02:23:28.976851 | instance | WARNING  [aio > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-03 02:23:28.984926 | instance | INFO     [aio > destroy] Executing
2026-04-03 02:23:28.985032 | instance | WARNING  [aio > destroy] Skipping, '--destroy=never' requested.
2026-04-03 02:23:28.985130 | instance | INFO     [aio > destroy] Executed: Successful
2026-04-03 02:23:28.992547 | instance | INFO     [aio > syntax] Executing
2026-04-03 02:23:32.004078 | instance |
2026-04-03 02:23:32.004623 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-03 02:23:32.120239 | instance | INFO     [aio > syntax] Executed: Successful
2026-04-03 02:23:32.133186 | instance | INFO     [aio > create] Executing
2026-04-03 02:23:32.135045 | instance | WARNING  [aio > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-03 02:23:32.142550 | instance | INFO     [aio > prepare] Executing
2026-04-03 02:23:33.097037 | instance |
2026-04-03 02:23:33.097451 | instance | PLAY [Prepare] *****************************************************************
2026-04-03 02:23:33.097783 | instance |
2026-04-03 02:23:33.098123 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:23:33.098462 | instance | Friday 03 April 2026  02:23:33 +0000 (0:00:00.081)       0:00:00.081 **********
2026-04-03 02:23:34.318967 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-03 02:23:34.319450 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-03 02:23:34.319900 | instance | interpreter could change the meaning of that path. See
2026-04-03 02:23:34.320377 | instance | https://docs.ansible.com/ansible-
2026-04-03 02:23:34.320861 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-03 02:23:34.327185 | instance | ok: [instance]
2026-04-03 02:23:34.327430 | instance |
2026-04-03 02:23:34.327667 | instance | TASK [Configure short hostname] ************************************************
2026-04-03 02:23:34.327902 | instance | Friday 03 April 2026  02:23:34 +0000 (0:00:01.253)       0:00:01.334 **********
2026-04-03 02:23:35.037573 | instance | changed: [instance]
2026-04-03 02:23:35.037974 | instance |
2026-04-03 02:23:35.038327 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-03 02:23:35.038739 | instance | Friday 03 April 2026  02:23:35 +0000 (0:00:00.709)       0:00:02.043 **********
2026-04-03 02:23:35.319439 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-03 02:23:35.319664 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-04-03 02:23:35.319835 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-03 02:23:35.328661 | instance | changed: [instance]
2026-04-03 02:23:35.328813 | instance |
2026-04-03 02:23:35.328987 | instance | TASK [Install "dirmngr" for GPG keyserver operations] **************************
2026-04-03 02:23:35.329138 | instance | Friday 03 April 2026  02:23:35 +0000 (0:00:00.291)       0:00:02.335 **********
2026-04-03 02:23:36.503862 | instance | ok: [instance]
2026-04-03 02:23:36.504092 | instance |
2026-04-03 02:23:36.504246 | instance | TASK [Purge "snapd" package] ***************************************************
2026-04-03 02:23:36.504418 | instance | Friday 03 April 2026  02:23:36 +0000 (0:00:01.174)       0:00:03.510 **********
2026-04-03 02:23:37.288595 | instance | ok: [instance]
2026-04-03 02:23:37.289016 | instance |
2026-04-03 02:23:37.289396 | instance | PLAY [Generate workspace for Atmosphere] ***************************************
2026-04-03 02:23:37.289744 | instance |
2026-04-03 02:23:37.290109 | instance | TASK [Create folders for workspace] ********************************************
2026-04-03 02:23:37.290468 | instance | Friday 03 April 2026  02:23:37 +0000 (0:00:00.784)       0:00:04.295 **********
2026-04-03 02:23:38.271371 | instance | changed: [localhost] => (item=group_vars)
2026-04-03 02:23:38.271780 | instance | changed: [localhost] => (item=group_vars/all)
2026-04-03 02:23:38.272117 | instance | changed: [localhost] => (item=group_vars/controllers)
2026-04-03 02:23:38.272741 | instance | changed: [localhost] => (item=group_vars/cephs)
2026-04-03 02:23:38.273133 | instance | changed: [localhost] => (item=group_vars/computes)
2026-04-03 02:23:38.273476 | instance | changed: [localhost] => (item=host_vars)
2026-04-03 02:23:38.273797 | instance |
2026-04-03 02:23:38.274161 | instance | PLAY [Generate Ceph control plane configuration for workspace] *****************
2026-04-03 02:23:38.274562 | instance |
2026-04-03 02:23:38.274920 | instance | TASK [Ensure the Ceph control plane configuration file exists] *****************
2026-04-03 02:23:38.275257 | instance | Friday 03 April 2026  02:23:38 +0000 (0:00:00.982)       0:00:05.278 **********
2026-04-03 02:23:38.444115 | instance | changed: [localhost]
2026-04-03 02:23:38.444536 | instance |
2026-04-03 02:23:38.444905 | instance | TASK [Load the current Ceph control plane configuration into a variable] *******
2026-04-03 02:23:38.445254 | instance | Friday 03 April 2026  02:23:38 +0000 (0:00:00.172)       0:00:05.450 **********
2026-04-03 02:23:38.470012 | instance | ok: [localhost]
2026-04-03 02:23:38.470441 | instance |
2026-04-03 02:23:38.470796 | instance | TASK [Generate Ceph control plane values for missing variables] ****************
2026-04-03 02:23:38.471134 | instance | Friday 03 April 2026  02:23:38 +0000 (0:00:00.026)       0:00:05.476 **********
2026-04-03 02:23:38.524859 | instance | ok: [localhost] => (item={'key': 'ceph_fsid', 'value': '058533b7-a262-5ba7-9fa1-5e314da72c5d'})
2026-04-03 02:23:38.525231 | instance | ok: [localhost] => (item={'key': 'ceph_mon_public_network', 'value': '10.96.240.0/24'})
2026-04-03 02:23:38.525548 | instance |
2026-04-03 02:23:38.525880 | instance | TASK [Write new Ceph control plane configuration file to disk] *****************
2026-04-03 02:23:38.526215 | instance | Friday 03 April 2026  02:23:38 +0000 (0:00:00.055)       0:00:05.531 **********
2026-04-03 02:23:39.105941 | instance | changed: [localhost]
2026-04-03 02:23:39.106334 | instance |
2026-04-03 02:23:39.106693 | instance | PLAY [Generate Ceph OSD configuration for workspace] ***************************
2026-04-03 02:23:39.107047 | instance |
2026-04-03 02:23:39.107564 | instance | TASK [Ensure the Ceph OSDs configuration file exists] **************************
2026-04-03 02:23:39.107903 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.580)       0:00:06.112 **********
2026-04-03 02:23:39.287593 | instance | changed: [localhost]
2026-04-03 02:23:39.287940 | instance |
2026-04-03 02:23:39.288283 | instance | TASK [Load the current Ceph OSDs configuration into a variable] ****************
2026-04-03 02:23:39.288753 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.181)       0:00:06.294 **********
2026-04-03 02:23:39.316041 | instance | ok: [localhost]
2026-04-03 02:23:39.316435 | instance |
2026-04-03 02:23:39.316791 | instance | TASK [Generate Ceph OSDs values for missing variables] *************************
2026-04-03 02:23:39.317125 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.028)       0:00:06.322 **********
2026-04-03 02:23:39.352185 | instance | ok: [localhost] => (item={'key': 'ceph_osd_devices', 'value': ['/dev/vdb', '/dev/vdc', '/dev/vdd']})
2026-04-03 02:23:39.352556 | instance |
2026-04-03 02:23:39.352901 | instance | TASK [Write new Ceph OSDs configuration file to disk] **************************
2026-04-03 02:23:39.353232 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.036)       0:00:06.358 **********
2026-04-03 02:23:39.694209 | instance | changed: [localhost]
2026-04-03 02:23:39.694591 | instance |
2026-04-03 02:23:39.694937 | instance | PLAY [Generate Kubernetes configuration for workspace] *************************
2026-04-03 02:23:39.695253 | instance |
2026-04-03 02:23:39.695590 | instance | TASK [Ensure the Kubernetes configuration file exists] *************************
2026-04-03 02:23:39.695925 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.341)       0:00:06.700 **********
2026-04-03 02:23:39.888015 | instance | changed: [localhost]
2026-04-03 02:23:39.888460 | instance |
2026-04-03 02:23:39.888832 | instance | TASK [Load the current Kubernetes configuration into a variable] ***************
2026-04-03 02:23:39.896621 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.193)       0:00:06.894 **********
2026-04-03 02:23:39.913700 | instance | ok: [localhost]
2026-04-03 02:23:39.914057 | instance |
2026-04-03 02:23:39.914420 | instance | TASK [Generate Kubernetes values for missing variables] ************************
2026-04-03 02:23:39.914755 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.025)       0:00:06.920 **********
2026-04-03 02:23:39.956539 | instance | ok: [localhost] => (item={'key': 'kubernetes_hostname', 'value': '10.96.240.10'})
2026-04-03 02:23:39.956656 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vrid', 'value': 42})
2026-04-03 02:23:39.956668 | instance | ok: [localhost] => (item={'key': 'kubernetes_keepalived_vip', 'value': '10.96.240.10'})
2026-04-03 02:23:39.956678 | instance |
2026-04-03 02:23:39.956702 | instance | TASK [Write new Kubernetes configuration file to disk] *************************
2026-04-03 02:23:39.956711 | instance | Friday 03 April 2026  02:23:39 +0000 (0:00:00.042)       0:00:06.962 **********
2026-04-03 02:23:40.358219 | instance | changed: [localhost]
2026-04-03 02:23:40.358395 | instance |
2026-04-03 02:23:40.358617 | instance | PLAY [Generate Keepalived configuration for workspace] *************************
2026-04-03 02:23:40.358823 | instance |
2026-04-03 02:23:40.359080 | instance | TASK [Ensure the Keeaplived configuration file exists] *************************
2026-04-03 02:23:40.359321 | instance | Friday 03 April 2026  02:23:40 +0000 (0:00:00.402)       0:00:07.364 **********
2026-04-03 02:23:40.523861 | instance | changed: [localhost]
2026-04-03 02:23:40.523995 | instance |
2026-04-03 02:23:40.524498 | instance | TASK [Load the current Keepalived configuration into a variable] ***************
2026-04-03 02:23:40.524928 | instance | Friday 03 April 2026  02:23:40 +0000 (0:00:00.165)       0:00:07.530 **********
2026-04-03 02:23:40.550601 | instance | ok: [localhost]
2026-04-03 02:23:40.550905 | instance |
2026-04-03 02:23:40.551239 | instance | TASK [Generate Keepalived values for missing variables] ************************
2026-04-03 02:23:40.551571 | instance | Friday 03 April 2026  02:23:40 +0000 (0:00:00.026)       0:00:07.557 **********
2026-04-03 02:23:40.592843 | instance | ok: [localhost] => (item={'key': 'keepalived_interface', 'value': 'br-ex'})
2026-04-03 02:23:40.593057 | instance | ok: [localhost] => (item={'key': 'keepalived_vip', 'value': '10.96.250.10'})
2026-04-03 02:23:40.593265 | instance |
2026-04-03 02:23:40.593485 | instance | TASK [Write new Keepalived configuration file to disk] *************************
2026-04-03 02:23:40.593701 | instance | Friday 03 April 2026  02:23:40 +0000 (0:00:00.042)       0:00:07.599 **********
2026-04-03 02:23:40.952959 | instance | changed: [localhost]
2026-04-03 02:23:40.953281 | instance |
2026-04-03 02:23:40.953601 | instance | PLAY [Generate endpoints for workspace] ****************************************
2026-04-03 02:23:40.953891 | instance |
2026-04-03 02:23:40.954206 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:23:40.954514 | instance | Friday 03 April 2026  02:23:40 +0000 (0:00:00.359)       0:00:07.959 **********
2026-04-03 02:23:41.662878 | instance | ok: [localhost]
2026-04-03 02:23:41.663049 | instance |
2026-04-03 02:23:41.663280 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-03 02:23:41.663518 | instance | Friday 03 April 2026  02:23:41 +0000 (0:00:00.710)       0:00:08.669 **********
2026-04-03 02:23:41.840978 | instance | changed: [localhost]
2026-04-03 02:23:41.841320 | instance |
2026-04-03 02:23:41.841675 | instance | TASK [Load the current endpoints into a variable] ******************************
2026-04-03 02:23:41.842033 | instance | Friday 03 April 2026  02:23:41 +0000 (0:00:00.178)       0:00:08.847 **********
2026-04-03 02:23:41.873238 | instance | ok: [localhost]
2026-04-03 02:23:41.873375 | instance |
2026-04-03 02:23:41.873551 | instance | TASK [Generate endpoint skeleton for missing variables] ************************
2026-04-03 02:23:41.873731 | instance | Friday 03 April 2026  02:23:41 +0000 (0:00:00.032)       0:00:08.880 **********
2026-04-03 02:23:42.690590 | instance | ok: [localhost] => (item=keycloak_host)
2026-04-03 02:23:42.691024 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_host)
2026-04-03 02:23:42.691429 | instance | ok: [localhost] => (item=kube_prometheus_stack_alertmanager_host)
2026-04-03 02:23:42.691769 | instance | ok: [localhost] => (item=kube_prometheus_stack_prometheus_host)
2026-04-03 02:23:42.692102 | instance | ok: [localhost] => (item=openstack_helm_endpoints_region_name)
2026-04-03 02:23:42.692561 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_api_host)
2026-04-03 02:23:42.692893 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_api_host)
2026-04-03 02:23:42.693217 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_api_host)
2026-04-03 02:23:42.693539 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_api_host)
2026-04-03 02:23:42.693862 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_api_host)
2026-04-03 02:23:42.694185 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_api_host)
2026-04-03 02:23:42.694505 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_api_host)
2026-04-03 02:23:42.694827 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_novnc_host)
2026-04-03 02:23:42.695355 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_api_host)
2026-04-03 02:23:42.695681 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_api_host)
2026-04-03 02:23:42.696006 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_api_host)
2026-04-03 02:23:42.696379 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_api_host)
2026-04-03 02:23:42.696713 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_registry_host)
2026-04-03 02:23:42.697035 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_api_host)
2026-04-03 02:23:42.697353 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_cfn_api_host)
2026-04-03 02:23:42.697671 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_api_host)
2026-04-03 02:23:42.697992 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_host)
2026-04-03 02:23:42.698315 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_api_host)
2026-04-03 02:23:42.698622 | instance |
2026-04-03 02:23:42.698945 | instance | TASK [Write new endpoints file to disk] ****************************************
2026-04-03 02:23:42.699345 | instance | Friday 03 April 2026  02:23:42 +0000 (0:00:00.817)       0:00:09.697 **********
2026-04-03 02:23:43.068985 | instance | changed: [localhost]
2026-04-03 02:23:43.069169 | instance |
2026-04-03 02:23:43.069551 | instance | TASK [Ensure the endpoints file exists] ****************************************
2026-04-03 02:23:43.069780 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.377)       0:00:10.074 **********
2026-04-03 02:23:43.244876 | instance | changed: [localhost]
2026-04-03 02:23:43.245219 | instance |
2026-04-03 02:23:43.245560 | instance | PLAY [Generate Neutron configuration for workspace] ****************************
2026-04-03 02:23:43.245870 | instance |
2026-04-03 02:23:43.246204 | instance | TASK [Ensure the Neutron configuration file exists] ****************************
2026-04-03 02:23:43.246535 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.176)       0:00:10.250 **********
2026-04-03 02:23:43.421177 | instance | changed: [localhost]
2026-04-03 02:23:43.421584 | instance |
2026-04-03 02:23:43.421940 | instance | TASK [Load the current Neutron configuration into a variable] ******************
2026-04-03 02:23:43.422283 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.174)       0:00:10.425 **********
2026-04-03 02:23:43.448830 | instance | ok: [localhost]
2026-04-03 02:23:43.449163 | instance |
2026-04-03 02:23:43.449511 | instance | TASK [Generate Neutron values for missing variables] ***************************
2026-04-03 02:23:43.449842 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.029)       0:00:10.455 **********
2026-04-03 02:23:43.484895 | instance | ok: [localhost] => (item={'key': 'neutron_networks', 'value': [{'name': 'public', 'external': True, 'shared': True, 'mtu_size': 1500, 'port_security_enabled': True, 'provider_network_type': 'flat', 'provider_physical_network': 'external', 'subnets': [{'name': 'public-subnet', 'cidr': '10.96.250.0/24', 'gateway_ip': '10.96.250.10', 'allocation_pool_start': '10.96.250.200', 'allocation_pool_end': '10.96.250.220', 'enable_dhcp': True}]}]})
2026-04-03 02:23:43.485232 | instance |
2026-04-03 02:23:43.485564 | instance | TASK [Write new Neutron configuration file to disk] ****************************
2026-04-03 02:23:43.485894 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.036)       0:00:10.491 **********
2026-04-03 02:23:43.827865 | instance | changed: [localhost]
2026-04-03 02:23:43.828451 | instance |
2026-04-03 02:23:43.828650 | instance | PLAY [Generate Nova configuration for workspace] *******************************
2026-04-03 02:23:43.828663 | instance |
2026-04-03 02:23:43.828678 | instance | TASK [Ensure the Nova configuration file exists] *******************************
2026-04-03 02:23:43.828692 | instance | Friday 03 April 2026  02:23:43 +0000 (0:00:00.342)       0:00:10.834 **********
2026-04-03 02:23:44.021227 | instance | changed: [localhost]
2026-04-03 02:23:44.021343 | instance |
2026-04-03 02:23:44.021691 | instance | TASK [Load the current Nova configuration into a variable] *********************
2026-04-03 02:23:44.021712 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.193)       0:00:11.028 **********
2026-04-03 02:23:44.054482 | instance | ok: [localhost]
2026-04-03 02:23:44.054627 | instance |
2026-04-03 02:23:44.054978 | instance | TASK [Generate Nova values for missing variables] ******************************
2026-04-03 02:23:44.054997 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.033)       0:00:11.061 **********
2026-04-03 02:23:44.103823 | instance | ok: [localhost] => (item={'key': 'nova_flavors', 'value': [{'name': 'm1.tiny', 'ram': 512, 'disk': 1, 'vcpus': 1}, {'name': 'm1.small', 'ram': 2048, 'disk': 20, 'vcpus': 1}, {'name': 'm1.medium', 'ram': 4096, 'disk': 40, 'vcpus': 2}, {'name': 'm1.large', 'ram': 8192, 'disk': 80, 'vcpus': 4}, {'name': 'm1.xlarge', 'ram': 16384, 'disk': 160, 'vcpus': 8}]})
2026-04-03 02:23:44.103947 | instance |
2026-04-03 02:23:44.104299 | instance | TASK [Write new Nova configuration file to disk] *******************************
2026-04-03 02:23:44.104336 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.048)       0:00:11.110 **********
2026-04-03 02:23:44.499737 | instance | changed: [localhost]
2026-04-03 02:23:44.500369 | instance |
2026-04-03 02:23:44.500404 | instance | PLAY [Generate secrets for workspace] ******************************************
2026-04-03 02:23:44.501030 | instance |
2026-04-03 02:23:44.501131 | instance | TASK [Ensure the secrets file exists] ******************************************
2026-04-03 02:23:44.501142 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.391)       0:00:11.501 **********
2026-04-03 02:23:44.682620 | instance | changed: [localhost]
2026-04-03 02:23:44.682767 | instance |
2026-04-03 02:23:44.683132 | instance | TASK [Load the current secrets into a variable] ********************************
2026-04-03 02:23:44.683187 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.187)       0:00:11.689 **********
2026-04-03 02:23:44.717638 | instance | ok: [localhost]
2026-04-03 02:23:44.717804 | instance |
2026-04-03 02:23:44.718176 | instance | TASK [Generate secrets for missing variables] **********************************
2026-04-03 02:23:44.718214 | instance | Friday 03 April 2026  02:23:44 +0000 (0:00:00.034)       0:00:11.724 **********
2026-04-03 02:23:45.116097 | instance | ok: [localhost] => (item=heat_auth_encryption_key)
2026-04-03 02:23:45.116680 | instance | ok: [localhost] => (item=keepalived_password)
2026-04-03 02:23:45.116691 | instance | ok: [localhost] => (item=keycloak_admin_password)
2026-04-03 02:23:45.116698 | instance | ok: [localhost] => (item=keycloak_database_password)
2026-04-03 02:23:45.116869 | instance | ok: [localhost] => (item=keystone_keycloak_client_secret)
2026-04-03 02:23:45.117140 | instance | ok: [localhost] => (item=keystone_oidc_crypto_passphrase)
2026-04-03 02:23:45.117354 | instance | ok: [localhost] => (item=kube_prometheus_stack_grafana_admin_password)
2026-04-03 02:23:45.117583 | instance | ok: [localhost] => (item=octavia_heartbeat_key)
2026-04-03 02:23:45.117809 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rabbitmq_admin_password)
2026-04-03 02:23:45.118017 | instance | ok: [localhost] => (item=openstack_helm_endpoints_memcached_secret_key)
2026-04-03 02:23:45.118223 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_admin_password)
2026-04-03 02:23:45.118428 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_mariadb_password)
2026-04-03 02:23:45.118632 | instance | ok: [localhost] => (item=openstack_helm_endpoints_keystone_rabbitmq_password)
2026-04-03 02:23:45.119064 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_keystone_password)
2026-04-03 02:23:45.119300 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_mariadb_password)
2026-04-03 02:23:45.119512 | instance | ok: [localhost] => (item=openstack_helm_endpoints_glance_rabbitmq_password)
2026-04-03 02:23:45.119721 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_keystone_password)
2026-04-03 02:23:45.119930 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_mariadb_password)
2026-04-03 02:23:45.120142 | instance | ok: [localhost] => (item=openstack_helm_endpoints_cinder_rabbitmq_password)
2026-04-03 02:23:45.120367 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_keystone_password)
2026-04-03 02:23:45.120584 | instance | ok: [localhost] => (item=openstack_helm_endpoints_placement_mariadb_password)
2026-04-03 02:23:45.120790 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_keystone_password)
2026-04-03 02:23:45.120997 | instance | ok: [localhost] => (item=openstack_helm_endpoints_barbican_mariadb_password)
2026-04-03 02:23:45.121202 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_keystone_password)
2026-04-03 02:23:45.121404 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_mariadb_password)
2026-04-03 02:23:45.121711 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_rabbitmq_password)
2026-04-03 02:23:45.121932 | instance | ok: [localhost] => (item=openstack_helm_endpoints_neutron_metadata_secret)
2026-04-03 02:23:45.122149 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_keystone_password)
2026-04-03 02:23:45.122304 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_mariadb_password)
2026-04-03 02:23:45.122451 | instance | ok: [localhost] => (item=openstack_helm_endpoints_nova_rabbitmq_password)
2026-04-03 02:23:45.122596 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_keystone_password)
2026-04-03 02:23:45.122742 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_mariadb_password)
2026-04-03 02:23:45.122888 | instance | ok: [localhost] => (item=openstack_helm_endpoints_ironic_rabbitmq_password)
2026-04-03 02:23:45.123033 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_keystone_password)
2026-04-03 02:23:45.123185 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_mariadb_password)
2026-04-03 02:23:45.123331 | instance | ok: [localhost] => (item=openstack_helm_endpoints_designate_rabbitmq_password)
2026-04-03 02:23:45.123496 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_keystone_password)
2026-04-03 02:23:45.123641 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_mariadb_password)
2026-04-03 02:23:45.123787 | instance | ok: [localhost] => (item=openstack_helm_endpoints_octavia_rabbitmq_password)
2026-04-03 02:23:45.123932 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_keystone_password)
2026-04-03 02:23:45.124079 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_mariadb_password)
2026-04-03 02:23:45.124227 | instance | ok: [localhost] => (item=openstack_helm_endpoints_magnum_rabbitmq_password)
2026-04-03 02:23:45.124391 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_keystone_password)
2026-04-03 02:23:45.124554 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_trustee_keystone_password)
2026-04-03 02:23:45.124709 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_stack_user_keystone_password)
2026-04-03 02:23:45.124858 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_mariadb_password)
2026-04-03 02:23:45.125004 | instance | ok: [localhost] => (item=openstack_helm_endpoints_heat_rabbitmq_password)
2026-04-03 02:23:45.125151 | instance | ok: [localhost] => (item=openstack_helm_endpoints_horizon_mariadb_password)
2026-04-03 02:23:45.125299 | instance | ok: [localhost] => (item=openstack_helm_endpoints_tempest_keystone_password)
2026-04-03 02:23:45.125500 | instance | ok: [localhost] => (item=openstack_helm_endpoints_openstack_exporter_keystone_password)
2026-04-03 02:23:45.125696 | instance | ok: [localhost] => (item=openstack_helm_endpoints_rgw_keystone_password)
2026-04-03 02:23:45.125853 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_keystone_password)
2026-04-03 02:23:45.126000 | instance | ok: [localhost] => (item=openstack_helm_endpoints_manila_mariadb_password)
2026-04-03 02:23:45.126152 | instance | ok: [localhost] => (item=openstack_helm_endpoints_staffeln_mariadb_password)
2026-04-03 02:23:45.126308 | instance |
2026-04-03 02:23:45.126461 | instance | TASK [Generate base64 encoded secrets] *****************************************
2026-04-03 02:23:45.126614 | instance | Friday 03 April 2026  02:23:45 +0000 (0:00:00.398)       0:00:12.122 **********
2026-04-03 02:23:45.165299 | instance | ok: [localhost] => (item=barbican_kek)
2026-04-03 02:23:45.165758 | instance |
2026-04-03 02:23:45.166101 | instance | TASK [Generate temporary files for generating keys for missing variables] ******
2026-04-03 02:23:45.166428 | instance | Friday 03 April 2026  02:23:45 +0000 (0:00:00.048)       0:00:12.171 **********
2026-04-03 02:23:45.572920 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-03 02:23:45.573057 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-03 02:23:45.573375 | instance |
2026-04-03 02:23:45.573533 | instance | TASK [Generate SSH keys for missing variables] *********************************
2026-04-03 02:23:45.573686 | instance | Friday 03 April 2026  02:23:45 +0000 (0:00:00.407)       0:00:12.579 **********
2026-04-03 02:23:48.776453 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-03 02:23:48.776662 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-03 02:23:48.776807 | instance |
2026-04-03 02:23:48.776959 | instance | TASK [Set values for SSH keys] *************************************************
2026-04-03 02:23:48.777122 | instance | Friday 03 April 2026  02:23:48 +0000 (0:00:03.202)       0:00:15.781 **********
2026-04-03 02:23:48.831866 | instance | ok: [localhost] => (item=manila_ssh_key)
2026-04-03 02:23:48.831922 | instance | ok: [localhost] => (item=nova_ssh_key)
2026-04-03 02:23:48.831930 | instance |
2026-04-03 02:23:48.831937 | instance | TASK [Delete the temporary files generated for SSH keys] ***********************
2026-04-03 02:23:48.831943 | instance | Friday 03 April 2026  02:23:48 +0000 (0:00:00.056)       0:00:15.838 **********
2026-04-03 02:23:49.179476 | instance | changed: [localhost] => (item=manila_ssh_key)
2026-04-03 02:23:49.179534 | instance | changed: [localhost] => (item=nova_ssh_key)
2026-04-03 02:23:49.179546 | instance |
2026-04-03 02:23:49.179556 | instance | TASK [Write new secrets file to disk] ******************************************
2026-04-03 02:23:49.179567 | instance | Friday 03 April 2026  02:23:49 +0000 (0:00:00.346)       0:00:16.184 **********
2026-04-03 02:23:49.532462 | instance | changed: [localhost]
2026-04-03 02:23:49.532549 | instance |
2026-04-03 02:23:49.532566 | instance | TASK [Encrypt secrets file with Vault password] ********************************
2026-04-03 02:23:49.532882 | instance | Friday 03 April 2026  02:23:49 +0000 (0:00:00.353)       0:00:16.537 **********
2026-04-03 02:23:49.573222 | instance | skipping: [localhost]
2026-04-03 02:23:49.573453 | instance |
2026-04-03 02:23:49.573719 | instance | PLAY [Setup networking] ********************************************************
2026-04-03 02:23:49.573994 | instance |
2026-04-03 02:23:49.574242 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:23:49.574502 | instance | Friday 03 April 2026  02:23:49 +0000 (0:00:00.042)       0:00:16.580 **********
2026-04-03 02:23:50.301779 | instance | ok: [instance]
2026-04-03 02:23:50.302005 | instance |
2026-04-03 02:23:50.302387 | instance | TASK [Create bridge for management network] ************************************
2026-04-03 02:23:50.302698 | instance | Friday 03 April 2026  02:23:50 +0000 (0:00:00.727)       0:00:17.308 **********
2026-04-03 02:23:50.631139 | instance | ok: [instance]
2026-04-03 02:23:50.631566 | instance |
2026-04-03 02:23:50.631966 | instance | TASK [Create fake interface for management bridge] *****************************
2026-04-03 02:23:50.632383 | instance | Friday 03 April 2026  02:23:50 +0000 (0:00:00.329)       0:00:17.637 **********
2026-04-03 02:23:50.850236 | instance | ok: [instance]
2026-04-03 02:23:50.850480 | instance |
2026-04-03 02:23:50.850783 | instance | TASK [Assign dummy interface to management bridge] *****************************
2026-04-03 02:23:50.851057 | instance | Friday 03 April 2026  02:23:50 +0000 (0:00:00.209)       0:00:17.847 **********
2026-04-03 02:23:51.057004 | instance | ok: [instance]
2026-04-03 02:23:51.057235 | instance |
2026-04-03 02:23:51.057507 | instance | TASK [Assign IP address for management bridge] *********************************
2026-04-03 02:23:51.057835 | instance | Friday 03 April 2026  02:23:51 +0000 (0:00:00.216)       0:00:18.063 **********
2026-04-03 02:23:51.269137 | instance | ok: [instance]
2026-04-03 02:23:51.269377 | instance |
2026-04-03 02:23:51.269751 | instance | TASK [Bring up interfaces] *****************************************************
2026-04-03 02:23:51.270054 | instance | Friday 03 April 2026  02:23:51 +0000 (0:00:00.212)       0:00:18.275 **********
2026-04-03 02:23:51.648906 | instance | ok: [instance] => (item=br-mgmt)
2026-04-03 02:23:51.649395 | instance | ok: [instance] => (item=dummy0)
2026-04-03 02:23:51.649761 | instance |
2026-04-03 02:23:51.650127 | instance | PLAY [Create devices for Ceph] *************************************************
2026-04-03 02:23:51.650473 | instance |
2026-04-03 02:23:51.650832 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:23:51.651188 | instance | Friday 03 April 2026  02:23:51 +0000 (0:00:00.379)       0:00:18.655 **********
2026-04-03 02:23:52.452656 | instance | ok: [instance]
2026-04-03 02:23:52.452989 | instance |
2026-04-03 02:23:52.453266 | instance | TASK [Install depedencies] *****************************************************
2026-04-03 02:23:52.453451 | instance | Friday 03 April 2026  02:23:52 +0000 (0:00:00.800)       0:00:19.456 **********
2026-04-03 02:24:24.635624 | instance | changed: [instance]
2026-04-03 02:24:24.635707 | instance |
2026-04-03 02:24:24.635720 | instance | TASK [Start up service] ********************************************************
2026-04-03 02:24:24.635731 | instance | Friday 03 April 2026  02:24:24 +0000 (0:00:32.184)       0:00:51.641 **********
2026-04-03 02:24:25.195105 | instance | ok: [instance]
2026-04-03 02:24:25.195186 | instance |
2026-04-03 02:24:25.195199 | instance | TASK [Generate lvm.conf] *******************************************************
2026-04-03 02:24:25.195254 | instance | Friday 03 April 2026  02:24:25 +0000 (0:00:00.559)       0:00:52.200 **********
2026-04-03 02:24:25.431695 | instance | ok: [instance]
2026-04-03 02:24:25.432100 | instance |
2026-04-03 02:24:25.432506 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-03 02:24:25.432868 | instance | Friday 03 April 2026  02:24:25 +0000 (0:00:00.237)       0:00:52.438 **********
2026-04-03 02:24:25.963454 | instance | changed: [instance]
2026-04-03 02:24:25.963845 | instance |
2026-04-03 02:24:25.964188 | instance | TASK [Get list of all loopback devices] ****************************************
2026-04-03 02:24:25.964586 | instance | Friday 03 April 2026  02:24:25 +0000 (0:00:00.531)       0:00:52.970 **********
2026-04-03 02:24:26.182520 | instance | ok: [instance]
2026-04-03 02:24:26.182658 | instance |
2026-04-03 02:24:26.182920 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-04-03 02:24:26.183182 | instance | Friday 03 April 2026  02:24:26 +0000 (0:00:00.219)       0:00:53.189 **********
2026-04-03 02:24:26.212941 | instance | skipping: [instance]
2026-04-03 02:24:26.213063 | instance |
2026-04-03 02:24:26.213296 | instance | TASK [Create devices for Ceph] *************************************************
2026-04-03 02:24:26.213515 | instance | Friday 03 April 2026  02:24:26 +0000 (0:00:00.028)       0:00:53.217 **********
2026-04-03 02:24:26.828889 | instance | changed: [instance] => (item=osd0)
2026-04-03 02:24:26.828950 | instance | changed: [instance] => (item=osd1)
2026-04-03 02:24:26.829070 | instance | changed: [instance] => (item=osd2)
2026-04-03 02:24:26.829226 | instance |
2026-04-03 02:24:26.829379 | instance | TASK [Set permissions on loopback devices] *************************************
2026-04-03 02:24:26.829529 | instance | Friday 03 April 2026  02:24:26 +0000 (0:00:00.615)       0:00:53.832 **********
2026-04-03 02:24:27.416122 | instance | changed: [instance] => (item=osd0)
2026-04-03 02:24:27.416338 | instance | changed: [instance] => (item=osd1)
2026-04-03 02:24:27.416495 | instance | changed: [instance] => (item=osd2)
2026-04-03 02:24:27.416642 | instance |
2026-04-03 02:24:27.416811 | instance | TASK [Start loop devices] ******************************************************
2026-04-03 02:24:27.416963 | instance | Friday 03 April 2026  02:24:27 +0000 (0:00:00.587)       0:00:54.420 **********
2026-04-03 02:24:28.151151 | instance | changed: [instance] => (item=osd0)
2026-04-03 02:24:28.151203 | instance | changed: [instance] => (item=osd1)
2026-04-03 02:24:28.151214 | instance | changed: [instance] => (item=osd2)
2026-04-03 02:24:28.151224 | instance |
2026-04-03 02:24:28.151234 | instance | TASK [Create a volume group for each loop device] ******************************
2026-04-03 02:24:28.151243 | instance | Friday 03 April 2026  02:24:28 +0000 (0:00:00.736)       0:00:55.156 **********
2026-04-03 02:24:31.299681 | instance | changed: [instance] => (item=osd0)
2026-04-03 02:24:31.299736 | instance | changed: [instance] => (item=osd1)
2026-04-03 02:24:31.299746 | instance | changed: [instance] => (item=osd2)
2026-04-03 02:24:31.299754 | instance |
2026-04-03 02:24:31.299763 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-04-03 02:24:31.299771 | instance | Friday 03 April 2026  02:24:31 +0000 (0:00:03.148)       0:00:58.305 **********
2026-04-03 02:24:33.285077 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-04-03 02:24:33.285549 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-04-03 02:24:33.285908 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-04-03 02:24:33.286238 | instance |
2026-04-03 02:24:33.286583 | instance | PLAY [controllers] *************************************************************
2026-04-03 02:24:33.286911 | instance |
2026-04-03 02:24:33.287261 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:24:33.287604 | instance | Friday 03 April 2026  02:24:33 +0000 (0:00:01.986)       0:01:00.291 **********
2026-04-03 02:24:34.207997 | instance | ok: [instance]
2026-04-03 02:24:34.208565 | instance |
2026-04-03 02:24:34.208730 | instance | TASK [Set masquerade rule] *****************************************************
2026-04-03 02:24:34.208910 | instance | Friday 03 April 2026  02:24:34 +0000 (0:00:00.917)       0:01:01.209 **********
2026-04-03 02:24:34.694406 | instance | changed: [instance]
2026-04-03 02:24:34.696899 | instance |
2026-04-03 02:24:34.697207 | instance | PLAY RECAP *********************************************************************
2026-04-03 02:24:34.697472 | instance | instance                   : ok=24   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-03 02:24:34.697705 | instance | localhost                  : ok=40   changed=21   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-03 02:24:34.697912 | instance |
2026-04-03 02:24:34.698149 | instance | Friday 03 April 2026  02:24:34 +0000 (0:00:00.491)       0:01:01.700 **********
2026-04-03 02:24:34.698368 | instance | ===============================================================================
2026-04-03 02:24:34.698604 | instance | Install depedencies ---------------------------------------------------- 32.18s
2026-04-03 02:24:34.698821 | instance | Generate SSH keys for missing variables --------------------------------- 3.20s
2026-04-03 02:24:34.699037 | instance | Create a volume group for each loop device ------------------------------ 3.15s
2026-04-03 02:24:34.699276 | instance | Create a logical volume for each loop device ---------------------------- 1.99s
2026-04-03 02:24:34.699488 | instance | Gathering Facts --------------------------------------------------------- 1.25s
2026-04-03 02:24:34.699699 | instance | Install "dirmngr" for GPG keyserver operations -------------------------- 1.17s
2026-04-03 02:24:34.699907 | instance | Create folders for workspace -------------------------------------------- 0.98s
2026-04-03 02:24:34.700137 | instance | Gathering Facts --------------------------------------------------------- 0.92s
2026-04-03 02:24:34.700458 | instance | Generate endpoint skeleton for missing variables ------------------------ 0.82s
2026-04-03 02:24:34.700685 | instance | Gathering Facts --------------------------------------------------------- 0.80s
2026-04-03 02:24:34.700896 | instance | Purge "snapd" package --------------------------------------------------- 0.78s
2026-04-03 02:24:34.701142 | instance | Start loop devices ------------------------------------------------------ 0.74s
2026-04-03 02:24:34.701371 | instance | Gathering Facts --------------------------------------------------------- 0.73s
2026-04-03 02:24:34.701580 | instance | Gathering Facts --------------------------------------------------------- 0.71s
2026-04-03 02:24:34.701789 | instance | Configure short hostname ------------------------------------------------ 0.71s
2026-04-03 02:24:34.701999 | instance | Create devices for Ceph ------------------------------------------------- 0.62s
2026-04-03 02:24:34.702233 | instance | Set permissions on loopback devices ------------------------------------- 0.59s
2026-04-03 02:24:34.702449 | instance | Write new Ceph control plane configuration file to disk ----------------- 0.58s
2026-04-03 02:24:34.702662 | instance | Start up service -------------------------------------------------------- 0.56s
2026-04-03 02:24:34.702870 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.53s
2026-04-03 02:24:34.771402 | instance | INFO     [aio > prepare] Executed: Successful
2026-04-03 02:24:34.785509 | instance | INFO     [aio > converge] Executing
2026-04-03 02:24:37.802435 | instance |
2026-04-03 02:24:37.803056 | instance | PLAY [all] *********************************************************************
2026-04-03 02:24:37.803470 | instance |
2026-04-03 02:24:37.804140 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:24:37.804773 | instance | Friday 03 April 2026  02:24:37 +0000 (0:00:00.017)       0:00:00.017 **********
2026-04-03 02:24:39.045228 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-04-03 02:24:39.045638 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-04-03 02:24:39.045988 | instance | interpreter could change the meaning of that path. See
2026-04-03 02:24:39.046326 | instance | https://docs.ansible.com/ansible-
2026-04-03 02:24:39.046725 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-04-03 02:24:39.057313 | instance | ok: [instance]
2026-04-03 02:24:39.057643 | instance |
2026-04-03 02:24:39.057975 | instance | TASK [Fail if atmosphere_ceph_enabled is set] **********************************
2026-04-03 02:24:39.058302 | instance | Friday 03 April 2026  02:24:39 +0000 (0:00:01.255)       0:00:01.272 **********
2026-04-03 02:24:39.099132 | instance | skipping: [instance]
2026-04-03 02:24:39.099465 | instance |
2026-04-03 02:24:39.099802 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-03 02:24:39.100125 | instance | Friday 03 April 2026  02:24:39 +0000 (0:00:00.041)       0:00:01.314 **********
2026-04-03 02:24:39.291466 | instance | ok: [instance]
2026-04-03 02:24:39.291817 | instance |
2026-04-03 02:24:39.292155 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-03 02:24:39.292521 | instance |
2026-04-03 02:24:39.292855 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:24:39.293214 | instance | Friday 03 April 2026  02:24:39 +0000 (0:00:00.192)       0:00:01.507 **********
2026-04-03 02:24:40.180176 | instance | ok: [instance]
2026-04-03 02:24:40.180602 | instance |
2026-04-03 02:24:40.180945 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:24:40.181275 | instance | Friday 03 April 2026  02:24:40 +0000 (0:00:00.888)       0:00:02.395 **********
2026-04-03 02:24:40.468870 | instance | ok: [instance]
2026-04-03 02:24:40.468997 | instance |
2026-04-03 02:24:40.469205 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:24:40.469364 | instance | Friday 03 April 2026  02:24:40 +0000 (0:00:00.285)       0:00:02.680 **********
2026-04-03 02:24:40.512012 | instance | skipping: [instance]
2026-04-03 02:24:40.512195 | instance |
2026-04-03 02:24:40.512398 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-03 02:24:40.512558 | instance | Friday 03 April 2026  02:24:40 +0000 (0:00:00.045)       0:00:02.726 **********
2026-04-03 02:24:40.895645 | instance | changed: [instance]
2026-04-03 02:24:40.895688 | instance |
2026-04-03 02:24:40.895695 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:24:40.895702 | instance | Friday 03 April 2026  02:24:40 +0000 (0:00:00.384)       0:00:03.110 **********
2026-04-03 02:24:40.971678 | instance | ok: [instance] => {
2026-04-03 02:24:40.971721 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-04-03 02:24:40.971727 | instance | }
2026-04-03 02:24:40.971732 | instance |
2026-04-03 02:24:40.971736 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:24:40.971741 | instance | Friday 03 April 2026  02:24:40 +0000 (0:00:00.075)       0:00:03.186 **********
2026-04-03 02:24:41.807790 | instance | changed: [instance]
2026-04-03 02:24:41.807828 | instance |
2026-04-03 02:24:41.807835 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:24:41.807842 | instance | Friday 03 April 2026  02:24:41 +0000 (0:00:00.836)       0:00:04.022 **********
2026-04-03 02:24:41.868514 | instance | skipping: [instance]
2026-04-03 02:24:41.868593 | instance |
2026-04-03 02:24:41.868668 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:24:41.868785 | instance | Friday 03 April 2026  02:24:41 +0000 (0:00:00.061)       0:00:04.084 **********
2026-04-03 02:24:41.922992 | instance | skipping: [instance]
2026-04-03 02:24:41.923086 | instance |
2026-04-03 02:24:41.923208 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:24:41.923332 | instance | Friday 03 April 2026  02:24:41 +0000 (0:00:00.054)       0:00:04.138 **********
2026-04-03 02:24:42.131897 | instance | ok: [instance]
2026-04-03 02:24:42.132164 | instance |
2026-04-03 02:24:42.132682 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:24:42.132974 | instance | Friday 03 April 2026  02:24:42 +0000 (0:00:00.208)       0:00:04.347 **********
2026-04-03 02:24:43.518641 | instance | ok: [instance]
2026-04-03 02:24:43.518737 | instance |
2026-04-03 02:24:43.518751 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:24:43.518762 | instance | Friday 03 April 2026  02:24:43 +0000 (0:00:01.385)       0:00:05.732 **********
2026-04-03 02:24:43.590749 | instance | ok: [instance] => {
2026-04-03 02:24:43.590831 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-04-03 02:24:43.590952 | instance | }
2026-04-03 02:24:43.591156 | instance |
2026-04-03 02:24:43.591346 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:24:43.591501 | instance | Friday 03 April 2026  02:24:43 +0000 (0:00:00.073)       0:00:05.805 **********
2026-04-03 02:24:44.301779 | instance | changed: [instance]
2026-04-03 02:24:44.301864 | instance |
2026-04-03 02:24:44.301931 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:24:44.302090 | instance | Friday 03 April 2026  02:24:44 +0000 (0:00:00.710)       0:00:06.516 **********
2026-04-03 02:24:47.230663 | instance | changed: [instance]
2026-04-03 02:24:47.230750 | instance |
2026-04-03 02:24:47.230866 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-03 02:24:47.231073 | instance | Friday 03 April 2026  02:24:47 +0000 (0:00:02.929)       0:00:09.446 **********
2026-04-03 02:24:47.277188 | instance | skipping: [instance]
2026-04-03 02:24:47.277258 | instance |
2026-04-03 02:24:47.277442 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-03 02:24:47.277661 | instance | Friday 03 April 2026  02:24:47 +0000 (0:00:00.042)       0:00:09.489 **********
2026-04-03 02:24:47.313061 | instance | skipping: [instance]
2026-04-03 02:24:47.313248 | instance |
2026-04-03 02:24:47.313409 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-03 02:24:47.313562 | instance | Friday 03 April 2026  02:24:47 +0000 (0:00:00.038)       0:00:09.527 **********
2026-04-03 02:24:47.352938 | instance | skipping: [instance]
2026-04-03 02:24:47.353037 | instance |
2026-04-03 02:24:47.353164 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-03 02:24:47.353353 | instance | Friday 03 April 2026  02:24:47 +0000 (0:00:00.039)       0:00:09.566 **********
2026-04-03 02:24:53.513341 | instance | changed: [instance]
2026-04-03 02:24:53.513746 | instance |
2026-04-03 02:24:53.514108 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-03 02:24:53.514540 | instance | Friday 03 April 2026  02:24:53 +0000 (0:00:06.158)       0:00:15.725 **********
2026-04-03 02:24:54.141253 | instance | changed: [instance]
2026-04-03 02:24:54.141347 | instance |
2026-04-03 02:24:54.141542 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-03 02:24:54.141768 | instance | Friday 03 April 2026  02:24:54 +0000 (0:00:00.630)       0:00:16.356 **********
2026-04-03 02:24:55.063876 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-04-03 02:24:55.063985 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-03 02:24:55.064076 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-03 02:24:55.064409 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-03 02:24:55.064473 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-03 02:24:55.064491 | instance |
2026-04-03 02:24:55.064712 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-03 02:24:55.064832 | instance | Friday 03 April 2026  02:24:55 +0000 (0:00:00.923)       0:00:17.279 **********
2026-04-03 02:24:55.632909 | instance | changed: [instance]
2026-04-03 02:24:55.632991 | instance |
2026-04-03 02:24:55.633896 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-03 02:24:55.633960 | instance | Friday 03 April 2026  02:24:55 +0000 (0:00:00.556)       0:00:17.835 **********
2026-04-03 02:24:55.633966 | instance |
2026-04-03 02:24:55.633972 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-03 02:24:55.633976 | instance | Friday 03 April 2026  02:24:55 +0000 (0:00:00.012)       0:00:17.848 **********
2026-04-03 02:24:56.587513 | instance | ok: [instance]
2026-04-03 02:24:56.587618 | instance |
2026-04-03 02:24:56.587858 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-03 02:24:56.587903 | instance | Friday 03 April 2026  02:24:56 +0000 (0:00:00.954)       0:00:18.803 **********
2026-04-03 02:24:57.038817 | instance | changed: [instance]
2026-04-03 02:24:57.038911 | instance |
2026-04-03 02:24:57.039248 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-03 02:24:57.039323 | instance | Friday 03 April 2026  02:24:57 +0000 (0:00:00.450)       0:00:19.253 **********
2026-04-03 02:24:57.590380 | instance | changed: [instance]
2026-04-03 02:24:57.590523 | instance |
2026-04-03 02:24:57.590536 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:24:57.590615 | instance | Friday 03 April 2026  02:24:57 +0000 (0:00:00.552)       0:00:19.805 **********
2026-04-03 02:24:57.810609 | instance | ok: [instance]
2026-04-03 02:24:57.810678 | instance |
2026-04-03 02:24:57.810687 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:24:57.810711 | instance | Friday 03 April 2026  02:24:57 +0000 (0:00:00.219)       0:00:20.025 **********
2026-04-03 02:24:57.868663 | instance | ok: [instance] => {
2026-04-03 02:24:57.868767 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-03 02:24:57.869225 | instance | }
2026-04-03 02:24:57.869281 | instance |
2026-04-03 02:24:57.869287 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:24:57.869292 | instance | Friday 03 April 2026  02:24:57 +0000 (0:00:00.059)       0:00:20.084 **********
2026-04-03 02:24:59.080347 | instance | changed: [instance]
2026-04-03 02:24:59.080436 | instance |
2026-04-03 02:24:59.080704 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:24:59.080746 | instance | Friday 03 April 2026  02:24:59 +0000 (0:00:01.211)       0:00:21.295 **********
2026-04-03 02:25:03.950340 | instance | changed: [instance]
2026-04-03 02:25:03.950410 | instance |
2026-04-03 02:25:03.950690 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-03 02:25:03.950728 | instance | Friday 03 April 2026  02:25:03 +0000 (0:00:04.870)       0:00:26.165 **********
2026-04-03 02:25:05.189772 | instance | ok: [instance]
2026-04-03 02:25:05.189908 | instance |
2026-04-03 02:25:05.189922 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-03 02:25:05.190079 | instance | Friday 03 April 2026  02:25:05 +0000 (0:00:01.239)       0:00:27.405 **********
2026-04-03 02:25:07.549043 | instance | changed: [instance]
2026-04-03 02:25:07.549141 | instance |
2026-04-03 02:25:07.549205 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-03 02:25:07.549337 | instance | Friday 03 April 2026  02:25:07 +0000 (0:00:02.355)       0:00:29.760 **********
2026-04-03 02:25:08.017628 | instance | changed: [instance]
2026-04-03 02:25:08.017732 | instance |
2026-04-03 02:25:08.017754 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-03 02:25:08.017834 | instance | Friday 03 April 2026  02:25:08 +0000 (0:00:00.472)       0:00:30.232 **********
2026-04-03 02:25:08.620368 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-04-03 02:25:08.620644 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-03 02:25:08.621187 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-03 02:25:08.621204 | instance |
2026-04-03 02:25:08.621466 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-03 02:25:08.621723 | instance | Friday 03 April 2026  02:25:08 +0000 (0:00:00.592)       0:00:30.825 **********
2026-04-03 02:25:09.103601 | instance | changed: [instance]
2026-04-03 02:25:09.103815 | instance |
2026-04-03 02:25:09.104111 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-03 02:25:09.104432 | instance | Friday 03 April 2026  02:25:09 +0000 (0:00:00.493)       0:00:31.318 **********
2026-04-03 02:25:09.585676 | instance | changed: [instance]
2026-04-03 02:25:09.585901 | instance |
2026-04-03 02:25:09.586183 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-03 02:25:09.586454 | instance | Friday 03 April 2026  02:25:09 +0000 (0:00:00.473)       0:00:31.791 **********
2026-04-03 02:25:09.586743 | instance |
2026-04-03 02:25:09.587013 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-03 02:25:09.587278 | instance | Friday 03 April 2026  02:25:09 +0000 (0:00:00.008)       0:00:31.800 **********
2026-04-03 02:25:10.323519 | instance | ok: [instance]
2026-04-03 02:25:10.323858 | instance |
2026-04-03 02:25:10.323872 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-03 02:25:10.323883 | instance | Friday 03 April 2026  02:25:10 +0000 (0:00:00.737)       0:00:32.537 **********
2026-04-03 02:25:14.410316 | instance | changed: [instance]
2026-04-03 02:25:14.410380 | instance |
2026-04-03 02:25:14.410630 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-03 02:25:14.410650 | instance | Friday 03 April 2026  02:25:14 +0000 (0:00:04.088)       0:00:36.625 **********
2026-04-03 02:25:14.994833 | instance | changed: [instance]
2026-04-03 02:25:14.994937 | instance |
2026-04-03 02:25:14.995301 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-03 02:25:14.995341 | instance | Friday 03 April 2026  02:25:14 +0000 (0:00:00.584)       0:00:37.210 **********
2026-04-03 02:25:15.054136 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-03 02:25:15.054198 | instance |
2026-04-03 02:25:15.054467 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-03 02:25:15.054483 | instance | Friday 03 April 2026  02:25:15 +0000 (0:00:00.059)       0:00:37.269 **********
2026-04-03 02:25:21.227369 | instance | changed: [instance]
2026-04-03 02:25:21.227453 | instance |
2026-04-03 02:25:21.227840 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-03 02:25:21.227885 | instance | Friday 03 April 2026  02:25:21 +0000 (0:00:06.172)       0:00:43.442 **********
2026-04-03 02:25:21.908975 | instance | ok: [instance] => (item=chronyd)
2026-04-03 02:25:21.909056 | instance | ok: [instance] => (item=sshd)
2026-04-03 02:25:21.909458 | instance |
2026-04-03 02:25:21.909501 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-03 02:25:21.909507 | instance | Friday 03 April 2026  02:25:21 +0000 (0:00:00.682)       0:00:44.124 **********
2026-04-03 02:25:22.627049 | instance | changed: [instance]
2026-04-03 02:25:22.627399 | instance |
2026-04-03 02:25:22.627414 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-03 02:25:22.627419 | instance | Friday 03 April 2026  02:25:22 +0000 (0:00:00.718)       0:00:44.842 **********
2026-04-03 02:25:22.819685 | instance | ok: [instance]
2026-04-03 02:25:22.819755 | instance |
2026-04-03 02:25:22.819979 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-03 02:25:22.819996 | instance | Friday 03 April 2026  02:25:22 +0000 (0:00:00.192)       0:00:45.035 **********
2026-04-03 02:25:23.295986 | instance | changed: [instance]
2026-04-03 02:25:23.296059 | instance |
2026-04-03 02:25:23.296368 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-03 02:25:23.296411 | instance | Friday 03 April 2026  02:25:23 +0000 (0:00:00.476)       0:00:45.511 **********
2026-04-03 02:25:23.673305 | instance | changed: [instance]
2026-04-03 02:25:23.673369 | instance |
2026-04-03 02:25:23.673636 | instance | TASK [vexxhost.ceph.mon : Get `cephadm ls` status] *****************************
2026-04-03 02:25:23.673672 | instance | Friday 03 April 2026  02:25:23 +0000 (0:00:00.377)       0:00:45.888 **********
2026-04-03 02:25:25.336512 | instance | ok: [instance]
2026-04-03 02:25:25.336577 | instance |
2026-04-03 02:25:25.336837 | instance | TASK [vexxhost.ceph.mon : Parse the `cephadm ls` output] ***********************
2026-04-03 02:25:25.336876 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:01.663)       0:00:47.552 **********
2026-04-03 02:25:25.405346 | instance | ok: [instance]
2026-04-03 02:25:25.405412 | instance |
2026-04-03 02:25:25.405683 | instance | TASK [vexxhost.ceph.mon : Assimilate existing configs in `ceph.conf`] **********
2026-04-03 02:25:25.405725 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.068)       0:00:47.620 **********
2026-04-03 02:25:25.446477 | instance | skipping: [instance]
2026-04-03 02:25:25.446583 | instance |
2026-04-03 02:25:25.446881 | instance | TASK [vexxhost.ceph.mon : Adopt monitor to cluster] ****************************
2026-04-03 02:25:25.447117 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.040)       0:00:47.661 **********
2026-04-03 02:25:25.486393 | instance | skipping: [instance]
2026-04-03 02:25:25.486521 | instance |
2026-04-03 02:25:25.486535 | instance | TASK [vexxhost.ceph.mon : Adopt manager to cluster] ****************************
2026-04-03 02:25:25.486711 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.040)       0:00:47.701 **********
2026-04-03 02:25:25.532169 | instance | skipping: [instance]
2026-04-03 02:25:25.532466 | instance |
2026-04-03 02:25:25.532535 | instance | TASK [vexxhost.ceph.mon : Enable "cephadm" mgr module] *************************
2026-04-03 02:25:25.532676 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.045)       0:00:47.747 **********
2026-04-03 02:25:25.578691 | instance | skipping: [instance]
2026-04-03 02:25:25.578757 | instance |
2026-04-03 02:25:25.578898 | instance | TASK [vexxhost.ceph.mon : Set orchestrator backend to "cephadm"] ***************
2026-04-03 02:25:25.579071 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.047)       0:00:47.794 **********
2026-04-03 02:25:25.622553 | instance | skipping: [instance]
2026-04-03 02:25:25.622691 | instance |
2026-04-03 02:25:25.622906 | instance | TASK [vexxhost.ceph.mon : Use `cephadm` user for cephadm] **********************
2026-04-03 02:25:25.623071 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.043)       0:00:47.837 **********
2026-04-03 02:25:25.662951 | instance | skipping: [instance]
2026-04-03 02:25:25.663066 | instance |
2026-04-03 02:25:25.663249 | instance | TASK [vexxhost.ceph.mon : Generate "cephadm" key] ******************************
2026-04-03 02:25:25.663401 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.040)       0:00:47.878 **********
2026-04-03 02:25:25.708973 | instance | skipping: [instance]
2026-04-03 02:25:25.709095 | instance |
2026-04-03 02:25:25.709289 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-03 02:25:25.709456 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.044)       0:00:47.922 **********
2026-04-03 02:25:25.825043 | instance | ok: [instance]
2026-04-03 02:25:25.825285 | instance |
2026-04-03 02:25:25.825500 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-03 02:25:25.825713 | instance | Friday 03 April 2026  02:25:25 +0000 (0:00:00.117)       0:00:48.040 **********
2026-04-03 02:25:26.089470 | instance | ok: [instance] => (item=instance)
2026-04-03 02:25:26.089514 | instance |
2026-04-03 02:25:26.089520 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-03 02:25:26.089525 | instance | Friday 03 April 2026  02:25:26 +0000 (0:00:00.264)       0:00:48.304 **********
2026-04-03 02:25:26.146597 | instance | ok: [instance]
2026-04-03 02:25:26.146640 | instance |
2026-04-03 02:25:26.146645 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-03 02:25:26.146650 | instance | Friday 03 April 2026  02:25:26 +0000 (0:00:00.057)       0:00:48.361 **********
2026-04-03 02:25:26.223227 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-04-03 02:25:26.223268 | instance |
2026-04-03 02:25:26.223274 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-04-03 02:25:26.223279 | instance | Friday 03 April 2026  02:25:26 +0000 (0:00:00.076)       0:00:48.438 **********
2026-04-03 02:25:26.589489 | instance | changed: [instance]
2026-04-03 02:25:26.589585 | instance |
2026-04-03 02:25:26.589906 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-04-03 02:25:26.589975 | instance | Friday 03 April 2026  02:25:26 +0000 (0:00:00.366)       0:00:48.804 **********
2026-04-03 02:25:27.334008 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-04-03 02:25:27.334120 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-04-03 02:25:27.334133 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-04-03 02:25:27.334659 | instance |
2026-04-03 02:25:27.334725 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap coomand] *******************************
2026-04-03 02:25:27.334732 | instance | Friday 03 April 2026  02:25:27 +0000 (0:00:00.744)       0:00:49.548 **********
2026-04-03 02:28:17.875735 | instance | ok: [instance]
2026-04-03 02:28:17.876063 | instance |
2026-04-03 02:28:17.876357 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-04-03 02:28:17.876598 | instance | Friday 03 April 2026  02:28:17 +0000 (0:02:50.538)       0:03:40.086 **********
2026-04-03 02:28:18.111578 | instance | changed: [instance]
2026-04-03 02:28:18.111669 | instance |
2026-04-03 02:28:18.111944 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-04-03 02:28:18.111998 | instance | Friday 03 April 2026  02:28:18 +0000 (0:00:00.240)       0:03:40.327 **********
2026-04-03 02:28:18.156336 | instance | ok: [instance]
2026-04-03 02:28:18.156445 | instance |
2026-04-03 02:28:18.156573 | instance | TASK [Install Ceph host] *******************************************************
2026-04-03 02:28:18.156701 | instance | Friday 03 April 2026  02:28:18 +0000 (0:00:00.044)       0:03:40.371 **********
2026-04-03 02:28:18.238373 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-03 02:28:18.238753 | instance |
2026-04-03 02:28:18.238795 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-03 02:28:18.238801 | instance | Friday 03 April 2026  02:28:18 +0000 (0:00:00.082)       0:03:40.453 **********
2026-04-03 02:28:20.025529 | instance | ok: [instance]
2026-04-03 02:28:20.025647 | instance |
2026-04-03 02:28:20.025972 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-03 02:28:20.026028 | instance | Friday 03 April 2026  02:28:20 +0000 (0:00:01.786)       0:03:42.240 **********
2026-04-03 02:28:20.096517 | instance | ok: [instance] => (item=instance)
2026-04-03 02:28:20.096561 | instance |
2026-04-03 02:28:20.096895 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-03 02:28:20.096935 | instance | Friday 03 April 2026  02:28:20 +0000 (0:00:00.070)       0:03:42.311 **********
2026-04-03 02:28:20.549580 | instance | ok: [instance]
2026-04-03 02:28:20.549876 | instance |
2026-04-03 02:28:20.549897 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-03 02:28:20.550143 | instance | Friday 03 April 2026  02:28:20 +0000 (0:00:00.453)       0:03:42.764 **********
2026-04-03 02:28:22.765518 | instance | ok: [instance]
2026-04-03 02:28:22.765723 | instance |
2026-04-03 02:28:22.766042 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-03 02:28:22.766333 | instance | Friday 03 April 2026  02:28:22 +0000 (0:00:02.215)       0:03:44.980 **********
2026-04-03 02:28:24.505356 | instance | ok: [instance]
2026-04-03 02:28:24.505463 | instance |
2026-04-03 02:28:24.505649 | instance | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-03 02:28:24.505817 | instance | Friday 03 April 2026  02:28:24 +0000 (0:00:01.739)       0:03:46.720 **********
2026-04-03 02:28:34.886443 | instance | ok: [instance]
2026-04-03 02:28:34.886531 | instance |
2026-04-03 02:28:34.886543 | instance | TASK [Install Ceph host] *******************************************************
2026-04-03 02:28:34.886553 | instance | Friday 03 April 2026  02:28:34 +0000 (0:00:10.379)       0:03:57.100 **********
2026-04-03 02:28:34.966097 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-03 02:28:34.966191 | instance |
2026-04-03 02:28:34.966499 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-03 02:28:34.966563 | instance | Friday 03 April 2026  02:28:34 +0000 (0:00:00.080)       0:03:57.181 **********
2026-04-03 02:28:35.027581 | instance | skipping: [instance]
2026-04-03 02:28:35.027678 | instance |
2026-04-03 02:28:35.027986 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-03 02:28:35.028045 | instance | Friday 03 April 2026  02:28:35 +0000 (0:00:00.061)       0:03:57.242 **********
2026-04-03 02:28:35.088286 | instance | skipping: [instance] => (item=instance)
2026-04-03 02:28:35.088396 | instance | skipping: [instance]
2026-04-03 02:28:35.088445 | instance |
2026-04-03 02:28:35.088586 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-03 02:28:35.088708 | instance | Friday 03 April 2026  02:28:35 +0000 (0:00:00.060)       0:03:57.303 **********
2026-04-03 02:28:35.365623 | instance | ok: [instance]
2026-04-03 02:28:35.365797 | instance |
2026-04-03 02:28:35.366124 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-03 02:28:35.366399 | instance | Friday 03 April 2026  02:28:35 +0000 (0:00:00.276)       0:03:57.580 **********
2026-04-03 02:28:37.582563 | instance | ok: [instance]
2026-04-03 02:28:37.582891 | instance |
2026-04-03 02:28:37.583275 | instance | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-03 02:28:37.583656 | instance | Friday 03 April 2026  02:28:37 +0000 (0:00:02.216)       0:03:59.797 **********
2026-04-03 02:28:39.335183 | instance | ok: [instance]
2026-04-03 02:28:39.335262 | instance |
2026-04-03 02:28:39.335275 | instance | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-03 02:28:39.335285 | instance | Friday 03 April 2026  02:28:39 +0000 (0:00:01.751)       0:04:01.549 **********
2026-04-03 02:28:41.091696 | instance | ok: [instance]
2026-04-03 02:28:41.091817 | instance |
2026-04-03 02:28:41.091829 | instance | TASK [vexxhost.ceph.mgr : Enable the Ceph Manager prometheus module] ***********
2026-04-03 02:28:41.091974 | instance | Friday 03 April 2026  02:28:41 +0000 (0:00:01.757)       0:04:03.306 **********
2026-04-03 02:28:43.492084 | instance | ok: [instance]
2026-04-03 02:28:43.492144 | instance |
2026-04-03 02:28:43.492149 | instance | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-03 02:28:43.492154 | instance |
2026-04-03 02:28:43.492158 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:28:43.492163 | instance | Friday 03 April 2026  02:28:43 +0000 (0:00:02.400)       0:04:05.707 **********
2026-04-03 02:28:44.441923 | instance | ok: [instance]
2026-04-03 02:28:44.441977 | instance |
2026-04-03 02:28:44.441983 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:28:44.441987 | instance | Friday 03 April 2026  02:28:44 +0000 (0:00:00.949)       0:04:06.656 **********
2026-04-03 02:28:44.653098 | instance | ok: [instance]
2026-04-03 02:28:44.653146 | instance |
2026-04-03 02:28:44.653152 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:28:44.653156 | instance | Friday 03 April 2026  02:28:44 +0000 (0:00:00.211)       0:04:06.868 **********
2026-04-03 02:28:44.697076 | instance | skipping: [instance]
2026-04-03 02:28:44.697132 | instance |
2026-04-03 02:28:44.697137 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-03 02:28:44.697143 | instance | Friday 03 April 2026  02:28:44 +0000 (0:00:00.043)       0:04:06.911 **********
2026-04-03 02:28:44.900502 | instance | ok: [instance]
2026-04-03 02:28:44.900561 | instance |
2026-04-03 02:28:44.900574 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:28:44.900581 | instance | Friday 03 April 2026  02:28:44 +0000 (0:00:00.203)       0:04:07.115 **********
2026-04-03 02:28:44.955575 | instance | ok: [instance] => {
2026-04-03 02:28:44.955621 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-04-03 02:28:44.955627 | instance | }
2026-04-03 02:28:44.955632 | instance |
2026-04-03 02:28:44.955637 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:28:44.955642 | instance | Friday 03 April 2026  02:28:44 +0000 (0:00:00.054)       0:04:07.170 **********
2026-04-03 02:28:45.281774 | instance | ok: [instance]
2026-04-03 02:28:45.281822 | instance |
2026-04-03 02:28:45.281833 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:28:45.281838 | instance | Friday 03 April 2026  02:28:45 +0000 (0:00:00.326)       0:04:07.496 **********
2026-04-03 02:28:45.331523 | instance | skipping: [instance]
2026-04-03 02:28:45.331576 | instance |
2026-04-03 02:28:45.331581 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:28:45.331586 | instance | Friday 03 April 2026  02:28:45 +0000 (0:00:00.049)       0:04:07.546 **********
2026-04-03 02:28:45.382009 | instance | skipping: [instance]
2026-04-03 02:28:45.382062 | instance |
2026-04-03 02:28:45.382068 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:28:45.382073 | instance | Friday 03 April 2026  02:28:45 +0000 (0:00:00.050)       0:04:07.596 **********
2026-04-03 02:28:45.614403 | instance | ok: [instance]
2026-04-03 02:28:45.614451 | instance |
2026-04-03 02:28:45.614457 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:28:45.614462 | instance | Friday 03 April 2026  02:28:45 +0000 (0:00:00.232)       0:04:07.829 **********
2026-04-03 02:28:46.889693 | instance | ok: [instance]
2026-04-03 02:28:46.889741 | instance |
2026-04-03 02:28:46.889747 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:28:46.889752 | instance | Friday 03 April 2026  02:28:46 +0000 (0:00:01.274)       0:04:09.104 **********
2026-04-03 02:28:46.962507 | instance | ok: [instance] => {
2026-04-03 02:28:46.962554 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-04-03 02:28:46.962560 | instance | }
2026-04-03 02:28:46.962579 | instance |
2026-04-03 02:28:46.962583 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:28:46.962588 | instance | Friday 03 April 2026  02:28:46 +0000 (0:00:00.073)       0:04:09.177 **********
2026-04-03 02:28:47.330058 | instance | ok: [instance]
2026-04-03 02:28:47.330095 | instance |
2026-04-03 02:28:47.330101 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:28:47.330106 | instance | Friday 03 April 2026  02:28:47 +0000 (0:00:00.367)       0:04:09.544 **********
2026-04-03 02:28:49.358572 | instance | ok: [instance]
2026-04-03 02:28:49.358623 | instance |
2026-04-03 02:28:49.358629 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-03 02:28:49.358634 | instance | Friday 03 April 2026  02:28:49 +0000 (0:00:02.028)       0:04:11.573 **********
2026-04-03 02:28:49.397904 | instance | skipping: [instance]
2026-04-03 02:28:49.397966 | instance |
2026-04-03 02:28:49.397972 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-03 02:28:49.397977 | instance | Friday 03 April 2026  02:28:49 +0000 (0:00:00.039)       0:04:11.612 **********
2026-04-03 02:28:49.434991 | instance | skipping: [instance]
2026-04-03 02:28:49.435027 | instance |
2026-04-03 02:28:49.435033 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-03 02:28:49.435038 | instance | Friday 03 April 2026  02:28:49 +0000 (0:00:00.036)       0:04:11.649 **********
2026-04-03 02:28:49.472767 | instance | skipping: [instance]
2026-04-03 02:28:49.472825 | instance |
2026-04-03 02:28:49.472832 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-03 02:28:49.472839 | instance | Friday 03 April 2026  02:28:49 +0000 (0:00:00.037)       0:04:11.687 **********
2026-04-03 02:28:50.545573 | instance | ok: [instance]
2026-04-03 02:28:50.545623 | instance |
2026-04-03 02:28:50.545628 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-03 02:28:50.545634 | instance | Friday 03 April 2026  02:28:50 +0000 (0:00:01.073)       0:04:12.760 **********
2026-04-03 02:28:50.993139 | instance | ok: [instance]
2026-04-03 02:28:50.993182 | instance |
2026-04-03 02:28:50.993188 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-03 02:28:50.993193 | instance | Friday 03 April 2026  02:28:50 +0000 (0:00:00.447)       0:04:13.208 **********
2026-04-03 02:28:51.959845 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-03 02:28:51.959918 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-03 02:28:51.959924 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-03 02:28:51.959929 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-03 02:28:51.959933 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-03 02:28:51.959939 | instance |
2026-04-03 02:28:51.959943 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-03 02:28:51.959947 | instance | Friday 03 April 2026  02:28:51 +0000 (0:00:00.966)       0:04:14.174 **********
2026-04-03 02:28:52.476848 | instance | ok: [instance]
2026-04-03 02:28:52.476883 | instance |
2026-04-03 02:28:52.476889 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-03 02:28:52.476895 | instance | Friday 03 April 2026  02:28:52 +0000 (0:00:00.510)       0:04:14.684 **********
2026-04-03 02:28:52.476899 | instance |
2026-04-03 02:28:52.476903 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-03 02:28:52.476907 | instance | Friday 03 April 2026  02:28:52 +0000 (0:00:00.006)       0:04:14.691 **********
2026-04-03 02:28:52.859407 | instance | ok: [instance]
2026-04-03 02:28:52.859458 | instance |
2026-04-03 02:28:52.859464 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:28:52.859469 | instance | Friday 03 April 2026  02:28:52 +0000 (0:00:00.382)       0:04:15.074 **********
2026-04-03 02:28:53.080694 | instance | ok: [instance]
2026-04-03 02:28:53.080754 | instance |
2026-04-03 02:28:53.080763 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:28:53.080787 | instance | Friday 03 April 2026  02:28:53 +0000 (0:00:00.221)       0:04:15.295 **********
2026-04-03 02:28:53.136888 | instance | ok: [instance] => {
2026-04-03 02:28:53.136941 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-03 02:28:53.136947 | instance | }
2026-04-03 02:28:53.136951 | instance |
2026-04-03 02:28:53.136956 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:28:53.136961 | instance | Friday 03 April 2026  02:28:53 +0000 (0:00:00.055)       0:04:15.351 **********
2026-04-03 02:28:53.504462 | instance | ok: [instance]
2026-04-03 02:28:53.504512 | instance |
2026-04-03 02:28:53.504519 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:28:53.504524 | instance | Friday 03 April 2026  02:28:53 +0000 (0:00:00.368)       0:04:15.719 **********
2026-04-03 02:28:56.645263 | instance | ok: [instance]
2026-04-03 02:28:56.645322 | instance |
2026-04-03 02:28:56.645328 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-03 02:28:56.645333 | instance | Friday 03 April 2026  02:28:56 +0000 (0:00:03.140)       0:04:18.859 **********
2026-04-03 02:28:57.688521 | instance | ok: [instance]
2026-04-03 02:28:57.688639 | instance |
2026-04-03 02:28:57.688652 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-03 02:28:57.688807 | instance | Friday 03 April 2026  02:28:57 +0000 (0:00:01.043)       0:04:19.903 **********
2026-04-03 02:28:57.882832 | instance | ok: [instance]
2026-04-03 02:28:57.882909 | instance |
2026-04-03 02:28:57.883181 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-03 02:28:57.883246 | instance | Friday 03 April 2026  02:28:57 +0000 (0:00:00.194)       0:04:20.097 **********
2026-04-03 02:28:58.338437 | instance | ok: [instance]
2026-04-03 02:28:58.338522 | instance |
2026-04-03 02:28:58.338626 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-03 02:28:58.338750 | instance | Friday 03 April 2026  02:28:58 +0000 (0:00:00.455)       0:04:20.553 **********
2026-04-03 02:28:58.974871 | instance | ok: [instance] => (item={'path': '/etc/docker'})
2026-04-03 02:28:58.974977 | instance | ok: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-03 02:28:58.975065 | instance | ok: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-03 02:28:58.975172 | instance |
2026-04-03 02:28:58.975305 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-03 02:28:58.975422 | instance | Friday 03 April 2026  02:28:58 +0000 (0:00:00.636)       0:04:21.190 **********
2026-04-03 02:28:59.415043 | instance | ok: [instance]
2026-04-03 02:28:59.415148 | instance |
2026-04-03 02:28:59.415296 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-03 02:28:59.415468 | instance | Friday 03 April 2026  02:28:59 +0000 (0:00:00.439)       0:04:21.630 **********
2026-04-03 02:28:59.865771 | instance | ok: [instance]
2026-04-03 02:28:59.865900 | instance |
2026-04-03 02:28:59.866019 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-03 02:28:59.866159 | instance | Friday 03 April 2026  02:28:59 +0000 (0:00:00.444)       0:04:22.074 **********
2026-04-03 02:28:59.866260 | instance |
2026-04-03 02:28:59.866381 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-03 02:28:59.866504 | instance | Friday 03 April 2026  02:28:59 +0000 (0:00:00.007)       0:04:22.081 **********
2026-04-03 02:29:00.248831 | instance | ok: [instance]
2026-04-03 02:29:00.248934 | instance |
2026-04-03 02:29:00.248959 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-03 02:29:00.248970 | instance | Friday 03 April 2026  02:29:00 +0000 (0:00:00.382)       0:04:22.464 **********
2026-04-03 02:29:00.318704 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-04-03 02:29:00.318804 | instance |
2026-04-03 02:29:00.318881 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-03 02:29:00.319021 | instance | Friday 03 April 2026  02:29:00 +0000 (0:00:00.070)       0:04:22.534 **********
2026-04-03 02:29:01.657335 | instance | ok: [instance]
2026-04-03 02:29:01.657444 | instance |
2026-04-03 02:29:01.657511 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-03 02:29:01.657678 | instance | Friday 03 April 2026  02:29:01 +0000 (0:00:01.338)       0:04:23.872 **********
2026-04-03 02:29:02.351143 | instance | ok: [instance] => (item=chronyd)
2026-04-03 02:29:02.351235 | instance | ok: [instance] => (item=sshd)
2026-04-03 02:29:02.351566 | instance |
2026-04-03 02:29:02.351583 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-03 02:29:02.351588 | instance | Friday 03 April 2026  02:29:02 +0000 (0:00:00.693)       0:04:24.566 **********
2026-04-03 02:29:03.080237 | instance | ok: [instance]
2026-04-03 02:29:03.080374 | instance |
2026-04-03 02:29:03.080422 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-03 02:29:03.080610 | instance | Friday 03 April 2026  02:29:03 +0000 (0:00:00.729)       0:04:25.295 **********
2026-04-03 02:29:03.278305 | instance | ok: [instance]
2026-04-03 02:29:03.278380 | instance |
2026-04-03 02:29:03.278634 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-03 02:29:03.278684 | instance | Friday 03 April 2026  02:29:03 +0000 (0:00:00.198)       0:04:25.493 **********
2026-04-03 02:29:03.536916 | instance | ok: [instance]
2026-04-03 02:29:03.536954 | instance |
2026-04-03 02:29:03.536960 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-03 02:29:03.536965 | instance | Friday 03 April 2026  02:29:03 +0000 (0:00:00.258)       0:04:25.751 **********
2026-04-03 02:29:03.743077 | instance | ok: [instance]
2026-04-03 02:29:03.743171 | instance |
2026-04-03 02:29:03.743457 | instance | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-03 02:29:03.743506 | instance | Friday 03 April 2026  02:29:03 +0000 (0:00:00.206)       0:04:25.958 **********
2026-04-03 02:29:03.983055 | instance | ok: [instance] => (item=instance)
2026-04-03 02:29:03.983123 | instance |
2026-04-03 02:29:03.983262 | instance | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-03 02:29:03.983407 | instance | Friday 03 April 2026  02:29:03 +0000 (0:00:00.239)       0:04:26.198 **********
2026-04-03 02:29:04.039321 | instance | ok: [instance]
2026-04-03 02:29:04.039739 | instance |
2026-04-03 02:29:04.039802 | instance | TASK [vexxhost.ceph.osd : Get `cephadm ls` status] *****************************
2026-04-03 02:29:04.039809 | instance | Friday 03 April 2026  02:29:04 +0000 (0:00:00.056)       0:04:26.254 **********
2026-04-03 02:29:09.358676 | instance | ok: [instance]
2026-04-03 02:29:09.358847 | instance |
2026-04-03 02:29:09.358915 | instance | TASK [vexxhost.ceph.osd : Parse the `cephadm ls` output] ***********************
2026-04-03 02:29:09.359106 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:05.314)       0:04:31.568 **********
2026-04-03 02:29:09.410676 | instance | ok: [instance]
2026-04-03 02:29:09.410779 | instance |
2026-04-03 02:29:09.410993 | instance | TASK [Install Ceph host] *******************************************************
2026-04-03 02:29:09.411188 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:00.057)       0:04:31.625 **********
2026-04-03 02:29:09.477002 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-04-03 02:29:09.477230 | instance |
2026-04-03 02:29:09.477506 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-03 02:29:09.477777 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:00.065)       0:04:31.691 **********
2026-04-03 02:29:09.524217 | instance | skipping: [instance]
2026-04-03 02:29:09.524346 | instance |
2026-04-03 02:29:09.524561 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-03 02:29:09.524734 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:00.047)       0:04:31.739 **********
2026-04-03 02:29:09.574397 | instance | skipping: [instance] => (item=instance)
2026-04-03 02:29:09.574506 | instance | skipping: [instance]
2026-04-03 02:29:09.574639 | instance |
2026-04-03 02:29:09.574793 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-03 02:29:09.574991 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:00.050)       0:04:31.789 **********
2026-04-03 02:29:09.834595 | instance | ok: [instance]
2026-04-03 02:29:09.834717 | instance |
2026-04-03 02:29:09.834896 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-03 02:29:09.835179 | instance | Friday 03 April 2026  02:29:09 +0000 (0:00:00.260)       0:04:32.049 **********
2026-04-03 02:29:12.552966 | instance | ok: [instance]
2026-04-03 02:29:12.553078 | instance |
2026-04-03 02:29:12.553091 | instance | TASK [vexxhost.ceph.osd : Adopt OSDs to cluster] *******************************
2026-04-03 02:29:12.553101 | instance | Friday 03 April 2026  02:29:12 +0000 (0:00:02.717)       0:04:34.767 **********
2026-04-03 02:29:12.678159 | instance | skipping: [instance]
2026-04-03 02:29:12.678309 | instance |
2026-04-03 02:29:12.678617 | instance | TASK [vexxhost.ceph.osd : Wait until OSD added to cephadm] *********************
2026-04-03 02:29:12.678928 | instance | Friday 03 April 2026  02:29:12 +0000 (0:00:00.125)       0:04:34.893 **********
2026-04-03 02:29:12.711819 | instance | skipping: [instance]
2026-04-03 02:29:12.712065 | instance |
2026-04-03 02:29:12.712373 | instance | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-03 02:29:12.712670 | instance | Friday 03 April 2026  02:29:12 +0000 (0:00:00.033)       0:04:34.926 **********
2026-04-03 02:29:18.078163 | instance | ok: [instance]
2026-04-03 02:29:18.078239 | instance |
2026-04-03 02:29:18.078251 | instance | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-03 02:29:18.078261 | instance | Friday 03 April 2026  02:29:18 +0000 (0:00:05.365)       0:04:40.292 **********
2026-04-03 02:29:29.359481 | instance | ok: [instance]
2026-04-03 02:29:29.359581 | instance |
2026-04-03 02:29:29.361425 | instance | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-03 02:29:29.361454 | instance | Friday 03 April 2026  02:29:29 +0000 (0:00:11.282)       0:04:51.574 **********
2026-04-03 02:31:14.317636 | instance | ok: [instance] => (item=/dev/ceph-instance-osd0/data)
2026-04-03 02:31:14.317887 | instance | ok: [instance] => (item=/dev/ceph-instance-osd1/data)
2026-04-03 02:31:14.318045 | instance | ok: [instance] => (item=/dev/ceph-instance-osd2/data)
2026-04-03 02:31:14.318907 | instance |
2026-04-03 02:31:14.319490 | instance | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-03 02:31:14.320028 | instance | Friday 03 April 2026  02:31:14 +0000 (0:01:44.951)       0:06:36.526 **********
2026-04-03 02:31:16.625249 | instance | ok: [instance]
2026-04-03 02:31:16.625357 | instance |
2026-04-03 02:31:16.625430 | instance | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-03 02:31:16.625623 | instance | Friday 03 April 2026  02:31:16 +0000 (0:00:02.313)       0:06:38.840 **********
2026-04-03 02:31:18.370659 | instance | ok: [instance]
2026-04-03 02:31:18.370738 | instance |
2026-04-03 02:31:18.371018 | instance | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-03 02:31:18.371054 | instance | Friday 03 April 2026  02:31:18 +0000 (0:00:01.745)       0:06:40.586 **********
2026-04-03 02:31:18.446118 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for instance
2026-04-03 02:31:18.446185 | instance |
2026-04-03 02:31:18.446537 | instance | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-03 02:31:18.446596 | instance | Friday 03 April 2026  02:31:18 +0000 (0:00:00.074)       0:06:40.661 **********
2026-04-03 02:31:18.501203 | instance | ok: [instance]
2026-04-03 02:31:18.501298 | instance |
2026-04-03 02:31:18.501394 | instance | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-03 02:31:18.501526 | instance | Friday 03 April 2026  02:31:18 +0000 (0:00:00.055)       0:06:40.716 **********
2026-04-03 02:31:20.367738 | instance | ok: [instance]
2026-04-03 02:31:20.367804 | instance |
2026-04-03 02:31:20.368101 | instance | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-03 02:31:20.368151 | instance | Friday 03 April 2026  02:31:20 +0000 (0:00:01.866)       0:06:42.583 **********
2026-04-03 02:31:20.418873 | instance | ok: [instance]
2026-04-03 02:31:20.418962 | instance |
2026-04-03 02:31:20.419380 | instance | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-03 02:31:20.419427 | instance | Friday 03 April 2026  02:31:20 +0000 (0:00:00.050)       0:06:42.634 **********
2026-04-03 02:31:20.466953 | instance | skipping: [instance] => (item=1)
2026-04-03 02:31:20.468135 | instance | skipping: [instance] => (item=1)
2026-04-03 02:31:20.468191 | instance | skipping: [instance] => (item=1)
2026-04-03 02:31:20.468199 | instance | skipping: [instance]
2026-04-03 02:31:20.468206 | instance |
2026-04-03 02:31:20.468213 | instance | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-03 02:31:20.468220 | instance | Friday 03 April 2026  02:31:20 +0000 (0:00:00.047)       0:06:42.681 **********
2026-04-03 02:31:20.515799 | instance | skipping: [instance]
2026-04-03 02:31:20.515889 | instance |
2026-04-03 02:31:20.516334 | instance | PLAY [all] *********************************************************************
2026-04-03 02:31:20.516357 | instance |
2026-04-03 02:31:20.516362 | instance | TASK [Ensure RBD kernel module is loaded] **************************************
2026-04-03 02:31:20.516373 | instance | Friday 03 April 2026  02:31:20 +0000 (0:00:00.049)       0:06:42.731 **********
2026-04-03 02:31:20.826106 | instance | changed: [instance]
2026-04-03 02:31:20.826193 | instance |
2026-04-03 02:31:20.826745 | instance | PLAY [all] *********************************************************************
2026-04-03 02:31:20.826801 | instance |
2026-04-03 02:31:20.826807 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:31:20.826812 | instance | Friday 03 April 2026  02:31:20 +0000 (0:00:00.309)       0:06:43.041 **********
2026-04-03 02:31:21.790840 | instance | ok: [instance]
2026-04-03 02:31:21.790880 | instance |
2026-04-03 02:31:21.790885 | instance | TASK [vexxhost.atmosphere.sysctl : Configure sysctl values] ********************
2026-04-03 02:31:21.790890 | instance | Friday 03 April 2026  02:31:21 +0000 (0:00:00.964)       0:06:44.005 **********
2026-04-03 02:31:25.585356 | instance | changed: [instance] => (item={'name': 'fs.aio-max-nr', 'value': 1048576})
2026-04-03 02:31:25.585438 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_timestamps', 'value': 0})
2026-04-03 02:31:25.587926 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_sack', 'value': 1})
2026-04-03 02:31:25.587945 | instance | changed: [instance] => (item={'name': 'net.core.netdev_budget', 'value': 1000})
2026-04-03 02:31:25.587951 | instance | changed: [instance] => (item={'name': 'net.core.netdev_max_backlog', 'value': 250000})
2026-04-03 02:31:25.587955 | instance | changed: [instance] => (item={'name': 'net.core.rmem_max', 'value': 4194304})
2026-04-03 02:31:25.587959 | instance | changed: [instance] => (item={'name': 'net.core.wmem_max', 'value': 4194304})
2026-04-03 02:31:25.587963 | instance | changed: [instance] => (item={'name': 'net.core.rmem_default', 'value': 4194304})
2026-04-03 02:31:25.587967 | instance | changed: [instance] => (item={'name': 'net.core.wmem_default', 'value': 4194304})
2026-04-03 02:31:25.587971 | instance | changed: [instance] => (item={'name': 'net.core.optmem_max', 'value': 4194304})
2026-04-03 02:31:25.587975 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_rmem', 'value': '4096 87380 4194304'})
2026-04-03 02:31:25.587979 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_wmem', 'value': '4096 65536 4194304'})
2026-04-03 02:31:25.587983 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_low_latency', 'value': 1})
2026-04-03 02:31:25.587986 | instance | changed: [instance] => (item={'name': 'net.ipv4.tcp_adv_win_scale', 'value': 1})
2026-04-03 02:31:25.587990 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh1', 'value': 128})
2026-04-03 02:31:25.587994 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh2', 'value': 28872})
2026-04-03 02:31:25.587998 | instance | changed: [instance] => (item={'name': 'net.ipv4.neigh.default.gc_thresh3', 'value': 32768})
2026-04-03 02:31:25.588002 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh1', 'value': 128})
2026-04-03 02:31:25.588006 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh2', 'value': 28872})
2026-04-03 02:31:25.588010 | instance | changed: [instance] => (item={'name': 'net.ipv6.neigh.default.gc_thresh3', 'value': 32768})
2026-04-03 02:31:25.588014 | instance |
2026-04-03 02:31:25.588018 | instance | TASK [vexxhost.atmosphere.ethtool : Create folder for persistent configuration] ***
2026-04-03 02:31:25.588022 | instance | Friday 03 April 2026  02:31:25 +0000 (0:00:03.794)       0:06:47.800 **********
2026-04-03 02:31:25.789878 | instance | changed: [instance]
2026-04-03 02:31:25.790578 | instance |
2026-04-03 02:31:25.790607 | instance | TASK [vexxhost.atmosphere.ethtool : Install persistent "ethtool" tuning] *******
2026-04-03 02:31:25.790618 | instance | Friday 03 April 2026  02:31:25 +0000 (0:00:00.204)       0:06:48.005 **********
2026-04-03 02:31:26.275903 | instance | changed: [instance]
2026-04-03 02:31:26.276000 | instance |
2026-04-03 02:31:26.276081 | instance | TASK [vexxhost.atmosphere.ethtool : Run "ethtool" tuning] **********************
2026-04-03 02:31:26.276277 | instance | Friday 03 April 2026  02:31:26 +0000 (0:00:00.486)       0:06:48.491 **********
2026-04-03 02:31:26.521785 | instance | ok: [instance]
2026-04-03 02:31:26.521847 | instance |
2026-04-03 02:31:26.522120 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-04-03 02:31:26.522167 | instance | Friday 03 April 2026  02:31:26 +0000 (0:00:00.245)       0:06:48.737 **********
2026-04-03 02:31:26.574928 | instance | ok: [instance]
2026-04-03 02:31:26.575002 | instance |
2026-04-03 02:31:26.575484 | instance | PLAY [Configure Kubernetes VIP] ************************************************
2026-04-03 02:31:26.575522 | instance |
2026-04-03 02:31:26.575528 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:31:26.575532 | instance | Friday 03 April 2026  02:31:26 +0000 (0:00:00.052)       0:06:48.790 **********
2026-04-03 02:31:27.557999 | instance | ok: [instance]
2026-04-03 02:31:27.558527 | instance |
2026-04-03 02:31:27.558578 | instance | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-04-03 02:31:27.558586 | instance | Friday 03 April 2026  02:31:27 +0000 (0:00:00.982)       0:06:49.773 **********
2026-04-03 02:31:27.778901 | instance | changed: [instance]
2026-04-03 02:31:27.779005 | instance |
2026-04-03 02:31:27.779110 | instance | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-04-03 02:31:27.779220 | instance | Friday 03 April 2026  02:31:27 +0000 (0:00:00.221)       0:06:49.994 **********
2026-04-03 02:31:28.681617 | instance | ok: [instance] => (item=/etc/keepalived/keepalived.conf)
2026-04-03 02:31:28.681721 | instance | ok: [instance] => (item=/etc/keepalived/check_apiserver.sh)
2026-04-03 02:31:28.681792 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-04-03 02:31:28.682413 | instance | ok: [instance] => (item=/etc/haproxy/haproxy.cfg)
2026-04-03 02:31:28.682479 | instance | ok: [instance] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-04-03 02:31:28.682485 | instance |
2026-04-03 02:31:28.682491 | instance | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-04-03 02:31:28.682497 | instance | Friday 03 April 2026  02:31:28 +0000 (0:00:00.902)       0:06:50.896 **********
2026-04-03 02:31:28.864662 | instance | failed: [instance] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-04-03 02:31:29.020182 | instance | failed: [instance] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-04-03 02:31:29.192917 | instance | failed: [instance] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-04-03 02:31:29.207172 | instance | ...ignoring
2026-04-03 02:31:29.207764 | instance |
2026-04-03 02:31:29.207817 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-04-03 02:31:29.207825 | instance | Friday 03 April 2026  02:31:29 +0000 (0:00:00.525)       0:06:51.422 **********
2026-04-03 02:31:29.399129 | instance | ok: [instance]
2026-04-03 02:31:29.399195 | instance |
2026-04-03 02:31:29.399288 | instance | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-04-03 02:31:29.399446 | instance | Friday 03 April 2026  02:31:29 +0000 (0:00:00.192)       0:06:51.614 **********
2026-04-03 02:31:29.603268 | instance | ok: [instance]
2026-04-03 02:31:29.603430 | instance |
2026-04-03 02:31:29.603783 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-04-03 02:31:29.603843 | instance | Friday 03 April 2026  02:31:29 +0000 (0:00:00.203)       0:06:51.818 **********
2026-04-03 02:31:29.644383 | instance | ok: [instance]
2026-04-03 02:31:29.645024 | instance |
2026-04-03 02:31:29.645089 | instance | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-04-03 02:31:29.645098 | instance | Friday 03 April 2026  02:31:29 +0000 (0:00:00.040)       0:06:51.859 **********
2026-04-03 02:31:29.690082 | instance | ok: [instance]
2026-04-03 02:31:29.690173 | instance |
2026-04-03 02:31:29.690462 | instance | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-04-03 02:31:29.690526 | instance | Friday 03 April 2026  02:31:29 +0000 (0:00:00.045)       0:06:51.905 **********
2026-04-03 02:31:30.270005 | instance | ok: [instance]
2026-04-03 02:31:30.270540 | instance |
2026-04-03 02:31:30.270608 | instance | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-04-03 02:31:30.270616 | instance | Friday 03 April 2026  02:31:30 +0000 (0:00:00.579)       0:06:52.484 **********
2026-04-03 02:31:30.543180 | instance | ok: [instance]
2026-04-03 02:31:30.543290 | instance |
2026-04-03 02:31:30.543306 | instance | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-04-03 02:31:30.544143 | instance | Friday 03 April 2026  02:31:30 +0000 (0:00:00.205)       0:06:52.690 **********
2026-04-03 02:31:30.544205 | instance |
2026-04-03 02:31:30.544212 | instance | PLAY [Install Kubernetes] ******************************************************
2026-04-03 02:31:30.544216 | instance |
2026-04-03 02:31:30.544220 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:31:30.544224 | instance | Friday 03 April 2026  02:31:30 +0000 (0:00:00.067)       0:06:52.758 **********
2026-04-03 02:31:31.562006 | instance | ok: [instance]
2026-04-03 02:31:31.562084 | instance |
2026-04-03 02:31:31.562395 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:31.562446 | instance | Friday 03 April 2026  02:31:31 +0000 (0:00:01.018)       0:06:53.777 **********
2026-04-03 02:31:31.803453 | instance | ok: [instance]
2026-04-03 02:31:31.803532 | instance |
2026-04-03 02:31:31.803738 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:31:31.803782 | instance | Friday 03 April 2026  02:31:31 +0000 (0:00:00.241)       0:06:54.019 **********
2026-04-03 02:31:31.845153 | instance | skipping: [instance]
2026-04-03 02:31:31.845630 | instance |
2026-04-03 02:31:31.845683 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-03 02:31:31.845690 | instance | Friday 03 April 2026  02:31:31 +0000 (0:00:00.041)       0:06:54.060 **********
2026-04-03 02:31:32.064898 | instance | ok: [instance]
2026-04-03 02:31:32.065003 | instance |
2026-04-03 02:31:32.065017 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:32.065210 | instance | Friday 03 April 2026  02:31:32 +0000 (0:00:00.219)       0:06:54.279 **********
2026-04-03 02:31:32.124559 | instance | ok: [instance] => {
2026-04-03 02:31:32.124647 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-04-03 02:31:32.125109 | instance | }
2026-04-03 02:31:32.125142 | instance |
2026-04-03 02:31:32.125148 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:32.125153 | instance | Friday 03 April 2026  02:31:32 +0000 (0:00:00.059)       0:06:54.339 **********
2026-04-03 02:31:32.433522 | instance | ok: [instance]
2026-04-03 02:31:32.434121 | instance |
2026-04-03 02:31:32.434787 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:32.435253 | instance | Friday 03 April 2026  02:31:32 +0000 (0:00:00.308)       0:06:54.647 **********
2026-04-03 02:31:32.482908 | instance | skipping: [instance]
2026-04-03 02:31:32.483095 | instance |
2026-04-03 02:31:32.483249 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:32.483399 | instance | Friday 03 April 2026  02:31:32 +0000 (0:00:00.048)       0:06:54.696 **********
2026-04-03 02:31:32.705922 | instance | ok: [instance]
2026-04-03 02:31:32.706366 | instance |
2026-04-03 02:31:32.706746 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:31:32.707148 | instance | Friday 03 April 2026  02:31:32 +0000 (0:00:00.224)       0:06:54.920 **********
2026-04-03 02:31:34.023437 | instance | ok: [instance]
2026-04-03 02:31:34.023856 | instance |
2026-04-03 02:31:34.024203 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:34.024599 | instance | Friday 03 April 2026  02:31:34 +0000 (0:00:01.317)       0:06:56.238 **********
2026-04-03 02:31:34.085662 | instance | ok: [instance] => {
2026-04-03 02:31:34.086150 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-04-03 02:31:34.086496 | instance | }
2026-04-03 02:31:34.086873 | instance |
2026-04-03 02:31:34.087261 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:34.087604 | instance | Friday 03 April 2026  02:31:34 +0000 (0:00:00.061)       0:06:56.300 **********
2026-04-03 02:31:34.462917 | instance | ok: [instance]
2026-04-03 02:31:34.463403 | instance |
2026-04-03 02:31:34.463781 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:34.464133 | instance | Friday 03 April 2026  02:31:34 +0000 (0:00:00.377)       0:06:56.677 **********
2026-04-03 02:31:36.447533 | instance | ok: [instance]
2026-04-03 02:31:36.447617 | instance |
2026-04-03 02:31:36.448065 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-03 02:31:36.448510 | instance | Friday 03 April 2026  02:31:36 +0000 (0:00:01.985)       0:06:58.662 **********
2026-04-03 02:31:36.486722 | instance | skipping: [instance]
2026-04-03 02:31:36.486834 | instance |
2026-04-03 02:31:36.487150 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-03 02:31:36.487201 | instance | Friday 03 April 2026  02:31:36 +0000 (0:00:00.039)       0:06:58.701 **********
2026-04-03 02:31:36.531245 | instance | skipping: [instance]
2026-04-03 02:31:36.531315 | instance |
2026-04-03 02:31:36.531323 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-03 02:31:36.531331 | instance | Friday 03 April 2026  02:31:36 +0000 (0:00:00.043)       0:06:58.745 **********
2026-04-03 02:31:36.569969 | instance | skipping: [instance]
2026-04-03 02:31:36.570097 | instance |
2026-04-03 02:31:36.570342 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-03 02:31:36.570401 | instance | Friday 03 April 2026  02:31:36 +0000 (0:00:00.039)       0:06:58.785 **********
2026-04-03 02:31:37.801065 | instance | ok: [instance]
2026-04-03 02:31:37.801162 | instance |
2026-04-03 02:31:37.801224 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-03 02:31:37.801361 | instance | Friday 03 April 2026  02:31:37 +0000 (0:00:01.231)       0:07:00.016 **********
2026-04-03 02:31:38.273778 | instance | ok: [instance]
2026-04-03 02:31:38.274321 | instance |
2026-04-03 02:31:38.274366 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-03 02:31:38.274374 | instance | Friday 03 April 2026  02:31:38 +0000 (0:00:00.472)       0:07:00.489 **********
2026-04-03 02:31:39.201289 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-03 02:31:39.201362 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-03 02:31:39.201667 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-03 02:31:39.201744 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-03 02:31:39.201764 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-03 02:31:39.202151 | instance |
2026-04-03 02:31:39.202209 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-03 02:31:39.202216 | instance | Friday 03 April 2026  02:31:39 +0000 (0:00:00.927)       0:07:01.416 **********
2026-04-03 02:31:39.724436 | instance | ok: [instance]
2026-04-03 02:31:39.725390 | instance |
2026-04-03 02:31:39.725460 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-03 02:31:39.725487 | instance | Friday 03 April 2026  02:31:39 +0000 (0:00:00.516)       0:07:01.933 **********
2026-04-03 02:31:39.725494 | instance |
2026-04-03 02:31:39.725500 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-03 02:31:39.725506 | instance | Friday 03 April 2026  02:31:39 +0000 (0:00:00.006)       0:07:01.939 **********
2026-04-03 02:31:40.113327 | instance | ok: [instance]
2026-04-03 02:31:40.113377 | instance |
2026-04-03 02:31:40.113626 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-04-03 02:31:40.113642 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.389)       0:07:02.328 **********
2026-04-03 02:31:40.776897 | instance | fatal: [instance]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on instance's Python /usr/bin/python3.10. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"}
2026-04-03 02:31:40.793386 | instance | ...ignoring
2026-04-03 02:31:40.793493 | instance |
2026-04-03 02:31:40.793837 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-04-03 02:31:40.793902 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.679)       0:07:03.008 **********
2026-04-03 02:31:40.837807 | instance | skipping: [instance]
2026-04-03 02:31:40.837916 | instance |
2026-04-03 02:31:40.838256 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-04-03 02:31:40.838318 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.044)       0:07:03.052 **********
2026-04-03 02:31:40.879884 | instance | skipping: [instance]
2026-04-03 02:31:40.880295 | instance |
2026-04-03 02:31:40.880380 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-04-03 02:31:40.880390 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.042)       0:07:03.095 **********
2026-04-03 02:31:40.923128 | instance | skipping: [instance]
2026-04-03 02:31:40.923225 | instance |
2026-04-03 02:31:40.923327 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-04-03 02:31:40.923564 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.043)       0:07:03.138 **********
2026-04-03 02:31:40.966032 | instance | skipping: [instance]
2026-04-03 02:31:40.966200 | instance |
2026-04-03 02:31:40.966475 | instance | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-04-03 02:31:40.966670 | instance | Friday 03 April 2026  02:31:40 +0000 (0:00:00.042)       0:07:03.180 **********
2026-04-03 02:31:41.009170 | instance | skipping: [instance]
2026-04-03 02:31:41.009235 | instance |
2026-04-03 02:31:41.009359 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:41.009517 | instance | Friday 03 April 2026  02:31:41 +0000 (0:00:00.043)       0:07:03.224 **********
2026-04-03 02:31:41.236557 | instance | ok: [instance]
2026-04-03 02:31:41.236670 | instance |
2026-04-03 02:31:41.236681 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:41.236804 | instance | Friday 03 April 2026  02:31:41 +0000 (0:00:00.227)       0:07:03.451 **********
2026-04-03 02:31:41.293104 | instance | ok: [instance] => {
2026-04-03 02:31:41.293196 | instance |     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubeadm"
2026-04-03 02:31:41.293330 | instance | }
2026-04-03 02:31:41.293680 | instance |
2026-04-03 02:31:41.293850 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:41.293999 | instance | Friday 03 April 2026  02:31:41 +0000 (0:00:00.053)       0:07:03.505 **********
2026-04-03 02:31:42.593082 | instance | changed: [instance]
2026-04-03 02:31:42.593357 | instance |
2026-04-03 02:31:42.593576 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:42.593787 | instance | Friday 03 April 2026  02:31:42 +0000 (0:00:01.302)       0:07:04.808 **********
2026-04-03 02:31:42.640969 | instance | skipping: [instance]
2026-04-03 02:31:42.641026 | instance |
2026-04-03 02:31:42.641167 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:42.641382 | instance | Friday 03 April 2026  02:31:42 +0000 (0:00:00.046)       0:07:04.854 **********
2026-04-03 02:31:42.869133 | instance | ok: [instance]
2026-04-03 02:31:42.869505 | instance |
2026-04-03 02:31:42.869839 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:42.870168 | instance | Friday 03 April 2026  02:31:42 +0000 (0:00:00.228)       0:07:05.082 **********
2026-04-03 02:31:42.908930 | instance | ok: [instance] => {
2026-04-03 02:31:42.909120 | instance |     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubectl"
2026-04-03 02:31:42.909367 | instance | }
2026-04-03 02:31:42.909560 | instance |
2026-04-03 02:31:42.909741 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:42.909890 | instance | Friday 03 April 2026  02:31:42 +0000 (0:00:00.040)       0:07:05.123 **********
2026-04-03 02:31:43.805195 | instance | changed: [instance]
2026-04-03 02:31:43.805477 | instance |
2026-04-03 02:31:43.805705 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:43.805939 | instance | Friday 03 April 2026  02:31:43 +0000 (0:00:00.896)       0:07:06.019 **********
2026-04-03 02:31:43.860900 | instance | skipping: [instance]
2026-04-03 02:31:43.860998 | instance |
2026-04-03 02:31:43.861113 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-03 02:31:43.861324 | instance | Friday 03 April 2026  02:31:43 +0000 (0:00:00.056)       0:07:06.075 **********
2026-04-03 02:31:43.904696 | instance | skipping: [instance]
2026-04-03 02:31:43.905124 | instance |
2026-04-03 02:31:43.905500 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-03 02:31:43.905864 | instance | Friday 03 April 2026  02:31:43 +0000 (0:00:00.041)       0:07:06.117 **********
2026-04-03 02:31:43.936565 | instance | skipping: [instance]
2026-04-03 02:31:43.937161 | instance |
2026-04-03 02:31:43.937501 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-03 02:31:43.937858 | instance | Friday 03 April 2026  02:31:43 +0000 (0:00:00.032)       0:07:06.149 **********
2026-04-03 02:31:43.966661 | instance | skipping: [instance]
2026-04-03 02:31:43.966729 | instance |
2026-04-03 02:31:43.966795 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-03 02:31:43.966953 | instance | Friday 03 April 2026  02:31:43 +0000 (0:00:00.031)       0:07:06.181 **********
2026-04-03 02:31:44.998071 | instance | ok: [instance]
2026-04-03 02:31:44.999025 | instance |
2026-04-03 02:31:44.999041 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-03 02:31:44.999049 | instance | Friday 03 April 2026  02:31:44 +0000 (0:00:01.031)       0:07:07.213 **********
2026-04-03 02:31:45.429935 | instance | ok: [instance]
2026-04-03 02:31:45.430061 | instance |
2026-04-03 02:31:45.430427 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-03 02:31:45.430470 | instance | Friday 03 April 2026  02:31:45 +0000 (0:00:00.432)       0:07:07.645 **********
2026-04-03 02:31:46.378396 | instance | ok: [instance] => (item={'path': '/etc/containerd'})
2026-04-03 02:31:46.378449 | instance | ok: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-03 02:31:46.378462 | instance | ok: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-03 02:31:46.378467 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-03 02:31:46.378472 | instance | ok: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-03 02:31:46.378477 | instance |
2026-04-03 02:31:46.378482 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-03 02:31:46.378486 | instance | Friday 03 April 2026  02:31:46 +0000 (0:00:00.947)       0:07:08.593 **********
2026-04-03 02:31:46.907846 | instance | ok: [instance]
2026-04-03 02:31:46.907920 | instance |
2026-04-03 02:31:46.908522 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-03 02:31:46.908603 | instance | Friday 03 April 2026  02:31:46 +0000 (0:00:00.523)       0:07:09.116 **********
2026-04-03 02:31:46.908611 | instance |
2026-04-03 02:31:46.908646 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-03 02:31:46.908673 | instance | Friday 03 April 2026  02:31:46 +0000 (0:00:00.006)       0:07:09.123 **********
2026-04-03 02:31:47.286418 | instance | ok: [instance]
2026-04-03 02:31:47.286504 | instance |
2026-04-03 02:31:47.286893 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:47.286913 | instance | Friday 03 April 2026  02:31:47 +0000 (0:00:00.378)       0:07:09.501 **********
2026-04-03 02:31:47.514608 | instance | ok: [instance]
2026-04-03 02:31:47.514725 | instance |
2026-04-03 02:31:47.514750 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:47.514906 | instance | Friday 03 April 2026  02:31:47 +0000 (0:00:00.228)       0:07:09.730 **********
2026-04-03 02:31:47.570766 | instance | ok: [instance] => {
2026-04-03 02:31:47.571419 | instance |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-04-03 02:31:47.571466 | instance | }
2026-04-03 02:31:47.571472 | instance |
2026-04-03 02:31:47.571476 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:47.571481 | instance | Friday 03 April 2026  02:31:47 +0000 (0:00:00.055)       0:07:09.785 **********
2026-04-03 02:31:48.137933 | instance | changed: [instance]
2026-04-03 02:31:48.138012 | instance |
2026-04-03 02:31:48.138405 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:48.138458 | instance | Friday 03 April 2026  02:31:48 +0000 (0:00:00.567)       0:07:10.353 **********
2026-04-03 02:31:49.590555 | instance | changed: [instance]
2026-04-03 02:31:49.590671 | instance |
2026-04-03 02:31:49.590686 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:49.590853 | instance | Friday 03 April 2026  02:31:49 +0000 (0:00:01.452)       0:07:11.806 **********
2026-04-03 02:31:49.659874 | instance | ok: [instance] => {
2026-04-03 02:31:49.660500 | instance |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-04-03 02:31:49.660880 | instance | }
2026-04-03 02:31:49.660894 | instance |
2026-04-03 02:31:49.660904 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:49.660922 | instance | Friday 03 April 2026  02:31:49 +0000 (0:00:00.068)       0:07:11.874 **********
2026-04-03 02:31:50.310468 | instance | changed: [instance]
2026-04-03 02:31:50.310537 | instance |
2026-04-03 02:31:50.310784 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:50.310835 | instance | Friday 03 April 2026  02:31:50 +0000 (0:00:00.651)       0:07:12.526 **********
2026-04-03 02:31:51.753292 | instance | changed: [instance]
2026-04-03 02:31:51.753384 | instance |
2026-04-03 02:31:51.753603 | instance | TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-04-03 02:31:51.753646 | instance | Friday 03 April 2026  02:31:51 +0000 (0:00:01.442)       0:07:13.968 **********
2026-04-03 02:31:52.231873 | instance | changed: [instance]
2026-04-03 02:31:52.231951 | instance |
2026-04-03 02:31:52.232046 | instance | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-04-03 02:31:52.232168 | instance | Friday 03 April 2026  02:31:52 +0000 (0:00:00.478)       0:07:14.447 **********
2026-04-03 02:31:52.450767 | instance | changed: [instance]
2026-04-03 02:31:52.450999 | instance |
2026-04-03 02:31:52.451268 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:52.451533 | instance | Friday 03 April 2026  02:31:52 +0000 (0:00:00.218)       0:07:14.665 **********
2026-04-03 02:31:52.667068 | instance | ok: [instance]
2026-04-03 02:31:52.667309 | instance |
2026-04-03 02:31:52.667602 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:31:52.667885 | instance | Friday 03 April 2026  02:31:52 +0000 (0:00:00.216)       0:07:14.882 **********
2026-04-03 02:31:52.730719 | instance | ok: [instance] => {
2026-04-03 02:31:52.731017 | instance |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-04-03 02:31:52.731311 | instance | }
2026-04-03 02:31:52.731580 | instance |
2026-04-03 02:31:52.731959 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:31:52.732377 | instance | Friday 03 April 2026  02:31:52 +0000 (0:00:00.063)       0:07:14.945 **********
2026-04-03 02:31:53.744694 | instance | changed: [instance]
2026-04-03 02:31:53.744984 | instance |
2026-04-03 02:31:53.745303 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:31:53.745616 | instance | Friday 03 April 2026  02:31:53 +0000 (0:00:01.014)       0:07:15.959 **********
2026-04-03 02:31:56.446497 | instance | changed: [instance]
2026-04-03 02:31:56.446729 | instance |
2026-04-03 02:31:56.447028 | instance | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] ***
2026-04-03 02:31:56.447343 | instance | Friday 03 April 2026  02:31:56 +0000 (0:00:02.701)       0:07:18.661 **********
2026-04-03 02:31:56.497863 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-04-03 02:31:56.498052 | instance |
2026-04-03 02:31:56.498206 | instance | TASK [vexxhost.containers.cni_plugins : Install additional packages] ***********
2026-04-03 02:31:56.498413 | instance | Friday 03 April 2026  02:31:56 +0000 (0:00:00.051)       0:07:18.712 **********
2026-04-03 02:31:58.289933 | instance | ok: [instance]
2026-04-03 02:31:58.290313 | instance |
2026-04-03 02:31:58.290658 | instance | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] ****************
2026-04-03 02:31:58.290991 | instance | Friday 03 April 2026  02:31:58 +0000 (0:00:01.792)       0:07:20.504 **********
2026-04-03 02:31:58.509077 | instance | changed: [instance]
2026-04-03 02:31:58.509493 | instance |
2026-04-03 02:31:58.509844 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] *********
2026-04-03 02:31:58.510178 | instance | Friday 03 April 2026  02:31:58 +0000 (0:00:00.216)       0:07:20.721 **********
2026-04-03 02:31:59.053887 | instance | changed: [instance]
2026-04-03 02:31:59.054005 | instance |
2026-04-03 02:31:59.054388 | instance | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ******
2026-04-03 02:31:59.054449 | instance | Friday 03 April 2026  02:31:59 +0000 (0:00:00.547)       0:07:21.268 **********
2026-04-03 02:31:59.842989 | instance | changed: [instance] => (item=br_netfilter)
2026-04-03 02:31:59.843149 | instance | ok: [instance] => (item=ip_tables)
2026-04-03 02:31:59.844141 | instance | changed: [instance] => (item=ip6_tables)
2026-04-03 02:31:59.844213 | instance | ok: [instance] => (item=nf_conntrack)
2026-04-03 02:31:59.844224 | instance |
2026-04-03 02:31:59.844234 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:31:59.844241 | instance | Friday 03 April 2026  02:31:59 +0000 (0:00:00.788)       0:07:22.057 **********
2026-04-03 02:32:00.051153 | instance | ok: [instance]
2026-04-03 02:32:00.051254 | instance |
2026-04-03 02:32:00.051326 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:32:00.051470 | instance | Friday 03 April 2026  02:32:00 +0000 (0:00:00.208)       0:07:22.266 **********
2026-04-03 02:32:00.107389 | instance | ok: [instance] => {
2026-04-03 02:32:00.108328 | instance |     "msg": "https://dl.k8s.io/release/v1.28.13/bin/linux/amd64/kubelet"
2026-04-03 02:32:00.108381 | instance | }
2026-04-03 02:32:00.108389 | instance |
2026-04-03 02:32:00.108396 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:32:00.108403 | instance | Friday 03 April 2026  02:32:00 +0000 (0:00:00.055)       0:07:22.322 **********
2026-04-03 02:32:02.240620 | instance | changed: [instance]
2026-04-03 02:32:02.240733 | instance |
2026-04-03 02:32:02.240892 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:32:02.241074 | instance | Friday 03 April 2026  02:32:02 +0000 (0:00:02.133)       0:07:24.455 **********
2026-04-03 02:32:02.286066 | instance | skipping: [instance]
2026-04-03 02:32:02.286216 | instance |
2026-04-03 02:32:02.286404 | instance | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] ***
2026-04-03 02:32:02.286582 | instance | Friday 03 April 2026  02:32:02 +0000 (0:00:00.045)       0:07:24.501 **********
2026-04-03 02:32:02.344115 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-04-03 02:32:02.344263 | instance |
2026-04-03 02:32:02.344598 | instance | TASK [vexxhost.kubernetes.kubelet : Install coreutils] *************************
2026-04-03 02:32:02.344883 | instance | Friday 03 April 2026  02:32:02 +0000 (0:00:00.057)       0:07:24.559 **********
2026-04-03 02:32:02.382970 | instance | skipping: [instance]
2026-04-03 02:32:02.383156 | instance |
2026-04-03 02:32:02.383430 | instance | TASK [vexxhost.kubernetes.kubelet : Install additional packages] ***************
2026-04-03 02:32:02.383753 | instance | Friday 03 April 2026  02:32:02 +0000 (0:00:00.039)       0:07:24.598 **********
2026-04-03 02:32:06.889909 | instance | changed: [instance]
2026-04-03 02:32:06.890120 | instance |
2026-04-03 02:32:06.890417 | instance | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] *******************
2026-04-03 02:32:06.890706 | instance | Friday 03 April 2026  02:32:06 +0000 (0:00:04.506)       0:07:29.104 **********
2026-04-03 02:32:09.209554 | instance | changed: [instance] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-04-03 02:32:09.209720 | instance | changed: [instance] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-04-03 02:32:09.209925 | instance | changed: [instance] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-04-03 02:32:09.210134 | instance | changed: [instance] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-04-03 02:32:09.210360 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-04-03 02:32:09.210582 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-04-03 02:32:09.210811 | instance | changed: [instance] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-04-03 02:32:09.211004 | instance |
2026-04-03 02:32:09.211223 | instance | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] ***
2026-04-03 02:32:09.211434 | instance | Friday 03 April 2026  02:32:09 +0000 (0:00:02.319)       0:07:31.424 **********
2026-04-03 02:32:09.785494 | instance | changed: [instance] => (item=/etc/systemd/system/kubelet.service.d)
2026-04-03 02:32:09.785769 | instance | ok: [instance] => (item=/etc/kubernetes)
2026-04-03 02:32:09.786068 | instance | ok: [instance] => (item=/etc/kubernetes/manifests)
2026-04-03 02:32:09.786326 | instance |
2026-04-03 02:32:09.786647 | instance | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ********
2026-04-03 02:32:09.786933 | instance | Friday 03 April 2026  02:32:09 +0000 (0:00:00.575)       0:07:32.000 **********
2026-04-03 02:32:10.259714 | instance | changed: [instance]
2026-04-03 02:32:10.259793 | instance |
2026-04-03 02:32:10.259805 | instance | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] ***
2026-04-03 02:32:10.259816 | instance | Friday 03 April 2026  02:32:10 +0000 (0:00:00.473)       0:07:32.473 **********
2026-04-03 02:32:10.713246 | instance | changed: [instance]
2026-04-03 02:32:10.713662 | instance |
2026-04-03 02:32:10.713708 | instance | TASK [vexxhost.kubernetes.kubelet : Check swap status] *************************
2026-04-03 02:32:10.713715 | instance | Friday 03 April 2026  02:32:10 +0000 (0:00:00.454)       0:07:32.928 **********
2026-04-03 02:32:11.020552 | instance | ok: [instance]
2026-04-03 02:32:11.020599 | instance |
2026-04-03 02:32:11.020605 | instance | TASK [vexxhost.kubernetes.kubelet : Disable swap] ******************************
2026-04-03 02:32:11.020610 | instance | Friday 03 April 2026  02:32:10 +0000 (0:00:00.252)       0:07:33.181 **********
2026-04-03 02:32:11.020614 | instance | skipping: [instance]
2026-04-03 02:32:11.020618 | instance |
2026-04-03 02:32:11.020622 | instance | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] ***********
2026-04-03 02:32:11.020627 | instance | Friday 03 April 2026  02:32:10 +0000 (0:00:00.030)       0:07:33.211 **********
2026-04-03 02:32:11.566581 | instance | ok: [instance] => (item=swap)
2026-04-03 02:32:11.566648 | instance | ok: [instance] => (item=none)
2026-04-03 02:32:11.567094 | instance |
2026-04-03 02:32:11.567110 | instance | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] ***
2026-04-03 02:32:11.567117 | instance | Friday 03 April 2026  02:32:11 +0000 (0:00:00.570)       0:07:33.782 **********
2026-04-03 02:32:12.017830 | instance | changed: [instance]
2026-04-03 02:32:12.017941 | instance |
2026-04-03 02:32:12.018298 | instance | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] *********************
2026-04-03 02:32:12.018368 | instance | Friday 03 April 2026  02:32:12 +0000 (0:00:00.450)       0:07:34.233 **********
2026-04-03 02:32:12.612499 | instance | changed: [instance]
2026-04-03 02:32:12.612574 | instance |
2026-04-03 02:32:12.613184 | instance | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-04-03 02:32:12.613231 | instance | Friday 03 April 2026  02:32:12 +0000 (0:00:00.587)       0:07:34.820 **********
2026-04-03 02:32:12.613237 | instance |
2026-04-03 02:32:12.613242 | instance | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-04-03 02:32:12.613252 | instance | Friday 03 April 2026  02:32:12 +0000 (0:00:00.007)       0:07:34.828 **********
2026-04-03 02:32:13.428115 | instance | ok: [instance]
2026-04-03 02:32:13.428186 | instance |
2026-04-03 02:32:13.428322 | instance | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] **********
2026-04-03 02:32:13.428490 | instance | Friday 03 April 2026  02:32:13 +0000 (0:00:00.815)       0:07:35.643 **********
2026-04-03 02:32:14.022245 | instance | changed: [instance]
2026-04-03 02:32:14.022345 | instance |
2026-04-03 02:32:14.022633 | instance | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] *****
2026-04-03 02:32:14.022692 | instance | Friday 03 April 2026  02:32:14 +0000 (0:00:00.593)       0:07:36.237 **********
2026-04-03 02:32:15.023409 | instance | ok: [instance]
2026-04-03 02:32:15.023483 | instance |
2026-04-03 02:32:15.023760 | instance | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ******************
2026-04-03 02:32:15.023820 | instance | Friday 03 April 2026  02:32:15 +0000 (0:00:01.001)       0:07:37.238 **********
2026-04-03 02:32:15.844640 | instance | ok: [instance]
2026-04-03 02:32:15.844740 | instance |
2026-04-03 02:32:15.844794 | instance | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] *********
2026-04-03 02:32:15.844958 | instance | Friday 03 April 2026  02:32:15 +0000 (0:00:00.821)       0:07:38.060 **********
2026-04-03 02:32:16.063443 | instance | ok: [instance]
2026-04-03 02:32:16.063526 | instance |
2026-04-03 02:32:16.063783 | instance | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] ***********
2026-04-03 02:32:16.063843 | instance | Friday 03 April 2026  02:32:16 +0000 (0:00:00.218)       0:07:38.278 **********
2026-04-03 02:32:16.612984 | instance | ok: [instance]
2026-04-03 02:32:16.613091 | instance |
2026-04-03 02:32:16.613160 | instance | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ********************
2026-04-03 02:32:16.613308 | instance | Friday 03 April 2026  02:32:16 +0000 (0:00:00.549)       0:07:38.828 **********
2026-04-03 02:32:16.696197 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for instance
2026-04-03 02:32:16.696286 | instance |
2026-04-03 02:32:16.696585 | instance | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] **********************
2026-04-03 02:32:16.696635 | instance | Friday 03 April 2026  02:32:16 +0000 (0:00:00.082)       0:07:38.911 **********
2026-04-03 02:32:16.779246 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for instance
2026-04-03 02:32:16.779306 | instance |
2026-04-03 02:32:16.779313 | instance | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] ***
2026-04-03 02:32:16.779320 | instance | Friday 03 April 2026  02:32:16 +0000 (0:00:00.082)       0:07:38.993 **********
2026-04-03 02:32:17.008258 | instance | ok: [instance] => (item=instance)
2026-04-03 02:32:17.008418 | instance |
2026-04-03 02:32:17.008667 | instance | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] ****
2026-04-03 02:32:17.008728 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.229)       0:07:39.223 **********
2026-04-03 02:32:17.060943 | instance | skipping: [instance]
2026-04-03 02:32:17.061149 | instance |
2026-04-03 02:32:17.061309 | instance | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] ***
2026-04-03 02:32:17.061459 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.051)       0:07:39.274 **********
2026-04-03 02:32:17.118643 | instance | ok: [instance]
2026-04-03 02:32:17.118758 | instance |
2026-04-03 02:32:17.118959 | instance | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] **********
2026-04-03 02:32:17.119129 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.058)       0:07:39.333 **********
2026-04-03 02:32:17.186357 | instance | ok: [instance] => {
2026-04-03 02:32:17.186461 | instance |     "msg": "instance"
2026-04-03 02:32:17.186521 | instance | }
2026-04-03 02:32:17.186634 | instance |
2026-04-03 02:32:17.186809 | instance | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] ***
2026-04-03 02:32:17.186963 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.067)       0:07:39.401 **********
2026-04-03 02:32:17.799832 | instance | changed: [instance]
2026-04-03 02:32:17.799935 | instance |
2026-04-03 02:32:17.799999 | instance | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] **********************
2026-04-03 02:32:17.800149 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.613)       0:07:40.015 **********
2026-04-03 02:32:17.837885 | instance | skipping: [instance]
2026-04-03 02:32:17.838324 | instance |
2026-04-03 02:32:17.838371 | instance | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] ***************
2026-04-03 02:32:17.838377 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.037)       0:07:40.053 **********
2026-04-03 02:32:17.876447 | instance | skipping: [instance]
2026-04-03 02:32:17.876528 | instance |
2026-04-03 02:32:17.876785 | instance | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] **************
2026-04-03 02:32:17.876826 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.038)       0:07:40.091 **********
2026-04-03 02:32:17.920931 | instance | skipping: [instance]
2026-04-03 02:32:17.921038 | instance |
2026-04-03 02:32:17.921341 | instance | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] *********************
2026-04-03 02:32:17.921404 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.043)       0:07:40.135 **********
2026-04-03 02:32:17.962591 | instance | skipping: [instance]
2026-04-03 02:32:17.962661 | instance |
2026-04-03 02:32:17.962955 | instance | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ********************
2026-04-03 02:32:17.963013 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.041)       0:07:40.177 **********
2026-04-03 02:32:18.001252 | instance | skipping: [instance]
2026-04-03 02:32:18.001319 | instance |
2026-04-03 02:32:18.001472 | instance | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] **************
2026-04-03 02:32:18.001669 | instance | Friday 03 April 2026  02:32:17 +0000 (0:00:00.038)       0:07:40.216 **********
2026-04-03 02:32:18.046511 | instance | skipping: [instance]
2026-04-03 02:32:18.046560 | instance |
2026-04-03 02:32:18.046566 | instance | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] *************
2026-04-03 02:32:18.046572 | instance | Friday 03 April 2026  02:32:18 +0000 (0:00:00.044)       0:07:40.261 **********
2026-04-03 02:32:18.085211 | instance | skipping: [instance]
2026-04-03 02:32:18.085244 | instance |
2026-04-03 02:32:18.085250 | instance | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] *********************
2026-04-03 02:32:18.085255 | instance | Friday 03 April 2026  02:32:18 +0000 (0:00:00.039)       0:07:40.300 **********
2026-04-03 02:32:54.782975 | instance | changed: [instance]
2026-04-03 02:32:54.783052 | instance |
2026-04-03 02:32:54.783376 | instance | TASK [vexxhost.kubernetes.kubernetes : Check if the node is already part of the cluster] ***
2026-04-03 02:32:54.783425 | instance | Friday 03 April 2026  02:32:54 +0000 (0:00:36.697)       0:08:16.998 **********
2026-04-03 02:32:55.008393 | instance | ok: [instance]
2026-04-03 02:32:55.008462 | instance |
2026-04-03 02:32:55.008745 | instance | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-04-03 02:32:55.008786 | instance | Friday 03 April 2026  02:32:55 +0000 (0:00:00.225)       0:08:17.224 **********
2026-04-03 02:32:55.043559 | instance | skipping: [instance]
2026-04-03 02:32:55.043639 | instance |
2026-04-03 02:32:55.043887 | instance | TASK [vexxhost.kubernetes.kubernetes : Create folder for admin configuration] ***
2026-04-03 02:32:55.043920 | instance | Friday 03 April 2026  02:32:55 +0000 (0:00:00.035)       0:08:17.259 **********
2026-04-03 02:32:55.249152 | instance | changed: [instance]
2026-04-03 02:32:55.249219 | instance |
2026-04-03 02:32:55.249523 | instance | TASK [vexxhost.kubernetes.kubernetes : Creating a symlink for admin configuration file] ***
2026-04-03 02:32:55.249578 | instance | Friday 03 April 2026  02:32:55 +0000 (0:00:00.205)       0:08:17.464 **********
2026-04-03 02:32:55.447646 | instance | changed: [instance]
2026-04-03 02:32:55.447729 | instance |
2026-04-03 02:32:55.447999 | instance | TASK [vexxhost.kubernetes.kubernetes : Add bash autocomplete for kubectl] ******
2026-04-03 02:32:55.448040 | instance | Friday 03 April 2026  02:32:55 +0000 (0:00:00.198)       0:08:17.663 **********
2026-04-03 02:32:55.675153 | instance | changed: [instance]
2026-04-03 02:32:55.675218 | instance |
2026-04-03 02:32:55.675442 | instance | TASK [vexxhost.kubernetes.kubernetes : Install PIP] ****************************
2026-04-03 02:32:55.675561 | instance | Friday 03 April 2026  02:32:55 +0000 (0:00:00.227)       0:08:17.890 **********
2026-04-03 02:33:12.104883 | instance | changed: [instance]
2026-04-03 02:33:12.104999 | instance |
2026-04-03 02:33:12.105171 | instance | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems] ***
2026-04-03 02:33:12.105343 | instance | Friday 03 April 2026  02:33:12 +0000 (0:00:16.429)       0:08:34.320 **********
2026-04-03 02:33:16.888408 | instance | changed: [instance]
2026-04-03 02:33:16.888478 | instance |
2026-04-03 02:33:16.888486 | instance | TASK [vexxhost.kubernetes.kubernetes : Enable EPEL repository] *****************
2026-04-03 02:33:16.888493 | instance | Friday 03 April 2026  02:33:16 +0000 (0:00:04.783)       0:08:39.103 **********
2026-04-03 02:33:16.941977 | instance | skipping: [instance]
2026-04-03 02:33:16.942111 | instance |
2026-04-03 02:33:16.942131 | instance | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems] ***
2026-04-03 02:33:16.942308 | instance | Friday 03 April 2026  02:33:16 +0000 (0:00:00.054)       0:08:39.157 **********
2026-04-03 02:33:16.995082 | instance | skipping: [instance]
2026-04-03 02:33:16.995146 | instance |
2026-04-03 02:33:16.995152 | instance | TASK [vexxhost.kubernetes.kubernetes : Allow workload on control plane node] ***
2026-04-03 02:33:16.995157 | instance | Friday 03 April 2026  02:33:16 +0000 (0:00:00.052)       0:08:39.209 **********
2026-04-03 02:33:17.847983 | instance | changed: [instance]
2026-04-03 02:33:17.848324 | instance |
2026-04-03 02:33:17.848340 | instance | TASK [vexxhost.kubernetes.kubernetes : Remove kube-proxy resources] ************
2026-04-03 02:33:17.848345 | instance | Friday 03 April 2026  02:33:17 +0000 (0:00:00.853)       0:08:40.063 **********
2026-04-03 02:33:17.897616 | instance | skipping: [instance] => (item=DaemonSet)
2026-04-03 02:33:17.897690 | instance | skipping: [instance] => (item=ConfigMap)
2026-04-03 02:33:17.897853 | instance | skipping: [instance]
2026-04-03 02:33:17.898010 | instance |
2026-04-03 02:33:17.898150 | instance | TASK [vexxhost.kubernetes.kubernetes : Start an upgrade] ***********************
2026-04-03 02:33:17.898319 | instance | Friday 03 April 2026  02:33:17 +0000 (0:00:00.049)       0:08:40.112 **********
2026-04-03 02:33:17.943016 | instance | skipping: [instance]
2026-04-03 02:33:17.943228 | instance |
2026-04-03 02:33:17.943516 | instance | TASK [vexxhost.kubernetes.kubernetes : Check if the Kubernetes API services is up to date] ***
2026-04-03 02:33:17.943823 | instance | Friday 03 April 2026  02:33:17 +0000 (0:00:00.045)       0:08:40.158 **********
2026-04-03 02:33:17.984023 | instance | skipping: [instance]
2026-04-03 02:33:17.984283 | instance |
2026-04-03 02:33:17.984720 | instance | TASK [vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services] ***
2026-04-03 02:33:17.985015 | instance | Friday 03 April 2026  02:33:17 +0000 (0:00:00.041)       0:08:40.199 **********
2026-04-03 02:33:18.027901 | instance | skipping: [instance]
2026-04-03 02:33:18.028145 | instance |
2026-04-03 02:33:18.028457 | instance | TASK [vexxhost.kubernetes.kubernetes : Setup nodes] ****************************
2026-04-03 02:33:18.028731 | instance | Friday 03 April 2026  02:33:18 +0000 (0:00:00.043)       0:08:40.243 **********
2026-04-03 02:33:18.076819 | instance | skipping: [instance]
2026-04-03 02:33:18.077017 | instance |
2026-04-03 02:33:18.077307 | instance | TASK [vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed)] ***
2026-04-03 02:33:18.077576 | instance | Friday 03 April 2026  02:33:18 +0000 (0:00:00.047)       0:08:40.290 **********
2026-04-03 02:33:18.606043 | instance | ok: [instance]
2026-04-03 02:33:18.606177 | instance |
2026-04-03 02:33:18.606359 | instance | TASK [vexxhost.kubernetes.kubernetes : Set node selector for CoreDNS components] ***
2026-04-03 02:33:18.606537 | instance | Friday 03 April 2026  02:33:18 +0000 (0:00:00.530)       0:08:40.821 **********
2026-04-03 02:33:19.720085 | instance | changed: [instance]
2026-04-03 02:33:19.720337 | instance |
2026-04-03 02:33:19.720663 | instance | PLAY [Install control-plane components] ****************************************
2026-04-03 02:33:19.720906 | instance |
2026-04-03 02:33:19.721170 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:33:19.721434 | instance | Friday 03 April 2026  02:33:19 +0000 (0:00:01.113)       0:08:41.935 **********
2026-04-03 02:33:20.730616 | instance | ok: [instance]
2026-04-03 02:33:20.730693 | instance |
2026-04-03 02:33:20.730705 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-03 02:33:20.730716 | instance | Friday 03 April 2026  02:33:20 +0000 (0:00:00.998)       0:08:42.934 **********
2026-04-03 02:33:20.937270 | instance | ok: [instance]
2026-04-03 02:33:20.937634 | instance |
2026-04-03 02:33:20.937650 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-03 02:33:20.937985 | instance | Friday 03 April 2026  02:33:20 +0000 (0:00:00.218)       0:08:43.152 **********
2026-04-03 02:33:22.359434 | instance | ok: [instance]
2026-04-03 02:33:22.359517 | instance |
2026-04-03 02:33:22.359757 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-03 02:33:22.359811 | instance | Friday 03 April 2026  02:33:22 +0000 (0:00:01.422)       0:08:44.574 **********
2026-04-03 02:33:22.610226 | instance | ok: [instance]
2026-04-03 02:33:22.610312 | instance |
2026-04-03 02:33:22.610323 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:33:22.610333 | instance | Friday 03 April 2026  02:33:22 +0000 (0:00:00.248)       0:08:44.823 **********
2026-04-03 02:33:22.661070 | instance | ok: [instance] => {
2026-04-03 02:33:22.661167 | instance |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-04-03 02:33:22.661285 | instance | }
2026-04-03 02:33:22.661397 | instance |
2026-04-03 02:33:22.661521 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:33:22.661638 | instance | Friday 03 April 2026  02:33:22 +0000 (0:00:00.052)       0:08:44.876 **********
2026-04-03 02:33:23.243798 | instance | changed: [instance]
2026-04-03 02:33:23.244059 | instance |
2026-04-03 02:33:23.244386 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:33:23.244822 | instance | Friday 03 April 2026  02:33:23 +0000 (0:00:00.582)       0:08:45.458 **********
2026-04-03 02:33:24.745893 | instance | changed: [instance]
2026-04-03 02:33:24.746121 | instance |
2026-04-03 02:33:24.746451 | instance | TASK [vexxhost.kubernetes.helm : Remove Helm repository] ***********************
2026-04-03 02:33:24.746720 | instance | Friday 03 April 2026  02:33:24 +0000 (0:00:01.502)       0:08:46.960 **********
2026-04-03 02:33:25.085291 | instance | ok: [instance]
2026-04-03 02:33:25.085524 | instance |
2026-04-03 02:33:25.085815 | instance | TASK [vexxhost.kubernetes.helm : Add bash autocomplete for helm] ***************
2026-04-03 02:33:25.086142 | instance | Friday 03 April 2026  02:33:25 +0000 (0:00:00.338)       0:08:47.299 **********
2026-04-03 02:33:25.298893 | instance | changed: [instance]
2026-04-03 02:33:25.299008 | instance |
2026-04-03 02:33:25.299185 | instance | TASK [vexxhost.kubernetes.helm : Get Helm plugins dir] *************************
2026-04-03 02:33:25.299353 | instance | Friday 03 April 2026  02:33:25 +0000 (0:00:00.214)       0:08:47.513 **********
2026-04-03 02:33:25.590002 | instance | ok: [instance]
2026-04-03 02:33:25.590281 | instance |
2026-04-03 02:33:25.590657 | instance | TASK [vexxhost.kubernetes.helm : Create Helm plugins directory if it does not exist] ***
2026-04-03 02:33:25.590948 | instance | Friday 03 April 2026  02:33:25 +0000 (0:00:00.290)       0:08:47.804 **********
2026-04-03 02:33:25.810412 | instance | changed: [instance]
2026-04-03 02:33:25.810480 | instance |
2026-04-03 02:33:25.810495 | instance | TASK [vexxhost.kubernetes.helm : Remove Helm diff plugin installed by kubernetes.core.helm_plugin] ***
2026-04-03 02:33:25.810861 | instance | Friday 03 April 2026  02:33:25 +0000 (0:00:00.219)       0:08:48.024 **********
2026-04-03 02:33:26.020437 | instance | ok: [instance]
2026-04-03 02:33:26.020529 | instance |
2026-04-03 02:33:26.020630 | instance | TASK [Install plugin] **********************************************************
2026-04-03 02:33:26.020760 | instance | Friday 03 April 2026  02:33:26 +0000 (0:00:00.211)       0:08:48.235 **********
2026-04-03 02:33:26.085320 | instance | included: vexxhost.containers.download_artifact for instance
2026-04-03 02:33:26.085520 | instance |
2026-04-03 02:33:26.085814 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-03 02:33:26.086055 | instance | Friday 03 April 2026  02:33:26 +0000 (0:00:00.064)       0:08:48.300 **********
2026-04-03 02:33:26.139477 | instance | ok: [instance] => {
2026-04-03 02:33:26.139770 | instance |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-04-03 02:33:26.140040 | instance | }
2026-04-03 02:33:26.140239 | instance |
2026-04-03 02:33:26.140631 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-03 02:33:26.140976 | instance | Friday 03 April 2026  02:33:26 +0000 (0:00:00.053)       0:08:48.354 **********
2026-04-03 02:33:27.519485 | instance | changed: [instance]
2026-04-03 02:33:27.519685 | instance |
2026-04-03 02:33:27.519947 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-03 02:33:27.520235 | instance | Friday 03 April 2026  02:33:27 +0000 (0:00:01.379)       0:08:49.734 **********
2026-04-03 02:33:29.382476 | instance | changed: [instance]
2026-04-03 02:33:29.382615 | instance |
2026-04-03 02:33:29.382814 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:33:29.383009 | instance | Friday 03 April 2026  02:33:29 +0000 (0:00:01.863)       0:08:51.597 **********
2026-04-03 02:33:29.422171 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:33:29.422416 | instance |
2026-04-03 02:33:29.422688 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:33:29.422952 | instance | Friday 03 April 2026  02:33:29 +0000 (0:00:00.039)       0:08:51.637 **********
2026-04-03 02:33:30.702977 | instance | changed: [instance]
2026-04-03 02:33:30.703175 | instance |
2026-04-03 02:33:30.703312 | instance | TASK [vexxhost.kubernetes.cilium : Get current Kubernetes version] *************
2026-04-03 02:33:30.703576 | instance | Friday 03 April 2026  02:33:30 +0000 (0:00:01.280)       0:08:52.917 **********
2026-04-03 02:33:31.618807 | instance | ok: [instance]
2026-04-03 02:33:31.619034 | instance |
2026-04-03 02:33:31.619346 | instance | TASK [vexxhost.kubernetes.cilium : Deploy Helm chart] **************************
2026-04-03 02:33:31.619745 | instance | Friday 03 April 2026  02:33:31 +0000 (0:00:00.915)       0:08:53.833 **********
2026-04-03 02:33:33.649769 | instance | changed: [instance]
2026-04-03 02:33:33.650370 | instance |
2026-04-03 02:33:33.650652 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:33:33.651100 | instance | Friday 03 April 2026  02:33:33 +0000 (0:00:02.031)       0:08:55.865 **********
2026-04-03 02:33:33.709249 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:33:33.709525 | instance |
2026-04-03 02:33:33.709811 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:33:33.710097 | instance | Friday 03 April 2026  02:33:33 +0000 (0:00:00.059)       0:08:55.924 **********
2026-04-03 02:33:34.241090 | instance | changed: [instance]
2026-04-03 02:33:34.241204 | instance |
2026-04-03 02:33:34.241225 | instance | TASK [vexxhost.kubernetes.envoy_gateway : Deploy Helm chart] *******************
2026-04-03 02:33:34.241381 | instance | Friday 03 April 2026  02:33:34 +0000 (0:00:00.531)       0:08:56.456 **********
2026-04-03 02:34:28.261242 | instance | changed: [instance]
2026-04-03 02:34:28.261549 | instance |
2026-04-03 02:34:28.261890 | instance | TASK [vexxhost.kubernetes.envoy_gateway : Create GatewayClass] *****************
2026-04-03 02:34:28.262234 | instance | Friday 03 April 2026  02:34:28 +0000 (0:00:54.019)       0:09:50.476 **********
2026-04-03 02:34:28.945292 | instance | changed: [instance]
2026-04-03 02:34:28.945532 | instance |
2026-04-03 02:34:28.945790 | instance | PLAY [all] *********************************************************************
2026-04-03 02:34:28.946033 | instance |
2026-04-03 02:34:28.946313 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:34:28.946577 | instance | Friday 03 April 2026  02:34:28 +0000 (0:00:00.684)       0:09:51.160 **********
2026-04-03 02:34:30.106372 | instance | ok: [instance]
2026-04-03 02:34:30.106426 | instance |
2026-04-03 02:34:30.106434 | instance | TASK [vexxhost.atmosphere.kubernetes_node_labels : Add labels to node] *********
2026-04-03 02:34:30.106441 | instance | Friday 03 April 2026  02:34:30 +0000 (0:00:01.160)       0:09:52.321 **********
2026-04-03 02:34:30.813438 | instance | changed: [instance]
2026-04-03 02:34:30.813517 | instance |
2026-04-03 02:34:30.813775 | instance | PLAY [all] *********************************************************************
2026-04-03 02:34:30.813840 | instance |
2026-04-03 02:34:30.813858 | instance | TASK [Uninstall unattended-upgrades] *******************************************
2026-04-03 02:34:30.814020 | instance | Friday 03 April 2026  02:34:30 +0000 (0:00:00.707)       0:09:53.029 **********
2026-04-03 02:34:31.594829 | instance | ok: [instance]
2026-04-03 02:34:31.594925 | instance |
2026-04-03 02:34:31.595153 | instance | PLAY [controllers] *************************************************************
2026-04-03 02:34:31.595225 | instance |
2026-04-03 02:34:31.595375 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:34:31.595467 | instance | Friday 03 April 2026  02:34:31 +0000 (0:00:00.781)       0:09:53.810 **********
2026-04-03 02:34:32.851634 | instance | ok: [instance]
2026-04-03 02:34:32.851681 | instance |
2026-04-03 02:34:32.851687 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:34:32.851692 | instance | Friday 03 April 2026  02:34:32 +0000 (0:00:01.256)       0:09:55.066 **********
2026-04-03 02:34:32.901732 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:34:32.901821 | instance |
2026-04-03 02:34:32.901841 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:34:32.901977 | instance | Friday 03 April 2026  02:34:32 +0000 (0:00:00.050)       0:09:55.117 **********
2026-04-03 02:34:33.359019 | instance | changed: [instance]
2026-04-03 02:34:33.359094 | instance |
2026-04-03 02:34:33.359366 | instance | TASK [vexxhost.atmosphere.local_path_provisioner : Deploy Helm chart] **********
2026-04-03 02:34:33.359410 | instance | Friday 03 April 2026  02:34:33 +0000 (0:00:00.457)       0:09:55.574 **********
2026-04-03 02:34:35.218481 | instance | changed: [instance]
2026-04-03 02:34:35.218597 | instance |
2026-04-03 02:34:35.218916 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:34:35.219383 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:01.859)       0:09:57.433 **********
2026-04-03 02:34:35.257227 | instance | skipping: [instance]
2026-04-03 02:34:35.257630 | instance |
2026-04-03 02:34:35.257730 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Collect "ceph mon dump" output from a monitor] ***
2026-04-03 02:34:35.257752 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.038)       0:09:57.472 **********
2026-04-03 02:34:35.309969 | instance | skipping: [instance]
2026-04-03 02:34:35.310073 | instance |
2026-04-03 02:34:35.310295 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Generate fact with Ceph FSID] *********
2026-04-03 02:34:35.310343 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.052)       0:09:57.525 **********
2026-04-03 02:34:35.347881 | instance | skipping: [instance]
2026-04-03 02:34:35.347996 | instance |
2026-04-03 02:34:35.348140 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Generate fact with list of Ceph monitors] ***
2026-04-03 02:34:35.348345 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.037)       0:09:57.563 **********
2026-04-03 02:34:35.386426 | instance | skipping: [instance]
2026-04-03 02:34:35.386513 | instance |
2026-04-03 02:34:35.386790 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Create Ceph pool] *********************
2026-04-03 02:34:35.386839 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.038)       0:09:57.601 **********
2026-04-03 02:34:35.438420 | instance | skipping: [instance]
2026-04-03 02:34:35.439459 | instance |
2026-04-03 02:34:35.439492 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Create user client.kube] **************
2026-04-03 02:34:35.439533 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.050)       0:09:57.652 **********
2026-04-03 02:34:35.486848 | instance | skipping: [instance]
2026-04-03 02:34:35.486934 | instance |
2026-04-03 02:34:35.487068 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Retrieve keyring for client.kube] *****
2026-04-03 02:34:35.487244 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.049)       0:09:57.701 **********
2026-04-03 02:34:35.553319 | instance | skipping: [instance]
2026-04-03 02:34:35.553393 | instance |
2026-04-03 02:34:35.553522 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Store keyring inside fact] ************
2026-04-03 02:34:35.553656 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.066)       0:09:57.768 **********
2026-04-03 02:34:35.599423 | instance | skipping: [instance]
2026-04-03 02:34:35.599890 | instance |
2026-04-03 02:34:35.599989 | instance | TASK [vexxhost.atmosphere.ceph_csi_rbd : Deploy Helm chart] ********************
2026-04-03 02:34:35.600292 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.046)       0:09:57.814 **********
2026-04-03 02:34:35.654424 | instance | skipping: [instance]
2026-04-03 02:34:35.654619 | instance |
2026-04-03 02:34:35.654888 | instance | TASK [vexxhost.atmosphere.powerstore_csi : Clone PowerStore CSI from GitHub] ***
2026-04-03 02:34:35.655157 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.055)       0:09:57.869 **********
2026-04-03 02:34:35.691781 | instance | skipping: [instance]
2026-04-03 02:34:35.692030 | instance |
2026-04-03 02:34:35.692296 | instance | TASK [vexxhost.atmosphere.powerstore_csi : Create Secret] **********************
2026-04-03 02:34:35.692619 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.037)       0:09:57.907 **********
2026-04-03 02:34:35.722701 | instance | skipping: [instance]
2026-04-03 02:34:35.722841 | instance |
2026-04-03 02:34:35.723099 | instance | TASK [vexxhost.atmosphere.powerstore_csi : Create StorageClass] ****************
2026-04-03 02:34:35.723358 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.030)       0:09:57.938 **********
2026-04-03 02:34:35.762857 | instance | skipping: [instance]
2026-04-03 02:34:35.763102 | instance |
2026-04-03 02:34:35.763367 | instance | TASK [vexxhost.atmosphere.powerstore_csi : Deploy Helm chart] ******************
2026-04-03 02:34:35.763627 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.040)       0:09:57.978 **********
2026-04-03 02:34:35.820847 | instance | skipping: [instance]
2026-04-03 02:34:35.821101 | instance |
2026-04-03 02:34:35.821381 | instance | TASK [vexxhost.atmosphere.multipathd : Add backports PPA] **********************
2026-04-03 02:34:35.821657 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.058)       0:09:58.036 **********
2026-04-03 02:34:35.858817 | instance | skipping: [instance]
2026-04-03 02:34:35.859203 | instance |
2026-04-03 02:34:35.859465 | instance | TASK [vexxhost.atmosphere.multipathd : Install the multipathd package] *********
2026-04-03 02:34:35.859723 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.037)       0:09:58.074 **********
2026-04-03 02:34:35.897802 | instance | skipping: [instance]
2026-04-03 02:34:35.898101 | instance |
2026-04-03 02:34:35.898380 | instance | TASK [vexxhost.atmosphere.multipathd : Install the configuration file] *********
2026-04-03 02:34:35.898663 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.039)       0:09:58.113 **********
2026-04-03 02:34:35.952517 | instance | skipping: [instance]
2026-04-03 02:34:35.952734 | instance |
2026-04-03 02:34:35.952994 | instance | TASK [vexxhost.atmosphere.portworx : Detect if InitiatorName is set] ***********
2026-04-03 02:34:35.953252 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.054)       0:09:58.167 **********
2026-04-03 02:34:35.995655 | instance | skipping: [instance]
2026-04-03 02:34:35.995927 | instance |
2026-04-03 02:34:35.996234 | instance | TASK [vexxhost.atmosphere.portworx : Generate a new InitiatorName] *************
2026-04-03 02:34:35.996568 | instance | Friday 03 April 2026  02:34:35 +0000 (0:00:00.042)       0:09:58.210 **********
2026-04-03 02:34:36.039288 | instance | skipping: [instance]
2026-04-03 02:34:36.039547 | instance |
2026-04-03 02:34:36.039904 | instance | TASK [vexxhost.atmosphere.portworx : Write the new InitiatorName] **************
2026-04-03 02:34:36.040205 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.043)       0:09:58.254 **********
2026-04-03 02:34:36.078950 | instance | skipping: [instance]
2026-04-03 02:34:36.079148 | instance |
2026-04-03 02:34:36.079433 | instance | TASK [vexxhost.atmosphere.portworx : Create namespace] *************************
2026-04-03 02:34:36.079854 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.039)       0:09:58.294 **********
2026-04-03 02:34:36.116350 | instance | skipping: [instance]
2026-04-03 02:34:36.116569 | instance |
2026-04-03 02:34:36.116835 | instance | TASK [vexxhost.atmosphere.portworx : Install Portworx] *************************
2026-04-03 02:34:36.117100 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.037)       0:09:58.331 **********
2026-04-03 02:34:36.158286 | instance | skipping: [instance]
2026-04-03 02:34:36.158409 | instance |
2026-04-03 02:34:36.158605 | instance | TASK [vexxhost.atmosphere.portworx : Wait till the CRDs are created] ***********
2026-04-03 02:34:36.158778 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.042)       0:09:58.373 **********
2026-04-03 02:34:36.199622 | instance | skipping: [instance]
2026-04-03 02:34:36.199930 | instance |
2026-04-03 02:34:36.200354 | instance | TASK [vexxhost.atmosphere.portworx : Create Portworx Storage Cluster] **********
2026-04-03 02:34:36.200693 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.040)       0:09:58.414 **********
2026-04-03 02:34:36.250926 | instance | skipping: [instance]
2026-04-03 02:34:36.304059 | instance |
2026-04-03 02:34:36.304087 | instance | TASK [vexxhost.atmosphere.storpool_csi : Deploy CSI RBAC] **********************
2026-04-03 02:34:36.304097 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.051)       0:09:58.466 **********
2026-04-03 02:34:36.304107 | instance | skipping: [instance] => (item={'name': 'controllerplugin'})
2026-04-03 02:34:36.304116 | instance | skipping: [instance] => (item={'name': 'nodeplugin'})
2026-04-03 02:34:36.304125 | instance | skipping: [instance]
2026-04-03 02:34:36.304134 | instance |
2026-04-03 02:34:36.304142 | instance | TASK [vexxhost.atmosphere.storpool_csi : Deploy CSI] ***************************
2026-04-03 02:34:36.304151 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.041)       0:09:58.508 **********
2026-04-03 02:34:36.335803 | instance | skipping: [instance]
2026-04-03 02:34:36.335961 | instance |
2026-04-03 02:34:36.336109 | instance | TASK [vexxhost.atmosphere.storpool_csi : Create StorageClass] ******************
2026-04-03 02:34:36.336272 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.042)       0:09:58.550 **********
2026-04-03 02:34:36.394590 | instance | skipping: [instance]
2026-04-03 02:34:36.394684 | instance |
2026-04-03 02:34:36.394934 | instance | TASK [vexxhost.atmosphere.ibm_block_csi_driver : Deploy CSI] *******************
2026-04-03 02:34:36.395004 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.059)       0:09:58.610 **********
2026-04-03 02:34:36.437674 | instance | skipping: [instance]
2026-04-03 02:34:36.437907 | instance |
2026-04-03 02:34:36.438188 | instance | TASK [vexxhost.atmosphere.ibm_block_csi_driver : Create Secret] ****************
2026-04-03 02:34:36.438544 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.042)       0:09:58.652 **********
2026-04-03 02:34:36.475678 | instance | skipping: [instance]
2026-04-03 02:34:36.508734 | instance |
2026-04-03 02:34:36.508751 | instance | TASK [vexxhost.atmosphere.ibm_block_csi_driver : Create StorageClass] **********
2026-04-03 02:34:36.508758 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.037)       0:09:58.690 **********
2026-04-03 02:34:36.527709 | instance | skipping: [instance]
2026-04-03 02:34:36.527965 | instance |
2026-04-03 02:34:36.528258 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:34:36.528570 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.052)       0:09:58.743 **********
2026-04-03 02:34:36.585199 | instance | skipping: [instance]
2026-04-03 02:34:36.585236 | instance |
2026-04-03 02:34:36.585248 | instance | TASK [vexxhost.atmosphere.hpe_nimble_csi : Create Secret] **********************
2026-04-03 02:34:36.585258 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.044)       0:09:58.788 **********
2026-04-03 02:34:36.626433 | instance | skipping: [instance]
2026-04-03 02:34:36.626480 | instance |
2026-04-03 02:34:36.626496 | instance | TASK [vexxhost.atmosphere.hpe_nimble_csi : Create StorageClass] ****************
2026-04-03 02:34:36.626510 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.042)       0:09:58.830 **********
2026-04-03 02:34:36.654099 | instance | skipping: [instance]
2026-04-03 02:34:36.654341 | instance |
2026-04-03 02:34:36.654626 | instance | TASK [vexxhost.atmosphere.hpe_nimble_csi : Deploy Helm chart] ******************
2026-04-03 02:34:36.654894 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.038)       0:09:58.869 **********
2026-04-03 02:34:36.729022 | instance | skipping: [instance]
2026-04-03 02:34:36.729288 | instance |
2026-04-03 02:34:36.729605 | instance | PLAY [Deploy Infrastructure] ***************************************************
2026-04-03 02:34:36.729886 | instance |
2026-04-03 02:34:36.730193 | instance | TASK [Gathering Facts] *********************************************************
2026-04-03 02:34:36.730547 | instance | Friday 03 April 2026  02:34:36 +0000 (0:00:00.075)       0:09:58.944 **********
2026-04-03 02:34:37.963409 | instance | ok: [instance]
2026-04-03 02:34:37.963670 | instance |
2026-04-03 02:34:37.964138 | instance | TASK [Deploy Helm chart] *******************************************************
2026-04-03 02:34:37.964254 | instance | Friday 03 April 2026  02:34:37 +0000 (0:00:01.234)       0:10:00.178 **********
2026-04-03 02:34:38.018671 | instance | included: vexxhost.kubernetes.cert_manager for instance
2026-04-03 02:34:38.023885 | instance |
2026-04-03 02:34:38.023924 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:34:38.023939 | instance | Friday 03 April 2026  02:34:38 +0000 (0:00:00.055)       0:10:00.233 **********
2026-04-03 02:34:38.067833 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:34:38.068077 | instance |
2026-04-03 02:34:38.068410 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:34:38.068695 | instance | Friday 03 April 2026  02:34:38 +0000 (0:00:00.049)       0:10:00.282 **********
2026-04-03 02:34:38.747659 | instance | changed: [instance]
2026-04-03 02:34:38.747743 | instance |
2026-04-03 02:34:38.747847 | instance | TASK [vexxhost.kubernetes.cert_manager : Deploy Helm chart] ********************
2026-04-03 02:34:38.747950 | instance | Friday 03 April 2026  02:34:38 +0000 (0:00:00.680)       0:10:00.963 **********
2026-04-03 02:35:09.403245 | instance | changed: [instance]
2026-04-03 02:35:09.403445 | instance |
2026-04-03 02:35:09.403818 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Create self-signed cluster issuer] ***
2026-04-03 02:35:09.404165 | instance | Friday 03 April 2026  02:35:09 +0000 (0:00:30.655)       0:10:31.618 **********
2026-04-03 02:35:10.596413 | instance | changed: [instance]
2026-04-03 02:35:10.596667 | instance |
2026-04-03 02:35:10.597018 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Import tasks for ClusterIssuer type] ***
2026-04-03 02:35:10.597309 | instance | Friday 03 April 2026  02:35:10 +0000 (0:00:01.193)       0:10:32.811 **********
2026-04-03 02:35:10.641122 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/atmosphere/roles/cluster_issuer/tasks/type/self-signed/main.yml for instance
2026-04-03 02:35:10.641392 | instance |
2026-04-03 02:35:10.641670 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Create ClusterIssuer] ***************
2026-04-03 02:35:10.641928 | instance | Friday 03 April 2026  02:35:10 +0000 (0:00:00.044)       0:10:32.856 **********
2026-04-03 02:35:11.883218 | instance | changed: [instance]
2026-04-03 02:35:11.883466 | instance |
2026-04-03 02:35:11.883810 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Wait till the secret is created] ****
2026-04-03 02:35:11.884195 | instance | Friday 03 April 2026  02:35:11 +0000 (0:00:01.242)       0:10:34.098 **********
2026-04-03 02:35:12.673796 | instance | ok: [instance]
2026-04-03 02:35:12.674026 | instance |
2026-04-03 02:35:12.674300 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Copy CA certificate on host] ********
2026-04-03 02:35:12.674566 | instance | Friday 03 April 2026  02:35:12 +0000 (0:00:00.790)       0:10:34.889 **********
2026-04-03 02:35:13.149063 | instance | changed: [instance]
2026-04-03 02:35:13.149152 | instance |
2026-04-03 02:35:13.149269 | instance | TASK [vexxhost.atmosphere.cluster_issuer : Flush all handlers] *****************
2026-04-03 02:35:13.149422 | instance | Friday 03 April 2026  02:35:13 +0000 (0:00:00.467)       0:10:35.356 **********
2026-04-03 02:35:13.149501 | instance |
2026-04-03 02:35:13.149733 | instance | RUNNING HANDLER [vexxhost.atmosphere.cluster_issuer : Install openssl-perl package] ***
2026-04-03 02:35:13.149894 | instance | Friday 03 April 2026  02:35:13 +0000 (0:00:00.007)       0:10:35.364 **********
2026-04-03 02:35:13.188938 | instance | skipping: [instance]
2026-04-03 02:35:13.189159 | instance |
2026-04-03 02:35:13.189434 | instance | RUNNING HANDLER [vexxhost.atmosphere.cluster_issuer : Update CA certificates] ***
2026-04-03 02:35:13.189694 | instance | Friday 03 April 2026  02:35:13 +0000 (0:00:00.039)       0:10:35.404 **********
2026-04-03 02:35:14.886512 | instance | changed: [instance]
2026-04-03 02:35:14.886642 | instance |
2026-04-03 02:35:14.886832 | instance | RUNNING HANDLER [vexxhost.atmosphere.cluster_issuer : Rehash CA certificates] ***
2026-04-03 02:35:14.886978 | instance | Friday 03 April 2026  02:35:14 +0000 (0:00:01.697)       0:10:37.101 **********
2026-04-03 02:35:17.400641 | instance | changed: [instance]
2026-04-03 02:35:17.400860 | instance |
2026-04-03 02:35:17.401151 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:35:17.401421 | instance | Friday 03 April 2026  02:35:17 +0000 (0:00:02.513)       0:10:39.615 **********
2026-04-03 02:35:17.443486 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:35:17.443632 | instance |
2026-04-03 02:35:17.444008 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:35:17.444206 | instance | Friday 03 April 2026  02:35:17 +0000 (0:00:00.043)       0:10:39.658 **********
2026-04-03 02:35:17.959127 | instance | changed: [instance]
2026-04-03 02:35:17.959259 | instance |
2026-04-03 02:35:17.959337 | instance | TASK [vexxhost.atmosphere.ingress_nginx : Deploy Helm chart] *******************
2026-04-03 02:35:17.959465 | instance | Friday 03 April 2026  02:35:17 +0000 (0:00:00.515)       0:10:40.174 **********
2026-04-03 02:35:38.230477 | instance | changed: [instance]
2026-04-03 02:35:38.230545 | instance |
2026-04-03 02:35:38.230559 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:35:38.230572 | instance | Friday 03 April 2026  02:35:38 +0000 (0:00:20.269)       0:11:00.444 **********
2026-04-03 02:35:38.274696 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:35:38.274762 | instance |
2026-04-03 02:35:38.274770 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:35:38.274775 | instance | Friday 03 April 2026  02:35:38 +0000 (0:00:00.045)       0:11:00.489 **********
2026-04-03 02:35:38.817255 | instance | changed: [instance]
2026-04-03 02:35:38.817869 | instance |
2026-04-03 02:35:38.818392 | instance | TASK [vexxhost.atmosphere.rabbitmq_cluster_operator : Install all CRDs] ********
2026-04-03 02:35:38.818739 | instance | Friday 03 April 2026  02:35:38 +0000 (0:00:00.543)       0:11:01.032 **********
2026-04-03 02:35:42.766644 | instance | ok: [instance] => (item=messaging-topology-operator)
2026-04-03 02:35:42.766721 | instance | ok: [instance] => (item=rabbitmq-cluster)
2026-04-03 02:35:42.767201 | instance |
2026-04-03 02:35:42.767257 | instance | TASK [vexxhost.atmosphere.rabbitmq_cluster_operator : Deploy Helm chart] *******
2026-04-03 02:35:42.767265 | instance | Friday 03 April 2026  02:35:42 +0000 (0:00:03.949)       0:11:04.982 **********
2026-04-03 02:35:49.066217 | instance | changed: [instance]
2026-04-03 02:35:49.066305 | instance |
2026-04-03 02:35:49.066616 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:35:49.066659 | instance | Friday 03 April 2026  02:35:49 +0000 (0:00:06.299)       0:11:11.281 **********
2026-04-03 02:35:49.112565 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:35:49.112627 | instance |
2026-04-03 02:35:49.112751 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:35:49.112871 | instance | Friday 03 April 2026  02:35:49 +0000 (0:00:00.046)       0:11:11.328 **********
2026-04-03 02:35:49.640010 | instance | changed: [instance]
2026-04-03 02:35:49.640088 | instance |
2026-04-03 02:35:49.640426 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster_operator : Install all CRDs] ***
2026-04-03 02:35:49.640471 | instance | Friday 03 April 2026  02:35:49 +0000 (0:00:00.527)       0:11:11.855 **********
2026-04-03 02:35:53.562223 | instance | ok: [instance]
2026-04-03 02:35:53.562323 | instance |
2026-04-03 02:35:53.562335 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster_operator : Deploy Helm chart] ***
2026-04-03 02:35:53.562402 | instance | Friday 03 April 2026  02:35:53 +0000 (0:00:03.921)       0:11:15.777 **********
2026-04-03 02:35:57.098647 | instance | changed: [instance]
2026-04-03 02:35:57.098716 | instance |
2026-04-03 02:35:57.098723 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Check if the Percona XtraDB cluster secret exists] ***
2026-04-03 02:35:57.098728 | instance | Friday 03 April 2026  02:35:57 +0000 (0:00:03.536)       0:11:19.313 **********
2026-04-03 02:35:57.808600 | instance | ok: [instance]
2026-04-03 02:35:57.808688 | instance |
2026-04-03 02:35:57.808989 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Create a secret] ************
2026-04-03 02:35:57.809047 | instance | Friday 03 April 2026  02:35:57 +0000 (0:00:00.710)       0:11:20.023 **********
2026-04-03 02:35:58.665174 | instance | changed: [instance]
2026-04-03 02:35:58.665239 | instance |
2026-04-03 02:35:58.665510 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Check if the Percona XtraDB cluster exists] ***
2026-04-03 02:35:58.665582 | instance | Friday 03 April 2026  02:35:58 +0000 (0:00:00.856)       0:11:20.880 **********
2026-04-03 02:35:59.900767 | instance | ok: [instance]
2026-04-03 02:35:59.901033 | instance |
2026-04-03 02:35:59.901084 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Get current status of the cluster] ***
2026-04-03 02:35:59.901255 | instance | Friday 03 April 2026  02:35:59 +0000 (0:00:01.235)       0:11:22.116 **********
2026-04-03 02:35:59.952799 | instance | skipping: [instance]
2026-04-03 02:35:59.953164 | instance |
2026-04-03 02:35:59.953179 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Assert that the cluster is healthy before upgrade] ***
2026-04-03 02:35:59.953185 | instance | Friday 03 April 2026  02:35:59 +0000 (0:00:00.051)       0:11:22.168 **********
2026-04-03 02:36:00.017704 | instance | skipping: [instance]
2026-04-03 02:36:00.017822 | instance |
2026-04-03 02:36:00.018003 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Stop PXC-operator] **********
2026-04-03 02:36:00.018173 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.064)       0:11:22.233 **********
2026-04-03 02:36:00.066194 | instance | skipping: [instance]
2026-04-03 02:36:00.066414 | instance |
2026-04-03 02:36:00.066713 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Change the cluster Statefulset image to 8.0] ***
2026-04-03 02:36:00.067004 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.047)       0:11:22.281 **********
2026-04-03 02:36:00.108374 | instance | skipping: [instance]
2026-04-03 02:36:00.126576 | instance |
2026-04-03 02:36:00.126599 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Wait until the cluster Statefulset rollout] ***
2026-04-03 02:36:00.126607 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.042)       0:11:22.323 **********
2026-04-03 02:36:00.152100 | instance | skipping: [instance]
2026-04-03 02:36:00.152288 | instance |
2026-04-03 02:36:00.152598 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Update pxc cluster spec] ****
2026-04-03 02:36:00.152894 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.043)       0:11:22.366 **********
2026-04-03 02:36:00.195511 | instance | skipping: [instance]
2026-04-03 02:36:00.199974 | instance |
2026-04-03 02:36:00.200023 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Start PXC-operator] *********
2026-04-03 02:36:00.200032 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.043)       0:11:22.410 **********
2026-04-03 02:36:00.234361 | instance | skipping: [instance]
2026-04-03 02:36:00.234592 | instance |
2026-04-03 02:36:00.234901 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Apply Percona XtraDB cluster] ***
2026-04-03 02:36:00.235335 | instance | Friday 03 April 2026  02:36:00 +0000 (0:00:00.039)       0:11:22.449 **********
2026-04-03 02:37:53.752057 | instance | changed: [instance]
2026-04-03 02:37:53.752254 | instance |
2026-04-03 02:37:53.752658 | instance | TASK [vexxhost.atmosphere.percona_xtradb_cluster : Create percona haproxy metric service] ***
2026-04-03 02:37:53.753022 | instance | Friday 03 April 2026  02:37:53 +0000 (0:01:53.517)       0:13:15.966 **********
2026-04-03 02:37:54.449436 | instance | changed: [instance]
2026-04-03 02:37:54.449524 | instance |
2026-04-03 02:37:54.449722 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:37:54.449906 | instance | Friday 03 April 2026  02:37:54 +0000 (0:00:00.697)       0:13:16.664 **********
2026-04-03 02:37:54.500048 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:37:54.500262 | instance |
2026-04-03 02:37:54.500642 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:37:54.500905 | instance | Friday 03 April 2026  02:37:54 +0000 (0:00:00.050)       0:13:16.715 **********
2026-04-03 02:37:54.996730 | instance | changed: [instance]
2026-04-03 02:37:54.996979 | instance |
2026-04-03 02:37:54.997279 | instance | TASK [vexxhost.atmosphere.valkey : Create TLS resources] ***********************
2026-04-03 02:37:54.997573 | instance | Friday 03 April 2026  02:37:54 +0000 (0:00:00.496)       0:13:17.211 **********
2026-04-03 02:37:55.779312 | instance | changed: [instance]
2026-04-03 02:37:55.779442 | instance |
2026-04-03 02:37:55.779627 | instance | TASK [vexxhost.atmosphere.valkey : Deploy Helm chart] **************************
2026-04-03 02:37:55.779789 | instance | Friday 03 April 2026  02:37:55 +0000 (0:00:00.782)       0:13:17.994 **********
2026-04-03 02:37:57.334027 | instance | changed: [instance]
2026-04-03 02:37:57.334270 | instance |
2026-04-03 02:37:57.334548 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Retrieve list of all the needed endpoints] ***
2026-04-03 02:37:57.334567 | instance | Friday 03 April 2026  02:37:57 +0000 (0:00:01.554)       0:13:19.549 **********
2026-04-03 02:37:57.383848 | instance | skipping: [instance]
2026-04-03 02:37:57.383924 | instance |
2026-04-03 02:37:57.384201 | instance | TASK [Create RabbitMQ cluster] *************************************************
2026-04-03 02:37:57.384244 | instance | Friday 03 April 2026  02:37:57 +0000 (0:00:00.049)       0:13:19.599 **********
2026-04-03 02:37:57.421528 | instance | skipping: [instance]
2026-04-03 02:37:57.421742 | instance |
2026-04-03 02:37:57.422009 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Grab RabbitMQ cluster secret] ***
2026-04-03 02:37:57.422214 | instance | Friday 03 April 2026  02:37:57 +0000 (0:00:00.037)       0:13:19.636 **********
2026-04-03 02:37:57.459087 | instance | skipping: [instance]
2026-04-03 02:37:57.459150 | instance |
2026-04-03 02:37:57.459156 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Cache fact with RabbitMQ cluster credentials] ***
2026-04-03 02:37:57.459162 | instance | Friday 03 April 2026  02:37:57 +0000 (0:00:00.037)       0:13:19.673 **********
2026-04-03 02:37:57.500762 | instance | skipping: [instance]
2026-04-03 02:37:57.500860 | instance |
2026-04-03 02:37:57.501072 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Grab Percona XtraDB cluster secret] ***
2026-04-03 02:37:57.501300 | instance | Friday 03 April 2026  02:37:57 +0000 (0:00:00.042)       0:13:19.715 **********
2026-04-03 02:37:58.213471 | instance | ok: [instance]
2026-04-03 02:37:58.213590 | instance |
2026-04-03 02:37:58.214003 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Cache fact with Percona XtraDB password] ***
2026-04-03 02:37:58.214053 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.712)       0:13:20.428 **********
2026-04-03 02:37:58.275528 | instance | ok: [instance]
2026-04-03 02:37:58.275580 | instance |
2026-04-03 02:37:58.275587 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Reset value for OpenStack_Helm endpoints] ***
2026-04-03 02:37:58.275594 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.061)       0:13:20.490 **********
2026-04-03 02:37:58.318595 | instance | ok: [instance]
2026-04-03 02:37:58.319042 | instance |
2026-04-03 02:37:58.319172 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Generate OpenStack-Helm endpoints] ***
2026-04-03 02:37:58.319205 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.043)       0:13:20.533 **********
2026-04-03 02:37:58.374396 | instance | ok: [instance] => (item=oslo_db)
2026-04-03 02:37:58.374500 | instance |
2026-04-03 02:37:58.374642 | instance | TASK [vexxhost.atmosphere.openstack_helm_endpoints : Clean-up facts] ***********
2026-04-03 02:37:58.374758 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.056)       0:13:20.590 **********
2026-04-03 02:37:58.422064 | instance | ok: [instance]
2026-04-03 02:37:58.422163 | instance |
2026-04-03 02:37:58.422269 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-04-03 02:37:58.422390 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.047)       0:13:20.637 **********
2026-04-03 02:37:58.472671 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for instance
2026-04-03 02:37:58.472784 | instance |
2026-04-03 02:37:58.472954 | instance | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-04-03 02:37:58.473088 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.050)       0:13:20.688 **********
2026-04-03 02:37:58.968703 | instance | changed: [instance]
2026-04-03 02:37:58.968811 | instance |
2026-04-03 02:37:58.968905 | instance | TASK [vexxhost.atmosphere.keycloak : Get the Kuberentes service for Percona XtraDB Cluster] ***
2026-04-03 02:37:58.969030 | instance | Friday 03 April 2026  02:37:58 +0000 (0:00:00.496)       0:13:21.184 **********
2026-04-03 02:37:59.609993 | instance | ok: [instance]
2026-04-03 02:37:59.610066 | instance |
2026-04-03 02:37:59.610344 | instance | TASK [vexxhost.atmosphere.keycloak : Install MySQL python package] *************
2026-04-03 02:37:59.610390 | instance | Friday 03 April 2026  02:37:59 +0000 (0:00:00.641)       0:13:21.825 **********
2026-04-03 02:38:00.776736 | instance | changed: [instance]
2026-04-03 02:38:00.776829 | instance |
2026-04-03 02:38:00.776931 | instance | TASK [vexxhost.atmosphere.keycloak : Check MySQL ready] ************************
2026-04-03 02:38:00.777046 | instance | Friday 03 April 2026  02:38:00 +0000 (0:00:01.166)       0:13:22.992 **********
2026-04-03 02:38:01.113421 | instance | ok: [instance]
2026-04-03 02:38:01.113580 | instance |
2026-04-03 02:38:01.113814 | instance | TASK [vexxhost.atmosphere.keycloak : Create Keycloak database] *****************
2026-04-03 02:38:01.114016 | instance | Friday 03 April 2026  02:38:01 +0000 (0:00:00.336)       0:13:23.328 **********
2026-04-03 02:38:01.455022 | instance | changed: [instance]
2026-04-03 02:38:01.455217 | instance |
2026-04-03 02:38:01.455381 | instance | TASK [vexxhost.atmosphere.keycloak : Create a Keycloak user] *******************
2026-04-03 02:38:01.455543 | instance | Friday 03 April 2026  02:38:01 +0000 (0:00:00.341)       0:13:23.670 **********
2026-04-03 02:38:01.830568 | instance | changed: [instance]
2026-04-03 02:38:01.830819 | instance |
2026-04-03 02:38:01.831119 | instance | TASK [vexxhost.atmosphere.keycloak : Disable pxc strict mode] ******************
2026-04-03 02:38:01.831479 | instance | Friday 03 April 2026  02:38:01 +0000 (0:00:00.375)       0:13:24.045 **********
2026-04-03 02:38:02.147756 | instance | ok: [instance]
2026-04-03 02:38:02.148045 | instance |
2026-04-03 02:38:02.148388 | instance | TASK [vexxhost.atmosphere.keycloak : Deploy Helm chart] ************************
2026-04-03 02:38:02.148657 | instance | Friday 03 April 2026  02:38:02 +0000 (0:00:00.317)       0:13:24.362 **********
2026-04-03 02:39:01.023182 | instance | fatal: [instance]: FAILED! => {"changed": false, "command": "/usr/bin/helm upgrade -i --reset-values --wait --timeout 10m --create-namespace -f=/tmp/tmpumj3k2_3.yml keycloak /usr/local/src/keycloak", "msg": "Failure when executing Helm command. Exited 1.\nstdout: Release \"keycloak\" does not exist. Installing it now.\n\nstderr: Error: etcdserver: request timed out\n", "stderr": "Error: etcdserver: request timed out\n", "stderr_lines": ["Error: etcdserver: request timed out"], "stdout": "Release \"keycloak\" does not exist. Installing it now.\n", "stdout_lines": ["Release \"keycloak\" does not exist. Installing it now."]}
2026-04-03 02:39:01.030464 | instance |
2026-04-03 02:39:01.030715 | instance | PLAY RECAP *********************************************************************
2026-04-03 02:39:01.030957 | instance | instance                   : ok=285  changed=99   unreachable=0    failed=1    skipped=107  rescued=0    ignored=2
2026-04-03 02:39:01.031168 | instance |
2026-04-03 02:39:01.031418 | instance | Friday 03 April 2026  02:39:01 +0000 (0:00:58.880)       0:14:23.243 **********
2026-04-03 02:39:01.031652 | instance | ===============================================================================
2026-04-03 02:39:01.031885 | instance | vexxhost.ceph.mon : Run Bootstrap coomand ----------------------------- 170.54s
2026-04-03 02:39:01.032146 | instance | vexxhost.atmosphere.percona_xtradb_cluster : Apply Percona XtraDB cluster - 113.52s
2026-04-03 02:39:01.032390 | instance | vexxhost.ceph.osd : Install OSDs -------------------------------------- 104.95s
2026-04-03 02:39:01.032603 | instance | vexxhost.atmosphere.keycloak : Deploy Helm chart ----------------------- 58.88s
2026-04-03 02:39:01.032826 | instance | vexxhost.kubernetes.envoy_gateway : Deploy Helm chart ------------------ 54.02s
2026-04-03 02:39:01.033016 | instance | vexxhost.kubernetes.kubernetes : Initialize cluster -------------------- 36.70s
2026-04-03 02:39:01.033334 | instance | vexxhost.kubernetes.cert_manager : Deploy Helm chart ------------------- 30.66s
2026-04-03 02:39:01.033421 | instance | vexxhost.atmosphere.ingress_nginx : Deploy Helm chart ------------------ 20.27s
2026-04-03 02:39:01.033606 | instance | vexxhost.kubernetes.kubernetes : Install PIP --------------------------- 16.43s
2026-04-03 02:39:01.033807 | instance | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 11.28s
2026-04-03 02:39:01.033994 | instance | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 10.38s
2026-04-03 02:39:01.034201 | instance | vexxhost.atmosphere.rabbitmq_cluster_operator : Deploy Helm chart ------- 6.30s
2026-04-03 02:39:01.034365 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 6.17s
2026-04-03 02:39:01.034534 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.16s
2026-04-03 02:39:01.034704 | instance | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.37s
2026-04-03 02:39:01.034871 | instance | vexxhost.ceph.osd : Get `cephadm ls` status ----------------------------- 5.31s
2026-04-03 02:39:01.035040 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.87s
2026-04-03 02:39:01.035226 | instance | vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems --- 4.78s
2026-04-03 02:39:01.035388 | instance | vexxhost.kubernetes.kubelet : Install additional packages --------------- 4.51s
2026-04-03 02:39:01.035556 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 4.09s
2026-04-03 02:39:01.238182 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-03 02:39:01.238317 | instance | ERROR    [aio > converge] Executed: Failed
2026-04-03 02:39:01.238447 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.aio/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/aio/converge.yml
2026-04-03 02:39:01.913894 | instance | ERROR
2026-04-03 02:39:01.914232 | instance | {
2026-04-03 02:39:01.914274 | instance |   "delta": "0:16:21.047835",
2026-04-03 02:39:01.914304 | instance |   "end": "2026-04-03 02:39:01.316672",
2026-04-03 02:39:01.914330 | instance |   "msg": "non-zero return code",
2026-04-03 02:39:01.914356 | instance |   "rc": 2,
2026-04-03 02:39:01.914386 | instance |   "start": "2026-04-03 02:22:40.268837"
2026-04-03 02:39:01.914412 | instance | }
failure
2026-04-03 02:39:02.428679 | 
2026-04-03 02:39:02.428836 | PLAY RECAP
2026-04-03 02:39:02.428916 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-03 02:39:02.429011 | 
2026-04-03 02:39:02.556762 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-03 02:39:02.565614 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-03 02:39:03.396593 | 
2026-04-03 02:39:03.396747 | PLAY [all]
2026-04-03 02:39:03.415184 | 
2026-04-03 02:39:03.415291 | TASK [gather-host-logs : creating directory for system status]
2026-04-03 02:39:03.746811 | instance | changed
2026-04-03 02:39:03.754216 | 
2026-04-03 02:39:03.754408 | TASK [gather-host-logs : Get logs for each host]
2026-04-03 02:39:04.105203 | instance | + systemd-cgls --full --all --no-pager
2026-04-03 02:39:04.133609 | instance | + ip addr
2026-04-03 02:39:04.136206 | instance | + ip route
2026-04-03 02:39:04.137998 | instance | + lsblk
2026-04-03 02:39:04.141947 | instance | + mount
2026-04-03 02:39:04.145651 | instance | + docker images
2026-04-03 02:39:04.163610 | instance | + brctl show
2026-04-03 02:39:04.164108 | instance | /bin/bash: line 8: brctl: command not found
2026-04-03 02:39:04.164280 | instance | + ps aux --sort=-%mem
2026-04-03 02:39:04.190282 | instance | + dpkg -l
2026-04-03 02:39:04.196770 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-03 02:39:04.197282 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-03 02:39:04.217487 | instance | + '[' '!' -z '' ']'
2026-04-03 02:39:04.293159 | instance | ok: Runtime: 0:00:00.117373
2026-04-03 02:39:04.301772 | 
2026-04-03 02:39:04.301865 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-03 02:39:04.995687 | instance | changed:
2026-04-03 02:39:04.995894 | instance | created directory /var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/logs/instance
2026-04-03 02:39:04.995935 | instance | cd+++++++++ system/
2026-04-03 02:39:04.995970 | instance | >f+++++++++ system/brctl-show.txt
2026-04-03 02:39:04.996001 | instance | >f+++++++++ system/docker-images.txt
2026-04-03 02:39:04.996030 | instance | >f+++++++++ system/ip-addr.txt
2026-04-03 02:39:04.996063 | instance | >f+++++++++ system/ip-route.txt
2026-04-03 02:39:04.996094 | instance | >f+++++++++ system/lsblk.txt
2026-04-03 02:39:04.996135 | instance | >f+++++++++ system/mount.txt
2026-04-03 02:39:04.996165 | instance | >f+++++++++ system/packages.txt
2026-04-03 02:39:04.996193 | instance | >f+++++++++ system/ps.txt
2026-04-03 02:39:04.996225 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-03 02:39:05.008949 | 
2026-04-03 02:39:05.009113 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-03 02:39:05.369582 | instance | changed: "values"
2026-04-03 02:39:05.544923 | instance | changed: "releases"
2026-04-03 02:39:05.562454 | 
2026-04-03 02:39:05.562706 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-03 02:40:09.406362 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.453813 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.504023 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.548500 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.596296 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.640048 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.688284 | instance | Error: Kubernetes cluster unreachable: Get "https://162.253.55.70:6443/version": dial tcp 162.253.55.70:6443: connect: connection refused
2026-04-03 02:40:09.805708 | instance | ok: Runtime: 0:01:03.876859
2026-04-03 02:40:09.810881 | 
2026-04-03 02:40:09.810951 | TASK [helm-release-status : Downloads logs to executor]
2026-04-03 02:40:10.435448 | instance | changed:
2026-04-03 02:40:10.435633 | instance | cd+++++++++ helm/
2026-04-03 02:40:10.435672 | instance | cd+++++++++ helm/releases/
2026-04-03 02:40:10.435700 | instance | cd+++++++++ helm/releases/auth-system/
2026-04-03 02:40:10.435726 | instance | >f+++++++++ helm/releases/auth-system/keycloak.txt
2026-04-03 02:40:10.435752 | instance | cd+++++++++ helm/releases/cert-manager/
2026-04-03 02:40:10.435779 | instance | >f+++++++++ helm/releases/cert-manager/cert-manager.txt
2026-04-03 02:40:10.435803 | instance | cd+++++++++ helm/values/
2026-04-03 02:40:10.435827 | instance | cd+++++++++ helm/values/auth-system/
2026-04-03 02:40:10.435850 | instance | >f+++++++++ helm/values/auth-system/keycloak.yaml
2026-04-03 02:40:10.435873 | instance | cd+++++++++ helm/values/cert-manager/
2026-04-03 02:40:10.435897 | instance | >f+++++++++ helm/values/cert-manager/cert-manager.yaml
2026-04-03 02:40:10.448208 | 
2026-04-03 02:40:10.448286 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-03 02:40:10.663354 | instance | changed
2026-04-03 02:40:10.695170 | 
2026-04-03 02:40:10.695304 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-03 02:40:10.926788 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-03 02:40:10.955160 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-03 02:40:10.955205 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-03 02:40:10.955230 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-03 02:40:10.999564 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:11.007461 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-03 02:40:11.010430 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:11.021228 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-03 02:40:11.106344 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:11.112580 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:11.115682 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-03 02:40:11.178753 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:11.378255 | instance | ok: Runtime: 0:00:00.265537
2026-04-03 02:40:11.383247 | 
2026-04-03 02:40:11.383310 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-03 02:40:11.618487 | instance | changed
2026-04-03 02:40:11.623471 | 
2026-04-03 02:40:11.623538 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-03 02:40:11.906715 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-03 02:40:11.906820 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-03 02:40:11.906840 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-03 02:40:11.917877 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:12.410168 | instance | ok: Runtime: 0:00:00.069446
2026-04-03 02:40:12.418118 | 
2026-04-03 02:40:12.418193 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-03 02:40:12.956218 | instance | changed:
2026-04-03 02:40:12.956422 | instance | cd+++++++++ objects/
2026-04-03 02:40:12.956460 | instance | cd+++++++++ objects/cluster/
2026-04-03 02:40:12.956490 | instance | cd+++++++++ objects/namespaced/
2026-04-03 02:40:12.968635 | 
2026-04-03 02:40:12.968708 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-03 02:40:13.164656 | instance | changed
2026-04-03 02:40:13.172778 | 
2026-04-03 02:40:13.172845 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-03 02:40:13.418594 | instance | changed
2026-04-03 02:40:13.425124 | 
2026-04-03 02:40:13.425198 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-03 02:40:13.715371 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:13.960138 | instance | ok: Runtime: 0:00:00.094906
2026-04-03 02:40:13.967063 | 
2026-04-03 02:40:13.967144 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-03 02:40:14.670139 | instance | changed:
2026-04-03 02:40:14.670301 | instance | cd+++++++++ pod-logs/
2026-04-03 02:40:14.670333 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-03 02:40:14.679942 | 
2026-04-03 02:40:14.680007 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-03 02:40:15.469559 | instance | changed
2026-04-03 02:40:15.474407 | 
2026-04-03 02:40:15.474472 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-03 02:40:15.809689 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:16.059425 | instance | ok: Runtime: 0:00:00.117217
2026-04-03 02:40:16.065033 | 
2026-04-03 02:40:16.065107 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-03 02:40:16.367854 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:16.373285 | instance | ceph-mgr endpoints:
2026-04-03 02:40:16.604081 | instance | ok: Runtime: 0:00:00.092126
2026-04-03 02:40:16.612003 | 
2026-04-03 02:40:16.612105 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-03 02:40:16.928693 | instance | The connection to the server 162.253.55.70:6443 was refused - did you specify the right host or port?
2026-04-03 02:40:17.147884 | instance | ok: Runtime: 0:00:00.104495
2026-04-03 02:40:17.153475 | 
2026-04-03 02:40:17.153550 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-03 02:40:17.679479 | instance | changed: cd+++++++++ prometheus/
2026-04-03 02:40:17.689669 | 
2026-04-03 02:40:17.689737 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-03 02:40:17.950583 | instance | changed
2026-04-03 02:40:17.956186 | 
2026-04-03 02:40:17.956250 | TASK [gather-selenium-data : Get selenium data]
2026-04-03 02:40:18.159377 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-03 02:40:18.162853 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-03 02:40:18.492487 | instance | ERROR
2026-04-03 02:40:18.492881 | instance | {
2026-04-03 02:40:18.492992 | instance |   "delta": "0:00:00.038977",
2026-04-03 02:40:18.493047 | instance |   "end": "2026-04-03 02:40:18.192739",
2026-04-03 02:40:18.493091 | instance |   "msg": "non-zero return code",
2026-04-03 02:40:18.493131 | instance |   "rc": 1,
2026-04-03 02:40:18.493169 | instance |   "start": "2026-04-03 02:40:18.153762"
2026-04-03 02:40:18.493208 | instance | }
2026-04-03 02:40:18.493249 | instance | ERROR: Ignoring Errors
2026-04-03 02:40:18.500115 | 
2026-04-03 02:40:18.500209 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-03 02:40:19.015540 | instance | changed: cd+++++++++ selenium/
2026-04-03 02:40:19.025780 | 
2026-04-03 02:40:19.025872 | PLAY RECAP
2026-04-03 02:40:19.025928 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-03 02:40:19.025959 | 
2026-04-03 02:40:19.125615 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-03 02:40:19.137631 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-03 02:40:20.720865 | 
2026-04-03 02:40:20.721000 | PLAY [all]
2026-04-03 02:40:20.731866 | 
2026-04-03 02:40:20.731942 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-03 02:40:20.776673 | instance | skipping: Conditional result was False
2026-04-03 02:40:20.788071 | 
2026-04-03 02:40:20.788180 | TASK [fetch-output : Set log path for single node]
2026-04-03 02:40:20.817198 | instance | ok
2026-04-03 02:40:20.823367 | 
2026-04-03 02:40:20.823455 | LOOP [fetch-output : Ensure local output dirs]
2026-04-03 02:40:21.306287 | instance -> localhost | ok: "/var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/logs"
2026-04-03 02:40:21.524269 | instance -> localhost | changed: "/var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/artifacts"
2026-04-03 02:40:22.401829 | instance -> localhost | changed: "/var/lib/zuul/builds/79dd88b30ea6476990f385ecd9e7346f/work/docs"
2026-04-03 02:40:22.419068 | 
2026-04-03 02:40:22.419140 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-03 02:40:23.560510 | instance | changed: .d..t...... ./
2026-04-03 02:40:23.711226 | instance | changed: All items complete
2026-04-03 02:40:23.711380 | 
2026-04-03 02:40:24.092640 | instance | changed: .d..t...... ./
2026-04-03 02:40:24.643008 | instance | changed: .d..t...... ./
2026-04-03 02:40:24.666380 | 
2026-04-03 02:40:24.666528 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-03 02:40:25.089875 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.006278
2026-04-03 02:40:25.303442 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006252
2026-04-03 02:40:25.323269 | 
2026-04-03 02:40:25.323722 | PLAY [all]
2026-04-03 02:40:25.331203 | 
2026-04-03 02:40:25.331266 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-03 02:40:25.720829 | instance | changed
2026-04-03 02:40:25.726730 | 
2026-04-03 02:40:25.726792 | PLAY RECAP
2026-04-03 02:40:25.726839 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-03 02:40:25.726861 | 
2026-04-03 02:40:25.846500 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-03 02:40:26.891550 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-03 02:40:28.076304 | 
2026-04-03 02:40:28.076471 | PLAY [localhost]
2026-04-03 02:40:28.086946 | 
2026-04-03 02:40:28.087021 | TASK [Generate Zuul manifest]
2026-04-03 02:40:28.108920 | localhost | ok
2026-04-03 02:40:28.671416 | 
2026-04-03 02:40:28.740038 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-03 02:40:29.213300 | localhost | changed
2026-04-03 02:40:29.224191 | 
2026-04-03 02:40:29.224342 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-03 02:40:29.255335 | localhost | ok
2026-04-03 02:40:29.264626 | 
2026-04-03 02:40:29.264754 | TASK [Upload logs]
2026-04-03 02:40:29.288727 | localhost | ok
2026-04-03 02:40:29.491958 | 
2026-04-03 02:40:29.492116 | TASK [Set zuul-log-path fact]
2026-04-03 02:40:29.513885 | localhost | ok
2026-04-03 02:40:29.527804 | 
2026-04-03 02:40:29.527872 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-03 02:40:29.560742 | localhost | ok
2026-04-03 02:40:29.572921 | 
2026-04-03 02:40:29.573007 | TASK [upload-logs : Create log directories]
2026-04-03 02:40:29.972528 | localhost | changed
2026-04-03 02:40:29.979529 | 
2026-04-03 02:40:29.979635 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-03 02:40:30.368326 | localhost -> localhost | ok: Runtime: 0:00:00.006311
2026-04-03 02:40:30.373854 | 
2026-04-03 02:40:30.373923 | TASK [upload-logs : Upload logs to log server]
2026-04-03 02:40:30.862979 | localhost | Output suppressed because no_log was given
2026-04-03 02:40:30.868386 | 
2026-04-03 02:40:30.868485 | LOOP [upload-logs : Compress console log and json output]
2026-04-03 02:40:30.920596 | localhost | skipping: Conditional result was False
2026-04-03 02:40:30.927900 | localhost | skipping: Conditional result was False
2026-04-03 02:40:30.941885 | 
2026-04-03 02:40:30.942039 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-03 02:40:30.991075 | localhost | skipping: Conditional result was False
2026-04-03 02:40:30.991410 | 
2026-04-03 02:40:30.995513 | localhost | skipping: Conditional result was False
2026-04-03 02:40:31.005762 | 
2026-04-03 02:40:31.005951 | LOOP [upload-logs : Upload console log and json output]