2026-02-16 21:11:04.987654 | Job console starting
2026-02-16 21:11:05.145609 | Updating git repos
2026-02-16 21:11:05.353764 | Cloning repos into workspace
2026-02-16 21:11:05.484628 | Restoring repo states
2026-02-16 21:11:05.531726 | Merging changes
2026-02-16 21:11:06.327164 | Checking out repos
2026-02-16 21:11:06.395253 | Preparing playbooks
2026-02-16 21:11:07.434533 | Running Ansible setup
2026-02-16 21:11:14.737128 | PRE-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main]
2026-02-16 21:11:15.347389 | 
2026-02-16 21:11:15.347551 | PLAY [localhost]
2026-02-16 21:11:15.356576 | 
2026-02-16 21:11:15.356666 | TASK [Gathering Facts]
2026-02-16 21:11:16.233664 | localhost | ok
2026-02-16 21:11:16.245374 | 
2026-02-16 21:11:16.245515 | TASK [Setup log path fact]
2026-02-16 21:11:16.269092 | localhost | ok
2026-02-16 21:11:16.284712 | 
2026-02-16 21:11:16.284907 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-16 21:11:16.317336 | localhost | ok
2026-02-16 21:11:16.324736 | 
2026-02-16 21:11:16.324813 | TASK [emit-job-header : Print job information]
2026-02-16 21:11:16.355382 | # Job Information
2026-02-16 21:11:16.355875 | Ansible Version: 2.16.15
2026-02-16 21:11:16.355923 | Job: ansible-collection-kubernetes-molecule-cluster-upgrade
2026-02-16 21:11:16.355948 | Pipeline: check
2026-02-16 21:11:16.355968 | Executor: 3a2793d2bd32
2026-02-16 21:11:16.355988 | Triggered by: https://github.com/vexxhost/ansible-collection-kubernetes/pull/229
2026-02-16 21:11:16.356011 | Event ID: cb3b7370-0b7b-11f1-9c52-05f14bb964d8
2026-02-16 21:11:16.359632 | 
2026-02-16 21:11:16.359758 | LOOP [emit-job-header : Print node information]
2026-02-16 21:11:16.445793 | localhost | ok:
2026-02-16 21:11:16.459180 | localhost | # Node Information
2026-02-16 21:11:16.459292 | localhost | Inventory Hostname: controller-1
2026-02-16 21:11:16.459349 | localhost | Hostname: np0000155787
2026-02-16 21:11:16.459394 | localhost | Username: zuul
2026-02-16 21:11:16.459442 | localhost | Distro: Debian 13.3
2026-02-16 21:11:16.459504 | localhost | Provider: yul1
2026-02-16 21:11:16.459549 | localhost | Region: ca-ymq-1
2026-02-16 21:11:16.459589 | localhost | Label: debian-trixie
2026-02-16 21:11:16.459629 | localhost | Product Name: OpenStack Nova
2026-02-16 21:11:16.459669 | localhost | Interface IP: 199.204.45.53
2026-02-16 21:11:16.503417 | localhost | ok:
2026-02-16 21:11:16.503656 | localhost | # Node Information
2026-02-16 21:11:16.503727 | localhost | Inventory Hostname: controller-2
2026-02-16 21:11:16.503782 | localhost | Hostname: np0000155788
2026-02-16 21:11:16.503832 | localhost | Username: zuul
2026-02-16 21:11:16.503882 | localhost | Distro: Debian 13.3
2026-02-16 21:11:16.503930 | localhost | Provider: yul1
2026-02-16 21:11:16.503977 | localhost | Region: ca-ymq-1
2026-02-16 21:11:16.504025 | localhost | Label: debian-trixie
2026-02-16 21:11:16.504073 | localhost | Product Name: OpenStack Nova
2026-02-16 21:11:16.504121 | localhost | Interface IP: 199.204.45.3
2026-02-16 21:11:16.534823 | localhost | ok:
2026-02-16 21:11:16.534987 | localhost | # Node Information
2026-02-16 21:11:16.535023 | localhost | Inventory Hostname: controller-3
2026-02-16 21:11:16.535046 | localhost | Hostname: np0000155789
2026-02-16 21:11:16.535065 | localhost | Username: zuul
2026-02-16 21:11:16.535084 | localhost | Distro: Debian 13.3
2026-02-16 21:11:16.535102 | localhost | Provider: yul1
2026-02-16 21:11:16.535128 | localhost | Region: ca-ymq-1
2026-02-16 21:11:16.535234 | localhost | Label: debian-trixie
2026-02-16 21:11:16.535274 | localhost | Product Name: OpenStack Nova
2026-02-16 21:11:16.535300 | localhost | Interface IP: 199.204.45.115
2026-02-16 21:11:16.549905 | 
2026-02-16 21:11:16.550047 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-02-16 21:11:17.043601 | localhost -> localhost | changed
2026-02-16 21:11:17.053174 | 
2026-02-16 21:11:17.053366 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-02-16 21:11:17.972268 | localhost -> localhost | changed
2026-02-16 21:11:17.985288 | 
2026-02-16 21:11:17.985398 | PLAY [all]
2026-02-16 21:11:17.999837 | 
2026-02-16 21:11:18.000121 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-02-16 21:11:18.285273 | controller-1 -> localhost | ok
2026-02-16 21:11:18.292579 | 
2026-02-16 21:11:18.292679 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-02-16 21:11:18.345947 | controller-1 | ok
2026-02-16 21:11:18.350753 | controller-2 | ok
2026-02-16 21:11:18.380301 | controller-3 | ok
2026-02-16 21:11:18.417594 | controller-1 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-02-16 21:11:18.417753 | controller-2 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-02-16 21:11:18.417789 | controller-3 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-02-16 21:11:18.426767 | 
2026-02-16 21:11:18.426863 | TASK [add-build-sshkey : Create Temp SSH key]
2026-02-16 21:11:19.954835 | controller-1 -> localhost | Generating public/private rsa key pair.
2026-02-16 21:11:19.955026 | controller-1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/1796f6c025284b9d915857ac8220b5bf_id_rsa
2026-02-16 21:11:19.955057 | controller-1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/1796f6c025284b9d915857ac8220b5bf_id_rsa.pub
2026-02-16 21:11:19.955080 | controller-1 -> localhost | The key fingerprint is:
2026-02-16 21:11:19.955101 | controller-1 -> localhost | SHA256:MCQxuEQ4xJs1MYLm6rqGh5irKkxzWCVsIeAe1c8inIY zuul-build-sshkey
2026-02-16 21:11:19.955122 | controller-1 -> localhost | The key's randomart image is:
2026-02-16 21:11:19.955142 | controller-1 -> localhost | +---[RSA 3072]----+
2026-02-16 21:11:19.955163 | controller-1 -> localhost | |**o*B..          |
2026-02-16 21:11:19.955183 | controller-1 -> localhost | |=o**.*           |
2026-02-16 21:11:19.955203 | controller-1 -> localhost | |o=B.= =          |
2026-02-16 21:11:19.955223 | controller-1 -> localhost | |.Eo* . =         |
2026-02-16 21:11:19.955243 | controller-1 -> localhost | |..+ . . S        |
2026-02-16 21:11:19.955262 | controller-1 -> localhost | |.+ .             |
2026-02-16 21:11:19.955281 | controller-1 -> localhost | |*oo              |
2026-02-16 21:11:19.955300 | controller-1 -> localhost | |*+.              |
2026-02-16 21:11:19.955320 | controller-1 -> localhost | |%+               |
2026-02-16 21:11:19.955340 | controller-1 -> localhost | +----[SHA256]-----+
2026-02-16 21:11:19.955387 | controller-1 -> localhost | ok: Runtime: 0:00:01.109886
2026-02-16 21:11:19.959560 | 
2026-02-16 21:11:19.959625 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-02-16 21:11:19.989955 | controller-1 | ok
2026-02-16 21:11:19.994229 | controller-2 | ok
2026-02-16 21:11:20.011954 | controller-3 | ok
2026-02-16 21:11:20.026992 | controller-1 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-02-16 21:11:20.027044 | controller-2 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-02-16 21:11:20.027068 | controller-3 | included: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-02-16 21:11:20.038331 | 
2026-02-16 21:11:20.038419 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-02-16 21:11:20.063472 | controller-1 | skipping: Conditional result was False
2026-02-16 21:11:20.065315 | controller-2 | skipping: Conditional result was False
2026-02-16 21:11:20.075718 | controller-3 | skipping: Conditional result was False
2026-02-16 21:11:20.084074 | 
2026-02-16 21:11:20.084168 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-02-16 21:11:20.623098 | controller-1 | changed
2026-02-16 21:11:20.642563 | controller-2 | changed
2026-02-16 21:11:20.659811 | controller-3 | changed
2026-02-16 21:11:20.665766 | 
2026-02-16 21:11:20.665828 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-02-16 21:11:20.869555 | controller-1 | ok
2026-02-16 21:11:20.875635 | controller-2 | ok
2026-02-16 21:11:20.912374 | controller-3 | ok
2026-02-16 21:11:20.919148 | 
2026-02-16 21:11:20.919241 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-02-16 21:11:21.430448 | controller-1 | changed
2026-02-16 21:11:21.448525 | controller-2 | changed
2026-02-16 21:11:21.485079 | controller-3 | changed
2026-02-16 21:11:21.491264 | 
2026-02-16 21:11:21.491353 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-02-16 21:11:22.011343 | controller-1 | changed
2026-02-16 21:11:22.015245 | controller-2 | changed
2026-02-16 21:11:22.033310 | controller-3 | changed
2026-02-16 21:11:22.039404 | 
2026-02-16 21:11:22.039482 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-02-16 21:11:22.069654 | controller-1 | skipping: Conditional result was False
2026-02-16 21:11:22.073041 | controller-2 | skipping: Conditional result was False
2026-02-16 21:11:22.094671 | controller-3 | skipping: Conditional result was False
2026-02-16 21:11:22.100238 | 
2026-02-16 21:11:22.100380 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-02-16 21:11:22.479968 | controller-1 -> localhost | changed
2026-02-16 21:11:22.496240 | 
2026-02-16 21:11:22.496316 | TASK [add-build-sshkey : Add back temp key]
2026-02-16 21:11:22.866525 | controller-1 -> localhost | Identity added: /var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/1796f6c025284b9d915857ac8220b5bf_id_rsa (zuul-build-sshkey)
2026-02-16 21:11:22.866697 | controller-1 -> localhost | ok: Runtime: 0:00:00.014973
2026-02-16 21:11:22.871039 | 
2026-02-16 21:11:22.871103 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-02-16 21:11:23.161957 | controller-1 | ok
2026-02-16 21:11:23.178443 | controller-3 | ok
2026-02-16 21:11:23.182574 | controller-2 | ok
2026-02-16 21:11:23.186976 | 
2026-02-16 21:11:23.187041 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-02-16 21:11:23.220285 | controller-1 | skipping: Conditional result was False
2026-02-16 21:11:23.221561 | controller-2 | skipping: Conditional result was False
2026-02-16 21:11:23.232336 | controller-3 | skipping: Conditional result was False
2026-02-16 21:11:23.253607 | 
2026-02-16 21:11:23.253674 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-02-16 21:11:23.572291 | controller-1 | ok
2026-02-16 21:11:23.575811 | controller-2 | ok
2026-02-16 21:11:23.590162 | controller-3 | ok
2026-02-16 21:11:23.597131 | 
2026-02-16 21:11:23.597225 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-02-16 21:11:24.529083 | controller-1 | Output suppressed because no_log was given
2026-02-16 21:11:24.534831 | controller-2 | Output suppressed because no_log was given
2026-02-16 21:11:24.605776 | controller-3 | Output suppressed because no_log was given
2026-02-16 21:11:24.622695 | 
2026-02-16 21:11:24.622765 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-02-16 21:11:24.832924 | controller-1 | ok: "logs"
2026-02-16 21:11:24.833397 | controller-1 | ok: All items complete
2026-02-16 21:11:24.833450 | 
2026-02-16 21:11:24.874272 | controller-2 | ok: "logs"
2026-02-16 21:11:24.889546 | controller-3 | ok: "logs"
2026-02-16 21:11:25.015583 | controller-1 | ok: "artifacts"
2026-02-16 21:11:25.083681 | controller-3 | ok: "artifacts"
2026-02-16 21:11:25.087916 | controller-2 | ok: "artifacts"
2026-02-16 21:11:25.192115 | controller-1 | ok: "docs"
2026-02-16 21:11:25.270471 | controller-3 | ok: "docs"
2026-02-16 21:11:25.282471 | controller-2 | ok: "docs"
2026-02-16 21:11:25.292662 | 
2026-02-16 21:11:25.293368 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-02-16 21:11:25.495851 | controller-1 | changed: "logs"
2026-02-16 21:11:25.496151 | controller-1 | ok: All items complete
2026-02-16 21:11:25.496181 | 
2026-02-16 21:11:25.503156 | controller-2 | changed: "logs"
2026-02-16 21:11:25.521513 | controller-3 | changed: "logs"
2026-02-16 21:11:25.675914 | controller-1 | changed: "artifacts"
2026-02-16 21:11:25.681008 | controller-2 | changed: "artifacts"
2026-02-16 21:11:25.693326 | controller-3 | changed: "artifacts"
2026-02-16 21:11:25.856646 | controller-1 | changed: "docs"
2026-02-16 21:11:25.879273 | controller-2 | changed: "docs"
2026-02-16 21:11:25.884123 | controller-3 | changed: "docs"
2026-02-16 21:11:25.909836 | 
2026-02-16 21:11:25.909968 | PLAY RECAP
2026-02-16 21:11:25.910017 | controller-1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-02-16 21:11:25.910047 | controller-2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-02-16 21:11:25.910070 | controller-3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-02-16 21:11:25.910093 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-16 21:11:25.910111 | 
2026-02-16 21:11:26.088401 | PRE-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main]
2026-02-16 21:11:26.093113 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-02-16 21:11:26.741795 | 
2026-02-16 21:11:26.741935 | PLAY [all]
2026-02-16 21:11:26.754569 | 
2026-02-16 21:11:26.754642 | TASK [setup-uv : Extract archive]
2026-02-16 21:11:29.169336 | controller-1 | changed
2026-02-16 21:11:29.199036 | controller-2 | changed
2026-02-16 21:11:30.171309 | controller-3 | changed
2026-02-16 21:11:30.177583 | 
2026-02-16 21:11:30.177706 | TASK [setup-uv : Print version]
2026-02-16 21:11:30.550947 | controller-2 | uv 0.8.13
2026-02-16 21:11:30.571667 | controller-3 | uv 0.8.13
2026-02-16 21:11:30.562115 | controller-1 | uv 0.8.13
2026-02-16 21:11:30.738559 | controller-1 | ok: Runtime: 0:00:00.009928
2026-02-16 21:11:30.748736 | controller-2 | ok: Runtime: 0:00:00.013651
2026-02-16 21:11:30.754368 | controller-3 | ok: Runtime: 0:00:00.013756
2026-02-16 21:11:30.766313 | 
2026-02-16 21:11:30.766422 | PLAY RECAP
2026-02-16 21:11:30.766470 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-16 21:11:30.766498 | controller-2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-16 21:11:30.766524 | controller-3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-02-16 21:11:30.766543 | 
2026-02-16 21:11:30.893692 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-02-16 21:11:30.900113 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-02-16 21:11:31.479031 | 
2026-02-16 21:11:31.479182 | PLAY [all]
2026-02-16 21:11:31.490184 | 
2026-02-16 21:11:31.490254 | TASK [Copy inventory file for Zuul]
2026-02-16 21:11:32.422815 | controller-1 | changed
2026-02-16 21:11:32.427119 | 
2026-02-16 21:11:32.427194 | TASK [Switch "ansible_host" to private IP]
2026-02-16 21:11:32.713214 | controller-1 | changed: 3 replacements made
2026-02-16 21:11:32.718768 | 
2026-02-16 21:11:32.718835 | TASK [Run Molecule scenario]
2026-02-16 21:11:33.154737 | controller-1 | Using CPython 3.13.5 interpreter at: /usr/bin/python3
2026-02-16 21:11:33.154779 | controller-1 | Creating virtual environment at: .venv
2026-02-16 21:11:33.437877 | controller-1 | Downloading pygments (1.2MiB)
2026-02-16 21:11:33.438779 | controller-1 | Downloading cryptography (4.3MiB)
2026-02-16 21:11:33.439047 | controller-1 | Downloading ansible-core (2.3MiB)
2026-02-16 21:11:33.631880 | controller-1 |  Downloading cryptography
2026-02-16 21:11:33.661631 | controller-1 |  Downloading pygments
2026-02-16 21:11:33.743500 | controller-1 |  Downloading ansible-core
2026-02-16 21:11:33.790859 | controller-1 | Installed 36 packages in 44ms
2026-02-16 21:11:34.423694 | controller-1 | INFO     Collection 'vexxhost.kubernetes' detected.
2026-02-16 21:11:34.423720 | controller-1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-02-16 21:11:35.133558 | controller-1 | CRITICAL 'extensions/molecule/default/molecule.yml' glob failed.  Exiting.
2026-02-16 21:11:35.133610 | controller-1 | INFO     default scenario not found, disabling shared state.
2026-02-16 21:11:35.133731 | controller-1 | INFO     [cluster-upgrade > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-02-16 21:11:35.133826 | controller-1 | INFO     [cluster-upgrade > prerun] Performing prerun with role_name_check=0...
2026-02-16 21:11:51.365671 | controller-1 | INFO     [cluster-upgrade > dependency] Executing
2026-02-16 21:11:51.365719 | controller-1 | WARNING  [cluster-upgrade > dependency] Missing roles requirements file: requirements.yml
2026-02-16 21:11:51.365723 | controller-1 | WARNING  [cluster-upgrade > dependency] Missing collections requirements file: collections.yml
2026-02-16 21:11:51.365736 | controller-1 | WARNING  [cluster-upgrade > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-02-16 21:11:51.372058 | controller-1 | INFO     [cluster-upgrade > cleanup] Executing
2026-02-16 21:11:51.372358 | controller-1 | WARNING  [cluster-upgrade > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-02-16 21:11:51.377661 | controller-1 | INFO     [cluster-upgrade > destroy] Executing
2026-02-16 21:11:51.377736 | controller-1 | WARNING  [cluster-upgrade > destroy] Skipping, '--destroy=never' requested.
2026-02-16 21:11:51.377800 | controller-1 | INFO     [cluster-upgrade > destroy] Executed: Successful
2026-02-16 21:11:51.383061 | controller-1 | INFO     [cluster-upgrade > syntax] Executing
2026-02-16 21:11:52.608322 | controller-1 |
2026-02-16 21:11:52.608603 | controller-1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/converge.yml
2026-02-16 21:11:52.702357 | controller-1 | INFO     [cluster-upgrade > syntax] Executed: Successful
2026-02-16 21:11:52.712340 | controller-1 | INFO     [cluster-upgrade > create] Executing
2026-02-16 21:11:52.714466 | controller-1 | WARNING  [cluster-upgrade > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-02-16 21:11:52.721340 | controller-1 | INFO     [cluster-upgrade > prepare] Executing
2026-02-16 21:11:53.969777 | controller-1 |
2026-02-16 21:11:53.969798 | controller-1 | PLAY [Prepare] *****************************************************************
2026-02-16 21:11:53.969802 | controller-1 |
2026-02-16 21:11:53.969806 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-02-16 21:11:53.969809 | controller-1 | Monday 16 February 2026  21:11:53 +0000 (0:00:00.028)       0:00:00.028 *******
2026-02-16 21:11:55.165838 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-02-16 21:11:55.168841 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-02-16 21:11:55.205709 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-02-16 21:11:55.215391 | controller-1 | ok: [controller-1]
2026-02-16 21:11:55.215524 | controller-1 | ok: [controller-2]
2026-02-16 21:11:55.215640 | controller-1 | ok: [controller-3]
2026-02-16 21:11:55.215749 | controller-1 |
2026-02-16 21:11:55.215869 | controller-1 | TASK [Install Debian packages] *************************************************
2026-02-16 21:11:55.215983 | controller-1 | Monday 16 February 2026  21:11:55 +0000 (0:00:01.243)       0:00:01.272 *******
2026-02-16 21:12:01.176415 | controller-1 | ok: [controller-1]
2026-02-16 21:12:01.176438 | controller-1 | ok: [controller-2]
2026-02-16 21:12:01.176442 | controller-1 | ok: [controller-3]
2026-02-16 21:12:01.176445 | controller-1 |
2026-02-16 21:12:01.176449 | controller-1 | PLAY [Configure Kubernetes VIP] ************************************************
2026-02-16 21:12:01.176453 | controller-1 |
2026-02-16 21:12:01.176457 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-02-16 21:12:01.176461 | controller-1 | Monday 16 February 2026  21:12:01 +0000 (0:00:05.960)       0:00:07.233 *******
2026-02-16 21:12:01.998190 | controller-1 | ok: [controller-1]
2026-02-16 21:12:01.998381 | controller-1 | ok: [controller-2]
2026-02-16 21:12:02.002739 | controller-1 | ok: [controller-3]
2026-02-16 21:12:02.002752 | controller-1 |
2026-02-16 21:12:02.002758 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-02-16 21:12:02.002764 | controller-1 | Monday 16 February 2026  21:12:01 +0000 (0:00:00.825)       0:00:08.058 *******
2026-02-16 21:12:02.443948 | controller-1 | changed: [controller-1]
2026-02-16 21:12:02.443969 | controller-1 | changed: [controller-2]
2026-02-16 21:12:02.443973 | controller-1 | changed: [controller-3]
2026-02-16 21:12:02.443977 | controller-1 |
2026-02-16 21:12:02.443981 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-02-16 21:12:02.443985 | controller-1 | Monday 16 February 2026  21:12:02 +0000 (0:00:00.445)       0:00:08.504 *******
2026-02-16 21:12:03.891453 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/keepalived.conf)
2026-02-16 21:12:03.891594 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/keepalived.conf)
2026-02-16 21:12:03.891710 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/keepalived.conf)
2026-02-16 21:12:03.891824 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/check_apiserver.sh)
2026-02-16 21:12:03.891935 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/check_apiserver.sh)
2026-02-16 21:12:03.892047 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/check_apiserver.sh)
2026-02-16 21:12:03.892161 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-02-16 21:12:03.892272 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-02-16 21:12:03.892383 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-02-16 21:12:03.892494 | controller-1 | ok: [controller-1] => (item=/etc/haproxy/haproxy.cfg)
2026-02-16 21:12:03.892604 | controller-1 | ok: [controller-2] => (item=/etc/haproxy/haproxy.cfg)
2026-02-16 21:12:03.892714 | controller-1 | ok: [controller-3] => (item=/etc/haproxy/haproxy.cfg)
2026-02-16 21:12:03.892825 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-02-16 21:12:03.892936 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-02-16 21:12:03.893046 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-02-16 21:12:03.893149 | controller-1 |
2026-02-16 21:12:03.893272 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-02-16 21:12:03.893387 | controller-1 | Monday 16 February 2026  21:12:03 +0000 (0:00:01.446)       0:00:09.950 *******
2026-02-16 21:12:04.271145 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !
2026-02-16 21:12:04.274949 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-02-16 21:12:04.274960 | controller-1 |
2026-02-16 21:12:04.274964 | controller-1 | 30     - Restart "kubelet" service
2026-02-16 21:12:04.274968 | controller-1 | 31
2026-02-16 21:12:04.274972 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-02-16 21:12:04.274975 | controller-1 |      ^ column 3
2026-02-16 21:12:04.275161 | controller-1 |
2026-02-16 21:12:04.275169 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-02-16 21:12:04.323263 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-02-16 21:12:04.327203 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-02-16 21:12:04.529663 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/controller-manager.conf does not exist !
2026-02-16 21:12:04.535242 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-02-16 21:12:04.535371 | controller-1 |
2026-02-16 21:12:04.535496 | controller-1 | 30     - Restart "kubelet" service
2026-02-16 21:12:04.535609 | controller-1 | 31
2026-02-16 21:12:04.535733 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-02-16 21:12:04.535851 | controller-1 |      ^ column 3
2026-02-16 21:12:04.535959 | controller-1 |
2026-02-16 21:12:04.536182 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.592806 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.607188 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.784916 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/scheduler.conf does not exist !
2026-02-16 21:12:04.785057 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-02-16 21:12:04.785183 | controller-1 |
2026-02-16 21:12:04.785316 | controller-1 | 30     - Restart "kubelet" service
2026-02-16 21:12:04.785460 | controller-1 | 31
2026-02-16 21:12:04.785597 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-02-16 21:12:04.785726 | controller-1 |      ^ column 3
2026-02-16 21:12:04.785868 | controller-1 |
2026-02-16 21:12:04.786452 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.844043 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.849437 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-02-16 21:12:04.856970 | controller-1 | ...ignoring
2026-02-16 21:12:04.857166 | controller-1 | ...ignoring
2026-02-16 21:12:04.857348 | controller-1 | ...ignoring
2026-02-16 21:12:04.857518 | controller-1 |
2026-02-16 21:12:04.857714 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-02-16 21:12:04.857900 | controller-1 | Monday 16 February 2026  21:12:04 +0000 (0:00:00.966)       0:00:10.917 *******
2026-02-16 21:12:05.306030 | controller-1 | ok: [controller-1]
2026-02-16 21:12:05.306142 | controller-1 | ok: [controller-2]
2026-02-16 21:12:05.306265 | controller-1 | ok: [controller-3]
2026-02-16 21:12:05.306383 | controller-1 |
2026-02-16 21:12:05.306532 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-02-16 21:12:05.306665 | controller-1 | Monday 16 February 2026  21:12:05 +0000 (0:00:00.449)       0:00:11.366 *******
2026-02-16 21:12:05.634312 | controller-1 | ok: [controller-1]
2026-02-16 21:12:05.634506 | controller-1 | ok: [controller-2]
2026-02-16 21:12:05.634723 | controller-1 | ok: [controller-3]
2026-02-16 21:12:05.634946 | controller-1 |
2026-02-16 21:12:05.635153 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-02-16 21:12:05.635351 | controller-1 | Monday 16 February 2026  21:12:05 +0000 (0:00:00.327)       0:00:11.694 *******
2026-02-16 21:12:05.690378 | controller-1 | ok: [controller-1]
2026-02-16 21:12:05.690466 | controller-1 | ok: [controller-2]
2026-02-16 21:12:05.690654 | controller-1 | ok: [controller-3]
2026-02-16 21:12:05.690873 | controller-1 |
2026-02-16 21:12:05.691095 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-02-16 21:12:05.691286 | controller-1 | Monday 16 February 2026  21:12:05 +0000 (0:00:00.056)       0:00:11.750 *******
2026-02-16 21:12:05.746516 | controller-1 | ok: [controller-1]
2026-02-16 21:12:05.746702 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:05.746955 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:05.747134 | controller-1 |
2026-02-16 21:12:05.747330 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-02-16 21:12:05.747519 | controller-1 | Monday 16 February 2026  21:12:05 +0000 (0:00:00.056)       0:00:11.807 *******
2026-02-16 21:12:06.732638 | controller-1 | ok: [controller-1]
2026-02-16 21:12:06.732778 | controller-1 | ok: [controller-3]
2026-02-16 21:12:06.732899 | controller-1 | ok: [controller-2]
2026-02-16 21:12:06.733020 | controller-1 |
2026-02-16 21:12:06.733149 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-02-16 21:12:06.733272 | controller-1 | Monday 16 February 2026  21:12:06 +0000 (0:00:00.985)       0:00:12.792 *******
2026-02-16 21:12:07.138118 | controller-1 | ok: [controller-1]
2026-02-16 21:12:07.138161 | controller-1 | ok: [controller-2]
2026-02-16 21:12:07.138261 | controller-1 | ok: [controller-3]
2026-02-16 21:12:07.138341 | controller-1 |
2026-02-16 21:12:07.138435 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-02-16 21:12:07.138515 | controller-1 | Monday 16 February 2026  21:12:07 +0000 (0:00:00.342)       0:00:13.135 *******
2026-02-16 21:12:07.138588 | controller-1 |
2026-02-16 21:12:07.138681 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-02-16 21:12:07.138762 | controller-1 | Monday 16 February 2026  21:12:07 +0000 (0:00:00.004)       0:00:13.139 *******
2026-02-16 21:12:07.138872 | controller-1 |
2026-02-16 21:12:07.138957 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-02-16 21:12:07.139034 | controller-1 | Monday 16 February 2026  21:12:07 +0000 (0:00:00.002)       0:00:13.141 *******
2026-02-16 21:12:07.139109 | controller-1 |
2026-02-16 21:12:07.139192 | controller-1 | PLAY [Install Kubernetes] ******************************************************
2026-02-16 21:12:07.139268 | controller-1 |
2026-02-16 21:12:07.139351 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-02-16 21:12:07.139441 | controller-1 | Monday 16 February 2026  21:12:07 +0000 (0:00:00.055)       0:00:13.196 *******
2026-02-16 21:12:08.993643 | controller-1 | ok: [controller-1]
2026-02-16 21:12:08.993706 | controller-1 | ok: [controller-2]
2026-02-16 21:12:08.993766 | controller-1 | ok: [controller-3]
2026-02-16 21:12:08.993836 | controller-1 |
2026-02-16 21:12:08.994847 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:08.994859 | controller-1 | Monday 16 February 2026  21:12:08 +0000 (0:00:01.857)       0:00:15.054 *******
2026-02-16 21:12:09.430998 | controller-1 | ok: [controller-1]
2026-02-16 21:12:09.431040 | controller-1 | ok: [controller-2]
2026-02-16 21:12:09.431048 | controller-1 | ok: [controller-3]
2026-02-16 21:12:09.431056 | controller-1 |
2026-02-16 21:12:09.431064 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-02-16 21:12:09.431072 | controller-1 | Monday 16 February 2026  21:12:09 +0000 (0:00:00.435)       0:00:15.489 *******
2026-02-16 21:12:09.492988 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:09.493300 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:09.493567 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:09.493815 | controller-1 |
2026-02-16 21:12:09.494107 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-02-16 21:12:09.494376 | controller-1 | Monday 16 February 2026  21:12:09 +0000 (0:00:00.063)       0:00:15.553 *******
2026-02-16 21:12:09.881737 | controller-1 | changed: [controller-1]
2026-02-16 21:12:09.883304 | controller-1 | changed: [controller-2]
2026-02-16 21:12:09.883506 | controller-1 | changed: [controller-3]
2026-02-16 21:12:09.883677 | controller-1 |
2026-02-16 21:12:09.883871 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:09.884070 | controller-1 | Monday 16 February 2026  21:12:09 +0000 (0:00:00.389)       0:00:15.942 *******
2026-02-16 21:12:10.011213 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:10.011462 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-02-16 21:12:10.011657 | controller-1 | }
2026-02-16 21:12:10.011846 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:10.012041 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-02-16 21:12:10.012247 | controller-1 | }
2026-02-16 21:12:10.012463 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:10.012706 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-02-16 21:12:10.012893 | controller-1 | }
2026-02-16 21:12:10.013082 | controller-1 |
2026-02-16 21:12:10.013305 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:10.013520 | controller-1 | Monday 16 February 2026  21:12:10 +0000 (0:00:00.129)       0:00:16.071 *******
2026-02-16 21:12:10.800757 | controller-1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
2026-02-16 21:12:10.866314 | controller-1 | changed: [controller-1]
2026-02-16 21:12:10.866359 | controller-1 | changed: [controller-3]
2026-02-16 21:12:10.866434 | controller-1 | changed: [controller-2]
2026-02-16 21:12:10.866513 | controller-1 |
2026-02-16 21:12:10.866600 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:10.866685 | controller-1 | Monday 16 February 2026  21:12:10 +0000 (0:00:00.855)       0:00:16.926 *******
2026-02-16 21:12:10.953452 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:10.953474 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:10.953478 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:10.953482 | controller-1 |
2026-02-16 21:12:10.953486 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:10.953489 | controller-1 | Monday 16 February 2026  21:12:10 +0000 (0:00:00.085)       0:00:17.012 *******
2026-02-16 21:12:11.333013 | controller-1 | ok: [controller-1]
2026-02-16 21:12:11.333071 | controller-1 | ok: [controller-3]
2026-02-16 21:12:11.333090 | controller-1 | ok: [controller-2]
2026-02-16 21:12:11.333098 | controller-1 |
2026-02-16 21:12:11.333183 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-02-16 21:12:11.334880 | controller-1 | Monday 16 February 2026  21:12:11 +0000 (0:00:00.381)       0:00:17.393 *******
2026-02-16 21:12:12.266285 | controller-1 | ok: [controller-1]
2026-02-16 21:12:12.266321 | controller-1 | ok: [controller-2]
2026-02-16 21:12:12.266329 | controller-1 | ok: [controller-3]
2026-02-16 21:12:12.266337 | controller-1 |
2026-02-16 21:12:12.266345 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:12.266353 | controller-1 | Monday 16 February 2026  21:12:12 +0000 (0:00:00.931)       0:00:18.325 *******
2026-02-16 21:12:12.404004 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:12.404315 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-02-16 21:12:12.404561 | controller-1 | }
2026-02-16 21:12:12.404807 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:12.405090 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-02-16 21:12:12.405323 | controller-1 | }
2026-02-16 21:12:12.405562 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:12.405812 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-02-16 21:12:12.406042 | controller-1 | }
2026-02-16 21:12:12.406263 | controller-1 |
2026-02-16 21:12:12.406510 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:12.406768 | controller-1 | Monday 16 February 2026  21:12:12 +0000 (0:00:00.138)       0:00:18.463 *******
2026-02-16 21:12:13.430895 | controller-1 | changed: [controller-2]
2026-02-16 21:12:13.430926 | controller-1 | changed: [controller-3]
2026-02-16 21:12:13.430931 | controller-1 | changed: [controller-1]
2026-02-16 21:12:13.430936 | controller-1 |
2026-02-16 21:12:13.430942 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:13.430948 | controller-1 | Monday 16 February 2026  21:12:13 +0000 (0:00:01.024)       0:00:19.488 *******
2026-02-16 21:12:16.507697 | controller-1 | changed: [controller-1]
2026-02-16 21:12:16.507839 | controller-1 | changed: [controller-3]
2026-02-16 21:12:16.507956 | controller-1 | changed: [controller-2]
2026-02-16 21:12:16.508064 | controller-1 |
2026-02-16 21:12:16.508183 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-02-16 21:12:16.510960 | controller-1 | Monday 16 February 2026  21:12:16 +0000 (0:00:03.079)       0:00:22.568 *******
2026-02-16 21:12:16.563104 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:16.563124 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:16.563128 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:16.563131 | controller-1 |
2026-02-16 21:12:16.563135 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-02-16 21:12:16.563139 | controller-1 | Monday 16 February 2026  21:12:16 +0000 (0:00:00.055)       0:00:22.623 *******
2026-02-16 21:12:16.610579 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:16.613273 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:16.613283 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:16.613286 | controller-1 |
2026-02-16 21:12:16.613290 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-02-16 21:12:16.613294 | controller-1 | Monday 16 February 2026  21:12:16 +0000 (0:00:00.047)       0:00:22.671 *******
2026-02-16 21:12:16.666448 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:16.666590 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:16.666704 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:16.666808 | controller-1 |
2026-02-16 21:12:16.666950 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-02-16 21:12:16.667062 | controller-1 | Monday 16 February 2026  21:12:16 +0000 (0:00:00.055)       0:00:22.726 *******
2026-02-16 21:12:23.832351 | controller-1 | changed: [controller-1]
2026-02-16 21:12:23.832636 | controller-1 | changed: [controller-3]
2026-02-16 21:12:23.832883 | controller-1 | changed: [controller-2]
2026-02-16 21:12:23.833111 | controller-1 |
2026-02-16 21:12:23.833377 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-02-16 21:12:23.833625 | controller-1 | Monday 16 February 2026  21:12:23 +0000 (0:00:07.165)       0:00:29.892 *******
2026-02-16 21:12:24.549683 | controller-1 | changed: [controller-2]
2026-02-16 21:12:24.551811 | controller-1 | changed: [controller-3]
2026-02-16 21:12:24.551821 | controller-1 | changed: [controller-1]
2026-02-16 21:12:24.551825 | controller-1 |
2026-02-16 21:12:24.551829 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-02-16 21:12:24.551833 | controller-1 | Monday 16 February 2026  21:12:24 +0000 (0:00:00.717)       0:00:30.610 *******
2026-02-16 21:12:25.995345 | controller-1 | changed: [controller-1] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:25.995543 | controller-1 | changed: [controller-2] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:25.995709 | controller-1 | changed: [controller-3] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:25.995877 | controller-1 | changed: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:25.996044 | controller-1 | changed: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:25.996208 | controller-1 | changed: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:25.996370 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:25.996529 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:25.996687 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:25.996851 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:25.997024 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:25.997238 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:25.997405 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:25.997570 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:25.997732 | controller-1 | changed: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:25.997925 | controller-1 |
2026-02-16 21:12:25.998180 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-02-16 21:12:25.998430 | controller-1 | Monday 16 February 2026  21:12:25 +0000 (0:00:01.445)       0:00:32.055 *******
2026-02-16 21:12:26.933801 | controller-1 | changed: [controller-1]
2026-02-16 21:12:26.933848 | controller-1 | changed: [controller-3]
2026-02-16 21:12:26.933892 | controller-1 | changed: [controller-2]
2026-02-16 21:12:26.933985 | controller-1 |
2026-02-16 21:12:26.934077 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:26.934178 | controller-1 | Monday 16 February 2026  21:12:26 +0000 (0:00:00.923)       0:00:32.978 *******
2026-02-16 21:12:26.934238 | controller-1 |
2026-02-16 21:12:26.934343 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:26.934417 | controller-1 | Monday 16 February 2026  21:12:26 +0000 (0:00:00.005)       0:00:32.984 *******
2026-02-16 21:12:26.934495 | controller-1 |
2026-02-16 21:12:26.934583 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:26.934884 | controller-1 | Monday 16 February 2026  21:12:26 +0000 (0:00:00.004)       0:00:32.988 *******
2026-02-16 21:12:26.934906 | controller-1 |
2026-02-16 21:12:26.934937 | controller-1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-02-16 21:12:26.935054 | controller-1 | Monday 16 February 2026  21:12:26 +0000 (0:00:00.005)       0:00:32.994 *******
2026-02-16 21:12:27.815206 | controller-1 | changed: [controller-1]
2026-02-16 21:12:27.815321 | controller-1 | changed: [controller-3]
2026-02-16 21:12:27.815827 | controller-1 | changed: [controller-2]
2026-02-16 21:12:27.815852 | controller-1 |
2026-02-16 21:12:27.815858 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-02-16 21:12:27.815864 | controller-1 | Monday 16 February 2026  21:12:27 +0000 (0:00:00.880)       0:00:33.875 *******
2026-02-16 21:12:29.593316 | controller-1 | ok: [controller-1]
2026-02-16 21:12:29.593360 | controller-1 | ok: [controller-2]
2026-02-16 21:12:29.593476 | controller-1 | ok: [controller-3]
2026-02-16 21:12:29.593558 | controller-1 |
2026-02-16 21:12:29.593645 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-02-16 21:12:29.593735 | controller-1 | Monday 16 February 2026  21:12:29 +0000 (0:00:01.778)       0:00:35.653 *******
2026-02-16 21:12:30.414454 | controller-1 | changed: [controller-2]
2026-02-16 21:12:30.414475 | controller-1 | changed: [controller-1]
2026-02-16 21:12:30.414479 | controller-1 | changed: [controller-3]
2026-02-16 21:12:30.414482 | controller-1 |
2026-02-16 21:12:30.414486 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-02-16 21:12:30.414490 | controller-1 | Monday 16 February 2026  21:12:30 +0000 (0:00:00.817)       0:00:36.471 *******
2026-02-16 21:12:31.007243 | controller-1 | [ERROR]: Task failed: Module failed: Failed to import the required Python library (kubernetes) on np0000155787's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter
2026-02-16 21:12:31.007449 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes_upgrade_check/tasks/main.yml:16:3
2026-02-16 21:12:31.007607 | controller-1 |
2026-02-16 21:12:31.007768 | controller-1 | 14
2026-02-16 21:12:31.007924 | controller-1 | 15 ---
2026-02-16 21:12:31.008087 | controller-1 | 16 - name: Retrieve the "kubeadm-config" ConfigMap
2026-02-16 21:12:31.008252 | controller-1 |      ^ column 3
2026-02-16 21:12:31.011176 | controller-1 |
2026-02-16 21:12:31.011189 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on np0000155787's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"}
2026-02-16 21:12:31.017108 | controller-1 | ...ignoring
2026-02-16 21:12:31.017269 | controller-1 |
2026-02-16 21:12:31.017443 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-02-16 21:12:31.017604 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.605)       0:00:37.077 *******
2026-02-16 21:12:31.059145 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:31.062499 | controller-1 |
2026-02-16 21:12:31.062508 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-02-16 21:12:31.062517 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.041)       0:00:37.118 *******
2026-02-16 21:12:31.097730 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:31.097845 | controller-1 |
2026-02-16 21:12:31.097973 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-02-16 21:12:31.098088 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.039)       0:00:37.158 *******
2026-02-16 21:12:31.135915 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:31.136073 | controller-1 |
2026-02-16 21:12:31.136244 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-02-16 21:12:31.136401 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.037)       0:00:37.196 *******
2026-02-16 21:12:31.201941 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:31.202130 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:31.202306 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:31.202454 | controller-1 |
2026-02-16 21:12:31.202621 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-02-16 21:12:31.202777 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.065)       0:00:37.262 *******
2026-02-16 21:12:31.279531 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:31.279819 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:31.280084 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:31.280314 | controller-1 |
2026-02-16 21:12:31.280567 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:31.280813 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.077)       0:00:37.339 *******
2026-02-16 21:12:31.630159 | controller-1 | ok: [controller-1]
2026-02-16 21:12:31.631392 | controller-1 | ok: [controller-2]
2026-02-16 21:12:31.631595 | controller-1 | ok: [controller-3]
2026-02-16 21:12:31.631771 | controller-1 |
2026-02-16 21:12:31.631972 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:31.632159 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.351)       0:00:37.690 *******
2026-02-16 21:12:31.702380 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:31.702574 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-02-16 21:12:31.702783 | controller-1 | }
2026-02-16 21:12:31.703027 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:31.703244 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-02-16 21:12:31.703419 | controller-1 | }
2026-02-16 21:12:31.703600 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:31.703790 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubeadm"
2026-02-16 21:12:31.703962 | controller-1 | }
2026-02-16 21:12:31.704133 | controller-1 |
2026-02-16 21:12:31.704322 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:31.704508 | controller-1 | Monday 16 February 2026  21:12:31 +0000 (0:00:00.071)       0:00:37.762 *******
2026-02-16 21:12:33.113375 | controller-1 | changed: [controller-1]
2026-02-16 21:12:33.113444 | controller-1 | changed: [controller-3]
2026-02-16 21:12:33.113526 | controller-1 | changed: [controller-2]
2026-02-16 21:12:33.113600 | controller-1 |
2026-02-16 21:12:33.113687 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:33.113771 | controller-1 | Monday 16 February 2026  21:12:33 +0000 (0:00:01.411)       0:00:39.173 *******
2026-02-16 21:12:33.195149 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:33.195369 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:33.195619 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:33.195821 | controller-1 |
2026-02-16 21:12:33.196062 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:33.196322 | controller-1 | Monday 16 February 2026  21:12:33 +0000 (0:00:00.081)       0:00:39.255 *******
2026-02-16 21:12:33.555804 | controller-1 | ok: [controller-1]
2026-02-16 21:12:33.555978 | controller-1 | ok: [controller-2]
2026-02-16 21:12:33.556160 | controller-1 | ok: [controller-3]
2026-02-16 21:12:33.556327 | controller-1 |
2026-02-16 21:12:33.556570 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:33.556761 | controller-1 | Monday 16 February 2026  21:12:33 +0000 (0:00:00.359)       0:00:39.615 *******
2026-02-16 21:12:33.644884 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:33.644994 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-02-16 21:12:33.645109 | controller-1 | }
2026-02-16 21:12:33.645248 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:33.645367 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-02-16 21:12:33.645475 | controller-1 | }
2026-02-16 21:12:33.645589 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:33.645706 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubectl"
2026-02-16 21:12:33.645813 | controller-1 | }
2026-02-16 21:12:33.645918 | controller-1 |
2026-02-16 21:12:33.646158 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:33.646278 | controller-1 | Monday 16 February 2026  21:12:33 +0000 (0:00:00.089)       0:00:39.704 *******
2026-02-16 21:12:35.192802 | controller-1 | changed: [controller-2]
2026-02-16 21:12:35.192896 | controller-1 | changed: [controller-1]
2026-02-16 21:12:35.193047 | controller-1 | changed: [controller-3]
2026-02-16 21:12:35.193168 | controller-1 |
2026-02-16 21:12:35.193288 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:35.193417 | controller-1 | Monday 16 February 2026  21:12:35 +0000 (0:00:01.548)       0:00:41.252 *******
2026-02-16 21:12:35.302543 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:35.302730 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:35.302982 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:35.303160 | controller-1 |
2026-02-16 21:12:35.303390 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-02-16 21:12:35.303608 | controller-1 | Monday 16 February 2026  21:12:35 +0000 (0:00:00.109)       0:00:41.362 *******
2026-02-16 21:12:35.365600 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:35.365786 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:35.365971 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:35.366139 | controller-1 |
2026-02-16 21:12:35.366331 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-02-16 21:12:35.366515 | controller-1 | Monday 16 February 2026  21:12:35 +0000 (0:00:00.063)       0:00:41.425 *******
2026-02-16 21:12:35.434397 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:35.434584 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:35.434765 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:35.434980 | controller-1 |
2026-02-16 21:12:35.435174 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-02-16 21:12:35.435403 | controller-1 | Monday 16 February 2026  21:12:35 +0000 (0:00:00.068)       0:00:41.494 *******
2026-02-16 21:12:35.497314 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:35.497501 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:35.497684 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:35.497856 | controller-1 |
2026-02-16 21:12:35.498050 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-02-16 21:12:35.498239 | controller-1 | Monday 16 February 2026  21:12:35 +0000 (0:00:00.062)       0:00:41.557 *******
2026-02-16 21:12:36.444380 | controller-1 | ok: [controller-1]
2026-02-16 21:12:36.444482 | controller-1 | ok: [controller-3]
2026-02-16 21:12:36.444596 | controller-1 | ok: [controller-2]
2026-02-16 21:12:36.444704 | controller-1 |
2026-02-16 21:12:36.444827 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-02-16 21:12:36.444947 | controller-1 | Monday 16 February 2026  21:12:36 +0000 (0:00:00.947)       0:00:42.504 *******
2026-02-16 21:12:37.113797 | controller-1 | ok: [controller-1]
2026-02-16 21:12:37.113844 | controller-1 | ok: [controller-3]
2026-02-16 21:12:37.113958 | controller-1 | ok: [controller-2]
2026-02-16 21:12:37.114035 | controller-1 |
2026-02-16 21:12:37.114875 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-02-16 21:12:37.114899 | controller-1 | Monday 16 February 2026  21:12:37 +0000 (0:00:00.669)       0:00:43.174 *******
2026-02-16 21:12:38.577821 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:38.577854 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:38.577862 | controller-1 | ok: [controller-2] => (item={'path': '/etc/containerd'})
2026-02-16 21:12:38.577871 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:38.577878 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:38.577885 | controller-1 | ok: [controller-2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-02-16 21:12:38.577892 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:38.577899 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:38.577906 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-02-16 21:12:38.577913 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:38.577921 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:38.577940 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-02-16 21:12:38.577948 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:38.577955 | controller-1 | ok: [controller-2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:38.577962 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-02-16 21:12:38.577970 | controller-1 |
2026-02-16 21:12:38.577978 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-02-16 21:12:38.577986 | controller-1 | Monday 16 February 2026  21:12:38 +0000 (0:00:01.460)       0:00:44.634 *******
2026-02-16 21:12:39.521823 | controller-1 | ok: [controller-1]
2026-02-16 21:12:39.522164 | controller-1 | ok: [controller-2]
2026-02-16 21:12:39.522414 | controller-1 | ok: [controller-3]
2026-02-16 21:12:39.522645 | controller-1 |
2026-02-16 21:12:39.522959 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:39.523221 | controller-1 | Monday 16 February 2026  21:12:39 +0000 (0:00:00.934)       0:00:45.569 *******
2026-02-16 21:12:39.523449 | controller-1 |
2026-02-16 21:12:39.523699 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:39.523947 | controller-1 | Monday 16 February 2026  21:12:39 +0000 (0:00:00.004)       0:00:45.573 *******
2026-02-16 21:12:39.524181 | controller-1 |
2026-02-16 21:12:39.524430 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-02-16 21:12:39.524677 | controller-1 | Monday 16 February 2026  21:12:39 +0000 (0:00:00.004)       0:00:45.577 *******
2026-02-16 21:12:39.524903 | controller-1 |
2026-02-16 21:12:39.525151 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-02-16 21:12:39.525397 | controller-1 | Monday 16 February 2026  21:12:39 +0000 (0:00:00.004)       0:00:45.582 *******
2026-02-16 21:12:40.038756 | controller-1 | ok: [controller-1]
2026-02-16 21:12:40.039820 | controller-1 | ok: [controller-2]
2026-02-16 21:12:40.040026 | controller-1 | ok: [controller-3]
2026-02-16 21:12:40.040196 | controller-1 |
2026-02-16 21:12:40.040389 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:40.040577 | controller-1 | Monday 16 February 2026  21:12:40 +0000 (0:00:00.517)       0:00:46.099 *******
2026-02-16 21:12:40.390064 | controller-1 | ok: [controller-1]
2026-02-16 21:12:40.390181 | controller-1 | ok: [controller-2]
2026-02-16 21:12:40.390306 | controller-1 | ok: [controller-3]
2026-02-16 21:12:40.390412 | controller-1 |
2026-02-16 21:12:40.390530 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:40.390649 | controller-1 | Monday 16 February 2026  21:12:40 +0000 (0:00:00.351)       0:00:46.450 *******
2026-02-16 21:12:40.507159 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:40.507202 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:40.507285 | controller-1 | }
2026-02-16 21:12:40.507372 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:40.507468 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:40.507552 | controller-1 | }
2026-02-16 21:12:40.507637 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:40.507729 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/crictl-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:40.507812 | controller-1 | }
2026-02-16 21:12:40.507890 | controller-1 |
2026-02-16 21:12:40.507981 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:40.508068 | controller-1 | Monday 16 February 2026  21:12:40 +0000 (0:00:00.116)       0:00:46.566 *******
2026-02-16 21:12:41.278375 | controller-1 | changed: [controller-1]
2026-02-16 21:12:41.278993 | controller-1 | changed: [controller-2]
2026-02-16 21:12:41.279020 | controller-1 | changed: [controller-3]
2026-02-16 21:12:41.279026 | controller-1 |
2026-02-16 21:12:41.279031 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:41.279037 | controller-1 | Monday 16 February 2026  21:12:41 +0000 (0:00:00.771)       0:00:47.338 *******
2026-02-16 21:12:43.022880 | controller-1 | changed: [controller-1]
2026-02-16 21:12:43.022928 | controller-1 | changed: [controller-2]
2026-02-16 21:12:43.023013 | controller-1 | changed: [controller-3]
2026-02-16 21:12:43.023090 | controller-1 |
2026-02-16 21:12:43.023176 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:43.023261 | controller-1 | Monday 16 February 2026  21:12:43 +0000 (0:00:01.744)       0:00:49.083 *******
2026-02-16 21:12:43.143133 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:43.143156 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:43.143160 | controller-1 | }
2026-02-16 21:12:43.143164 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:43.143167 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:43.143171 | controller-1 | }
2026-02-16 21:12:43.143174 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:43.143184 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.34.0/critest-v1.34.0-linux-amd64.tar.gz"
2026-02-16 21:12:43.143187 | controller-1 | }
2026-02-16 21:12:43.143191 | controller-1 |
2026-02-16 21:12:43.143195 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:43.143198 | controller-1 | Monday 16 February 2026  21:12:43 +0000 (0:00:00.116)       0:00:49.200 *******
2026-02-16 21:12:43.989567 | controller-1 | changed: [controller-3]
2026-02-16 21:12:43.989591 | controller-1 | changed: [controller-2]
2026-02-16 21:12:43.989597 | controller-1 | changed: [controller-1]
2026-02-16 21:12:43.989602 | controller-1 |
2026-02-16 21:12:43.989607 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:43.989612 | controller-1 | Monday 16 February 2026  21:12:43 +0000 (0:00:00.849)       0:00:50.049 *******
2026-02-16 21:12:45.735154 | controller-1 | changed: [controller-1]
2026-02-16 21:12:45.735450 | controller-1 | changed: [controller-2]
2026-02-16 21:12:45.735697 | controller-1 | changed: [controller-3]
2026-02-16 21:12:45.735926 | controller-1 |
2026-02-16 21:12:45.736176 | controller-1 | TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-02-16 21:12:45.736542 | controller-1 | Monday 16 February 2026  21:12:45 +0000 (0:00:01.746)       0:00:51.795 *******
2026-02-16 21:12:46.501650 | controller-1 | changed: [controller-1]
2026-02-16 21:12:46.501972 | controller-1 | changed: [controller-3]
2026-02-16 21:12:46.502222 | controller-1 | changed: [controller-2]
2026-02-16 21:12:46.502500 | controller-1 |
2026-02-16 21:12:46.502757 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-02-16 21:12:46.503073 | controller-1 | Monday 16 February 2026  21:12:46 +0000 (0:00:00.766)       0:00:52.561 *******
2026-02-16 21:12:46.893587 | controller-1 | changed: [controller-1]
2026-02-16 21:12:46.893895 | controller-1 | changed: [controller-2]
2026-02-16 21:12:46.894221 | controller-1 | changed: [controller-3]
2026-02-16 21:12:46.894455 | controller-1 |
2026-02-16 21:12:46.894707 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:46.895027 | controller-1 | Monday 16 February 2026  21:12:46 +0000 (0:00:00.392)       0:00:52.953 *******
2026-02-16 21:12:47.279379 | controller-1 | ok: [controller-1]
2026-02-16 21:12:47.279688 | controller-1 | ok: [controller-2]
2026-02-16 21:12:47.279933 | controller-1 | ok: [controller-3]
2026-02-16 21:12:47.280161 | controller-1 |
2026-02-16 21:12:47.280413 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:47.280662 | controller-1 | Monday 16 February 2026  21:12:47 +0000 (0:00:00.385)       0:00:53.339 *******
2026-02-16 21:12:47.408649 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:47.408871 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-02-16 21:12:47.409034 | controller-1 | }
2026-02-16 21:12:47.409188 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:47.409352 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-02-16 21:12:47.409499 | controller-1 | }
2026-02-16 21:12:47.409651 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:47.409854 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.8.0/cni-plugins-linux-amd64-v1.8.0.tgz"
2026-02-16 21:12:47.410005 | controller-1 | }
2026-02-16 21:12:47.410145 | controller-1 |
2026-02-16 21:12:47.410303 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:47.410459 | controller-1 | Monday 16 February 2026  21:12:47 +0000 (0:00:00.129)       0:00:53.468 *******
2026-02-16 21:12:48.608329 | controller-1 | changed: [controller-3]
2026-02-16 21:12:48.608603 | controller-1 | changed: [controller-1]
2026-02-16 21:12:48.608837 | controller-1 | changed: [controller-2]
2026-02-16 21:12:48.609057 | controller-1 |
2026-02-16 21:12:48.609325 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:48.609568 | controller-1 | Monday 16 February 2026  21:12:48 +0000 (0:00:01.200)       0:00:54.668 *******
2026-02-16 21:12:51.594946 | controller-1 | changed: [controller-1]
2026-02-16 21:12:51.594966 | controller-1 | changed: [controller-2]
2026-02-16 21:12:51.594969 | controller-1 | changed: [controller-3]
2026-02-16 21:12:51.594973 | controller-1 |
2026-02-16 21:12:51.594977 | controller-1 | TASK [vexxhost.containers.cni_plugins : Gather variables for each operating system] ***
2026-02-16 21:12:51.594981 | controller-1 | Monday 16 February 2026  21:12:51 +0000 (0:00:02.984)       0:00:57.653 *******
2026-02-16 21:12:51.678855 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-02-16 21:12:51.679002 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-02-16 21:12:51.679120 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/cni_plugins/vars/debian.yml)
2026-02-16 21:12:51.679222 | controller-1 |
2026-02-16 21:12:51.679334 | controller-1 | TASK [vexxhost.containers.cni_plugins : Install additional packages] ***********
2026-02-16 21:12:51.679449 | controller-1 | Monday 16 February 2026  21:12:51 +0000 (0:00:00.085)       0:00:57.738 *******
2026-02-16 21:12:54.073910 | controller-1 | changed: [controller-3]
2026-02-16 21:12:54.074007 | controller-1 | changed: [controller-1]
2026-02-16 21:12:54.074124 | controller-1 | changed: [controller-2]
2026-02-16 21:12:54.074235 | controller-1 |
2026-02-16 21:12:54.074359 | controller-1 | TASK [vexxhost.containers.cni_plugins : Ensure IPv6 is enabled] ****************
2026-02-16 21:12:54.074527 | controller-1 | Monday 16 February 2026  21:12:54 +0000 (0:00:02.395)       0:01:00.134 *******
2026-02-16 21:12:55.546374 | controller-1 | changed: [controller-1]
2026-02-16 21:12:55.546453 | controller-1 | changed: [controller-3]
2026-02-16 21:12:55.546606 | controller-1 | changed: [controller-2]
2026-02-16 21:12:55.546717 | controller-1 |
2026-02-16 21:12:55.546953 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules on-boot] *********
2026-02-16 21:12:55.546980 | controller-1 | Monday 16 February 2026  21:12:55 +0000 (0:00:01.472)       0:01:01.606 *******
2026-02-16 21:12:56.251121 | controller-1 | changed: [controller-1]
2026-02-16 21:12:56.251145 | controller-1 | changed: [controller-2]
2026-02-16 21:12:56.251151 | controller-1 | changed: [controller-3]
2026-02-16 21:12:56.251156 | controller-1 |
2026-02-16 21:12:56.251170 | controller-1 | TASK [vexxhost.containers.cni_plugins : Enable kernel modules in runtime] ******
2026-02-16 21:12:56.251176 | controller-1 | Monday 16 February 2026  21:12:56 +0000 (0:00:00.700)       0:01:02.307 *******
2026-02-16 21:12:57.716410 | controller-1 | changed: [controller-1] => (item=br_netfilter)
2026-02-16 21:12:57.716430 | controller-1 | changed: [controller-2] => (item=br_netfilter)
2026-02-16 21:12:57.716434 | controller-1 | changed: [controller-3] => (item=br_netfilter)
2026-02-16 21:12:57.716437 | controller-1 | ok: [controller-1] => (item=ip_tables)
2026-02-16 21:12:57.716440 | controller-1 | ok: [controller-3] => (item=ip_tables)
2026-02-16 21:12:57.716444 | controller-1 | ok: [controller-2] => (item=ip_tables)
2026-02-16 21:12:57.716447 | controller-1 | changed: [controller-1] => (item=ip6_tables)
2026-02-16 21:12:57.716450 | controller-1 | changed: [controller-3] => (item=ip6_tables)
2026-02-16 21:12:57.716453 | controller-1 | changed: [controller-2] => (item=ip6_tables)
2026-02-16 21:12:57.716456 | controller-1 | changed: [controller-1] => (item=nf_conntrack)
2026-02-16 21:12:57.716459 | controller-1 | changed: [controller-3] => (item=nf_conntrack)
2026-02-16 21:12:57.716462 | controller-1 | changed: [controller-2] => (item=nf_conntrack)
2026-02-16 21:12:57.716465 | controller-1 |
2026-02-16 21:12:57.716469 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:12:57.716473 | controller-1 | Monday 16 February 2026  21:12:57 +0000 (0:00:01.468)       0:01:03.775 *******
2026-02-16 21:12:58.061897 | controller-1 | ok: [controller-1]
2026-02-16 21:12:58.062033 | controller-1 | ok: [controller-3]
2026-02-16 21:12:58.062143 | controller-1 | ok: [controller-2]
2026-02-16 21:12:58.062245 | controller-1 |
2026-02-16 21:12:58.062357 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:12:58.062468 | controller-1 | Monday 16 February 2026  21:12:58 +0000 (0:00:00.346)       0:01:04.122 *******
2026-02-16 21:12:58.140172 | controller-1 | ok: [controller-1] => {
2026-02-16 21:12:58.140379 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-02-16 21:12:58.140537 | controller-1 | }
2026-02-16 21:12:58.140687 | controller-1 | ok: [controller-2] => {
2026-02-16 21:12:58.140838 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-02-16 21:12:58.140980 | controller-1 | }
2026-02-16 21:12:58.141127 | controller-1 | ok: [controller-3] => {
2026-02-16 21:12:58.141279 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.33.4/bin/linux/amd64/kubelet"
2026-02-16 21:12:58.141421 | controller-1 | }
2026-02-16 21:12:58.141563 | controller-1 |
2026-02-16 21:12:58.141715 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:12:58.141865 | controller-1 | Monday 16 February 2026  21:12:58 +0000 (0:00:00.078)       0:01:04.200 *******
2026-02-16 21:12:59.783051 | controller-1 | changed: [controller-1]
2026-02-16 21:12:59.786274 | controller-1 | changed: [controller-2]
2026-02-16 21:12:59.786284 | controller-1 | changed: [controller-3]
2026-02-16 21:12:59.786287 | controller-1 |
2026-02-16 21:12:59.786291 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:12:59.786295 | controller-1 | Monday 16 February 2026  21:12:59 +0000 (0:00:01.642)       0:01:05.843 *******
2026-02-16 21:12:59.856105 | controller-1 | skipping: [controller-1]
2026-02-16 21:12:59.856150 | controller-1 | skipping: [controller-2]
2026-02-16 21:12:59.856554 | controller-1 | skipping: [controller-3]
2026-02-16 21:12:59.856843 | controller-1 |
2026-02-16 21:12:59.856867 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Gather variables for each operating system] ***
2026-02-16 21:12:59.856872 | controller-1 | Monday 16 February 2026  21:12:59 +0000 (0:00:00.072)       0:01:05.916 *******
2026-02-16 21:12:59.897770 | controller-1 | ok: [controller-1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-02-16 21:12:59.957450 | controller-1 | ok: [controller-2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-02-16 21:12:59.957495 | controller-1 | ok: [controller-3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/vars/debian.yml)
2026-02-16 21:12:59.957592 | controller-1 |
2026-02-16 21:12:59.957684 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install coreutils] *************************
2026-02-16 21:12:59.957794 | controller-1 | Monday 16 February 2026  21:12:59 +0000 (0:00:00.101)       0:01:06.018 *******
2026-02-16 21:12:59.991181 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:00.022164 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:00.022180 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:00.022184 | controller-1 |
2026-02-16 21:13:00.022188 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Install additional packages] ***************
2026-02-16 21:13:00.022192 | controller-1 | Monday 16 February 2026  21:13:00 +0000 (0:00:00.062)       0:01:06.080 *******
2026-02-16 21:13:02.638878 | controller-1 | changed: [controller-1]
2026-02-16 21:13:02.641905 | controller-1 | changed: [controller-3]
2026-02-16 21:13:02.641914 | controller-1 | changed: [controller-2]
2026-02-16 21:13:02.641918 | controller-1 |
2026-02-16 21:13:02.641921 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure sysctl values] *******************
2026-02-16 21:13:02.641925 | controller-1 | Monday 16 February 2026  21:13:02 +0000 (0:00:02.619)       0:01:08.699 *******
2026-02-16 21:13:04.781741 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-02-16 21:13:04.781796 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-02-16 21:13:04.781884 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.ip_forward', 'value': 1})
2026-02-16 21:13:04.781974 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-02-16 21:13:04.782059 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-02-16 21:13:04.782147 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-iptables', 'value': 1})
2026-02-16 21:13:04.782234 | controller-1 | changed: [controller-1] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-02-16 21:13:04.782322 | controller-1 | changed: [controller-3] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-02-16 21:13:04.782409 | controller-1 | changed: [controller-2] => (item={'name': 'net.bridge.bridge-nf-call-ip6tables', 'value': 1})
2026-02-16 21:13:04.782841 | controller-1 | changed: [controller-1] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-02-16 21:13:04.782851 | controller-1 | changed: [controller-2] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-02-16 21:13:04.782861 | controller-1 | changed: [controller-3] => (item={'name': 'net.ipv4.conf.all.rp_filter', 'value': 0})
2026-02-16 21:13:04.782865 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-02-16 21:13:04.782921 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-02-16 21:13:04.783038 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_queued_events', 'value': 1048576})
2026-02-16 21:13:04.783152 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-02-16 21:13:04.783264 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-02-16 21:13:04.783377 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_instances', 'value': 8192})
2026-02-16 21:13:04.783490 | controller-1 | changed: [controller-1] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-02-16 21:13:04.783609 | controller-1 | changed: [controller-2] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-02-16 21:13:04.783723 | controller-1 | changed: [controller-3] => (item={'name': 'fs.inotify.max_user_watches', 'value': 1048576})
2026-02-16 21:13:04.783824 | controller-1 |
2026-02-16 21:13:04.783938 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create folders for kubernetes configuration] ***
2026-02-16 21:13:04.784047 | controller-1 | Monday 16 February 2026  21:13:04 +0000 (0:00:02.142)       0:01:10.842 *******
2026-02-16 21:13:05.659567 | controller-1 | changed: [controller-1] => (item=/etc/systemd/system/kubelet.service.d)
2026-02-16 21:13:05.659590 | controller-1 | changed: [controller-2] => (item=/etc/systemd/system/kubelet.service.d)
2026-02-16 21:13:05.659594 | controller-1 | changed: [controller-3] => (item=/etc/systemd/system/kubelet.service.d)
2026-02-16 21:13:05.659602 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes)
2026-02-16 21:13:05.659605 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes)
2026-02-16 21:13:05.659608 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes)
2026-02-16 21:13:05.659612 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests)
2026-02-16 21:13:05.659615 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests)
2026-02-16 21:13:05.659619 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests)
2026-02-16 21:13:05.659622 | controller-1 |
2026-02-16 21:13:05.659626 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubelet systemd service config] ********
2026-02-16 21:13:05.659629 | controller-1 | Monday 16 February 2026  21:13:05 +0000 (0:00:00.876)       0:01:11.718 *******
2026-02-16 21:13:06.417929 | controller-1 | changed: [controller-1]
2026-02-16 21:13:06.419156 | controller-1 | changed: [controller-2]
2026-02-16 21:13:06.419251 | controller-1 | changed: [controller-3]
2026-02-16 21:13:06.419333 | controller-1 |
2026-02-16 21:13:06.419434 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Add kubeadm dropin for kubelet systemd service config] ***
2026-02-16 21:13:06.419522 | controller-1 | Monday 16 February 2026  21:13:06 +0000 (0:00:00.760)       0:01:12.478 *******
2026-02-16 21:13:07.141673 | controller-1 | changed: [controller-1]
2026-02-16 21:13:07.141778 | controller-1 | changed: [controller-2]
2026-02-16 21:13:07.141894 | controller-1 | changed: [controller-3]
2026-02-16 21:13:07.142007 | controller-1 |
2026-02-16 21:13:07.142129 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Check swap status] *************************
2026-02-16 21:13:07.142248 | controller-1 | Monday 16 February 2026  21:13:07 +0000 (0:00:00.723)       0:01:13.201 *******
2026-02-16 21:13:07.592758 | controller-1 | ok: [controller-1]
2026-02-16 21:13:07.592901 | controller-1 | ok: [controller-2]
2026-02-16 21:13:07.593039 | controller-1 | ok: [controller-3]
2026-02-16 21:13:07.593151 | controller-1 |
2026-02-16 21:13:07.593283 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Disable swap] ******************************
2026-02-16 21:13:07.593409 | controller-1 | Monday 16 February 2026  21:13:07 +0000 (0:00:00.450)       0:01:13.652 *******
2026-02-16 21:13:07.642868 | controller-1 | [ERROR]: Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-02-16 21:13:07.642898 | controller-1 |
2026-02-16 21:13:07.642904 | controller-1 | Task failed.
2026-02-16 21:13:07.642910 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:78:7
2026-02-16 21:13:07.642914 | controller-1 |
2026-02-16 21:13:07.642919 | controller-1 | 76       register: kubelet_swapon
2026-02-16 21:13:07.642925 | controller-1 | 77
2026-02-16 21:13:07.642929 | controller-1 | 78     - name: Disable swap
2026-02-16 21:13:07.642934 | controller-1 |          ^ column 7
2026-02-16 21:13:07.642939 | controller-1 |
2026-02-16 21:13:07.642943 | controller-1 | <<< caused by >>>
2026-02-16 21:13:07.642948 | controller-1 |
2026-02-16 21:13:07.642953 | controller-1 | Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result.
2026-02-16 21:13:07.642957 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11
2026-02-16 21:13:07.642962 | controller-1 |
2026-02-16 21:13:07.642966 | controller-1 | 81       ignore_errors: "{{ ansible_check_mode }}"
2026-02-16 21:13:07.642971 | controller-1 | 82       when:
2026-02-16 21:13:07.642976 | controller-1 | 83         - kubelet_swapon.stdout
2026-02-16 21:13:07.642980 | controller-1 |              ^ column 11
2026-02-16 21:13:07.642985 | controller-1 |
2026-02-16 21:13:07.642989 | controller-1 | Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.
2026-02-16 21:13:07.642994 | controller-1 |
2026-02-16 21:13:07.643004 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-02-16 21:13:07.643122 | controller-1 | fatal: [controller-2]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-02-16 21:13:07.655273 | controller-1 | fatal: [controller-3]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (False) was derived from value of type 'str' at '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubelet/tasks/main.yml:83:11'. Conditionals must have a boolean result."}
2026-02-16 21:13:07.667608 | controller-1 | ...ignoring
2026-02-16 21:13:07.667680 | controller-1 | ...ignoring
2026-02-16 21:13:07.667760 | controller-1 | ...ignoring
2026-02-16 21:13:07.667838 | controller-1 |
2026-02-16 21:13:07.667940 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Remove swapfile from /etc/fstab] ***********
2026-02-16 21:13:07.668046 | controller-1 | Monday 16 February 2026  21:13:07 +0000 (0:00:00.075)       0:01:13.728 *******
2026-02-16 21:13:08.440044 | controller-1 | ok: [controller-1] => (item=swap)
2026-02-16 21:13:08.440164 | controller-1 | ok: [controller-2] => (item=swap)
2026-02-16 21:13:08.440300 | controller-1 | ok: [controller-3] => (item=swap)
2026-02-16 21:13:08.440423 | controller-1 | ok: [controller-1] => (item=none)
2026-02-16 21:13:08.440540 | controller-1 | ok: [controller-2] => (item=none)
2026-02-16 21:13:08.440658 | controller-1 | ok: [controller-3] => (item=none)
2026-02-16 21:13:08.440765 | controller-1 |
2026-02-16 21:13:08.440896 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Create noswap systemd service config file] ***
2026-02-16 21:13:08.441016 | controller-1 | Monday 16 February 2026  21:13:08 +0000 (0:00:00.771)       0:01:14.500 *******
2026-02-16 21:13:09.112239 | controller-1 | changed: [controller-1]
2026-02-16 21:13:09.112273 | controller-1 | changed: [controller-2]
2026-02-16 21:13:09.112281 | controller-1 | changed: [controller-3]
2026-02-16 21:13:09.112290 | controller-1 |
2026-02-16 21:13:09.112298 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable noswap service] *********************
2026-02-16 21:13:09.112307 | controller-1 | Monday 16 February 2026  21:13:09 +0000 (0:00:00.670)       0:01:15.171 *******
2026-02-16 21:13:09.942335 | controller-1 | changed: [controller-1]
2026-02-16 21:13:09.942381 | controller-1 | changed: [controller-2]
2026-02-16 21:13:09.942521 | controller-1 | changed: [controller-3]
2026-02-16 21:13:09.942608 | controller-1 |
2026-02-16 21:13:09.942703 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-02-16 21:13:09.942783 | controller-1 | Monday 16 February 2026  21:13:09 +0000 (0:00:00.814)       0:01:15.985 *******
2026-02-16 21:13:09.942906 | controller-1 |
2026-02-16 21:13:09.943007 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-02-16 21:13:09.943089 | controller-1 | Monday 16 February 2026  21:13:09 +0000 (0:00:00.007)       0:01:15.993 *******
2026-02-16 21:13:09.943166 | controller-1 |
2026-02-16 21:13:09.943255 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Force any restarts if necessary] ***********
2026-02-16 21:13:09.943343 | controller-1 | Monday 16 February 2026  21:13:09 +0000 (0:00:00.004)       0:01:15.998 *******
2026-02-16 21:13:09.943420 | controller-1 |
2026-02-16 21:13:09.943510 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-02-16 21:13:09.943596 | controller-1 | Monday 16 February 2026  21:13:09 +0000 (0:00:00.004)       0:01:16.002 *******
2026-02-16 21:13:11.573233 | controller-1 | ok: [controller-1]
2026-02-16 21:13:11.573337 | controller-1 | ok: [controller-2]
2026-02-16 21:13:11.573457 | controller-1 | ok: [controller-3]
2026-02-16 21:13:11.573572 | controller-1 |
2026-02-16 21:13:11.573700 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Enable and start kubelet service] **********
2026-02-16 21:13:11.574889 | controller-1 | Monday 16 February 2026  21:13:11 +0000 (0:00:01.630)       0:01:17.633 *******
2026-02-16 21:13:12.383433 | controller-1 | changed: [controller-1]
2026-02-16 21:13:12.383453 | controller-1 | changed: [controller-3]
2026-02-16 21:13:12.383457 | controller-1 | changed: [controller-2]
2026-02-16 21:13:12.383460 | controller-1 |
2026-02-16 21:13:12.383464 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure availability of dbus on Debian] *****
2026-02-16 21:13:12.383468 | controller-1 | Monday 16 February 2026  21:13:12 +0000 (0:00:00.807)       0:01:18.440 *******
2026-02-16 21:13:13.484835 | controller-1 | ok: [controller-1]
2026-02-16 21:13:13.485117 | controller-1 | ok: [controller-2]
2026-02-16 21:13:13.485384 | controller-1 | ok: [controller-3]
2026-02-16 21:13:13.485624 | controller-1 |
2026-02-16 21:13:13.485873 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Configure short hostname] ******************
2026-02-16 21:13:13.486116 | controller-1 | Monday 16 February 2026  21:13:13 +0000 (0:00:01.104)       0:01:19.545 *******
2026-02-16 21:13:14.426768 | controller-1 | changed: [controller-1]
2026-02-16 21:13:14.429881 | controller-1 | changed: [controller-2]
2026-02-16 21:13:14.429891 | controller-1 | changed: [controller-3]
2026-02-16 21:13:14.429895 | controller-1 |
2026-02-16 21:13:14.429898 | controller-1 | TASK [vexxhost.kubernetes.kubelet : Ensure hostname inside hosts file] *********
2026-02-16 21:13:14.429902 | controller-1 | Monday 16 February 2026  21:13:14 +0000 (0:00:00.942)       0:01:20.487 *******
2026-02-16 21:13:14.866306 | controller-1 | changed: [controller-1]
2026-02-16 21:13:14.866445 | controller-1 | changed: [controller-2]
2026-02-16 21:13:14.866559 | controller-1 | changed: [controller-3]
2026-02-16 21:13:14.866665 | controller-1 |
2026-02-16 21:13:14.866908 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kubernetes repository] ***********
2026-02-16 21:13:14.868847 | controller-1 | Monday 16 February 2026  21:13:14 +0000 (0:00:00.439)       0:01:20.926 *******
2026-02-16 21:13:15.451866 | controller-1 | ok: [controller-1]
2026-02-16 21:13:15.452020 | controller-1 | ok: [controller-2]
2026-02-16 21:13:15.452134 | controller-1 | ok: [controller-3]
2026-02-16 21:13:15.452261 | controller-1 |
2026-02-16 21:13:15.452381 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup control plane] ********************
2026-02-16 21:13:15.452494 | controller-1 | Monday 16 February 2026  21:13:15 +0000 (0:00:00.585)       0:01:21.512 *******
2026-02-16 21:13:15.579415 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/control-plane.yml for controller-1, controller-2, controller-3
2026-02-16 21:13:15.579688 | controller-1 |
2026-02-16 21:13:15.579948 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Bootstrap cluster] **********************
2026-02-16 21:13:15.580250 | controller-1 | Monday 16 February 2026  21:13:15 +0000 (0:00:00.127)       0:01:21.639 *******
2026-02-16 21:13:15.690294 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/bootstrap-cluster.yml for controller-1, controller-2, controller-3
2026-02-16 21:13:15.690949 | controller-1 |
2026-02-16 21:13:15.691074 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if any control plane is bootstrapped] ***
2026-02-16 21:13:15.691202 | controller-1 | Monday 16 February 2026  21:13:15 +0000 (0:00:00.111)       0:01:21.750 *******
2026-02-16 21:13:16.878393 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.53)] => (item=controller-1)
2026-02-16 21:13:16.878687 | controller-1 | ok: [controller-1] => (item=controller-1)
2026-02-16 21:13:16.879014 | controller-1 | ok: [controller-3 -> controller-1(199.204.45.53)] => (item=controller-1)
2026-02-16 21:13:16.879264 | controller-1 | ok: [controller-2] => (item=controller-2)
2026-02-16 21:13:16.879509 | controller-1 | ok: [controller-1 -> controller-2(199.204.45.3)] => (item=controller-2)
2026-02-16 21:13:16.879779 | controller-1 | ok: [controller-3 -> controller-2(199.204.45.3)] => (item=controller-2)
2026-02-16 21:13:16.880023 | controller-1 | ok: [controller-2 -> controller-3(199.204.45.115)] => (item=controller-3)
2026-02-16 21:13:16.880282 | controller-1 | ok: [controller-1 -> controller-3(199.204.45.115)] => (item=controller-3)
2026-02-16 21:13:16.880561 | controller-1 | ok: [controller-3] => (item=controller-3)
2026-02-16 21:13:16.880787 | controller-1 |
2026-02-16 21:13:16.881038 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Pick node from pre-existing cluster] ****
2026-02-16 21:13:16.881279 | controller-1 | Monday 16 February 2026  21:13:16 +0000 (0:00:01.187)       0:01:22.938 *******
2026-02-16 21:13:16.951136 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:16.953244 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:16.953253 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:16.953257 | controller-1 |
2026-02-16 21:13:16.953261 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Select first node to initialize cluster] ***
2026-02-16 21:13:16.953264 | controller-1 | Monday 16 February 2026  21:13:16 +0000 (0:00:00.072)       0:01:23.011 *******
2026-02-16 21:13:17.030734 | controller-1 | ok: [controller-1]
2026-02-16 21:13:17.033929 | controller-1 | ok: [controller-2]
2026-02-16 21:13:17.033938 | controller-1 | ok: [controller-3]
2026-02-16 21:13:17.033942 | controller-1 |
2026-02-16 21:13:17.033946 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Print selected bootstrap node] **********
2026-02-16 21:13:17.033954 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.079)       0:01:23.091 *******
2026-02-16 21:13:17.098338 | controller-1 | ok: [controller-1] => {
2026-02-16 21:13:17.098564 | controller-1 |     "msg": "controller-1"
2026-02-16 21:13:17.098716 | controller-1 | }
2026-02-16 21:13:17.098893 | controller-1 | ok: [controller-2] => {
2026-02-16 21:13:17.099044 | controller-1 |     "msg": "controller-1"
2026-02-16 21:13:17.099204 | controller-1 | }
2026-02-16 21:13:17.099383 | controller-1 | ok: [controller-3] => {
2026-02-16 21:13:17.099585 | controller-1 |     "msg": "controller-1"
2026-02-16 21:13:17.099731 | controller-1 | }
2026-02-16 21:13:17.099896 | controller-1 |
2026-02-16 21:13:17.100113 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload cluster configuration for bootstrap node] ***
2026-02-16 21:13:17.100303 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.067)       0:01:23.158 *******
2026-02-16 21:13:17.756149 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:17.756344 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:17.756569 | controller-1 | changed: [controller-1]
2026-02-16 21:13:17.756732 | controller-1 |
2026-02-16 21:13:17.756994 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create pki folder] **********************
2026-02-16 21:13:17.757180 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.657)       0:01:23.816 *******
2026-02-16 21:13:17.820241 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:17.820458 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:17.820733 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:17.820973 | controller-1 |
2026-02-16 21:13:17.821235 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca key] ***************
2026-02-16 21:13:17.821552 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.063)       0:01:23.880 *******
2026-02-16 21:13:17.878746 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:17.878770 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:17.878775 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:17.878780 | controller-1 |
2026-02-16 21:13:17.878786 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create kubernetes ca cert] **************
2026-02-16 21:13:17.878791 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.055)       0:01:23.936 *******
2026-02-16 21:13:17.910706 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:17.944678 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:17.944802 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:17.944904 | controller-1 |
2026-02-16 21:13:17.945016 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca key] *********************
2026-02-16 21:13:17.945125 | controller-1 | Monday 16 February 2026  21:13:17 +0000 (0:00:00.069)       0:01:24.005 *******
2026-02-16 21:13:18.005691 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:18.005971 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:18.006214 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:18.006436 | controller-1 |
2026-02-16 21:13:18.006682 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create etcd-ca cert] ********************
2026-02-16 21:13:18.006974 | controller-1 | Monday 16 February 2026  21:13:18 +0000 (0:00:00.060)       0:01:24.066 *******
2026-02-16 21:13:18.059635 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:18.060023 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:18.060313 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:18.060538 | controller-1 |
2026-02-16 21:13:18.060787 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca key] **************
2026-02-16 21:13:18.061066 | controller-1 | Monday 16 February 2026  21:13:18 +0000 (0:00:00.053)       0:01:24.119 *******
2026-02-16 21:13:18.119283 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:18.119308 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:18.119313 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:18.119318 | controller-1 |
2026-02-16 21:13:18.119323 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create front-proxy-ca cert] *************
2026-02-16 21:13:18.119328 | controller-1 | Monday 16 February 2026  21:13:18 +0000 (0:00:00.056)       0:01:24.176 *******
2026-02-16 21:13:18.146847 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:18.176188 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:18.178897 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:18.178906 | controller-1 |
2026-02-16 21:13:18.178910 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Initialize cluster] *********************
2026-02-16 21:13:18.178914 | controller-1 | Monday 16 February 2026  21:13:18 +0000 (0:00:00.060)       0:01:24.236 *******
2026-02-16 21:13:54.006117 | controller-1 | changed: [controller-1]
2026-02-16 21:13:54.035615 | controller-1 | skipping: [controller-2]
2026-02-16 21:13:54.036269 | controller-1 | skipping: [controller-3]
2026-02-16 21:13:54.036433 | controller-1 |
2026-02-16 21:13:54.036554 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the node is already part of the cluster] ***
2026-02-16 21:13:54.036664 | controller-1 | Monday 16 February 2026  21:13:54 +0000 (0:00:35.858)       0:02:00.095 *******
2026-02-16 21:13:54.399947 | controller-1 | ok: [controller-1]
2026-02-16 21:13:54.399969 | controller-1 | ok: [controller-2]
2026-02-16 21:13:54.399973 | controller-1 | ok: [controller-3]
2026-02-16 21:13:54.399977 | controller-1 |
2026-02-16 21:13:54.399981 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-02-16 21:13:54.399984 | controller-1 | Monday 16 February 2026  21:13:54 +0000 (0:00:00.364)       0:02:00.459 *******
2026-02-16 21:13:54.545576 | controller-1 | skipping: [controller-1]
2026-02-16 21:13:54.546178 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes/tasks/join-cluster.yml for controller-2, controller-3
2026-02-16 21:13:54.546288 | controller-1 |
2026-02-16 21:13:54.547664 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate control-plane certificates for joining cluster] ***
2026-02-16 21:13:54.547812 | controller-1 | Monday 16 February 2026  21:13:54 +0000 (0:00:00.145)       0:02:00.604 *******
2026-02-16 21:13:55.010301 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.53)]
2026-02-16 21:13:55.011387 | controller-1 |
2026-02-16 21:13:55.011618 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Retrieve SHA256 certificate hash] *******
2026-02-16 21:13:55.011831 | controller-1 | Monday 16 February 2026  21:13:55 +0000 (0:00:00.465)       0:02:01.070 *******
2026-02-16 21:13:55.605416 | controller-1 | ok: [controller-2 -> controller-1(199.204.45.53)]
2026-02-16 21:13:55.605459 | controller-1 |
2026-02-16 21:13:55.605556 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Generate token for joining cluster] *****
2026-02-16 21:13:55.605647 | controller-1 | Monday 16 February 2026  21:13:55 +0000 (0:00:00.595)       0:02:01.665 *******
2026-02-16 21:13:55.978023 | controller-1 | changed: [controller-2 -> controller-1(199.204.45.53)]
2026-02-16 21:13:55.978047 | controller-1 |
2026-02-16 21:13:55.978052 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upload kubeadm configuration] ***********
2026-02-16 21:13:55.978055 | controller-1 | Monday 16 February 2026  21:13:55 +0000 (0:00:00.370)       0:02:02.035 *******
2026-02-16 21:13:56.709273 | controller-1 | changed: [controller-2]
2026-02-16 21:13:56.709442 | controller-1 | changed: [controller-3]
2026-02-16 21:13:56.709612 | controller-1 |
2026-02-16 21:13:56.709807 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Join cluster] ***************************
2026-02-16 21:13:56.710137 | controller-1 | Monday 16 February 2026  21:13:56 +0000 (0:00:00.733)       0:02:02.769 *******
2026-02-16 21:15:46.504786 | controller-1 | changed: [controller-2]
2026-02-16 21:15:46.504831 | controller-1 | changed: [controller-3]
2026-02-16 21:15:46.504906 | controller-1 |
2026-02-16 21:15:46.505003 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Create folder for admin configuration] ***
2026-02-16 21:15:46.505086 | controller-1 | Monday 16 February 2026  21:15:46 +0000 (0:01:49.783)       0:03:52.552 *******
2026-02-16 21:15:47.039901 | controller-1 | changed: [controller-2]
2026-02-16 21:15:47.040000 | controller-1 | changed: [controller-3]
2026-02-16 21:15:47.040115 | controller-1 | changed: [controller-1]
2026-02-16 21:15:47.040218 | controller-1 |
2026-02-16 21:15:47.040346 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Creating a symlink for admin configuration file] ***
2026-02-16 21:15:47.040464 | controller-1 | Monday 16 February 2026  21:15:47 +0000 (0:00:00.546)       0:03:53.099 *******
2026-02-16 21:15:47.492446 | controller-1 | changed: [controller-1]
2026-02-16 21:15:47.492521 | controller-1 | changed: [controller-2]
2026-02-16 21:15:47.492635 | controller-1 | changed: [controller-3]
2026-02-16 21:15:47.492741 | controller-1 |
2026-02-16 21:15:47.492863 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Add bash autocomplete for kubectl] ******
2026-02-16 21:15:47.492981 | controller-1 | Monday 16 February 2026  21:15:47 +0000 (0:00:00.453)       0:03:53.552 *******
2026-02-16 21:15:47.907282 | controller-1 | changed: [controller-2]
2026-02-16 21:15:47.907334 | controller-1 | changed: [controller-1]
2026-02-16 21:15:47.907425 | controller-1 | changed: [controller-3]
2026-02-16 21:15:47.907504 | controller-1 |
2026-02-16 21:15:47.907590 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install PIP] ****************************
2026-02-16 21:15:47.907667 | controller-1 | Monday 16 February 2026  21:15:47 +0000 (0:00:00.414)       0:03:53.967 *******
2026-02-16 21:15:48.008250 | controller-1 | skipping: [controller-1]
2026-02-16 21:15:48.008319 | controller-1 | skipping: [controller-2]
2026-02-16 21:15:48.008402 | controller-1 | skipping: [controller-3]
2026-02-16 21:15:48.008478 | controller-1 |
2026-02-16 21:15:48.008570 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using pip on supported systems] ***
2026-02-16 21:15:48.008655 | controller-1 | Monday 16 February 2026  21:15:48 +0000 (0:00:00.100)       0:03:54.068 *******
2026-02-16 21:15:48.113190 | controller-1 | skipping: [controller-1]
2026-02-16 21:15:48.113914 | controller-1 | skipping: [controller-2]
2026-02-16 21:15:48.113949 | controller-1 | skipping: [controller-3]
2026-02-16 21:15:48.113955 | controller-1 |
2026-02-16 21:15:48.113961 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Enable EPEL repository] *****************
2026-02-16 21:15:48.113967 | controller-1 | Monday 16 February 2026  21:15:48 +0000 (0:00:00.104)       0:03:54.173 *******
2026-02-16 21:15:48.192110 | controller-1 | skipping: [controller-1]
2026-02-16 21:15:48.192146 | controller-1 | skipping: [controller-2]
2026-02-16 21:15:48.192153 | controller-1 | skipping: [controller-3]
2026-02-16 21:15:48.192158 | controller-1 |
2026-02-16 21:15:48.192169 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems] ***
2026-02-16 21:15:48.192280 | controller-1 | Monday 16 February 2026  21:15:48 +0000 (0:00:00.076)       0:03:54.249 *******
2026-02-16 21:15:59.644067 | controller-1 | changed: [controller-1]
2026-02-16 21:15:59.644134 | controller-1 | changed: [controller-2]
2026-02-16 21:15:59.644214 | controller-1 | changed: [controller-3]
2026-02-16 21:15:59.644295 | controller-1 |
2026-02-16 21:15:59.644401 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Allow workload on control plane node] ***
2026-02-16 21:15:59.644487 | controller-1 | Monday 16 February 2026  21:15:59 +0000 (0:00:11.453)       0:04:05.703 *******
2026-02-16 21:16:01.324393 | controller-1 | changed: [controller-1]
2026-02-16 21:16:01.324441 | controller-1 | changed: [controller-2]
2026-02-16 21:16:01.324510 | controller-1 | changed: [controller-3]
2026-02-16 21:16:01.324589 | controller-1 |
2026-02-16 21:16:01.324680 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Remove kube-proxy resources] ************
2026-02-16 21:16:01.324769 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:01.680)       0:04:07.384 *******
2026-02-16 21:16:01.373786 | controller-1 | skipping: [controller-1] => (item=DaemonSet)
2026-02-16 21:16:01.373818 | controller-1 | skipping: [controller-1] => (item=ConfigMap)
2026-02-16 21:16:01.373960 | controller-1 | skipping: [controller-1]
2026-02-16 21:16:01.374153 | controller-1 |
2026-02-16 21:16:01.374395 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Start an upgrade] ***********************
2026-02-16 21:16:01.374586 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:00.049)       0:04:07.433 *******
2026-02-16 21:16:01.420883 | controller-1 | skipping: [controller-1]
2026-02-16 21:16:01.420960 | controller-1 |
2026-02-16 21:16:01.421085 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Check if the Kubernetes API services is up to date] ***
2026-02-16 21:16:01.421241 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:00.047)       0:04:07.480 *******
2026-02-16 21:16:01.490934 | controller-1 | skipping: [controller-1]
2026-02-16 21:16:01.490993 | controller-1 | skipping: [controller-2]
2026-02-16 21:16:01.491085 | controller-1 | skipping: [controller-3]
2026-02-16 21:16:01.491162 | controller-1 |
2026-02-16 21:16:01.491257 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Trigger an upgrade of the Kubernetes API services] ***
2026-02-16 21:16:01.491350 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:00.070)       0:04:07.551 *******
2026-02-16 21:16:01.548125 | controller-1 | skipping: [controller-1]
2026-02-16 21:16:01.580222 | controller-1 | skipping: [controller-2]
2026-02-16 21:16:01.580308 | controller-1 | skipping: [controller-3]
2026-02-16 21:16:01.582994 | controller-1 |
2026-02-16 21:16:01.583085 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Setup nodes] ****************************
2026-02-16 21:16:01.583170 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:00.089)       0:04:07.640 *******
2026-02-16 21:16:01.621906 | controller-1 | skipping: [controller-1]
2026-02-16 21:16:01.654085 | controller-1 | skipping: [controller-2]
2026-02-16 21:16:01.654133 | controller-1 | skipping: [controller-3]
2026-02-16 21:16:01.654233 | controller-1 |
2026-02-16 21:16:01.654327 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Upgrade & restart Kubelet node for upgrade (if needed)] ***
2026-02-16 21:16:01.654414 | controller-1 | Monday 16 February 2026  21:16:01 +0000 (0:00:00.074)       0:04:07.714 *******
2026-02-16 21:16:02.512039 | controller-1 | ok: [controller-1]
2026-02-16 21:16:02.941156 | controller-1 | ok: [controller-2]
2026-02-16 21:16:02.941345 | controller-1 | ok: [controller-3]
2026-02-16 21:16:02.941527 | controller-1 |
2026-02-16 21:16:02.941750 | controller-1 | TASK [vexxhost.kubernetes.kubernetes : Set node selector for CoreDNS components] ***
2026-02-16 21:16:02.941943 | controller-1 | Monday 16 February 2026  21:16:02 +0000 (0:00:01.286)       0:04:09.001 *******
2026-02-16 21:16:04.000272 | controller-1 | changed: [controller-1]
2026-02-16 21:16:04.000302 | controller-1 |
2026-02-16 21:16:04.000306 | controller-1 | PLAY [Install control-plane components] ****************************************
2026-02-16 21:16:04.000310 | controller-1 |
2026-02-16 21:16:04.000313 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-02-16 21:16:04.000317 | controller-1 | Monday 16 February 2026  21:16:03 +0000 (0:00:01.051)       0:04:10.053 *******
2026-02-16 21:16:05.998454 | controller-1 | ok: [controller-1]
2026-02-16 21:16:05.998497 | controller-1 | ok: [controller-2]
2026-02-16 21:16:05.998617 | controller-1 | ok: [controller-3]
2026-02-16 21:16:05.998668 | controller-1 |
2026-02-16 21:16:05.998775 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-02-16 21:16:06.002215 | controller-1 | Monday 16 February 2026  21:16:05 +0000 (0:00:02.003)       0:04:12.056 *******
2026-02-16 21:16:06.398950 | controller-1 | ok: [controller-1]
2026-02-16 21:16:06.398987 | controller-1 | ok: [controller-2]
2026-02-16 21:16:06.398996 | controller-1 | ok: [controller-3]
2026-02-16 21:16:06.399051 | controller-1 |
2026-02-16 21:16:06.399138 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-02-16 21:16:06.399351 | controller-1 | Monday 16 February 2026  21:16:06 +0000 (0:00:00.399)       0:04:12.455 *******
2026-02-16 21:16:07.551652 | controller-1 | ok: [controller-1]
2026-02-16 21:16:07.551720 | controller-1 | ok: [controller-2]
2026-02-16 21:16:07.551803 | controller-1 | ok: [controller-3]
2026-02-16 21:16:07.551882 | controller-1 |
2026-02-16 21:16:07.551980 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-02-16 21:16:07.552063 | controller-1 | Monday 16 February 2026  21:16:07 +0000 (0:00:01.156)       0:04:13.612 *******
2026-02-16 21:16:07.913939 | controller-1 | ok: [controller-1]
2026-02-16 21:16:07.914012 | controller-1 | ok: [controller-2]
2026-02-16 21:16:07.914099 | controller-1 | ok: [controller-3]
2026-02-16 21:16:07.914180 | controller-1 |
2026-02-16 21:16:07.914270 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:16:07.914355 | controller-1 | Monday 16 February 2026  21:16:07 +0000 (0:00:00.362)       0:04:13.974 *******
2026-02-16 21:16:07.981368 | controller-1 | ok: [controller-1] => {
2026-02-16 21:16:07.982845 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-02-16 21:16:07.982851 | controller-1 | }
2026-02-16 21:16:07.982855 | controller-1 | ok: [controller-2] => {
2026-02-16 21:16:07.982858 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-02-16 21:16:07.982862 | controller-1 | }
2026-02-16 21:16:07.982865 | controller-1 | ok: [controller-3] => {
2026-02-16 21:16:07.982868 | controller-1 |     "msg": "https://get.helm.sh/helm-v3.11.2-linux-amd64.tar.gz"
2026-02-16 21:16:07.982871 | controller-1 | }
2026-02-16 21:16:07.982875 | controller-1 |
2026-02-16 21:16:07.982878 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:16:07.982882 | controller-1 | Monday 16 February 2026  21:16:07 +0000 (0:00:00.067)       0:04:14.041 *******
2026-02-16 21:16:09.615415 | controller-1 | changed: [controller-3]
2026-02-16 21:16:09.615484 | controller-1 | changed: [controller-1]
2026-02-16 21:16:09.615566 | controller-1 | changed: [controller-2]
2026-02-16 21:16:09.615644 | controller-1 |
2026-02-16 21:16:09.615732 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:16:09.615818 | controller-1 | Monday 16 February 2026  21:16:09 +0000 (0:00:01.633)       0:04:15.675 *******
2026-02-16 21:16:12.507036 | controller-1 | changed: [controller-1]
2026-02-16 21:16:12.507138 | controller-1 | changed: [controller-3]
2026-02-16 21:16:12.507227 | controller-1 | changed: [controller-2]
2026-02-16 21:16:12.507305 | controller-1 |
2026-02-16 21:16:12.507392 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm repository] ***********************
2026-02-16 21:16:12.507477 | controller-1 | Monday 16 February 2026  21:16:12 +0000 (0:00:02.876)       0:04:18.551 *******
2026-02-16 21:16:12.996055 | controller-1 | ok: [controller-2]
2026-02-16 21:16:12.996129 | controller-1 | ok: [controller-1]
2026-02-16 21:16:12.996215 | controller-1 | ok: [controller-3]
2026-02-16 21:16:12.996297 | controller-1 |
2026-02-16 21:16:12.996618 | controller-1 | TASK [vexxhost.kubernetes.helm : Add bash autocomplete for helm] ***************
2026-02-16 21:16:12.996628 | controller-1 | Monday 16 February 2026  21:16:12 +0000 (0:00:00.504)       0:04:19.056 *******
2026-02-16 21:16:13.355612 | controller-1 | changed: [controller-1]
2026-02-16 21:16:13.355688 | controller-1 | changed: [controller-3]
2026-02-16 21:16:13.355790 | controller-1 | changed: [controller-2]
2026-02-16 21:16:13.355886 | controller-1 |
2026-02-16 21:16:13.355994 | controller-1 | TASK [vexxhost.kubernetes.helm : Get Helm plugins dir] *************************
2026-02-16 21:16:13.356080 | controller-1 | Monday 16 February 2026  21:16:13 +0000 (0:00:00.359)       0:04:19.416 *******
2026-02-16 21:16:13.875661 | controller-1 | ok: [controller-1]
2026-02-16 21:16:13.875709 | controller-1 | ok: [controller-2]
2026-02-16 21:16:13.875799 | controller-1 | ok: [controller-3]
2026-02-16 21:16:13.875874 | controller-1 |
2026-02-16 21:16:13.876163 | controller-1 | TASK [vexxhost.kubernetes.helm : Create Helm plugins directory if it does not exist] ***
2026-02-16 21:16:13.876176 | controller-1 | Monday 16 February 2026  21:16:13 +0000 (0:00:00.519)       0:04:19.935 *******
2026-02-16 21:16:14.271771 | controller-1 | changed: [controller-1]
2026-02-16 21:16:14.271964 | controller-1 | changed: [controller-2]
2026-02-16 21:16:14.272155 | controller-1 | changed: [controller-3]
2026-02-16 21:16:14.272328 | controller-1 |
2026-02-16 21:16:14.272538 | controller-1 | TASK [vexxhost.kubernetes.helm : Remove Helm diff plugin installed by kubernetes.core.helm_plugin] ***
2026-02-16 21:16:14.272731 | controller-1 | Monday 16 February 2026  21:16:14 +0000 (0:00:00.395)       0:04:20.331 *******
2026-02-16 21:16:14.634236 | controller-1 | ok: [controller-1]
2026-02-16 21:16:14.634418 | controller-1 | ok: [controller-2]
2026-02-16 21:16:14.634584 | controller-1 | ok: [controller-3]
2026-02-16 21:16:14.634705 | controller-1 |
2026-02-16 21:16:14.635071 | controller-1 | TASK [Install plugin] **********************************************************
2026-02-16 21:16:14.635348 | controller-1 | Monday 16 February 2026  21:16:14 +0000 (0:00:00.359)       0:04:20.691 *******
2026-02-16 21:16:14.739374 | controller-1 | included: vexxhost.containers.download_artifact for controller-1, controller-2, controller-3
2026-02-16 21:16:14.739397 | controller-1 |
2026-02-16 21:16:14.739401 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-02-16 21:16:14.739405 | controller-1 | Monday 16 February 2026  21:16:14 +0000 (0:00:00.104)       0:04:20.795 *******
2026-02-16 21:16:14.805274 | controller-1 | ok: [controller-1] => {
2026-02-16 21:16:14.805296 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-02-16 21:16:14.805300 | controller-1 | }
2026-02-16 21:16:14.805304 | controller-1 | ok: [controller-3] => {
2026-02-16 21:16:14.805307 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-02-16 21:16:14.805310 | controller-1 | }
2026-02-16 21:16:14.805313 | controller-1 | ok: [controller-2] => {
2026-02-16 21:16:14.805317 | controller-1 |     "msg": "https://github.com/databus23/helm-diff/releases/download/v3.8.1/helm-diff-linux-amd64.tgz"
2026-02-16 21:16:14.805320 | controller-1 | }
2026-02-16 21:16:14.805323 | controller-1 |
2026-02-16 21:16:14.805327 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-02-16 21:16:14.805330 | controller-1 | Monday 16 February 2026  21:16:14 +0000 (0:00:00.068)       0:04:20.864 *******
2026-02-16 21:16:16.166718 | controller-1 | changed: [controller-1]
2026-02-16 21:16:16.166952 | controller-1 | changed: [controller-3]
2026-02-16 21:16:16.167106 | controller-1 | changed: [controller-2]
2026-02-16 21:16:16.167246 | controller-1 |
2026-02-16 21:16:16.167400 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-02-16 21:16:16.167550 | controller-1 | Monday 16 February 2026  21:16:16 +0000 (0:00:01.361)       0:04:22.226 *******
2026-02-16 21:16:18.442805 | controller-1 | changed: [controller-1]
2026-02-16 21:16:18.444152 | controller-1 | changed: [controller-3]
2026-02-16 21:16:18.444338 | controller-1 | changed: [controller-2]
2026-02-16 21:16:18.444443 | controller-1 |
2026-02-16 21:16:18.444562 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Include help chart upload method tasks] ***
2026-02-16 21:16:18.444678 | controller-1 | Monday 16 February 2026  21:16:18 +0000 (0:00:02.276)       0:04:24.503 *******
2026-02-16 21:16:18.573834 | controller-1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/upload_helm_chart/tasks/synchronize.yml for controller-1, controller-2, controller-3
2026-02-16 21:16:18.574132 | controller-1 |
2026-02-16 21:16:18.574399 | controller-1 | TASK [vexxhost.kubernetes.upload_helm_chart : Upload Helm chart] ***************
2026-02-16 21:16:18.574650 | controller-1 | Monday 16 February 2026  21:16:18 +0000 (0:00:00.130)       0:04:24.634 *******
2026-02-16 21:16:19.329121 | controller-1 | changed: [controller-1]
2026-02-16 21:16:19.329455 | controller-1 |
2026-02-16 21:16:19.329726 | controller-1 | TASK [vexxhost.kubernetes.cilium : Get current Kubernetes version] *************
2026-02-16 21:16:19.329979 | controller-1 | Monday 16 February 2026  21:16:19 +0000 (0:00:00.755)       0:04:25.389 *******
2026-02-16 21:16:20.245233 | controller-1 | ok: [controller-1]
2026-02-16 21:16:20.245543 | controller-1 |
2026-02-16 21:16:20.246521 | controller-1 | TASK [vexxhost.kubernetes.cilium : Deploy Helm chart] **************************
2026-02-16 21:16:20.246798 | controller-1 | Monday 16 February 2026  21:16:20 +0000 (0:00:00.915)       0:04:26.304 *******
2026-02-16 21:16:22.435323 | controller-1 | changed: [controller-1]
2026-02-16 21:16:22.435456 | controller-1 |
2026-02-16 21:16:22.435585 | controller-1 | PLAY [Wait for all nodes to become Ready] **************************************
2026-02-16 21:16:22.435692 | controller-1 |
2026-02-16 21:16:22.435804 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-02-16 21:16:22.435960 | controller-1 | Monday 16 February 2026  21:16:22 +0000 (0:00:02.188)       0:04:28.493 *******
2026-02-16 21:16:23.378873 | controller-1 | ok: [controller-1]
2026-02-16 21:16:23.379071 | controller-1 | ok: [controller-3]
2026-02-16 21:16:23.379223 | controller-1 | ok: [controller-2]
2026-02-16 21:16:23.379361 | controller-1 |
2026-02-16 21:16:23.379512 | controller-1 | TASK [Wait for node to be Ready] ***********************************************
2026-02-16 21:16:23.379670 | controller-1 | Monday 16 February 2026  21:16:23 +0000 (0:00:00.943)       0:04:29.437 *******
2026-02-16 21:16:48.874986 | controller-1 | [ERROR]: Task failed: Module failed: 500
2026-02-16 21:16:48.875388 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:48.875958 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '362c0b1d-fa57-464c-b637-393b3d47f10c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:48.875970 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:48.875975 | controller-1 | Original traceback:
2026-02-16 21:16:48.875997 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:48.876003 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:48.876008 | controller-1 |
2026-02-16 21:16:48.876015 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:48.878855 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:48.878871 | controller-1 |         path,
2026-02-16 21:16:48.878875 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:48.879004 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:48.879093 | controller-1 |     )
2026-02-16 21:16:48.879171 | controller-1 |
2026-02-16 21:16:48.879265 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:48.879350 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:48.879428 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.879510 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:48.879588 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.879668 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:48.879751 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:48.879830 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.879913 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:48.884643 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.884659 | controller-1 |
2026-02-16 21:16:48.884663 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:48.884666 | controller-1 |     response_data = self.request(
2026-02-16 21:16:48.884670 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:48.884674 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:48.884680 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:48.884743 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:48.884865 | controller-1 |
2026-02-16 21:16:48.884956 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:48.885038 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:48.885114 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:48.889795 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:48.889808 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.889812 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:48.889817 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.889821 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:48.889825 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.889828 | controller-1 |                                 headers=headers)
2026-02-16 21:16:48.889832 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.889836 | controller-1 |
2026-02-16 21:16:48.889841 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:48.889845 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:48.889848 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:48.889852 | controller-1 |                         headers=headers,
2026-02-16 21:16:48.893742 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.893754 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:48.893758 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.893761 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:48.893764 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.893768 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:48.893771 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.893774 | controller-1 |
2026-02-16 21:16:48.893778 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:48.893782 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:48.893785 | controller-1 |
2026-02-16 21:16:48.893788 | controller-1 | Task failed: Module failed.
2026-02-16 21:16:48.893792 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7
2026-02-16 21:16:48.902882 | controller-1 |
2026-02-16 21:16:48.902934 | controller-1 | 23   become: true
2026-02-16 21:16:48.920017 | controller-1 | 24   tasks:
2026-02-16 21:16:48.920059 | controller-1 | 25     - name: Wait for node to be Ready
2026-02-16 21:16:48.920064 | controller-1 |          ^ column 7
2026-02-16 21:16:48.920070 | controller-1 |
2026-02-16 21:16:48.920073 | controller-1 | <<< caused by >>>
2026-02-16 21:16:48.920077 | controller-1 |
2026-02-16 21:16:48.920080 | controller-1 | 500
2026-02-16 21:16:48.920083 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:48.920088 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '362c0b1d-fa57-464c-b637-393b3d47f10c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:48.920092 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:48.920107 | controller-1 | Original traceback:
2026-02-16 21:16:48.920111 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:48.920114 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:48.920118 | controller-1 |
2026-02-16 21:16:48.920121 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:48.920124 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:48.920127 | controller-1 |         path,
2026-02-16 21:16:48.920130 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:48.920134 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:48.920137 | controller-1 |     )
2026-02-16 21:16:48.920146 | controller-1 |
2026-02-16 21:16:48.920150 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:48.920202 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:48.920356 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.920448 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:48.920529 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.920665 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:48.920695 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:48.920956 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.920964 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:48.924360 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924371 | controller-1 |
2026-02-16 21:16:48.924375 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:48.924379 | controller-1 |     response_data = self.request(
2026-02-16 21:16:48.924382 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:48.924385 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:48.924388 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:48.924391 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:48.924395 | controller-1 |
2026-02-16 21:16:48.924398 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:48.924401 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:48.924404 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:48.924407 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:48.924410 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924414 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:48.924417 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924420 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:48.924423 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924426 | controller-1 |                                 headers=headers)
2026-02-16 21:16:48.924429 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924432 | controller-1 |
2026-02-16 21:16:48.924435 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:48.924438 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:48.924441 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:48.924444 | controller-1 |                         headers=headers,
2026-02-16 21:16:48.924447 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924450 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:48.924454 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924465 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:48.924469 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924472 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:48.924479 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.924485 | controller-1 |
2026-02-16 21:16:48.924488 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:48.924563 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:48.924630 | controller-1 |
2026-02-16 21:16:48.929030 | controller-1 | fatal: [controller-2 -> controller-1(199.204.45.53)]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '362c0b1d-fa57-464c-b637-393b3d47f10c', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n    resp = func(self, *args, **kwargs)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n    api_response = self.client.call_api(\n        path,\n    ...<11 lines>...\n        _request_timeout=params.get('_request_timeout')\n    )\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n    return self.__call_api(resource_path, method,\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n                           path_params, query_params, header_params,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    ...<2 lines>...\n                           _return_http_data_only, collection_formats,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                           _preload_content, _request_timeout, _host)\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n    response_data = self.request(\n        method, url, query_params=query_params, headers=header_params,\n        post_params=post_params, body=body,\n        _preload_content=_preload_content,\n        _request_timeout=_request_timeout)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n    return self.rest_client.GET(url,\n           ~~~~~~~~~~~~~~~~~~~~^^^^^\n                                query_params=query_params,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _preload_content=_preload_content,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _request_timeout=_request_timeout,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                headers=headers)\n                                ^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n    return self.request(\"GET\", url,\n           ~~~~~~~~~~~~^^^^^^^^^^^^\n                        headers=headers,\n                        ^^^^^^^^^^^^^^^^\n                        _preload_content=_preload_content,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        _request_timeout=_request_timeout,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        query_params=query_params)\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n    raise ApiException(http_resp=r)"}
2026-02-16 21:16:48.963059 | controller-1 | [ERROR]: Task failed: Module failed: 500
2026-02-16 21:16:48.963094 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:48.963100 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '833dadf3-a01b-4734-b066-6fb828ca1ad3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:48.963114 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:48.963119 | controller-1 | Original traceback:
2026-02-16 21:16:48.963122 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:48.963127 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:48.963131 | controller-1 |
2026-02-16 21:16:48.963135 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:48.963138 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:48.963141 | controller-1 |         path,
2026-02-16 21:16:48.963144 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:48.963148 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:48.963605 | controller-1 |     )
2026-02-16 21:16:48.963682 | controller-1 |
2026-02-16 21:16:48.963773 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:48.963857 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:48.963936 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.964017 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:48.964096 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.964180 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:48.964263 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:48.964346 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.964427 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:48.964505 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.964581 | controller-1 |
2026-02-16 21:16:48.965813 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:48.965994 | controller-1 |     response_data = self.request(
2026-02-16 21:16:48.966002 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:48.966122 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:48.966126 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:48.966253 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:48.966913 | controller-1 |
2026-02-16 21:16:48.967266 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:48.967271 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:48.967275 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:48.967278 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:48.967281 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.967396 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:48.967402 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.967563 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:48.967573 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.967643 | controller-1 |                                 headers=headers)
2026-02-16 21:16:48.967720 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.968251 | controller-1 |
2026-02-16 21:16:48.968261 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:48.968265 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:48.968268 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:48.968359 | controller-1 |                         headers=headers,
2026-02-16 21:16:48.968414 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.968494 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:48.968570 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.968656 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:48.968738 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.968810 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:48.968914 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.969615 | controller-1 |
2026-02-16 21:16:48.969867 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:48.969875 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:48.969879 | controller-1 |
2026-02-16 21:16:48.970016 | controller-1 | Task failed: Module failed.
2026-02-16 21:16:48.970055 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7
2026-02-16 21:16:48.970171 | controller-1 |
2026-02-16 21:16:48.970252 | controller-1 | 23   become: true
2026-02-16 21:16:48.970332 | controller-1 | 24   tasks:
2026-02-16 21:16:48.970419 | controller-1 | 25     - name: Wait for node to be Ready
2026-02-16 21:16:48.970507 | controller-1 |          ^ column 7
2026-02-16 21:16:48.970583 | controller-1 |
2026-02-16 21:16:48.970662 | controller-1 | <<< caused by >>>
2026-02-16 21:16:48.970740 | controller-1 |
2026-02-16 21:16:48.970847 | controller-1 | 500
2026-02-16 21:16:48.970915 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:48.971025 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '833dadf3-a01b-4734-b066-6fb828ca1ad3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:48.971114 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:48.971258 | controller-1 | Original traceback:
2026-02-16 21:16:48.971332 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:48.971410 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:48.971485 | controller-1 |
2026-02-16 21:16:48.971867 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:48.971875 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:48.971971 | controller-1 |         path,
2026-02-16 21:16:48.972519 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:48.972525 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:48.972529 | controller-1 |     )
2026-02-16 21:16:48.972532 | controller-1 |
2026-02-16 21:16:48.972536 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:48.972539 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:48.972559 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.972638 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:48.972716 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.972795 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:48.972878 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:48.972959 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.973041 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:48.973117 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.973194 | controller-1 |
2026-02-16 21:16:48.973316 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:48.973415 | controller-1 |     response_data = self.request(
2026-02-16 21:16:48.973488 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:48.973604 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:48.973664 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:48.973732 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:48.973806 | controller-1 |
2026-02-16 21:16:48.973893 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:48.974007 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:48.974086 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:48.974167 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:48.974247 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.974327 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:48.974445 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.974527 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:48.974604 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.974684 | controller-1 |                                 headers=headers)
2026-02-16 21:16:48.974768 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.974858 | controller-1 |
2026-02-16 21:16:48.974948 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:48.975032 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:48.975106 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:48.975185 | controller-1 |                         headers=headers,
2026-02-16 21:16:48.975269 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.975366 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:48.975471 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.975561 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:48.975640 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.975718 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:48.975797 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:48.975877 | controller-1 |
2026-02-16 21:16:48.975980 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:48.976059 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:48.976134 | controller-1 |
2026-02-16 21:16:48.976409 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '833dadf3-a01b-4734-b066-6fb828ca1ad3', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n    resp = func(self, *args, **kwargs)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n    api_response = self.client.call_api(\n        path,\n    ...<11 lines>...\n        _request_timeout=params.get('_request_timeout')\n    )\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n    return self.__call_api(resource_path, method,\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n                           path_params, query_params, header_params,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    ...<2 lines>...\n                           _return_http_data_only, collection_formats,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                           _preload_content, _request_timeout, _host)\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n    response_data = self.request(\n        method, url, query_params=query_params, headers=header_params,\n        post_params=post_params, body=body,\n        _preload_content=_preload_content,\n        _request_timeout=_request_timeout)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n    return self.rest_client.GET(url,\n           ~~~~~~~~~~~~~~~~~~~~^^^^^\n                                query_params=query_params,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _preload_content=_preload_content,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _request_timeout=_request_timeout,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                headers=headers)\n                                ^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n    return self.request(\"GET\", url,\n           ~~~~~~~~~~~~^^^^^^^^^^^^\n                        headers=headers,\n                        ^^^^^^^^^^^^^^^^\n                        _preload_content=_preload_content,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        _request_timeout=_request_timeout,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        query_params=query_params)\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n    raise ApiException(http_resp=r)"}
2026-02-16 21:16:49.001278 | controller-1 | [ERROR]: Task failed: Module failed: 500
2026-02-16 21:16:49.001312 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:49.001319 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '7ca75424-2946-4c5b-b315-a3462b37aa29', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:49.001324 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:49.001334 | controller-1 | Original traceback:
2026-02-16 21:16:49.004942 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:49.004966 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:49.004971 | controller-1 |
2026-02-16 21:16:49.004975 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:49.004978 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:49.004982 | controller-1 |         path,
2026-02-16 21:16:49.004985 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:49.004989 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:49.004993 | controller-1 |     )
2026-02-16 21:16:49.004997 | controller-1 |
2026-02-16 21:16:49.005000 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:49.005003 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:49.005007 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.005010 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:49.005014 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.005017 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:49.005020 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:49.005023 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.005026 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:49.005029 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.005032 | controller-1 |
2026-02-16 21:16:49.005035 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:49.005043 | controller-1 |     response_data = self.request(
2026-02-16 21:16:49.005061 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:49.005101 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:49.005184 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:49.005287 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:49.005426 | controller-1 |
2026-02-16 21:16:49.005674 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:49.005761 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:49.005836 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:49.006069 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:49.006076 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.006082 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:49.006254 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.006526 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:49.007202 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.007284 | controller-1 |                                 headers=headers)
2026-02-16 21:16:49.007365 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.007444 | controller-1 |
2026-02-16 21:16:49.007596 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:49.007624 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:49.007705 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:49.007787 | controller-1 |                         headers=headers,
2026-02-16 21:16:49.007868 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.007952 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:49.008035 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.008141 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:49.010376 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.010463 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:49.010552 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.010623 | controller-1 |
2026-02-16 21:16:49.010716 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:49.010857 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:49.010937 | controller-1 |
2026-02-16 21:16:49.011022 | controller-1 | Task failed: Module failed.
2026-02-16 21:16:49.011328 | controller-1 | Origin: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml:25:7
2026-02-16 21:16:49.011335 | controller-1 |
2026-02-16 21:16:49.012749 | controller-1 | 23   become: true
2026-02-16 21:16:49.012871 | controller-1 | 24   tasks:
2026-02-16 21:16:49.012956 | controller-1 | 25     - name: Wait for node to be Ready
2026-02-16 21:16:49.013042 | controller-1 |          ^ column 7
2026-02-16 21:16:49.013130 | controller-1 |
2026-02-16 21:16:49.013206 | controller-1 | <<< caused by >>>
2026-02-16 21:16:49.014454 | controller-1 |
2026-02-16 21:16:49.014541 | controller-1 | 500
2026-02-16 21:16:49.014625 | controller-1 | Reason: Internal Server Error
2026-02-16 21:16:49.014731 | controller-1 | HTTP response headers: HTTPHeaderDict({'Audit-Id': '7ca75424-2946-4c5b-b315-a3462b37aa29', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})
2026-02-16 21:16:49.014839 | controller-1 | HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"etcdserver: leader changed","code":500}\n'
2026-02-16 21:16:49.014937 | controller-1 | Original traceback:
2026-02-16 21:16:49.015024 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 55, in inner
2026-02-16 21:16:49.015108 | controller-1 |     resp = func(self, *args, **kwargs)
2026-02-16 21:16:49.015199 | controller-1 |
2026-02-16 21:16:49.015271 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py", line 273, in request
2026-02-16 21:16:49.015356 | controller-1 |     api_response = self.client.call_api(
2026-02-16 21:16:49.015434 | controller-1 |         path,
2026-02-16 21:16:49.015514 | controller-1 |     ...<11 lines>...
2026-02-16 21:16:49.015596 | controller-1 |         _request_timeout=params.get('_request_timeout')
2026-02-16 21:16:49.015673 | controller-1 |     )
2026-02-16 21:16:49.015746 | controller-1 |
2026-02-16 21:16:49.015835 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 348, in call_api
2026-02-16 21:16:49.015932 | controller-1 |     return self.__call_api(resource_path, method,
2026-02-16 21:16:49.016020 | controller-1 |            ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.016093 | controller-1 |                            path_params, query_params, header_params,
2026-02-16 21:16:49.016171 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.016258 | controller-1 |     ...<2 lines>...
2026-02-16 21:16:49.017510 | controller-1 |                            _return_http_data_only, collection_formats,
2026-02-16 21:16:49.017598 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.017685 | controller-1 |                            _preload_content, _request_timeout, _host)
2026-02-16 21:16:49.017763 | controller-1 |                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.017840 | controller-1 |
2026-02-16 21:16:49.017946 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 180, in __call_api
2026-02-16 21:16:49.018057 | controller-1 |     response_data = self.request(
2026-02-16 21:16:49.018136 | controller-1 |         method, url, query_params=query_params, headers=header_params,
2026-02-16 21:16:49.018221 | controller-1 |         post_params=post_params, body=body,
2026-02-16 21:16:49.018304 | controller-1 |         _preload_content=_preload_content,
2026-02-16 21:16:49.018392 | controller-1 |         _request_timeout=_request_timeout)
2026-02-16 21:16:49.018469 | controller-1 |
2026-02-16 21:16:49.018560 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/api_client.py", line 373, in request
2026-02-16 21:16:49.018645 | controller-1 |     return self.rest_client.GET(url,
2026-02-16 21:16:49.018725 | controller-1 |            ~~~~~~~~~~~~~~~~~~~~^^^^^
2026-02-16 21:16:49.018809 | controller-1 |                                 query_params=query_params,
2026-02-16 21:16:49.021829 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021838 | controller-1 |                                 _preload_content=_preload_content,
2026-02-16 21:16:49.021841 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021844 | controller-1 |                                 _request_timeout=_request_timeout,
2026-02-16 21:16:49.021847 | controller-1 |                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021851 | controller-1 |                                 headers=headers)
2026-02-16 21:16:49.021854 | controller-1 |                                 ^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021857 | controller-1 |
2026-02-16 21:16:49.021860 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 244, in GET
2026-02-16 21:16:49.021864 | controller-1 |     return self.request("GET", url,
2026-02-16 21:16:49.021867 | controller-1 |            ~~~~~~~~~~~~^^^^^^^^^^^^
2026-02-16 21:16:49.021870 | controller-1 |                         headers=headers,
2026-02-16 21:16:49.021873 | controller-1 |                         ^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021876 | controller-1 |                         _preload_content=_preload_content,
2026-02-16 21:16:49.021879 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021882 | controller-1 |                         _request_timeout=_request_timeout,
2026-02-16 21:16:49.021885 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021888 | controller-1 |                         query_params=query_params)
2026-02-16 21:16:49.021891 | controller-1 |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-02-16 21:16:49.021894 | controller-1 |
2026-02-16 21:16:49.021897 | controller-1 |   File "/usr/lib/python3/dist-packages/kubernetes/client/rest.py", line 238, in request
2026-02-16 21:16:49.021901 | controller-1 |     raise ApiException(http_resp=r)
2026-02-16 21:16:49.021904 | controller-1 |
2026-02-16 21:16:49.021917 | controller-1 | fatal: [controller-3 -> controller-1(199.204.45.53)]: FAILED! => {"changed": false, "msg": "Task failed: Module failed: 500\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Audit-Id': '7ca75424-2946-4c5b-b315-a3462b37aa29', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '77ec5070-cbc3-4a4c-942a-c0ec4295c831', 'X-Kubernetes-Pf-Prioritylevel-Uid': '2597a9b9-2cd1-45ec-85db-c413c203b910', 'Date': 'Mon, 16 Feb 2026 21:16:48 GMT', 'Content-Length': '119'})\nHTTP response body: b'{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: leader changed\",\"code\":500}\\n'\nOriginal traceback: \n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 55, in inner\n    resp = func(self, *args, **kwargs)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/dynamic/client.py\", line 273, in request\n    api_response = self.client.call_api(\n        path,\n    ...<11 lines>...\n        _request_timeout=params.get('_request_timeout')\n    )\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 348, in call_api\n    return self.__call_api(resource_path, method,\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n                           path_params, query_params, header_params,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n    ...<2 lines>...\n                           _return_http_data_only, collection_formats,\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                           _preload_content, _request_timeout, _host)\n                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 180, in __call_api\n    response_data = self.request(\n        method, url, query_params=query_params, headers=header_params,\n        post_params=post_params, body=body,\n        _preload_content=_preload_content,\n        _request_timeout=_request_timeout)\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/api_client.py\", line 373, in request\n    return self.rest_client.GET(url,\n           ~~~~~~~~~~~~~~~~~~~~^^^^^\n                                query_params=query_params,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _preload_content=_preload_content,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                _request_timeout=_request_timeout,\n                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                                headers=headers)\n                                ^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 244, in GET\n    return self.request(\"GET\", url,\n           ~~~~~~~~~~~~^^^^^^^^^^^^\n                        headers=headers,\n                        ^^^^^^^^^^^^^^^^\n                        _preload_content=_preload_content,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        _request_timeout=_request_timeout,\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n                        query_params=query_params)\n                        ^^^^^^^^^^^^^^^^^^^^^^^^^^\n\n  File \"/usr/lib/python3/dist-packages/kubernetes/client/rest.py\", line 238, in request\n    raise ApiException(http_resp=r)"}
2026-02-16 21:16:49.021927 | controller-1 |
2026-02-16 21:16:49.021946 | controller-1 | PLAY RECAP *********************************************************************
2026-02-16 21:16:49.021950 | controller-1 | controller-1               : ok=115  changed=52   unreachable=0    failed=1    skipped=34   rescued=0    ignored=3
2026-02-16 21:16:49.021953 | controller-1 | controller-2               : ok=113  changed=50   unreachable=0    failed=1    skipped=31   rescued=0    ignored=2
2026-02-16 21:16:49.021956 | controller-1 | controller-3               : ok=110  changed=49   unreachable=0    failed=1    skipped=31   rescued=0    ignored=2
2026-02-16 21:16:49.021959 | controller-1 |
2026-02-16 21:16:49.021962 | controller-1 |
2026-02-16 21:16:49.021965 | controller-1 | TASKS RECAP ********************************************************************
2026-02-16 21:16:49.021973 | controller-1 | Monday 16 February 2026  21:16:49 +0000 (0:00:25.628)       0:04:55.065 *******
2026-02-16 21:16:49.022067 | controller-1 | ===============================================================================
2026-02-16 21:16:49.022152 | controller-1 | vexxhost.kubernetes.kubernetes : Join cluster ------------------------- 109.78s
2026-02-16 21:16:49.022237 | controller-1 | vexxhost.kubernetes.kubernetes : Initialize cluster -------------------- 35.86s
2026-02-16 21:16:49.022321 | controller-1 | Wait for node to be Ready ---------------------------------------------- 25.63s
2026-02-16 21:16:49.022412 | controller-1 | vexxhost.kubernetes.kubernetes : Install Kubernetes Python package using package manager on supported systems -- 11.45s
2026-02-16 21:16:49.022497 | controller-1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.17s
2026-02-16 21:16:49.022636 | controller-1 | Install Debian packages ------------------------------------------------- 5.96s
2026-02-16 21:16:49.022719 | controller-1 | vexxhost.kubernetes.kubelet : Reload systemd ---------------------------- 3.41s
2026-02-16 21:16:49.022804 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s
2026-02-16 21:16:49.023037 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s
2026-02-16 21:16:49.023119 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.88s
2026-02-16 21:16:49.023205 | controller-1 | vexxhost.kubernetes.kubelet : Install additional packages --------------- 2.62s
2026-02-16 21:16:49.023289 | controller-1 | vexxhost.containers.cni_plugins : Install additional packages ----------- 2.40s
2026-02-16 21:16:49.023373 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.28s
2026-02-16 21:16:49.023459 | controller-1 | vexxhost.kubernetes.cilium : Deploy Helm chart -------------------------- 2.19s
2026-02-16 21:16:49.023544 | controller-1 | vexxhost.kubernetes.kubelet : Configure sysctl values ------------------- 2.14s
2026-02-16 21:16:49.023627 | controller-1 | Gathering Facts --------------------------------------------------------- 2.00s
2026-02-16 21:16:49.024136 | controller-1 | Gathering Facts --------------------------------------------------------- 1.86s
2026-02-16 21:16:49.024142 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.75s
2026-02-16 21:16:49.024145 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.74s
2026-02-16 21:16:49.024148 | controller-1 | vexxhost.kubernetes.kubernetes : Allow workload on control plane node --- 1.68s
2026-02-16 21:16:49.290447 | controller-1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml
2026-02-16 21:16:49.290575 | controller-1 | ERROR    [cluster-upgrade > prepare] Executed: Failed
2026-02-16 21:16:49.290780 | controller-1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.cluster-upgrade/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/cluster-upgrade/prepare.yml
2026-02-16 21:16:59.839656 | controller-1 | ERROR
2026-02-16 21:16:59.839953 | controller-1 | {
2026-02-16 21:16:59.840014 | controller-1 |   "delta": "0:05:16.304443",
2026-02-16 21:16:59.840058 | controller-1 |   "end": "2026-02-16 21:16:49.391179",
2026-02-16 21:16:59.840098 | controller-1 |   "msg": "non-zero return code",
2026-02-16 21:16:59.840137 | controller-1 |   "rc": 2,
2026-02-16 21:16:59.840179 | controller-1 |   "start": "2026-02-16 21:11:33.086736"
2026-02-16 21:16:59.840219 | controller-1 | }
failure
2026-02-16 21:16:59.856060 | 
2026-02-16 21:16:59.856129 | PLAY RECAP
2026-02-16 21:16:59.856177 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-02-16 21:16:59.856199 | 
2026-02-16 21:16:59.961002 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-02-16 21:16:59.966265 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main]
2026-02-16 21:17:00.562920 | 
2026-02-16 21:17:00.563250 | PLAY [all]
2026-02-16 21:17:00.574716 | 
2026-02-16 21:17:00.574801 | TASK [fetch-output : Set log path for multiple nodes]
2026-02-16 21:17:00.618923 | controller-1 | ok
2026-02-16 21:17:00.646157 | controller-2 | ok
2026-02-16 21:17:00.649049 | controller-3 | ok
2026-02-16 21:17:00.652601 | 
2026-02-16 21:17:00.652703 | TASK [fetch-output : Set log path for single node]
2026-02-16 21:17:00.685667 | controller-1 | skipping: Conditional result was False
2026-02-16 21:17:00.686358 | controller-2 | skipping: Conditional result was False
2026-02-16 21:17:00.696705 | controller-3 | skipping: Conditional result was False
2026-02-16 21:17:00.700802 | 
2026-02-16 21:17:00.700872 | LOOP [fetch-output : Ensure local output dirs]
2026-02-16 21:17:01.090953 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/logs/controller-2"
2026-02-16 21:17:01.092539 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/logs/controller-3"
2026-02-16 21:17:01.110782 | controller-1 -> localhost | changed: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/logs/controller-1"
2026-02-16 21:17:01.315868 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/artifacts"
2026-02-16 21:17:01.318395 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/artifacts"
2026-02-16 21:17:01.325498 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/artifacts"
2026-02-16 21:17:01.520588 | controller-2 -> localhost | changed: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/docs"
2026-02-16 21:17:01.544135 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/docs"
2026-02-16 21:17:01.544219 | controller-3 -> localhost | changed: All items complete
2026-02-16 21:17:01.544254 | 
2026-02-16 21:17:01.561740 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/1796f6c025284b9d915857ac8220b5bf/work/docs"
2026-02-16 21:17:01.579621 | 
2026-02-16 21:17:01.579776 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-02-16 21:17:02.228121 | controller-2 | changed: .d..t...... ./
2026-02-16 21:17:02.228426 | controller-2 | changed: All items complete
2026-02-16 21:17:02.228477 | 
2026-02-16 21:17:02.235239 | controller-3 | changed: .d..t...... ./
2026-02-16 21:17:02.266419 | controller-1 | changed: .d..t...... ./
2026-02-16 21:17:02.708253 | controller-2 | changed: .d..t...... ./
2026-02-16 21:17:02.713160 | controller-3 | ok
2026-02-16 21:17:02.735935 | controller-1 | ok
2026-02-16 21:17:03.153770 | controller-3 | changed: .d..t...... ./
2026-02-16 21:17:03.158768 | controller-2 | ok
2026-02-16 21:17:03.219931 | controller-1 | ok
2026-02-16 21:17:03.220057 | controller-1 | changed: All items complete
2026-02-16 21:17:03.220096 | 
2026-02-16 21:17:03.244617 | 
2026-02-16 21:17:03.244787 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-02-16 21:17:03.698679 | controller-1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008347
2026-02-16 21:17:03.938918 | controller-1 -> localhost | ok: Item: docs Runtime: 0:00:00.007663
2026-02-16 21:17:03.954615 | 
2026-02-16 21:17:03.954742 | PLAY [all]
2026-02-16 21:17:03.960302 | 
2026-02-16 21:17:03.960368 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-02-16 21:17:04.467068 | controller-1 | changed
2026-02-16 21:17:04.649866 | controller-2 | changed
2026-02-16 21:17:04.654643 | controller-3 | changed
2026-02-16 21:17:04.666586 | 
2026-02-16 21:17:04.666638 | PLAY RECAP
2026-02-16 21:17:04.666691 | controller-1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-02-16 21:17:04.666720 | controller-2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-02-16 21:17:04.666743 | controller-3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-02-16 21:17:04.666761 | 
2026-02-16 21:17:04.833786 | POST-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main]
2026-02-16 21:17:04.840164 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post-logs.yaml@main]
2026-02-16 21:17:05.420374 | 
2026-02-16 21:17:05.420502 | PLAY [localhost]
2026-02-16 21:17:05.431225 | 
2026-02-16 21:17:05.431303 | TASK [Generate Zuul manifest]
2026-02-16 21:17:05.454291 | localhost | ok
2026-02-16 21:17:05.469927 | 
2026-02-16 21:17:05.470005 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-02-16 21:17:05.784502 | localhost | changed
2026-02-16 21:17:05.795176 | 
2026-02-16 21:17:05.795253 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-02-16 21:17:05.827156 | localhost | ok
2026-02-16 21:17:05.836197 | 
2026-02-16 21:17:05.836262 | TASK [Upload logs]
2026-02-16 21:17:05.869452 | localhost | ok
2026-02-16 21:17:05.937226 | 
2026-02-16 21:17:05.937406 | TASK [Set zuul-log-path fact]
2026-02-16 21:17:05.957835 | localhost | ok
2026-02-16 21:17:05.971364 | 
2026-02-16 21:17:05.971433 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-02-16 21:17:06.004840 | localhost | ok
2026-02-16 21:17:06.014316 | 
2026-02-16 21:17:06.014384 | TASK [upload-logs : Create log directories]
2026-02-16 21:17:06.432111 | localhost | changed
2026-02-16 21:17:06.438574 | 
2026-02-16 21:17:06.438668 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-02-16 21:17:06.824373 | localhost -> localhost | ok: Runtime: 0:00:00.005347
2026-02-16 21:17:06.829473 | 
2026-02-16 21:17:06.829537 | TASK [upload-logs : Upload logs to log server]
2026-02-16 21:17:07.324882 | localhost | Output suppressed because no_log was given
2026-02-16 21:17:07.329798 | 
2026-02-16 21:17:07.329893 | LOOP [upload-logs : Compress console log and json output]
2026-02-16 21:17:07.380611 | localhost | skipping: Conditional result was False
2026-02-16 21:17:07.393525 | localhost | skipping: Conditional result was False
2026-02-16 21:17:07.405500 | 
2026-02-16 21:17:07.405669 | LOOP [upload-logs : Upload compressed console log and json output]
2026-02-16 21:17:07.446994 | localhost | skipping: Conditional result was False
2026-02-16 21:17:07.447426 | 
2026-02-16 21:17:07.450161 | localhost | skipping: Conditional result was False
2026-02-16 21:17:07.459302 | 
2026-02-16 21:17:07.459439 | LOOP [upload-logs : Upload console log and json output]