2026-06-08 07:42:22.713288 | Job console starting
2026-06-08 07:42:22.738071 | Updating git repos
2026-06-08 07:42:22.775734 | Cloning repos into workspace
2026-06-08 07:42:22.828518 | Restoring repo states
2026-06-08 07:42:22.845013 | Merging changes
2026-06-08 07:42:23.694143 | Checking out repos
2026-06-08 07:42:23.803437 | Preparing playbooks
2026-06-08 07:42:26.295686 | Running Ansible setup
2026-06-08 07:42:34.174428 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-06-08 07:42:34.849616 | 
2026-06-08 07:42:34.850140 | PLAY [localhost]
2026-06-08 07:42:34.858490 | 
2026-06-08 07:42:34.858576 | TASK [Gathering Facts]
2026-06-08 07:42:35.862676 | localhost | ok
2026-06-08 07:42:35.873822 | 
2026-06-08 07:42:35.873930 | TASK [Setup log path fact]
2026-06-08 07:42:35.897059 | localhost | ok
2026-06-08 07:42:35.910689 | 
2026-06-08 07:42:35.910803 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-06-08 07:42:35.941664 | localhost | ok
2026-06-08 07:42:35.950806 | 
2026-06-08 07:42:35.950873 | TASK [emit-job-header : Print job information]
2026-06-08 07:42:35.990579 | # Job Information
2026-06-08 07:42:35.990795 | Ansible Version: 2.16.18
2026-06-08 07:42:35.990839 | Job: ansible-collection-kubernetes-molecule-ha
2026-06-08 07:42:35.990870 | Pipeline: check
2026-06-08 07:42:35.990898 | Executor: 2d72f0692154
2026-06-08 07:42:35.990925 | Triggered by: https://github.com/vexxhost/ansible-collection-kubernetes/pull/279
2026-06-08 07:42:35.990956 | Event ID: 72386820-630d-11f1-8d42-7d1c9c7d40cc
2026-06-08 07:42:35.994747 | 
2026-06-08 07:42:35.994837 | LOOP [emit-job-header : Print node information]
2026-06-08 07:42:36.076193 | localhost | ok:
2026-06-08 07:42:36.076442 | localhost | # Node Information
2026-06-08 07:42:36.076486 | localhost | Inventory Hostname: controller-1
2026-06-08 07:42:36.076519 | localhost | Hostname: np0000178859
2026-06-08 07:42:36.076582 | localhost | Username: zuul
2026-06-08 07:42:36.076648 | localhost | Distro: Debian 13.5
2026-06-08 07:42:36.076687 | localhost | Provider: yul1
2026-06-08 07:42:36.076728 | localhost | Region: ca-ymq-1
2026-06-08 07:42:36.076764 | localhost | Label: debian-trixie
2026-06-08 07:42:36.076824 | localhost | Product Name: OpenStack Nova
2026-06-08 07:42:36.076902 | localhost | Interface IP: 199.204.45.162
2026-06-08 07:42:36.108908 | localhost | ok:
2026-06-08 07:42:36.109062 | localhost | # Node Information
2026-06-08 07:42:36.109121 | localhost | Inventory Hostname: controller-2
2026-06-08 07:42:36.109169 | localhost | Hostname: np0000178860
2026-06-08 07:42:36.109285 | localhost | Username: zuul
2026-06-08 07:42:36.109348 | localhost | Distro: Debian 13.5
2026-06-08 07:42:36.109393 | localhost | Provider: yul1
2026-06-08 07:42:36.109435 | localhost | Region: ca-ymq-1
2026-06-08 07:42:36.109476 | localhost | Label: debian-trixie
2026-06-08 07:42:36.109518 | localhost | Product Name: OpenStack Nova
2026-06-08 07:42:36.109562 | localhost | Interface IP: 199.204.45.89
2026-06-08 07:42:36.147805 | localhost | ok:
2026-06-08 07:42:36.147936 | localhost | # Node Information
2026-06-08 07:42:36.147968 | localhost | Inventory Hostname: controller-3
2026-06-08 07:42:36.147996 | localhost | Hostname: np0000178861
2026-06-08 07:42:36.148025 | localhost | Username: zuul
2026-06-08 07:42:36.148053 | localhost | Distro: Debian 13.5
2026-06-08 07:42:36.148076 | localhost | Provider: yul1
2026-06-08 07:42:36.148098 | localhost | Region: ca-ymq-1
2026-06-08 07:42:36.148121 | localhost | Label: debian-trixie
2026-06-08 07:42:36.148143 | localhost | Product Name: OpenStack Nova
2026-06-08 07:42:36.148165 | localhost | Interface IP: 199.19.213.223
2026-06-08 07:42:36.158850 | 
2026-06-08 07:42:36.158929 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-06-08 07:42:36.577512 | localhost -> localhost | changed
2026-06-08 07:42:36.584415 | 
2026-06-08 07:42:36.584565 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-06-08 07:42:37.540755 | localhost -> localhost | changed
2026-06-08 07:42:37.551687 | 
2026-06-08 07:42:37.551781 | PLAY [all]
2026-06-08 07:42:37.563952 | 
2026-06-08 07:42:37.564036 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-06-08 07:42:37.801066 | controller-1 -> localhost | ok
2026-06-08 07:42:37.813038 | 
2026-06-08 07:42:37.813159 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-06-08 07:42:37.849088 | controller-1 | ok
2026-06-08 07:42:37.854002 | controller-2 | ok
2026-06-08 07:42:38.003338 | controller-3 | ok
2026-06-08 07:42:38.023075 | controller-1 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-06-08 07:42:38.023157 | controller-2 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-06-08 07:42:38.023183 | controller-3 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-06-08 07:42:38.028272 | 
2026-06-08 07:42:38.028333 | TASK [add-build-sshkey : Create Temp SSH key]
2026-06-08 07:42:39.465541 | controller-1 -> localhost | Generating public/private rsa key pair.
2026-06-08 07:42:39.465814 | controller-1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/08bb302db05e43eeaf3caf838cb38a76_id_rsa
2026-06-08 07:42:39.465885 | controller-1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/08bb302db05e43eeaf3caf838cb38a76_id_rsa.pub
2026-06-08 07:42:39.465942 | controller-1 -> localhost | The key fingerprint is:
2026-06-08 07:42:39.465971 | controller-1 -> localhost | SHA256:Yk3REs5/Oud5mbbkGMtbIs0wyK25+wXKHSnmufa1JKs zuul-build-sshkey
2026-06-08 07:42:39.465998 | controller-1 -> localhost | The key's randomart image is:
2026-06-08 07:42:39.466022 | controller-1 -> localhost | +---[RSA 3072]----+
2026-06-08 07:42:39.466043 | controller-1 -> localhost | |        oo       |
2026-06-08 07:42:39.466064 | controller-1 -> localhost | |       o...      |
2026-06-08 07:42:39.466086 | controller-1 -> localhost | |        +.       |
2026-06-08 07:42:39.466107 | controller-1 -> localhost | |       + + .     |
2026-06-08 07:42:39.466127 | controller-1 -> localhost | |      o S O .    |
2026-06-08 07:42:39.466147 | controller-1 -> localhost | |     . = B X     |
2026-06-08 07:42:39.466167 | controller-1 -> localhost | |        B * X oo |
2026-06-08 07:42:39.466188 | controller-1 -> localhost | |        .o % @=  |
2026-06-08 07:42:39.466208 | controller-1 -> localhost | |       .E=+ O+o. |
2026-06-08 07:42:39.466229 | controller-1 -> localhost | +----[SHA256]-----+
2026-06-08 07:42:39.466276 | controller-1 -> localhost | ok: Runtime: 0:00:00.950406
2026-06-08 07:42:39.475781 | 
2026-06-08 07:42:39.475844 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-06-08 07:42:39.503729 | controller-1 | ok
2026-06-08 07:42:39.507841 | controller-2 | ok
2026-06-08 07:42:39.510800 | controller-3 | ok
2026-06-08 07:42:39.523977 | controller-1 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-06-08 07:42:39.524048 | controller-2 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-06-08 07:42:39.534054 | controller-3 | included: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-06-08 07:42:39.552632 | 
2026-06-08 07:42:39.552704 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-06-08 07:42:39.580169 | controller-1 | skipping: Conditional result was False
2026-06-08 07:42:39.591527 | controller-2 | skipping: Conditional result was False
2026-06-08 07:42:39.591880 | controller-3 | skipping: Conditional result was False
2026-06-08 07:42:39.599908 | 
2026-06-08 07:42:39.600001 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-06-08 07:42:40.221929 | controller-2 | changed
2026-06-08 07:42:40.227050 | controller-1 | changed
2026-06-08 07:42:40.230969 | controller-3 | changed
2026-06-08 07:42:40.235106 | 
2026-06-08 07:42:40.235192 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-06-08 07:42:40.453587 | controller-1 | ok
2026-06-08 07:42:40.469726 | controller-3 | ok
2026-06-08 07:42:40.474097 | controller-2 | ok
2026-06-08 07:42:40.478150 | 
2026-06-08 07:42:40.478227 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-06-08 07:42:41.035823 | controller-2 | changed
2026-06-08 07:42:41.052437 | controller-3 | changed
2026-06-08 07:42:41.057409 | controller-1 | changed
2026-06-08 07:42:41.062542 | 
2026-06-08 07:42:41.062627 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-06-08 07:42:41.615099 | controller-2 | changed
2026-06-08 07:42:41.620324 | controller-1 | changed
2026-06-08 07:42:41.679387 | controller-3 | changed
2026-06-08 07:42:41.685787 | 
2026-06-08 07:42:41.685878 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-06-08 07:42:41.713338 | controller-1 | skipping: Conditional result was False
2026-06-08 07:42:41.715763 | controller-2 | skipping: Conditional result was False
2026-06-08 07:42:41.726360 | controller-3 | skipping: Conditional result was False
2026-06-08 07:42:41.736189 | 
2026-06-08 07:42:41.736332 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-06-08 07:42:42.057972 | controller-1 -> localhost | changed
2026-06-08 07:42:42.076825 | 
2026-06-08 07:42:42.076943 | TASK [add-build-sshkey : Add back temp key]
2026-06-08 07:42:42.369429 | controller-1 -> localhost | Identity added: /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/08bb302db05e43eeaf3caf838cb38a76_id_rsa (zuul-build-sshkey)
2026-06-08 07:42:42.369609 | controller-1 -> localhost | ok: Runtime: 0:00:00.013895
2026-06-08 07:42:42.373690 | 
2026-06-08 07:42:42.373752 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-06-08 07:42:42.664244 | controller-3 | ok
2026-06-08 07:42:42.669541 | controller-1 | ok
2026-06-08 07:42:42.673210 | controller-2 | ok
2026-06-08 07:42:42.676789 | 
2026-06-08 07:42:42.676849 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-06-08 07:42:42.702476 | controller-1 | skipping: Conditional result was False
2026-06-08 07:42:42.713429 | controller-2 | skipping: Conditional result was False
2026-06-08 07:42:42.723961 | controller-3 | skipping: Conditional result was False
2026-06-08 07:42:42.744646 | 
2026-06-08 07:42:42.744736 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-06-08 07:42:43.053272 | controller-3 | ok
2026-06-08 07:42:43.081057 | controller-2 | ok
2026-06-08 07:42:43.088351 | controller-1 | ok
2026-06-08 07:42:43.092936 | 
2026-06-08 07:42:43.093027 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-06-08 07:42:44.026036 | controller-2 | Output suppressed because no_log was given
2026-06-08 07:42:44.060577 | controller-1 | Output suppressed because no_log was given
2026-06-08 07:42:44.108570 | controller-3 | Output suppressed because no_log was given
2026-06-08 07:42:44.124807 | 
2026-06-08 07:42:44.124935 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-06-08 07:42:44.349363 | controller-2 | ok: "logs"
2026-06-08 07:42:44.349753 | controller-2 | ok: All items complete
2026-06-08 07:42:44.349807 | 
2026-06-08 07:42:44.384129 | controller-1 | ok: "logs"
2026-06-08 07:42:44.388128 | controller-3 | ok: "logs"
2026-06-08 07:42:44.528759 | controller-2 | ok: "artifacts"
2026-06-08 07:42:44.561764 | controller-3 | ok: "artifacts"
2026-06-08 07:42:44.568427 | controller-1 | ok: "artifacts"
2026-06-08 07:42:44.736667 | controller-2 | ok: "docs"
2026-06-08 07:42:44.746165 | controller-3 | ok: "docs"
2026-06-08 07:42:44.754457 | controller-1 | ok: "docs"
2026-06-08 07:42:44.762845 | 
2026-06-08 07:42:44.763060 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-06-08 07:42:44.992572 | controller-2 | changed: "logs"
2026-06-08 07:42:44.992984 | controller-2 | ok: All items complete
2026-06-08 07:42:44.993052 | 
2026-06-08 07:42:44.997703 | controller-1 | changed: "logs"
2026-06-08 07:42:45.018034 | controller-3 | changed: "logs"
2026-06-08 07:42:45.188114 | controller-2 | changed: "artifacts"
2026-06-08 07:42:45.193668 | controller-1 | changed: "artifacts"
2026-06-08 07:42:45.212824 | controller-3 | changed: "artifacts"
2026-06-08 07:42:45.386985 | controller-1 | changed: "docs"
2026-06-08 07:42:45.395303 | controller-2 | changed: "docs"
2026-06-08 07:42:45.405287 | controller-3 | changed: "docs"
2026-06-08 07:42:45.427906 | 
2026-06-08 07:42:45.428098 | PLAY RECAP
2026-06-08 07:42:45.428178 | controller-1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-06-08 07:42:45.428226 | controller-2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-06-08 07:42:45.428262 | controller-3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-06-08 07:42:45.428294 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:42:45.428322 | 
2026-06-08 07:42:45.602370 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-06-08 07:42:45.607586 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-06-08 07:42:46.277838 | 
2026-06-08 07:42:46.277965 | PLAY [all]
2026-06-08 07:42:46.289312 | 
2026-06-08 07:42:46.289444 | TASK [setup-uv : Extract archive]
2026-06-08 07:42:48.890693 | controller-1 | changed
2026-06-08 07:42:50.656135 | controller-3 | changed
2026-06-08 07:42:56.329953 | controller-2 | changed
2026-06-08 07:42:56.337129 | 
2026-06-08 07:42:56.337278 | TASK [setup-uv : Print version]
2026-06-08 07:42:56.770965 | controller-1 | uv 0.8.13
2026-06-08 07:42:56.745943 | controller-2 | uv 0.8.13
2026-06-08 07:42:56.749971 | controller-3 | uv 0.8.13
2026-06-08 07:42:56.907985 | controller-3 | ok: Runtime: 0:00:00.013447
2026-06-08 07:42:56.919952 | controller-2 | ok: Runtime: 0:00:00.014152
2026-06-08 07:42:56.938073 | controller-1 | ok: Runtime: 0:00:00.023080
2026-06-08 07:42:56.952757 | 
2026-06-08 07:42:56.952904 | TASK [Install Ansible collection siblings]
2026-06-08 07:42:57.363049 | controller-1 | ok:
2026-06-08 07:42:57.363276 | controller-1 | Skipping ansible.posix: no checked-out sibling
2026-06-08 07:42:57.363324 | controller-1 | Skipping community.crypto: no checked-out sibling
2026-06-08 07:42:57.363358 | controller-1 | Skipping community.general: no checked-out sibling
2026-06-08 07:42:57.363388 | controller-1 | Skipping kubernetes.core: no checked-out sibling
2026-06-08 07:42:57.363425 | controller-1 | Skipping vexxhost.containers: no checked-out sibling
2026-06-08 07:42:57.367622 | 
2026-06-08 07:42:57.367694 | PLAY RECAP
2026-06-08 07:42:57.367758 | controller-1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:42:57.367799 | controller-2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:42:57.367835 | controller-3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:42:57.367862 | 
2026-06-08 07:42:57.567873 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-06-08 07:42:57.574712 | PRE-RUN START: [untrusted : github.com/vexxhost/ansible-collection-kubernetes/test-playbooks/molecule/pre.yml@main]
2026-06-08 07:42:58.196062 | 
2026-06-08 07:42:58.196186 | PLAY [all]
2026-06-08 07:42:58.207422 | 
2026-06-08 07:42:58.207508 | TASK [Update apt cache]
2026-06-08 07:43:03.343213 | controller-3 | ok
2026-06-08 07:43:03.553001 | controller-1 | ok
2026-06-08 07:43:03.672839 | controller-2 | ok
2026-06-08 07:43:03.680849 | 
2026-06-08 07:43:03.681048 | TASK [Disable firewalld]
2026-06-08 07:43:03.711467 | controller-1 | skipping: Conditional result was False
2026-06-08 07:43:03.714600 | controller-2 | skipping: Conditional result was False
2026-06-08 07:43:03.735520 | controller-3 | skipping: Conditional result was False
2026-06-08 07:43:03.744596 | 
2026-06-08 07:43:03.744704 | TASK [Install "jq" for log collection]
2026-06-08 07:43:06.228107 | controller-3 | changed
2026-06-08 07:43:06.488169 | controller-1 | changed
2026-06-08 07:43:06.494082 | controller-2 | changed
2026-06-08 07:43:06.496087 | 
2026-06-08 07:43:06.496155 | PLAY RECAP
2026-06-08 07:43:06.496205 | controller-1 | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:43:06.496245 | controller-2 | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:43:06.496276 | controller-3 | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:43:06.496296 | 
2026-06-08 07:43:06.684473 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/ansible-collection-kubernetes/test-playbooks/molecule/pre.yml@main]
2026-06-08 07:43:06.692003 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-06-08 07:43:07.331421 | 
2026-06-08 07:43:07.331580 | PLAY [all]
2026-06-08 07:43:07.343078 | 
2026-06-08 07:43:07.343163 | TASK [Copy inventory file for Zuul]
2026-06-08 07:43:08.357854 | controller-1 | changed
2026-06-08 07:43:08.569619 | 
2026-06-08 07:43:08.569800 | TASK [Switch "ansible_host" to private IP]
2026-06-08 07:43:08.977035 | controller-1 | changed: 3 replacements made
2026-06-08 07:43:08.997630 | 
2026-06-08 07:43:08.998150 | TASK [Run Molecule scenario]
2026-06-08 07:43:09.478161 | controller-1 | Using CPython 3.13.5 interpreter at: /usr/bin/python3
2026-06-08 07:43:09.478256 | controller-1 | Creating virtual environment at: .venv
2026-06-08 07:43:09.771633 | controller-1 | Downloading ansible-core (2.3MiB)
2026-06-08 07:43:09.771781 | controller-1 | Downloading pygments (1.2MiB)
2026-06-08 07:43:09.772010 | controller-1 | Downloading cryptography (4.3MiB)
2026-06-08 07:43:09.948229 | controller-1 |  Downloading cryptography
2026-06-08 07:43:10.001023 | controller-1 |  Downloading pygments
2026-06-08 07:43:10.208428 | controller-1 |  Downloading ansible-core
2026-06-08 07:43:10.257891 | controller-1 | Installed 36 packages in 48ms
2026-06-08 07:43:10.937303 | controller-1 | INFO     Collection 'vexxhost.kubernetes' detected.
2026-06-08 07:43:10.937421 | controller-1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-06-08 07:43:11.882941 | controller-1 | CRITICAL 'extensions/molecule/default/molecule.yml' glob failed.  Exiting.
2026-06-08 07:43:11.883018 | controller-1 | INFO     default scenario not found, disabling shared state.
2026-06-08 07:43:11.883113 | controller-1 | INFO     [ha > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-06-08 07:43:11.883425 | controller-1 | INFO     [ha > prerun] Performing prerun with role_name_check=0...
2026-06-08 07:43:27.944973 | controller-1 | INFO     [ha > dependency] Executing
2026-06-08 07:43:27.945109 | controller-1 | WARNING  [ha > dependency] Missing roles requirements file: requirements.yml
2026-06-08 07:43:27.945395 | controller-1 | WARNING  [ha > dependency] Missing collections requirements file: collections.yml
2026-06-08 07:43:27.945563 | controller-1 | WARNING  [ha > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-06-08 07:43:27.953330 | controller-1 | INFO     [ha > cleanup] Executing
2026-06-08 07:43:27.953666 | controller-1 | WARNING  [ha > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-06-08 07:43:27.960420 | controller-1 | INFO     [ha > destroy] Executing
2026-06-08 07:43:27.960495 | controller-1 | WARNING  [ha > destroy] Skipping, '--destroy=never' requested.
2026-06-08 07:43:27.960505 | controller-1 | INFO     [ha > destroy] Executed: Successful
2026-06-08 07:43:27.966989 | controller-1 | INFO     [ha > syntax] Executing
2026-06-08 07:43:29.394029 | controller-1 |
2026-06-08 07:43:29.394205 | controller-1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/ha/converge.yml
2026-06-08 07:43:29.555707 | controller-1 | INFO     [ha > syntax] Executed: Successful
2026-06-08 07:43:29.569402 | controller-1 | INFO     [ha > create] Executing
2026-06-08 07:43:29.571250 | controller-1 | WARNING  [ha > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-06-08 07:43:29.576631 | controller-1 | INFO     [ha > prepare] Executing
2026-06-08 07:43:30.612552 | controller-1 |
2026-06-08 07:43:30.612673 | controller-1 | PLAY [Prepare] *****************************************************************
2026-06-08 07:43:30.612883 | controller-1 |
2026-06-08 07:43:30.613164 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-06-08 07:43:30.613377 | controller-1 | Monday 08 June 2026  07:43:30 +0000 (0:00:00.077)       0:00:00.077 ***********
2026-06-08 07:43:31.930480 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:31.954309 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:32.950835 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:32.958815 | controller-1 | ok: [controller-1]
2026-06-08 07:43:32.959153 | controller-1 | ok: [controller-3]
2026-06-08 07:43:32.959354 | controller-1 | ok: [controller-2]
2026-06-08 07:43:32.959564 | controller-1 |
2026-06-08 07:43:32.959748 | controller-1 | TASK [Install Debian packages] *************************************************
2026-06-08 07:43:32.959989 | controller-1 | Monday 08 June 2026  07:43:32 +0000 (0:00:02.347)       0:00:02.424 ***********
2026-06-08 07:43:34.940445 | controller-1 | ok: [controller-3]
2026-06-08 07:43:34.940522 | controller-1 | ok: [controller-2]
2026-06-08 07:43:34.940531 | controller-1 | ok: [controller-1]
2026-06-08 07:43:34.940540 | controller-1 |
2026-06-08 07:43:34.940548 | controller-1 | PLAY RECAP *********************************************************************
2026-06-08 07:43:34.940559 | controller-1 | controller-1               : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-06-08 07:43:34.940567 | controller-1 | controller-2               : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-06-08 07:43:34.940574 | controller-1 | controller-3               : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-06-08 07:43:34.940586 | controller-1 |
2026-06-08 07:43:34.940712 | controller-1 |
2026-06-08 07:43:34.940887 | controller-1 | TASKS RECAP ********************************************************************
2026-06-08 07:43:34.941042 | controller-1 | Monday 08 June 2026  07:43:34 +0000 (0:00:01.981)       0:00:04.405 ***********
2026-06-08 07:43:34.941167 | controller-1 | ===============================================================================
2026-06-08 07:43:34.941277 | controller-1 | Gathering Facts --------------------------------------------------------- 2.35s
2026-06-08 07:43:34.941405 | controller-1 | Install Debian packages ------------------------------------------------- 1.98s
2026-06-08 07:43:35.037899 | controller-1 | INFO     [ha > prepare] Executed: Successful
2026-06-08 07:43:35.047766 | controller-1 | INFO     [ha > converge] Executing
2026-06-08 07:43:36.703968 | controller-1 |
2026-06-08 07:43:36.704049 | controller-1 | PLAY [Configure Kubernetes VIP] ************************************************
2026-06-08 07:43:36.704136 | controller-1 |
2026-06-08 07:43:36.704281 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-06-08 07:43:36.704417 | controller-1 | Monday 08 June 2026  07:43:36 +0000 (0:00:00.069)       0:00:00.069 ***********
2026-06-08 07:43:37.801172 | controller-1 | [WARNING]: Host 'controller-3' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:37.805083 | controller-1 | [WARNING]: Host 'controller-1' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:37.819303 | controller-1 | [WARNING]: Host 'controller-2' is using the discovered Python interpreter at '/usr/bin/python3.13', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-06-08 07:43:37.827675 | controller-1 | ok: [controller-3]
2026-06-08 07:43:37.827883 | controller-1 | ok: [controller-1]
2026-06-08 07:43:37.828076 | controller-1 | ok: [controller-2]
2026-06-08 07:43:37.828260 | controller-1 |
2026-06-08 07:43:37.828473 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/etc/kubernetes/manifests)] ***
2026-06-08 07:43:37.828737 | controller-1 | Monday 08 June 2026  07:43:37 +0000 (0:00:01.123)       0:00:01.193 ***********
2026-06-08 07:43:38.314213 | controller-1 | changed: [controller-3]
2026-06-08 07:43:38.314304 | controller-1 | changed: [controller-2]
2026-06-08 07:43:38.314567 | controller-1 | changed: [controller-1]
2026-06-08 07:43:38.314746 | controller-1 |
2026-06-08 07:43:38.314962 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack] ****************
2026-06-08 07:43:38.315146 | controller-1 | Monday 08 June 2026  07:43:38 +0000 (0:00:00.485)       0:00:01.679 ***********
2026-06-08 07:43:39.823270 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/keepalived.conf)
2026-06-08 07:43:39.823447 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/keepalived.conf)
2026-06-08 07:43:39.823718 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/keepalived.conf)
2026-06-08 07:43:39.824012 | controller-1 | ok: [controller-1] => (item=/etc/keepalived/check_apiserver.sh)
2026-06-08 07:43:39.824386 | controller-1 | ok: [controller-2] => (item=/etc/keepalived/check_apiserver.sh)
2026-06-08 07:43:39.824587 | controller-1 | ok: [controller-3] => (item=/etc/keepalived/check_apiserver.sh)
2026-06-08 07:43:39.824798 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-06-08 07:43:39.825002 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-06-08 07:43:39.825282 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/keepalived.yaml)
2026-06-08 07:43:39.825524 | controller-1 | ok: [controller-3] => (item=/etc/haproxy/haproxy.cfg)
2026-06-08 07:43:39.825726 | controller-1 | ok: [controller-2] => (item=/etc/haproxy/haproxy.cfg)
2026-06-08 07:43:39.825938 | controller-1 | ok: [controller-1] => (item=/etc/haproxy/haproxy.cfg)
2026-06-08 07:43:39.826127 | controller-1 | ok: [controller-3] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-06-08 07:43:39.826324 | controller-1 | ok: [controller-2] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-06-08 07:43:39.826549 | controller-1 | ok: [controller-1] => (item=/etc/kubernetes/manifests/haproxy.yaml)
2026-06-08 07:43:39.826844 | controller-1 |
2026-06-08 07:43:39.827086 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443] ****
2026-06-08 07:43:39.827265 | controller-1 | Monday 08 June 2026  07:43:39 +0000 (0:00:01.508)       0:00:03.188 ***********
2026-06-08 07:43:40.228268 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !
2026-06-08 07:43:40.228373 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-06-08 07:43:40.228514 | controller-1 |
2026-06-08 07:43:40.228732 | controller-1 | 30     - Restart "kubelet" service
2026-06-08 07:43:40.228904 | controller-1 | 31
2026-06-08 07:43:40.229000 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-06-08 07:43:40.229144 | controller-1 |      ^ column 3
2026-06-08 07:43:40.229256 | controller-1 |
2026-06-08 07:43:40.229450 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-06-08 07:43:40.252418 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-06-08 07:43:40.254056 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/manifests/kube-apiserver.yaml) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/manifests/kube-apiserver.yaml", "msg": "Path /etc/kubernetes/manifests/kube-apiserver.yaml does not exist !", "rc": 257}
2026-06-08 07:43:40.486410 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/controller-manager.conf does not exist !
2026-06-08 07:43:40.486576 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-06-08 07:43:40.486805 | controller-1 |
2026-06-08 07:43:40.487043 | controller-1 | 30     - Restart "kubelet" service
2026-06-08 07:43:40.487264 | controller-1 | 31
2026-06-08 07:43:40.487564 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-06-08 07:43:40.487768 | controller-1 |      ^ column 3
2026-06-08 07:43:40.487950 | controller-1 |
2026-06-08 07:43:40.488275 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.541441 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.550379 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/controller-manager.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/controller-manager.conf", "msg": "Path /etc/kubernetes/controller-manager.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.755040 | controller-1 | [ERROR]: Task failed: Module failed: Path /etc/kubernetes/scheduler.conf does not exist !
2026-06-08 07:43:40.755219 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kube_vip/tasks/main.yml:32:3
2026-06-08 07:43:40.755449 | controller-1 |
2026-06-08 07:43:40.755677 | controller-1 | 30     - Restart "kubelet" service
2026-06-08 07:43:40.755880 | controller-1 | 31
2026-06-08 07:43:40.756096 | controller-1 | 32 - name: Switch API server to run on port 6443
2026-06-08 07:43:40.756302 | controller-1 |      ^ column 3
2026-06-08 07:43:40.756478 | controller-1 |
2026-06-08 07:43:40.756812 | controller-1 | failed: [controller-3] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.815111 | controller-1 | failed: [controller-2] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.832231 | controller-1 | failed: [controller-1] (item=/etc/kubernetes/scheduler.conf) => {"ansible_loop_var": "item", "changed": false, "item": "/etc/kubernetes/scheduler.conf", "msg": "Path /etc/kubernetes/scheduler.conf does not exist !", "rc": 257}
2026-06-08 07:43:40.843351 | controller-1 | ...ignoring
2026-06-08 07:43:40.843448 | controller-1 | ...ignoring
2026-06-08 07:43:40.843642 | controller-1 | ...ignoring
2026-06-08 07:43:40.843825 | controller-1 |
2026-06-08 07:43:40.844032 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if super-admin.conf exists] *********
2026-06-08 07:43:40.844225 | controller-1 | Monday 08 June 2026  07:43:40 +0000 (0:00:01.020)       0:00:04.208 ***********
2026-06-08 07:43:41.277551 | controller-1 | ok: [controller-3]
2026-06-08 07:43:41.277643 | controller-1 | ok: [controller-2]
2026-06-08 07:43:41.277815 | controller-1 | ok: [controller-1]
2026-06-08 07:43:41.277963 | controller-1 |
2026-06-08 07:43:41.278139 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Check if kubeadm has already run] *********
2026-06-08 07:43:41.278306 | controller-1 | Monday 08 June 2026  07:43:41 +0000 (0:00:00.434)       0:00:04.643 ***********
2026-06-08 07:43:41.609125 | controller-1 | ok: [controller-3]
2026-06-08 07:43:41.609196 | controller-1 | ok: [controller-2]
2026-06-08 07:43:41.609306 | controller-1 | ok: [controller-1]
2026-06-08 07:43:41.609407 | controller-1 |
2026-06-08 07:43:41.609531 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path] ************
2026-06-08 07:43:41.609647 | controller-1 | Monday 08 June 2026  07:43:41 +0000 (0:00:00.331)       0:00:04.974 ***********
2026-06-08 07:43:41.676226 | controller-1 | ok: [controller-1]
2026-06-08 07:43:41.676397 | controller-1 | ok: [controller-2]
2026-06-08 07:43:41.676583 | controller-1 | ok: [controller-3]
2026-06-08 07:43:41.676763 | controller-1 |
2026-06-08 07:43:41.676985 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Set fact with KUBECONFIG path (with super-admin.conf)] ***
2026-06-08 07:43:41.677179 | controller-1 | Monday 08 June 2026  07:43:41 +0000 (0:00:00.065)       0:00:05.040 ***********
2026-06-08 07:43:41.739137 | controller-1 | ok: [controller-1]
2026-06-08 07:43:41.739374 | controller-1 | skipping: [controller-2]
2026-06-08 07:43:41.739613 | controller-1 | skipping: [controller-3]
2026-06-08 07:43:41.739833 | controller-1 |
2026-06-08 07:43:41.740088 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest] ***************
2026-06-08 07:43:41.740336 | controller-1 | Monday 08 June 2026  07:43:41 +0000 (0:00:00.063)       0:00:05.104 ***********
2026-06-08 07:43:42.748100 | controller-1 | ok: [controller-1]
2026-06-08 07:43:42.748261 | controller-1 | ok: [controller-2]
2026-06-08 07:43:42.748468 | controller-1 | ok: [controller-3]
2026-06-08 07:43:42.748759 | controller-1 |
2026-06-08 07:43:42.749099 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Ensure kube-vip configuration file] *******
2026-06-08 07:43:42.749358 | controller-1 | Monday 08 June 2026  07:43:42 +0000 (0:00:01.009)       0:00:06.113 ***********
2026-06-08 07:43:43.150398 | controller-1 | ok: [controller-1]
2026-06-08 07:43:43.150682 | controller-1 | ok: [controller-3]
2026-06-08 07:43:43.150960 | controller-1 | ok: [controller-2]
2026-06-08 07:43:43.151158 | controller-1 |
2026-06-08 07:43:43.151363 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-06-08 07:43:43.151562 | controller-1 | Monday 08 June 2026  07:43:43 +0000 (0:00:00.339)       0:00:06.452 ***********
2026-06-08 07:43:43.151735 | controller-1 |
2026-06-08 07:43:43.151951 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-06-08 07:43:43.152189 | controller-1 | Monday 08 June 2026  07:43:43 +0000 (0:00:00.003)       0:00:06.456 ***********
2026-06-08 07:43:43.152435 | controller-1 |
2026-06-08 07:43:43.152661 | controller-1 | TASK [vexxhost.kubernetes.kube_vip : Flush handlers] ***************************
2026-06-08 07:43:43.152856 | controller-1 | Monday 08 June 2026  07:43:43 +0000 (0:00:00.002)       0:00:06.458 ***********
2026-06-08 07:43:43.153040 | controller-1 |
2026-06-08 07:43:43.153183 | controller-1 | PLAY [Install Kubernetes] ******************************************************
2026-06-08 07:43:43.153286 | controller-1 |
2026-06-08 07:43:43.153416 | controller-1 | TASK [Gathering Facts] *********************************************************
2026-06-08 07:43:43.153541 | controller-1 | Monday 08 June 2026  07:43:43 +0000 (0:00:00.057)       0:00:06.516 ***********
2026-06-08 07:43:44.034084 | controller-1 | ok: [controller-3]
2026-06-08 07:43:44.034181 | controller-1 | ok: [controller-1]
2026-06-08 07:43:44.034253 | controller-1 | ok: [controller-2]
2026-06-08 07:43:44.034351 | controller-1 |
2026-06-08 07:43:44.034478 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:43:44.034598 | controller-1 | Monday 08 June 2026  07:43:44 +0000 (0:00:00.883)       0:00:07.399 ***********
2026-06-08 07:43:44.476414 | controller-1 | ok: [controller-2]
2026-06-08 07:43:44.476552 | controller-1 | ok: [controller-1]
2026-06-08 07:43:44.476745 | controller-1 | ok: [controller-3]
2026-06-08 07:43:44.476930 | controller-1 |
2026-06-08 07:43:44.477144 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-06-08 07:43:44.477346 | controller-1 | Monday 08 June 2026  07:43:44 +0000 (0:00:00.442)       0:00:07.841 ***********
2026-06-08 07:43:44.558623 | controller-1 | skipping: [controller-1]
2026-06-08 07:43:44.558672 | controller-1 | skipping: [controller-2]
2026-06-08 07:43:44.558681 | controller-1 | skipping: [controller-3]
2026-06-08 07:43:44.558689 | controller-1 |
2026-06-08 07:43:44.558698 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-06-08 07:43:44.558729 | controller-1 | Monday 08 June 2026  07:43:44 +0000 (0:00:00.080)       0:00:07.922 ***********
2026-06-08 07:43:44.945531 | controller-1 | changed: [controller-1]
2026-06-08 07:43:44.945569 | controller-1 | changed: [controller-3]
2026-06-08 07:43:44.945574 | controller-1 | changed: [controller-2]
2026-06-08 07:43:44.945579 | controller-1 |
2026-06-08 07:43:44.945584 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:43:44.945589 | controller-1 | Monday 08 June 2026  07:43:44 +0000 (0:00:00.387)       0:00:08.310 ***********
2026-06-08 07:43:45.061942 | controller-1 | ok: [controller-2] => {
2026-06-08 07:43:45.062133 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-06-08 07:43:45.062270 | controller-1 | }
2026-06-08 07:43:45.062409 | controller-1 | ok: [controller-3] => {
2026-06-08 07:43:45.062561 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-06-08 07:43:45.062715 | controller-1 | }
2026-06-08 07:43:45.062853 | controller-1 | ok: [controller-1] => {
2026-06-08 07:43:45.062995 | controller-1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-06-08 07:43:45.063126 | controller-1 | }
2026-06-08 07:43:45.063253 | controller-1 |
2026-06-08 07:43:45.063391 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:43:45.063529 | controller-1 | Monday 08 June 2026  07:43:45 +0000 (0:00:00.116)       0:00:08.427 ***********
2026-06-08 07:43:47.819342 | controller-1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
2026-06-08 07:44:17.413153 | controller-1 | [ERROR]: Task failed: Module failed: Request failed
2026-06-08 07:44:17.413196 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers/roles/download_artifact/tasks/main.yml:19:3
2026-06-08 07:44:17.413222 | controller-1 |
2026-06-08 07:44:17.413231 | controller-1 | 17     msg: "{{ download_artifact_url }}"
2026-06-08 07:44:17.413239 | controller-1 | 18
2026-06-08 07:44:17.413247 | controller-1 | 19 - name: Download item
2026-06-08 07:44:17.413255 | controller-1 |      ^ column 3
2026-06-08 07:44:17.413262 | controller-1 |
2026-06-08 07:44:17.413270 | controller-1 | fatal: [controller-2]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-06-08 07:44:17.427015 | controller-1 | changed: [controller-3]
2026-06-08 07:44:17.427104 | controller-1 | changed: [controller-1]
2026-06-08 07:44:17.427238 | controller-1 | FAILED - RETRYING: [controller-2]: Download item (4 retries left).
2026-06-08 07:44:17.427404 | controller-1 | FAILED - RETRYING: [controller-2]: Download item (3 retries left).
2026-06-08 07:44:17.428043 | controller-1 | FAILED - RETRYING: [controller-2]: Download item (2 retries left).
2026-06-08 07:44:17.428069 | controller-1 | FAILED - RETRYING: [controller-2]: Download item (1 retries left).
2026-06-08 07:44:17.428073 | controller-1 |
2026-06-08 07:44:17.428077 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:44:17.428081 | controller-1 | Monday 08 June 2026  07:44:17 +0000 (0:00:32.362)       0:00:40.790 ***********
2026-06-08 07:44:17.514822 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:17.514977 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:17.515089 | controller-1 |
2026-06-08 07:44:17.515412 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:44:17.515536 | controller-1 | Monday 08 June 2026  07:44:17 +0000 (0:00:00.090)       0:00:40.880 ***********
2026-06-08 07:44:17.887011 | controller-1 | ok: [controller-1]
2026-06-08 07:44:17.887062 | controller-1 | ok: [controller-3]
2026-06-08 07:44:17.887149 | controller-1 |
2026-06-08 07:44:17.887277 | controller-1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-06-08 07:44:17.887388 | controller-1 | Monday 08 June 2026  07:44:17 +0000 (0:00:00.370)       0:00:41.250 ***********
2026-06-08 07:44:19.027439 | controller-1 | ok: [controller-1]
2026-06-08 07:44:19.027508 | controller-1 | ok: [controller-3]
2026-06-08 07:44:19.027518 | controller-1 |
2026-06-08 07:44:19.027739 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:44:19.027769 | controller-1 | Monday 08 June 2026  07:44:19 +0000 (0:00:01.142)       0:00:42.393 ***********
2026-06-08 07:44:19.135093 | controller-1 | ok: [controller-1] => {
2026-06-08 07:44:19.135177 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-06-08 07:44:19.135189 | controller-1 | }
2026-06-08 07:44:19.135297 | controller-1 | ok: [controller-3] => {
2026-06-08 07:44:19.135390 | controller-1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.1/containerd-2.3.1-linux-amd64.tar.gz"
2026-06-08 07:44:19.135752 | controller-1 | }
2026-06-08 07:44:19.135781 | controller-1 |
2026-06-08 07:44:19.135787 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:44:19.135792 | controller-1 | Monday 08 June 2026  07:44:19 +0000 (0:00:00.107)       0:00:42.500 ***********
2026-06-08 07:44:29.819056 | controller-1 | changed: [controller-3]
2026-06-08 07:44:29.819119 | controller-1 | changed: [controller-1]
2026-06-08 07:44:29.819135 | controller-1 |
2026-06-08 07:44:29.819376 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:44:29.819414 | controller-1 | Monday 08 June 2026  07:44:29 +0000 (0:00:10.681)       0:00:53.182 ***********
2026-06-08 07:44:32.959062 | controller-1 | changed: [controller-3]
2026-06-08 07:44:32.959132 | controller-1 | changed: [controller-1]
2026-06-08 07:44:32.959145 | controller-1 |
2026-06-08 07:44:32.959318 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-06-08 07:44:32.959353 | controller-1 | Monday 08 June 2026  07:44:32 +0000 (0:00:03.140)       0:00:56.322 ***********
2026-06-08 07:44:33.011390 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:33.011456 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:33.011549 | controller-1 |
2026-06-08 07:44:33.011709 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-06-08 07:44:33.011810 | controller-1 | Monday 08 June 2026  07:44:33 +0000 (0:00:00.054)       0:00:56.376 ***********
2026-06-08 07:44:33.064626 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:33.064739 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:33.064851 | controller-1 |
2026-06-08 07:44:33.064951 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-06-08 07:44:33.065059 | controller-1 | Monday 08 June 2026  07:44:33 +0000 (0:00:00.053)       0:00:56.430 ***********
2026-06-08 07:44:33.115282 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:33.115309 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:33.115313 | controller-1 |
2026-06-08 07:44:33.115318 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-06-08 07:44:33.115322 | controller-1 | Monday 08 June 2026  07:44:33 +0000 (0:00:00.048)       0:00:56.478 ***********
2026-06-08 07:44:38.590572 | controller-1 | changed: [controller-3]
2026-06-08 07:44:38.590599 | controller-1 | changed: [controller-1]
2026-06-08 07:44:38.590603 | controller-1 |
2026-06-08 07:44:38.590608 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-06-08 07:44:38.590612 | controller-1 | Monday 08 June 2026  07:44:38 +0000 (0:00:05.473)       0:01:01.952 ***********
2026-06-08 07:44:39.395286 | controller-1 | changed: [controller-1]
2026-06-08 07:44:39.395311 | controller-1 | changed: [controller-3]
2026-06-08 07:44:39.395316 | controller-1 |
2026-06-08 07:44:39.395320 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-06-08 07:44:39.395325 | controller-1 | Monday 08 June 2026  07:44:39 +0000 (0:00:00.806)       0:01:02.758 ***********
2026-06-08 07:44:40.888002 | controller-1 | changed: [controller-1] => (item={'path': '/etc/containerd'})
2026-06-08 07:44:40.888056 | controller-1 | changed: [controller-3] => (item={'path': '/etc/containerd'})
2026-06-08 07:44:40.888142 | controller-1 | changed: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-06-08 07:44:40.888235 | controller-1 | changed: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-06-08 07:44:40.888325 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-06-08 07:44:40.888416 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-06-08 07:44:40.888505 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-06-08 07:44:40.888596 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-06-08 07:44:40.888692 | controller-1 | changed: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-06-08 07:44:40.888785 | controller-1 | changed: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-06-08 07:44:40.888868 | controller-1 |
2026-06-08 07:44:40.888970 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-06-08 07:44:40.889062 | controller-1 | Monday 08 June 2026  07:44:40 +0000 (0:00:01.494)       0:01:04.253 ***********
2026-06-08 07:44:41.771180 | controller-1 | changed: [controller-1]
2026-06-08 07:44:41.771246 | controller-1 | changed: [controller-3]
2026-06-08 07:44:41.771256 | controller-1 |
2026-06-08 07:44:41.771395 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-06-08 07:44:41.772087 | controller-1 | Monday 08 June 2026  07:44:41 +0000 (0:00:00.867)       0:01:05.120 ***********
2026-06-08 07:44:41.772121 | controller-1 |
2026-06-08 07:44:41.772125 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-06-08 07:44:41.772129 | controller-1 | Monday 08 June 2026  07:44:41 +0000 (0:00:00.006)       0:01:05.126 ***********
2026-06-08 07:44:41.772133 | controller-1 |
2026-06-08 07:44:41.772136 | controller-1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-06-08 07:44:41.772140 | controller-1 | Monday 08 June 2026  07:44:41 +0000 (0:00:00.006)       0:01:05.133 ***********
2026-06-08 07:44:42.667095 | controller-1 | changed: [controller-3]
2026-06-08 07:44:42.667192 | controller-1 | changed: [controller-1]
2026-06-08 07:44:42.667215 | controller-1 |
2026-06-08 07:44:42.667400 | controller-1 | RUNNING HANDLER [vexxhost.kubernetes.kubelet : Reload systemd] *****************
2026-06-08 07:44:42.667426 | controller-1 | Monday 08 June 2026  07:44:42 +0000 (0:00:00.897)       0:01:06.031 ***********
2026-06-08 07:44:44.723184 | controller-1 | ok: [controller-3]
2026-06-08 07:44:44.723265 | controller-1 | ok: [controller-1]
2026-06-08 07:44:44.723274 | controller-1 |
2026-06-08 07:44:44.723368 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-06-08 07:44:44.723460 | controller-1 | Monday 08 June 2026  07:44:44 +0000 (0:00:02.053)       0:01:08.085 ***********
2026-06-08 07:44:45.612918 | controller-1 | changed: [controller-3]
2026-06-08 07:44:45.612962 | controller-1 | changed: [controller-1]
2026-06-08 07:44:45.613259 | controller-1 |
2026-06-08 07:44:45.613270 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the "kubeadm-config" ConfigMap] ***
2026-06-08 07:44:45.613275 | controller-1 | Monday 08 June 2026  07:44:45 +0000 (0:00:00.893)       0:01:08.978 ***********
2026-06-08 07:44:46.299381 | controller-1 | [ERROR]: Task failed: Module failed: Failed to import the required Python library (kubernetes) on np0000178859's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter
2026-06-08 07:44:46.299765 | controller-1 | Origin: /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes/roles/kubernetes_upgrade_check/tasks/main.yml:16:3
2026-06-08 07:44:46.300043 | controller-1 |
2026-06-08 07:44:46.300320 | controller-1 | 14
2026-06-08 07:44:46.300591 | controller-1 | 15 ---
2026-06-08 07:44:46.300878 | controller-1 | 16 - name: Retrieve the "kubeadm-config" ConfigMap
2026-06-08 07:44:46.301157 | controller-1 |      ^ column 3
2026-06-08 07:44:46.301414 | controller-1 |
2026-06-08 07:44:46.301824 | controller-1 | fatal: [controller-1]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (kubernetes) on np0000178859's Python /usr/bin/python3.13. Please read the module documentation and install it in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter"}
2026-06-08 07:44:46.310977 | controller-1 | ...ignoring
2026-06-08 07:44:46.311061 | controller-1 |
2026-06-08 07:44:46.311169 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Parse the ClusterConfiguration] ***
2026-06-08 07:44:46.311305 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.696)       0:01:09.675 ***********
2026-06-08 07:44:46.353840 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:46.353897 | controller-1 |
2026-06-08 07:44:46.353994 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Retrieve the current Kubernetes version] ***
2026-06-08 07:44:46.354074 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.044)       0:01:09.719 ***********
2026-06-08 07:44:46.397912 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:46.397962 | controller-1 |
2026-06-08 07:44:46.398024 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Extract major, minor, and patch versions] ***
2026-06-08 07:44:46.398117 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.044)       0:01:09.763 ***********
2026-06-08 07:44:46.447073 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:46.447126 | controller-1 |
2026-06-08 07:44:46.447145 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Fail if we're jumping more than one minor version] ***
2026-06-08 07:44:46.447248 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.045)       0:01:09.808 ***********
2026-06-08 07:44:46.499085 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:46.499112 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:46.499117 | controller-1 |
2026-06-08 07:44:46.499121 | controller-1 | TASK [vexxhost.kubernetes.kubernetes_upgrade_check : Set fact if we need to upgrade] ***
2026-06-08 07:44:46.499125 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.055)       0:01:09.864 ***********
2026-06-08 07:44:46.571080 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:46.571301 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:46.571465 | controller-1 |
2026-06-08 07:44:46.571642 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:44:46.571815 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.071)       0:01:09.935 ***********
2026-06-08 07:44:46.907040 | controller-1 | ok: [controller-1]
2026-06-08 07:44:46.907108 | controller-1 | ok: [controller-3]
2026-06-08 07:44:46.907121 | controller-1 |
2026-06-08 07:44:46.907237 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:44:46.907327 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.334)       0:01:10.269 ***********
2026-06-08 07:44:46.969522 | controller-1 | ok: [controller-1] => {
2026-06-08 07:44:46.969587 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubeadm"
2026-06-08 07:44:46.969720 | controller-1 | }
2026-06-08 07:44:46.969836 | controller-1 | ok: [controller-3] => {
2026-06-08 07:44:46.969977 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubeadm"
2026-06-08 07:44:46.970093 | controller-1 | }
2026-06-08 07:44:46.970217 | controller-1 |
2026-06-08 07:44:46.970333 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:44:46.970472 | controller-1 | Monday 08 June 2026  07:44:46 +0000 (0:00:00.065)       0:01:10.334 ***********
2026-06-08 07:44:48.005077 | controller-1 | changed: [controller-1]
2026-06-08 07:44:48.005141 | controller-1 | changed: [controller-3]
2026-06-08 07:44:48.005266 | controller-1 |
2026-06-08 07:44:48.005417 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:44:48.005551 | controller-1 | Monday 08 June 2026  07:44:48 +0000 (0:00:01.035)       0:01:11.370 ***********
2026-06-08 07:44:48.071081 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:48.071161 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:48.071171 | controller-1 |
2026-06-08 07:44:48.071216 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:44:48.071317 | controller-1 | Monday 08 June 2026  07:44:48 +0000 (0:00:00.066)       0:01:11.436 ***********
2026-06-08 07:44:48.406879 | controller-1 | ok: [controller-1]
2026-06-08 07:44:48.406940 | controller-1 | ok: [controller-3]
2026-06-08 07:44:48.406986 | controller-1 |
2026-06-08 07:44:48.407082 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:44:48.407174 | controller-1 | Monday 08 June 2026  07:44:48 +0000 (0:00:00.336)       0:01:11.772 ***********
2026-06-08 07:44:48.470999 | controller-1 | ok: [controller-1] => {
2026-06-08 07:44:48.471080 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl"
2026-06-08 07:44:48.471182 | controller-1 | }
2026-06-08 07:44:48.471284 | controller-1 | ok: [controller-3] => {
2026-06-08 07:44:48.471498 | controller-1 |     "msg": "https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl"
2026-06-08 07:44:48.471519 | controller-1 | }
2026-06-08 07:44:48.471533 | controller-1 |
2026-06-08 07:44:48.471653 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:44:48.471735 | controller-1 | Monday 08 June 2026  07:44:48 +0000 (0:00:00.062)       0:01:11.834 ***********
2026-06-08 07:44:49.329909 | controller-1 | changed: [controller-3]
2026-06-08 07:44:49.329988 | controller-1 | changed: [controller-1]
2026-06-08 07:44:49.330000 | controller-1 |
2026-06-08 07:44:49.330107 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:44:49.330226 | controller-1 | Monday 08 June 2026  07:44:49 +0000 (0:00:00.860)       0:01:12.695 ***********
2026-06-08 07:44:49.409912 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:49.409994 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:49.410004 | controller-1 |
2026-06-08 07:44:49.410116 | controller-1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-06-08 07:44:49.410196 | controller-1 | Monday 08 June 2026  07:44:49 +0000 (0:00:00.080)       0:01:12.775 ***********
2026-06-08 07:44:49.467123 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:49.467210 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:49.467329 | controller-1 |
2026-06-08 07:44:49.467465 | controller-1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-06-08 07:44:49.467589 | controller-1 | Monday 08 June 2026  07:44:49 +0000 (0:00:00.055)       0:01:12.830 ***********
2026-06-08 07:44:49.516940 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:49.516996 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:49.517066 | controller-1 |
2026-06-08 07:44:49.517162 | controller-1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-06-08 07:44:49.517256 | controller-1 | Monday 08 June 2026  07:44:49 +0000 (0:00:00.051)       0:01:12.882 ***********
2026-06-08 07:44:49.568370 | controller-1 | skipping: [controller-1]
2026-06-08 07:44:49.568413 | controller-1 | skipping: [controller-3]
2026-06-08 07:44:49.568509 | controller-1 |
2026-06-08 07:44:49.568600 | controller-1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-06-08 07:44:49.568693 | controller-1 | Monday 08 June 2026  07:44:49 +0000 (0:00:00.051)       0:01:12.933 ***********
2026-06-08 07:44:50.623099 | controller-1 | ok: [controller-3]
2026-06-08 07:44:50.623160 | controller-1 | ok: [controller-1]
2026-06-08 07:44:50.623263 | controller-1 |
2026-06-08 07:44:50.623397 | controller-1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-06-08 07:44:50.623524 | controller-1 | Monday 08 June 2026  07:44:50 +0000 (0:00:01.051)       0:01:13.985 ***********
2026-06-08 07:44:51.321280 | controller-1 | ok: [controller-1]
2026-06-08 07:44:51.321339 | controller-1 | ok: [controller-3]
2026-06-08 07:44:51.321438 | controller-1 |
2026-06-08 07:44:51.321547 | controller-1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-06-08 07:44:51.321649 | controller-1 | Monday 08 June 2026  07:44:51 +0000 (0:00:00.701)       0:01:14.686 ***********
2026-06-08 07:44:52.764657 | controller-1 | ok: [controller-1] => (item={'path': '/etc/containerd'})
2026-06-08 07:44:52.764685 | controller-1 | ok: [controller-3] => (item={'path': '/etc/containerd'})
2026-06-08 07:44:52.764691 | controller-1 | ok: [controller-1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-06-08 07:44:52.764697 | controller-1 | ok: [controller-3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-06-08 07:44:52.764702 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-06-08 07:44:52.764707 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-06-08 07:44:52.764712 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-06-08 07:44:52.764717 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-06-08 07:44:52.764722 | controller-1 | ok: [controller-1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-06-08 07:44:52.764727 | controller-1 | ok: [controller-3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-06-08 07:44:52.764732 | controller-1 |
2026-06-08 07:44:52.764737 | controller-1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-06-08 07:44:52.764742 | controller-1 | Monday 08 June 2026  07:44:52 +0000 (0:00:01.441)       0:01:16.128 ***********
2026-06-08 07:44:53.582830 | controller-1 | ok: [controller-3]
2026-06-08 07:44:53.582869 | controller-1 | ok: [controller-1]
2026-06-08 07:44:53.582959 | controller-1 |
2026-06-08 07:44:53.583648 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-06-08 07:44:53.583659 | controller-1 | Monday 08 June 2026  07:44:53 +0000 (0:00:00.810)       0:01:16.939 ***********
2026-06-08 07:44:53.583663 | controller-1 |
2026-06-08 07:44:53.583667 | controller-1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-06-08 07:44:53.583670 | controller-1 | Monday 08 June 2026  07:44:53 +0000 (0:00:00.004)       0:01:16.944 ***********
2026-06-08 07:44:53.583674 | controller-1 |
2026-06-08 07:44:53.583677 | controller-1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-06-08 07:44:53.583680 | controller-1 | Monday 08 June 2026  07:44:53 +0000 (0:00:00.004)       0:01:16.948 ***********
2026-06-08 07:44:54.095027 | controller-1 | ok: [controller-1]
2026-06-08 07:44:54.095096 | controller-1 | ok: [controller-3]
2026-06-08 07:44:54.095166 | controller-1 |
2026-06-08 07:44:54.095270 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:44:54.095367 | controller-1 | Monday 08 June 2026  07:44:54 +0000 (0:00:00.509)       0:01:17.458 ***********
2026-06-08 07:44:54.424147 | controller-1 | ok: [controller-1]
2026-06-08 07:44:54.424202 | controller-1 | ok: [controller-3]
2026-06-08 07:44:54.424260 | controller-1 |
2026-06-08 07:44:54.424369 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:44:54.424461 | controller-1 | Monday 08 June 2026  07:44:54 +0000 (0:00:00.331)       0:01:17.789 ***********
2026-06-08 07:44:54.521957 | controller-1 | ok: [controller-1] => {
2026-06-08 07:44:54.522035 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz"
2026-06-08 07:44:54.522122 | controller-1 | }
2026-06-08 07:44:54.522211 | controller-1 | ok: [controller-3] => {
2026-06-08 07:44:54.522311 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/crictl-v1.35.0-linux-amd64.tar.gz"
2026-06-08 07:44:54.522391 | controller-1 | }
2026-06-08 07:44:54.522487 | controller-1 |
2026-06-08 07:44:54.522733 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:44:54.522761 | controller-1 | Monday 08 June 2026  07:44:54 +0000 (0:00:00.097)       0:01:17.887 ***********
2026-06-08 07:45:26.760539 | controller-1 | fatal: [controller-3]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-06-08 07:45:26.770753 | controller-1 | changed: [controller-1]
2026-06-08 07:45:26.770814 | controller-1 | FAILED - RETRYING: [controller-3]: Download item (4 retries left).
2026-06-08 07:45:26.770947 | controller-1 | FAILED - RETRYING: [controller-3]: Download item (3 retries left).
2026-06-08 07:45:26.771068 | controller-1 | FAILED - RETRYING: [controller-3]: Download item (2 retries left).
2026-06-08 07:45:26.771193 | controller-1 | FAILED - RETRYING: [controller-3]: Download item (1 retries left).
2026-06-08 07:45:26.771275 | controller-1 |
2026-06-08 07:45:26.771360 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:45:26.771448 | controller-1 | Monday 08 June 2026  07:45:26 +0000 (0:00:32.248)       0:01:50.136 ***********
2026-06-08 07:45:28.470625 | controller-1 | changed: [controller-1]
2026-06-08 07:45:28.470691 | controller-1 |
2026-06-08 07:45:28.470879 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:45:28.470912 | controller-1 | Monday 08 June 2026  07:45:28 +0000 (0:00:01.697)       0:01:51.833 ***********
2026-06-08 07:45:28.542959 | controller-1 | ok: [controller-1] => {
2026-06-08 07:45:28.543161 | controller-1 |     "msg": "https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.35.0/critest-v1.35.0-linux-amd64.tar.gz"
2026-06-08 07:45:28.543279 | controller-1 | }
2026-06-08 07:45:28.543389 | controller-1 |
2026-06-08 07:45:28.543510 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:45:28.543626 | controller-1 | Monday 08 June 2026  07:45:28 +0000 (0:00:00.071)       0:01:51.904 ***********
2026-06-08 07:45:36.614725 | controller-1 | changed: [controller-1]
2026-06-08 07:45:36.614786 | controller-1 |
2026-06-08 07:45:36.614831 | controller-1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-06-08 07:45:36.614927 | controller-1 | Monday 08 June 2026  07:45:36 +0000 (0:00:08.075)       0:01:59.980 ***********
2026-06-08 07:45:38.283258 | controller-1 | changed: [controller-1]
2026-06-08 07:45:38.283318 | controller-1 |
2026-06-08 07:45:38.283372 | controller-1 | TASK [vexxhost.containers.cri_tools : Create crictl config] ********************
2026-06-08 07:45:38.283541 | controller-1 | Monday 08 June 2026  07:45:38 +0000 (0:00:01.665)       0:02:01.645 ***********
2026-06-08 07:45:38.995796 | controller-1 | changed: [controller-1]
2026-06-08 07:45:38.995833 | controller-1 |
2026-06-08 07:45:38.995843 | controller-1 | TASK [vexxhost.containers.directory : Create directory (/opt/cni/bin)] *********
2026-06-08 07:45:38.995851 | controller-1 | Monday 08 June 2026  07:45:38 +0000 (0:00:00.713)       0:02:02.358 ***********
2026-06-08 07:45:39.302935 | controller-1 | changed: [controller-1]
2026-06-08 07:45:39.302999 | controller-1 |
2026-06-08 07:45:39.303181 | controller-1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-06-08 07:45:39.303204 | controller-1 | Monday 08 June 2026  07:45:39 +0000 (0:00:00.307)       0:02:02.666 ***********
2026-06-08 07:45:39.598902 | controller-1 | ok: [controller-1]
2026-06-08 07:45:39.598974 | controller-1 |
2026-06-08 07:45:39.599099 | controller-1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-06-08 07:45:39.599193 | controller-1 | Monday 08 June 2026  07:45:39 +0000 (0:00:00.296)       0:02:02.963 ***********
2026-06-08 07:45:39.666605 | controller-1 | ok: [controller-1] => {
2026-06-08 07:45:39.666710 | controller-1 |     "msg": "https://github.com/containernetworking/plugins/releases/download/v1.9.1/cni-plugins-linux-amd64-v1.9.1.tgz"
2026-06-08 07:45:39.666786 | controller-1 | }
2026-06-08 07:45:39.666863 | controller-1 |
2026-06-08 07:45:39.666955 | controller-1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-06-08 07:45:39.667039 | controller-1 | Monday 08 June 2026  07:45:39 +0000 (0:00:00.069)       0:02:03.032 ***********
2026-06-08 07:46:11.820837 | controller-1 | fatal: [controller-1]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-06-08 07:46:11.823668 | controller-1 | FAILED - RETRYING: [controller-1]: Download item (4 retries left).
2026-06-08 07:46:11.823812 | controller-1 | FAILED - RETRYING: [controller-1]: Download item (3 retries left).
2026-06-08 07:46:11.823936 | controller-1 | FAILED - RETRYING: [controller-1]: Download item (2 retries left).
2026-06-08 07:46:11.824064 | controller-1 | FAILED - RETRYING: [controller-1]: Download item (1 retries left).
2026-06-08 07:46:11.824175 | controller-1 |
2026-06-08 07:46:11.824293 | controller-1 | PLAY RECAP *********************************************************************
2026-06-08 07:46:11.826584 | controller-1 | controller-1               : ok=50   changed=19   unreachable=0    failed=1    skipped=15   rescued=0    ignored=2
2026-06-08 07:46:11.826615 | controller-1 | controller-2               : ok=13   changed=2    unreachable=0    failed=1    skipped=2    rescued=0    ignored=1
2026-06-08 07:46:11.826620 | controller-1 | controller-3               : ok=39   changed=13   unreachable=0    failed=1    skipped=13   rescued=0    ignored=1
2026-06-08 07:46:11.826625 | controller-1 |
2026-06-08 07:46:11.826630 | controller-1 |
2026-06-08 07:46:11.826635 | controller-1 | TASKS RECAP ********************************************************************
2026-06-08 07:46:11.826640 | controller-1 | Monday 08 June 2026  07:46:11 +0000 (0:00:32.157)       0:02:35.190 ***********
2026-06-08 07:46:11.826645 | controller-1 | ===============================================================================
2026-06-08 07:46:11.826649 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------ 32.36s
2026-06-08 07:46:11.826653 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------ 32.25s
2026-06-08 07:46:11.826658 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------ 32.16s
2026-06-08 07:46:11.826662 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------ 10.68s
2026-06-08 07:46:11.826666 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 8.08s
2026-06-08 07:46:11.826671 | controller-1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.47s
2026-06-08 07:46:11.826675 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s
2026-06-08 07:46:11.826679 | controller-1 | vexxhost.kubernetes.kubelet : Reload systemd ---------------------------- 2.05s
2026-06-08 07:46:11.826684 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.70s
2026-06-08 07:46:11.826688 | controller-1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.67s
2026-06-08 07:46:11.826697 | controller-1 | vexxhost.kubernetes.kube_vip : Uninstall legacy HA stack ---------------- 1.51s
2026-06-08 07:46:11.827811 | controller-1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.49s
2026-06-08 07:46:11.827838 | controller-1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.44s
2026-06-08 07:46:11.827849 | controller-1 | vexxhost.containers.package : Update state for tar ---------------------- 1.14s
2026-06-08 07:46:11.827862 | controller-1 | Gathering Facts --------------------------------------------------------- 1.12s
2026-06-08 07:46:11.827869 | controller-1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 1.05s
2026-06-08 07:46:11.827875 | controller-1 | vexxhost.containers.download_artifact : Download item ------------------- 1.04s
2026-06-08 07:46:11.827881 | controller-1 | vexxhost.kubernetes.kube_vip : Switch API server to run on port 6443 ---- 1.02s
2026-06-08 07:46:11.827887 | controller-1 | vexxhost.kubernetes.kube_vip : Upload Kubernetes manifest --------------- 1.01s
2026-06-08 07:46:11.827893 | controller-1 | vexxhost.containers.containerd : Restart containerd --------------------- 0.90s
2026-06-08 07:46:12.067877 | controller-1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.ha/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/ha/converge.yml
2026-06-08 07:46:12.068206 | controller-1 | ERROR    [ha > converge] Executed: Failed
2026-06-08 07:46:12.068419 | controller-1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.Bs5j.ha/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes/extensions/molecule/ha/converge.yml
2026-06-08 07:46:22.680420 | controller-1 | ERROR
2026-06-08 07:46:22.680834 | controller-1 | {
2026-06-08 07:46:22.680922 | controller-1 |   "delta": "0:03:02.742948",
2026-06-08 07:46:22.681000 | controller-1 |   "end": "2026-06-08 07:46:12.144365",
2026-06-08 07:46:22.681045 | controller-1 |   "msg": "non-zero return code",
2026-06-08 07:46:22.681085 | controller-1 |   "rc": 2,
2026-06-08 07:46:22.681132 | controller-1 |   "start": "2026-06-08 07:43:09.401417"
2026-06-08 07:46:22.681172 | controller-1 | }
failure
2026-06-08 07:46:22.689925 | 
2026-06-08 07:46:22.689993 | PLAY RECAP
2026-06-08 07:46:22.690041 | controller-1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:46:22.690063 | 
2026-06-08 07:46:22.844362 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-06-08 07:46:22.851142 | POST-RUN START: [untrusted : github.com/vexxhost/ansible-collection-kubernetes/test-playbooks/molecule/post.yml@main]
2026-06-08 07:46:23.463823 | 
2026-06-08 07:46:23.463947 | PLAY [all]
2026-06-08 07:46:23.475510 | 
2026-06-08 07:46:23.475591 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-06-08 07:46:23.865433 | controller-1 | changed
2026-06-08 07:46:24.056787 | controller-3 | changed
2026-06-08 07:46:24.062220 | controller-2 | changed
2026-06-08 07:46:24.066417 | 
2026-06-08 07:46:24.066527 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-06-08 07:46:24.524646 | controller-2 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.525236 | controller-2 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.532337 | controller-2 | environment: line 1: kubectl: command not found
2026-06-08 07:46:24.534776 | controller-2 | environment: line 1: kubectl: command not found
2026-06-08 07:46:24.534973 | controller-2 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.536118 | controller-2 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.539378 | controller-2 | environment: line 1: kubectl: command not found
2026-06-08 07:46:24.540054 | controller-2 | environment: line 1: kubectl: command not found
2026-06-08 07:46:24.541072 | controller-2 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.541630 | controller-2 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.544173 | controller-2 | environment: line 1: kubectl: command not found
2026-06-08 07:46:24.545650 | controller-2 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.496503 | controller-3 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.496940 | controller-3 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.504514 | controller-3 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.508887 | controller-3 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.561631 | controller-3 | E0608 07:46:24.561517    2548 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.562447 | controller-3 | E0608 07:46:24.562398    2548 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.564652 | controller-3 | E0608 07:46:24.564581    2548 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.565546 | controller-3 | E0608 07:46:24.565472    2548 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.566285 | controller-3 | E0608 07:46:24.566243    2548 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.567462 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.569292 | controller-3 | E0608 07:46:24.569191    2553 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.569993 | controller-3 | E0608 07:46:24.569940    2553 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.572099 | controller-3 | E0608 07:46:24.571771    2553 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.575004 | controller-3 | E0608 07:46:24.572408    2553 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.576499 | controller-3 | E0608 07:46:24.576322    2553 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.576527 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.578909 | controller-3 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.590095 | controller-3 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.506142 | controller-1 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.506761 | controller-1 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:24.517454 | controller-1 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.520213 | controller-1 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.564188 | controller-1 | E0608 07:46:24.563779    3233 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.564545 | controller-1 | E0608 07:46:24.564509    3233 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.566403 | controller-1 | E0608 07:46:24.566133    3233 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.566784 | controller-1 | E0608 07:46:24.566761    3233 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.570319 | controller-1 | E0608 07:46:24.570275    3233 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.570391 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.575139 | controller-1 | E0608 07:46:24.575023    3236 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.578287 | controller-1 | E0608 07:46:24.578161    3236 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.580740 | controller-1 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.581955 | controller-1 | E0608 07:46:24.581864    3236 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.583802 | controller-1 | E0608 07:46:24.583303    3236 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.584767 | controller-1 | E0608 07:46:24.584100    3236 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.584916 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.596646 | controller-1 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.635965 | controller-3 | E0608 07:46:24.635875    2575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.636618 | controller-3 | E0608 07:46:24.636567    2575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.638259 | controller-3 | E0608 07:46:24.638221    2575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.638593 | controller-3 | E0608 07:46:24.638566    2575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.640918 | controller-3 | E0608 07:46:24.640267    2575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.640935 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.648443 | controller-3 | E0608 07:46:24.648339    2582 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.649060 | controller-3 | E0608 07:46:24.649014    2582 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.650099 | controller-3 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.651097 | controller-3 | E0608 07:46:24.651036    2582 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.652054 | controller-3 | E0608 07:46:24.651985    2582 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.654852 | controller-3 | E0608 07:46:24.653993    2582 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.654901 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.707253 | controller-3 | E0608 07:46:24.707060    2599 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.708263 | controller-3 | E0608 07:46:24.708207    2599 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.709547 | controller-3 | E0608 07:46:24.709493    2599 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.710381 | controller-3 | E0608 07:46:24.710302    2599 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.712428 | controller-3 | E0608 07:46:24.712222    2599 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.712445 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.635153 | controller-1 | E0608 07:46:24.635013    3258 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.635784 | controller-1 | E0608 07:46:24.635735    3258 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.637304 | controller-1 | E0608 07:46:24.637265    3258 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.637699 | controller-1 | E0608 07:46:24.637660    3258 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.639347 | controller-1 | E0608 07:46:24.639291    3258 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.639377 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.649619 | controller-1 | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-06-08 07:46:24.657581 | controller-1 | E0608 07:46:24.657482    3268 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.658408 | controller-1 | E0608 07:46:24.658354    3268 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.660105 | controller-1 | E0608 07:46:24.660078    3268 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.660825 | controller-1 | E0608 07:46:24.660798    3268 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.662477 | controller-1 | E0608 07:46:24.662435    3268 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.662494 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:24.709436 | controller-1 | E0608 07:46:24.709265    3282 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.710840 | controller-1 | E0608 07:46:24.710795    3282 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.711647 | controller-1 | E0608 07:46:24.711597    3282 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.713581 | controller-1 | E0608 07:46:24.713543    3282 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.714353 | controller-1 | E0608 07:46:24.714316    3282 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:24.715579 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:25.126397 | controller-2 | ok: Runtime: 0:00:00.033104
2026-06-08 07:46:25.134065 | controller-3 | ok: Runtime: 0:00:00.234500
2026-06-08 07:46:25.140126 | controller-1 | ok: Runtime: 0:00:00.229984
2026-06-08 07:46:25.144114 | 
2026-06-08 07:46:25.144174 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-06-08 07:46:25.384380 | controller-3 | changed
2026-06-08 07:46:25.401605 | controller-2 | changed
2026-06-08 07:46:25.406441 | controller-1 | changed
2026-06-08 07:46:25.413052 | 
2026-06-08 07:46:25.413129 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-06-08 07:46:25.682178 | controller-2 | environment: line 5: kubectl: command not found
2026-06-08 07:46:25.682815 | controller-2 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.683409 | controller-2 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.683554 | controller-2 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.757162 | controller-3 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.757251 | controller-3 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.757748 | controller-3 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.808406 | controller-3 | E0608 07:46:25.808254    2631 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.808901 | controller-3 | E0608 07:46:25.808843    2631 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.810626 | controller-3 | E0608 07:46:25.810537    2631 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.811259 | controller-3 | E0608 07:46:25.811175    2631 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.813304 | controller-3 | E0608 07:46:25.813143    2631 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.813335 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:25.710033 | controller-1 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.710403 | controller-1 | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuexargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-06-08 07:46:25.710556 | controller-1 |
2026-06-08 07:46:25.764062 | controller-1 | E0608 07:46:25.763914    3312 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.764649 | controller-1 | E0608 07:46:25.764605    3312 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.765965 | controller-1 | E0608 07:46:25.765913    3312 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.766652 | controller-1 | E0608 07:46:25.766589    3312 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.769043 | controller-1 | E0608 07:46:25.768195    3312 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:25.769097 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:25.971865 | controller-2 | ok: Runtime: 0:00:00.011794
2026-06-08 07:46:26.027127 | controller-1 | ok: Runtime: 0:00:00.077635
2026-06-08 07:46:26.034841 | controller-3 | ok: Runtime: 0:00:00.074630
2026-06-08 07:46:26.041234 | 
2026-06-08 07:46:26.041333 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-06-08 07:46:26.628189 | controller-2 | changed:
2026-06-08 07:46:26.628474 | controller-2 | created directory /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-2
2026-06-08 07:46:26.628505 | controller-2 | cd+++++++++ objects/
2026-06-08 07:46:26.628527 | controller-2 | cd+++++++++ objects/cluster/
2026-06-08 07:46:26.628548 | controller-2 | cd+++++++++ objects/namespaced/
2026-06-08 07:46:26.632147 | controller-3 | changed:
2026-06-08 07:46:26.632194 | controller-3 | created directory /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-3
2026-06-08 07:46:26.632219 | controller-3 | cd+++++++++ objects/
2026-06-08 07:46:26.632240 | controller-3 | cd+++++++++ objects/cluster/
2026-06-08 07:46:26.632260 | controller-3 | cd+++++++++ objects/namespaced/
2026-06-08 07:46:26.679854 | controller-1 | changed:
2026-06-08 07:46:26.679982 | controller-1 | created directory /var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-1
2026-06-08 07:46:26.680038 | controller-1 | cd+++++++++ objects/
2026-06-08 07:46:26.680084 | controller-1 | cd+++++++++ objects/cluster/
2026-06-08 07:46:26.680128 | controller-1 | cd+++++++++ objects/namespaced/
2026-06-08 07:46:26.698750 | 
2026-06-08 07:46:26.698839 | TASK [gather-pod-logs : creating directory for pod logs]
2026-06-08 07:46:26.937139 | controller-1 | changed
2026-06-08 07:46:26.944883 | controller-2 | changed
2026-06-08 07:46:26.950741 | controller-3 | changed
2026-06-08 07:46:26.956067 | 
2026-06-08 07:46:26.956152 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-06-08 07:46:27.201910 | controller-1 | changed
2026-06-08 07:46:27.208888 | controller-2 | changed
2026-06-08 07:46:27.212382 | controller-3 | changed
2026-06-08 07:46:27.216389 | 
2026-06-08 07:46:27.216469 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-06-08 07:46:27.489478 | controller-2 | environment: line 3: kubectl: command not found
2026-06-08 07:46:27.565714 | controller-3 | E0608 07:46:27.565541    2685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.566705 | controller-3 | E0608 07:46:27.566620    2685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.567522 | controller-3 | E0608 07:46:27.567447    2685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.569659 | controller-3 | E0608 07:46:27.569608    2685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.570380 | controller-3 | E0608 07:46:27.570316    2685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.571627 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:27.534890 | controller-1 | E0608 07:46:27.534674    3365 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.535868 | controller-1 | E0608 07:46:27.535806    3365 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.537187 | controller-1 | E0608 07:46:27.537145    3365 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.538136 | controller-1 | E0608 07:46:27.538093    3365 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.540011 | controller-1 | E0608 07:46:27.539834    3365 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:27.540037 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:27.777747 | controller-2 | ok: Runtime: 0:00:00.013074
2026-06-08 07:46:27.785450 | controller-1 | ok: Runtime: 0:00:00.079732
2026-06-08 07:46:27.791163 | controller-3 | ok: Runtime: 0:00:00.077125
2026-06-08 07:46:27.796137 | 
2026-06-08 07:46:27.796200 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-06-08 07:46:28.315942 | controller-1 | changed:
2026-06-08 07:46:28.316188 | controller-1 | cd+++++++++ pod-logs/
2026-06-08 07:46:28.316229 | controller-1 | cd+++++++++ pod-logs/failed-pods/
2026-06-08 07:46:28.321485 | controller-2 | changed:
2026-06-08 07:46:28.321571 | controller-2 | cd+++++++++ pod-logs/
2026-06-08 07:46:28.321609 | controller-2 | cd+++++++++ pod-logs/failed-pods/
2026-06-08 07:46:28.326628 | controller-3 | changed:
2026-06-08 07:46:28.326680 | controller-3 | cd+++++++++ pod-logs/
2026-06-08 07:46:28.326707 | controller-3 | cd+++++++++ pod-logs/failed-pods/
2026-06-08 07:46:28.341555 | 
2026-06-08 07:46:28.341696 | LOOP [helm-release-status : creating directory for helm release status]
2026-06-08 07:46:28.573180 | controller-1 | changed: "values"
2026-06-08 07:46:28.581825 | controller-2 | changed: "values"
2026-06-08 07:46:28.605457 | controller-3 | changed: "values"
2026-06-08 07:46:28.793389 | controller-1 | changed: "releases"
2026-06-08 07:46:28.803690 | controller-2 | changed: "releases"
2026-06-08 07:46:28.803777 | controller-2 | changed: All items complete
2026-06-08 07:46:28.803820 | 
2026-06-08 07:46:28.811445 | controller-3 | changed: "releases"
2026-06-08 07:46:28.822399 | 
2026-06-08 07:46:28.822619 | TASK [helm-release-status : Gather get release status for helm charts]
2026-06-08 07:46:29.106651 | controller-2 | /bin/bash: line 3: kubectl: command not found
2026-06-08 07:46:29.178986 | controller-3 | E0608 07:46:29.178861    2734 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.179688 | controller-3 | E0608 07:46:29.179616    2734 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.181507 | controller-3 | E0608 07:46:29.181364    2734 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.181919 | controller-3 | E0608 07:46:29.181873    2734 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.184043 | controller-3 | E0608 07:46:29.183978    2734 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.184093 | controller-3 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:29.160047 | controller-1 | E0608 07:46:29.159829    3415 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.161116 | controller-1 | E0608 07:46:29.161025    3415 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.162080 | controller-1 | E0608 07:46:29.162023    3415 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.163043 | controller-1 | E0608 07:46:29.162960    3415 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.164796 | controller-1 | E0608 07:46:29.164727    3415 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp [::1]:8080: connect: connection refused"
2026-06-08 07:46:29.164855 | controller-1 | The connection to the server localhost:8080 was refused - did you specify the right host or port?
2026-06-08 07:46:29.386349 | controller-2 | ok: Runtime: 0:00:00.008897
2026-06-08 07:46:29.396976 | controller-1 | ok: Runtime: 0:00:00.082642
2026-06-08 07:46:29.403342 | controller-3 | ok: Runtime: 0:00:00.083451
2026-06-08 07:46:29.407337 | 
2026-06-08 07:46:29.407401 | TASK [helm-release-status : Downloads logs to executor]
2026-06-08 07:46:29.910686 | controller-2 | changed:
2026-06-08 07:46:29.911076 | controller-2 | cd+++++++++ helm/
2026-06-08 07:46:29.911123 | controller-2 | cd+++++++++ helm/releases/
2026-06-08 07:46:29.911154 | controller-2 | cd+++++++++ helm/values/
2026-06-08 07:46:29.921984 | controller-1 | changed:
2026-06-08 07:46:29.922053 | controller-1 | cd+++++++++ helm/
2026-06-08 07:46:29.922077 | controller-1 | cd+++++++++ helm/releases/
2026-06-08 07:46:29.922096 | controller-1 | cd+++++++++ helm/values/
2026-06-08 07:46:29.959709 | controller-3 | changed:
2026-06-08 07:46:29.959869 | controller-3 | cd+++++++++ helm/
2026-06-08 07:46:29.959922 | controller-3 | cd+++++++++ helm/releases/
2026-06-08 07:46:29.959967 | controller-3 | cd+++++++++ helm/values/
2026-06-08 07:46:29.976005 | 
2026-06-08 07:46:29.976074 | PLAY RECAP
2026-06-08 07:46:29.976123 | controller-1 | ok: 12 changed: 12 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:46:29.976168 | controller-2 | ok: 12 changed: 12 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:46:29.976193 | controller-3 | ok: 12 changed: 12 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-06-08 07:46:29.976210 | 
2026-06-08 07:46:30.127590 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/ansible-collection-kubernetes/test-playbooks/molecule/post.yml@main]
2026-06-08 07:46:30.134424 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-06-08 07:46:30.732904 | 
2026-06-08 07:46:30.733137 | PLAY [all]
2026-06-08 07:46:30.743706 | 
2026-06-08 07:46:30.743781 | TASK [fetch-output : Set log path for multiple nodes]
2026-06-08 07:46:30.802411 | controller-1 | ok
2026-06-08 07:46:30.807790 | controller-2 | ok
2026-06-08 07:46:30.811518 | controller-3 | ok
2026-06-08 07:46:30.815918 | 
2026-06-08 07:46:30.816010 | TASK [fetch-output : Set log path for single node]
2026-06-08 07:46:30.848362 | controller-1 | skipping: Conditional result was False
2026-06-08 07:46:30.859878 | controller-2 | skipping: Conditional result was False
2026-06-08 07:46:30.860350 | controller-3 | skipping: Conditional result was False
2026-06-08 07:46:30.869179 | 
2026-06-08 07:46:30.869332 | LOOP [fetch-output : Ensure local output dirs]
2026-06-08 07:46:31.281399 | controller-3 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-3"
2026-06-08 07:46:31.303728 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-2"
2026-06-08 07:46:31.322560 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/logs/controller-1"
2026-06-08 07:46:31.498962 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/artifacts"
2026-06-08 07:46:31.528530 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/artifacts"
2026-06-08 07:46:31.539833 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/artifacts"
2026-06-08 07:46:31.720834 | controller-3 -> localhost | changed: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/docs"
2026-06-08 07:46:31.737065 | controller-2 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/docs"
2026-06-08 07:46:31.737212 | controller-2 -> localhost | changed: All items complete
2026-06-08 07:46:31.737274 | 
2026-06-08 07:46:31.756206 | controller-1 -> localhost | ok: "/var/lib/zuul/builds/08bb302db05e43eeaf3caf838cb38a76/work/docs"
2026-06-08 07:46:31.770048 | 
2026-06-08 07:46:31.770122 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-06-08 07:46:32.391531 | controller-2 | changed: .d..t...... ./
2026-06-08 07:46:32.392077 | controller-2 | ok: All items complete
2026-06-08 07:46:32.392168 | 
2026-06-08 07:46:32.408826 | controller-1 | changed: .d..t...... ./
2026-06-08 07:46:32.422903 | controller-3 | changed: .d..t...... ./
2026-06-08 07:46:32.847368 | controller-2 | changed: .d..t...... ./
2026-06-08 07:46:32.855705 | controller-1 | ok
2026-06-08 07:46:32.879217 | controller-3 | ok
2026-06-08 07:46:33.303686 | controller-2 | changed: .d..t...... ./
2026-06-08 07:46:33.308416 | controller-1 | ok
2026-06-08 07:46:33.322619 | controller-3 | ok
2026-06-08 07:46:33.345420 | 
2026-06-08 07:46:33.345808 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-06-08 07:46:33.767895 | controller-1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007926
2026-06-08 07:46:33.768147 | controller-1 -> localhost | changed: All items complete
2026-06-08 07:46:33.768186 | 
2026-06-08 07:46:33.987962 | controller-1 -> localhost | ok: Item: docs Runtime: 0:00:00.007101
2026-06-08 07:46:34.011070 | 
2026-06-08 07:46:34.011185 | PLAY [all]
2026-06-08 07:46:34.016496 | 
2026-06-08 07:46:34.016572 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-06-08 07:46:34.514919 | controller-1 | changed
2026-06-08 07:46:34.654452 | controller-2 | changed
2026-06-08 07:46:34.659375 | controller-3 | changed
2026-06-08 07:46:34.673496 | 
2026-06-08 07:46:34.673587 | PLAY RECAP
2026-06-08 07:46:34.673636 | controller-1 | ok: 5 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:46:34.673664 | controller-2 | ok: 4 changed: 2 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:46:34.673688 | controller-3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-06-08 07:46:34.673709 | 
2026-06-08 07:46:34.836206 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-06-08 07:46:34.847634 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-06-08 07:46:35.450161 | 
2026-06-08 07:46:35.450300 | PLAY [localhost]
2026-06-08 07:46:35.461192 | 
2026-06-08 07:46:35.461284 | TASK [Generate Zuul manifest]
2026-06-08 07:46:35.480790 | localhost | ok
2026-06-08 07:46:35.495172 | 
2026-06-08 07:46:35.495258 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-06-08 07:46:35.867726 | localhost | changed
2026-06-08 07:46:35.880070 | 
2026-06-08 07:46:35.880419 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-06-08 07:46:35.916760 | localhost | ok
2026-06-08 07:46:35.923657 | 
2026-06-08 07:46:35.923753 | TASK [Upload logs]
2026-06-08 07:46:35.947375 | localhost | ok
2026-06-08 07:46:36.016378 | 
2026-06-08 07:46:36.016531 | TASK [Set zuul-log-path fact]
2026-06-08 07:46:36.037952 | localhost | ok
2026-06-08 07:46:36.055387 | 
2026-06-08 07:46:36.055557 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-06-08 07:46:36.084294 | localhost | ok
2026-06-08 07:46:36.091223 | 
2026-06-08 07:46:36.091296 | TASK [upload-logs : Create log directories]
2026-06-08 07:46:36.512227 | localhost | changed
2026-06-08 07:46:36.522873 | 
2026-06-08 07:46:36.522969 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-06-08 07:46:36.972820 | localhost -> localhost | ok: Runtime: 0:00:00.005846
2026-06-08 07:46:36.978461 | 
2026-06-08 07:46:36.978528 | TASK [upload-logs : Upload logs to log server]
2026-06-08 07:46:37.425378 | localhost | Output suppressed because no_log was given
2026-06-08 07:46:37.430498 | 
2026-06-08 07:46:37.430590 | LOOP [upload-logs : Compress console log and json output]
2026-06-08 07:46:37.479202 | localhost | skipping: Conditional result was False
2026-06-08 07:46:37.487847 | localhost | skipping: Conditional result was False
2026-06-08 07:46:37.507721 | 
2026-06-08 07:46:37.508325 | LOOP [upload-logs : Upload compressed console log and json output]
2026-06-08 07:46:37.554469 | localhost | skipping: Conditional result was False
2026-06-08 07:46:37.555016 | 
2026-06-08 07:46:37.558507 | localhost | skipping: Conditional result was False
2026-06-08 07:46:37.573299 | 
2026-06-08 07:46:37.573450 | LOOP [upload-logs : Upload console log and json output]