I0306 21:18:36.936020 1 options.go:220] external host was not specified, using 199.204.45.233 I0306 21:18:36.938437 1 server.go:148] Version: v1.28.13 I0306 21:18:36.938501 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0306 21:18:37.400851 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0306 21:18:37.433497 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0306 21:18:37.433536 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0306 21:18:37.434114 1 instance.go:298] Using reconciler: lease I0306 21:18:37.701010 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0306 21:18:37.701030 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0306 21:18:37.959951 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0306 21:18:37.960102 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0306 21:18:38.428827 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0306 21:18:38.440557 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0306 21:18:38.440595 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.440604 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.441044 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0306 21:18:38.441061 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0306 21:18:38.441967 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0306 21:18:38.442766 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0306 21:18:38.442784 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0306 21:18:38.442789 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0306 21:18:38.446102 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0306 21:18:38.446155 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0306 21:18:38.449576 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0306 21:18:38.449600 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.449609 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.451655 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0306 21:18:38.451691 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.451790 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0306 21:18:38.453293 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0306 21:18:38.455116 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0306 21:18:38.455134 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.455139 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.455570 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0306 21:18:38.455585 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.455589 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.456374 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0306 21:18:38.456389 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0306 21:18:38.458263 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0306 21:18:38.458281 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.458287 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.458860 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0306 21:18:38.458878 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.458883 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.461027 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0306 21:18:38.461043 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.461046 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.462133 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0306 21:18:38.463260 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0306 21:18:38.463275 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.463278 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.466644 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0306 21:18:38.466658 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0306 21:18:38.466663 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0306 21:18:38.467340 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0306 21:18:38.467353 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0306 21:18:38.467357 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0306 21:18:38.467762 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0306 21:18:38.467775 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0306 21:18:38.506776 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0306 21:18:38.506806 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0306 21:18:38.879687 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0306 21:18:38.879721 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0306 21:18:38.880043 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0306 21:18:38.880196 1 secure_serving.go:213] Serving securely on [::]:6443 I0306 21:18:38.880310 1 available_controller.go:423] Starting AvailableConditionController I0306 21:18:38.880321 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0306 21:18:38.880377 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0306 21:18:38.880448 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0306 21:18:38.880532 1 controller.go:78] Starting OpenAPI AggregationController I0306 21:18:38.880594 1 system_namespaces_controller.go:67] Starting system namespaces controller I0306 21:18:38.880394 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0306 21:18:38.880719 1 gc_controller.go:78] Starting apiserver lease garbage collector I0306 21:18:38.880726 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0306 21:18:38.895338 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0306 21:18:38.880750 1 controller.go:80] Starting OpenAPI V3 AggregationController I0306 21:18:38.880834 1 controller.go:116] Starting legacy_token_tracking_controller I0306 21:18:38.895592 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0306 21:18:38.881030 1 aggregator.go:164] waiting for initial CRD sync... I0306 21:18:38.881023 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0306 21:18:38.895619 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0306 21:18:38.881043 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0306 21:18:38.881086 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0306 21:18:38.881110 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0306 21:18:38.881221 1 gc_controller.go:78] Starting apiserver lease garbage collector I0306 21:18:38.881341 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0306 21:18:38.881411 1 controller.go:134] Starting OpenAPI controller I0306 21:18:38.881457 1 controller.go:85] Starting OpenAPI V3 controller I0306 21:18:38.881474 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0306 21:18:38.896110 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0306 21:18:38.881479 1 naming_controller.go:291] Starting NamingConditionController I0306 21:18:38.881499 1 establishing_controller.go:76] Starting EstablishingController I0306 21:18:38.881525 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0306 21:18:38.881542 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0306 21:18:38.881558 1 crd_finalizer.go:266] Starting CRDFinalizer I0306 21:18:38.901002 1 shared_informer.go:318] Caches are synced for node_authorizer E0306 21:18:38.952623 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0306 21:18:38.980999 1 cache.go:39] Caches are synced for AvailableConditionController controller I0306 21:18:38.995440 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0306 21:18:38.995496 1 apf_controller.go:379] Running API Priority and Fairness config worker I0306 21:18:38.995578 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0306 21:18:38.995681 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0306 21:18:38.995686 1 shared_informer.go:318] Caches are synced for configmaps I0306 21:18:38.996204 1 shared_informer.go:318] Caches are synced for crd-autoregister I0306 21:18:38.996241 1 aggregator.go:166] initial CRD sync complete... I0306 21:18:38.996253 1 autoregister_controller.go:141] Starting autoregister controller I0306 21:18:38.996263 1 cache.go:32] Waiting for caches to sync for autoregister controller I0306 21:18:38.996272 1 cache.go:39] Caches are synced for autoregister controller I0306 21:18:38.997003 1 controller.go:624] quota admission added evaluator for: namespaces I0306 21:18:39.156961 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0306 21:18:39.890025 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0306 21:18:39.896149 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0306 21:18:39.896176 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0306 21:18:40.465601 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0306 21:18:40.512200 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0306 21:18:40.596360 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0306 21:18:40.603745 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.233] I0306 21:18:40.605510 1 controller.go:624] quota admission added evaluator for: endpoints I0306 21:18:40.610941 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0306 21:18:41.347907 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0306 21:18:42.337236 1 controller.go:624] quota admission added evaluator for: deployments.apps I0306 21:18:42.368145 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0306 21:18:42.570303 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0306 21:18:46.442186 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0306 21:18:46.489501 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0306 21:19:16.429743 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0306 21:19:16.453655 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0306 21:19:16.469827 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0306 21:19:16.489833 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.102.175.230"} I0306 21:19:16.497909 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.109.185.125"} I0306 21:19:16.545661 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0306 21:19:16.577562 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0306 21:19:16.612185 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0306 21:19:17.014168 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0306 21:19:17.026087 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:17.034397 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:17.041399 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0306 21:19:17.158703 1 controller.go:624] quota admission added evaluator for: jobs.batch I0306 21:19:17.408973 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0306 21:19:17.641949 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0306 21:19:18.615929 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0306 21:19:19.643916 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:20.031623 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:20.655672 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:20.882086 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0306 21:19:27.305835 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io W0306 21:19:36.106723 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.102.175.230:443: connect: connection refused W0306 21:19:41.074175 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.102.175.230:443: connect: connection refused W0306 21:19:46.069127 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.102.175.230:443: connect: connection refused I0306 21:19:51.083411 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0306 21:19:55.460549 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0306 21:20:08.949924 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.103.156.35"} I0306 21:20:08.962790 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.99.120.33"} I0306 21:20:08.976344 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.109.56.179"} I0306 21:20:08.984459 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.106.84.32"} I0306 21:20:15.087496 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.107450 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.127791 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.147207 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.169482 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.188545 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.208427 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.229373 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.254969 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.275510 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0306 21:20:15.293657 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.315373 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:15.333290 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:16.684473 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0306 21:20:19.600704 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0306 21:20:19.607380 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0306 21:20:19.654231 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.97.73.215"} I0306 21:20:19.683627 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0306 21:20:21.856231 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0306 21:20:21.954940 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0306 21:20:22.554327 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0306 21:20:22.554455 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0306 21:20:22.554522 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0306 21:20:29.096876 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0306 21:20:32.721526 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.96.233.239"} I0306 21:20:32.996418 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0306 21:20:33.254424 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.111.34.224"} I0306 21:20:33.269626 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.88.204"} I0306 21:21:27.808512 1 trace.go:236] Trace[1628479963]: "Update" accept:application/json, */*,audit-id:319d10bf-9d76-4ced-abb7-293a833aecbf,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (06-Mar-2026 21:21:27.285) (total time: 522ms): Trace[1628479963]: ["GuaranteedUpdate etcd3" audit-id:319d10bf-9d76-4ced-abb7-293a833aecbf,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 522ms (21:21:27.286) Trace[1628479963]: ---"Txn call completed" 521ms (21:21:27.808)] Trace[1628479963]: [522.502105ms] [522.502105ms] END I0306 21:21:28.000732 1 trace.go:236] Trace[1311515452]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0006b073-dc8b-446d-be5f-4ce952ff93e3,client:199.204.45.233,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (06-Mar-2026 21:21:27.285) (total time: 714ms): Trace[1311515452]: ["GuaranteedUpdate etcd3" audit-id:0006b073-dc8b-446d-be5f-4ce952ff93e3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 714ms (21:21:27.286) Trace[1311515452]: ---"Txn call completed" 713ms (21:21:28.000)] Trace[1311515452]: [714.750824ms] [714.750824ms] END I0306 21:21:28.001225 1 trace.go:236] Trace[1556967578]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ac8371db-121f-475c-a7e1-d78778940b45,client:199.204.45.233,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (06-Mar-2026 21:21:27.286) (total time: 714ms): Trace[1556967578]: ["GuaranteedUpdate etcd3" audit-id:ac8371db-121f-475c-a7e1-d78778940b45,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 714ms (21:21:27.286) Trace[1556967578]: ---"Txn call completed" 713ms (21:21:28.000)] Trace[1556967578]: [714.406714ms] [714.406714ms] END I0306 21:22:07.936064 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.104.75.235"} I0306 21:22:10.383850 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.111.75.93"} I0306 21:22:10.395585 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.108.16.170"} I0306 21:22:16.570517 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.103.208.104"} I0306 21:22:16.580089 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.104.96.111"} I0306 21:24:46.374659 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0306 21:24:50.230487 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0306 21:24:50.260013 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0306 21:24:53.820146 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0306 21:24:53.830408 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0306 21:24:53.849446 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0306 21:24:53.870959 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0306 21:24:53.881570 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0306 21:24:53.890547 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0306 21:24:53.903991 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0306 21:24:55.700584 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0306 21:25:06.935478 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0306 21:25:45.891826 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0306 21:26:00.268878 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0306 21:26:00.481269 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:00.520351 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:00.771252 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0306 21:26:01.035537 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:01.041835 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:01.134979 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0306 21:26:01.148024 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:01.235541 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0306 21:26:39.896256 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.96.252.213"} I0306 21:26:39.903866 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.102.214.56"} I0306 21:26:39.912444 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.110.227.156"} I0306 21:26:39.922364 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.110.71.221"} I0306 21:26:39.929603 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.99.234.180"} I0306 21:26:39.939633 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.105.189.199"} I0306 21:26:39.992693 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0306 21:26:40.007086 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0306 21:26:40.056959 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0306 21:26:40.084323 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0306 21:26:40.113472 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0306 21:26:40.124624 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.124668 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.125278 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.125277 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.125318 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.125331 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.125982 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.126023 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.126352 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.126397 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.126480 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.126511 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.126586 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.126592 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.126821 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.126849 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.127004 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.127023 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.127032 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.127056 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.127264 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.127325 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.127326 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.127401 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.127791 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.127818 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.128198 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.128237 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.129500 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.129522 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused W0306 21:26:40.129548 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused E0306 21:26:40.129578 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.96.252.213:443: connect: connection refused I0306 21:26:50.690959 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.103.92.27"} I0306 21:26:50.703376 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.96.175.240"} I0306 21:26:55.038901 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.104.159.5"} I0306 21:26:57.838381 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.104.203.86"} I0306 21:27:02.660004 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.99.209.138"} I0306 21:27:03.621065 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.105.140.10"} I0306 21:27:10.493294 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0306 21:27:10.653907 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.101.184.145"} I0306 21:27:51.912610 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.101.168.241"} I0306 21:27:51.932242 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0306 21:30:49.455100 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.108.145.6"} E0306 21:31:14.856104 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.204.45.233:52284->199.204.45.233:10250: write: broken pipe I0306 21:31:18.053622 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.107.154.255"} I0306 21:33:13.193786 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0306 21:33:13.202189 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.209383 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.231052 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.231140 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.239258 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0306 21:33:13.251517 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.268907 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.278863 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.290071 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.310912 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.320941 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.344526 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.361187 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.375029 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.476767 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.515767 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.562619 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:13.645783 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0306 21:33:54.205330 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0306 21:33:54.213624 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0306 21:34:27.681625 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.97.1.234"} I0306 21:34:29.899851 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.109.238.47"} I0306 21:34:59.061326 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.106.157.90"} I0306 21:37:48.706121 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.102.17.227"}