I0330 10:27:09.127094 1 options.go:220] external host was not specified, using 199.19.213.124 I0330 10:27:09.127882 1 server.go:148] Version: v1.28.13 I0330 10:27:09.127940 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0330 10:27:09.794135 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0330 10:27:09.800422 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0330 10:27:09.800445 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0330 10:27:09.800647 1 instance.go:298] Using reconciler: lease I0330 10:27:10.141949 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0330 10:27:10.141978 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0330 10:27:10.388154 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0330 10:27:10.388322 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0330 10:27:10.858787 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0330 10:27:10.871475 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0330 10:27:10.871512 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.871522 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.872419 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0330 10:27:10.872442 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0330 10:27:10.873911 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0330 10:27:10.875341 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0330 10:27:10.875357 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0330 10:27:10.875362 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0330 10:27:10.877178 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0330 10:27:10.877199 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0330 10:27:10.878578 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0330 10:27:10.878596 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.878601 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.879256 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0330 10:27:10.879272 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.879313 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0330 10:27:10.879865 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0330 10:27:10.881591 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0330 10:27:10.881607 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.881612 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.882094 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0330 10:27:10.882108 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.882113 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.883047 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0330 10:27:10.883064 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0330 10:27:10.885111 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0330 10:27:10.885128 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.885134 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.885686 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0330 10:27:10.885706 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.885710 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.888070 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0330 10:27:10.888084 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.888088 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.889080 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0330 10:27:10.889941 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0330 10:27:10.889954 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.889958 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.893177 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0330 10:27:10.893194 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0330 10:27:10.893198 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0330 10:27:10.894055 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0330 10:27:10.894068 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0330 10:27:10.894072 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0330 10:27:10.894476 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0330 10:27:10.894488 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0330 10:27:10.924116 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0330 10:27:10.924153 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0330 10:27:11.305822 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 10:27:11.305842 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 10:27:11.306039 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0330 10:27:11.306364 1 secure_serving.go:213] Serving securely on [::]:6443 I0330 10:27:11.306455 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0330 10:27:11.306462 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0330 10:27:11.306613 1 aggregator.go:164] waiting for initial CRD sync... I0330 10:27:11.306645 1 controller.go:80] Starting OpenAPI V3 AggregationController I0330 10:27:11.306650 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0330 10:27:11.306645 1 controller.go:78] Starting OpenAPI AggregationController I0330 10:27:11.306669 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0330 10:27:11.306746 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0330 10:27:11.306835 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0330 10:27:11.306864 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0330 10:27:11.306862 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0330 10:27:11.307125 1 system_namespaces_controller.go:67] Starting system namespaces controller I0330 10:27:11.307146 1 controller.go:116] Starting legacy_token_tracking_controller I0330 10:27:11.307156 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0330 10:27:11.307208 1 controller.go:134] Starting OpenAPI controller I0330 10:27:11.307242 1 controller.go:85] Starting OpenAPI V3 controller I0330 10:27:11.307291 1 naming_controller.go:291] Starting NamingConditionController I0330 10:27:11.307312 1 establishing_controller.go:76] Starting EstablishingController I0330 10:27:11.307326 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0330 10:27:11.307344 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0330 10:27:11.307386 1 crd_finalizer.go:266] Starting CRDFinalizer I0330 10:27:11.307484 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0330 10:27:11.307516 1 gc_controller.go:78] Starting apiserver lease garbage collector I0330 10:27:11.307518 1 gc_controller.go:78] Starting apiserver lease garbage collector I0330 10:27:11.307601 1 available_controller.go:423] Starting AvailableConditionController I0330 10:27:11.307615 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0330 10:27:11.307645 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 10:27:11.307733 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 10:27:11.307327 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0330 10:27:11.307997 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller E0330 10:27:11.383458 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0330 10:27:11.394934 1 shared_informer.go:318] Caches are synced for node_authorizer I0330 10:27:11.406900 1 shared_informer.go:318] Caches are synced for crd-autoregister I0330 10:27:11.406939 1 aggregator.go:166] initial CRD sync complete... I0330 10:27:11.406950 1 autoregister_controller.go:141] Starting autoregister controller I0330 10:27:11.406959 1 cache.go:32] Waiting for caches to sync for autoregister controller I0330 10:27:11.406968 1 cache.go:39] Caches are synced for autoregister controller I0330 10:27:11.406982 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0330 10:27:11.407233 1 apf_controller.go:379] Running API Priority and Fairness config worker I0330 10:27:11.407254 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0330 10:27:11.407305 1 shared_informer.go:318] Caches are synced for configmaps I0330 10:27:11.407711 1 cache.go:39] Caches are synced for AvailableConditionController controller I0330 10:27:11.408154 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0330 10:27:11.409404 1 controller.go:624] quota admission added evaluator for: namespaces I0330 10:27:11.425718 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0330 10:27:12.315088 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0330 10:27:12.320051 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0330 10:27:12.320075 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0330 10:27:12.879939 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0330 10:27:12.921624 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0330 10:27:13.018579 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0330 10:27:13.025657 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.124] I0330 10:27:13.026681 1 controller.go:624] quota admission added evaluator for: endpoints I0330 10:27:13.032063 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0330 10:27:14.504274 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0330 10:27:14.512267 1 controller.go:624] quota admission added evaluator for: deployments.apps I0330 10:27:14.584797 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0330 10:27:14.784111 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0330 10:27:20.022133 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0330 10:27:20.121348 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0330 10:27:39.471003 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 10:27:39.486916 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 10:27:39.508279 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 10:27:39.508364 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 10:27:39.529288 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 10:27:39.545912 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 10:27:39.567980 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 10:27:39.585671 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 10:27:39.585761 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 10:27:39.609389 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 10:27:39.638124 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 10:27:39.638319 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 10:27:39.690574 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 10:27:39.690651 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 10:27:39.752359 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 10:27:39.862477 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 10:27:39.862524 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 10:27:39.872422 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:39.912238 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:39.948321 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:39.996384 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:40.007489 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:40.596606 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:40.596803 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:40.680752 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 10:27:45.811437 1 trace.go:236] Trace[1519183293]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dd65ffd8-51eb-4dde-b6b5-15d45589822b,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:27:45.243) (total time: 567ms): Trace[1519183293]: ["GuaranteedUpdate etcd3" audit-id:dd65ffd8-51eb-4dde-b6b5-15d45589822b,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 567ms (10:27:45.243) Trace[1519183293]: ---"Txn call completed" 566ms (10:27:45.811)] Trace[1519183293]: [567.975766ms] [567.975766ms] END I0330 10:27:46.240148 1 trace.go:236] Trace[1959886079]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b07e750d-7e9a-4429-beeb-c9da42f7076c,client:199.19.213.124,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-t6pt7,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (30-Mar-2026 10:27:45.678) (total time: 561ms): Trace[1959886079]: ---"About to write a response" 561ms (10:27:46.239) Trace[1959886079]: [561.932574ms] [561.932574ms] END I0330 10:27:46.240176 1 trace.go:236] Trace[1534785070]: "Get" accept:application/json, */*,audit-id:448d1384-b4fe-4eb8-9138-264a839264ce,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:27:45.645) (total time: 594ms): Trace[1534785070]: ---"About to write a response" 594ms (10:27:46.239) Trace[1534785070]: [594.640018ms] [594.640018ms] END I0330 10:27:46.240265 1 trace.go:236] Trace[131047882]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:122a2ad3-26cc-42d9-a965-e1d05f5bb60f,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:27:45.306) (total time: 933ms): Trace[131047882]: ---"About to write a response" 933ms (10:27:46.240) Trace[131047882]: [933.45086ms] [933.45086ms] END I0330 10:27:46.240282 1 trace.go:236] Trace[1134315319]: "Get" accept:application/json, */*,audit-id:29eff146-5be4-4f62-8843-0bf35374ad4d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:27:45.642) (total time: 597ms): Trace[1134315319]: ---"About to write a response" 597ms (10:27:46.240) Trace[1134315319]: [597.883919ms] [597.883919ms] END I0330 10:27:46.273795 1 trace.go:236] Trace[644939358]: "Update" accept:application/json, */*,audit-id:de7b053c-7f77-4a37-9ebb-213cda04d768,client:199.19.213.124,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (30-Mar-2026 10:27:45.215) (total time: 1057ms): Trace[644939358]: ---"Conversion done" 20ms (10:27:45.239) Trace[644939358]: ["GuaranteedUpdate etcd3" audit-id:de7b053c-7f77-4a37-9ebb-213cda04d768,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 1033ms (10:27:45.240) Trace[644939358]: ---"Txn call completed" 994ms (10:27:46.239)] Trace[644939358]: ---"Writing http response done" 33ms (10:27:46.273) Trace[644939358]: [1.057778108s] [1.057778108s] END I0330 10:27:46.983889 1 trace.go:236] Trace[417136157]: "Create" accept:application/json,audit-id:64a6c3ec-f0d0-42a7-9b10-ebdc0b293f05,client:199.19.213.124,protocol:HTTP/2.0,resource:mutatingwebhookconfigurations,scope:resource,url:/apis/admissionregistration.k8s.io/v1/mutatingwebhookconfigurations,user-agent:Helm/3.11.2,verb:POST (30-Mar-2026 10:27:46.293) (total time: 690ms): Trace[417136157]: ["Create etcd3" audit-id:64a6c3ec-f0d0-42a7-9b10-ebdc0b293f05,key:/mutatingwebhookconfigurations/envoy-gateway-topology-injector.envoy-gateway-system,type:*admissionregistration.MutatingWebhookConfiguration,resource:mutatingwebhookconfigurations.admissionregistration.k8s.io 687ms (10:27:46.296) Trace[417136157]: ---"Txn call succeeded" 687ms (10:27:46.983)] Trace[417136157]: [690.707336ms] [690.707336ms] END I0330 10:27:47.460651 1 controller.go:624] quota admission added evaluator for: jobs.batch I0330 10:27:48.319531 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0330 10:27:48.326062 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0330 10:27:48.518026 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0330 10:27:48.732247 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0330 10:27:48.917788 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0330 10:27:49.119153 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0330 10:27:49.329242 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0330 10:27:50.624619 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0330 10:27:51.348234 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0330 10:27:52.132136 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0330 10:27:52.314334 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0330 10:27:58.040165 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0330 10:27:58.040219 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0330 10:27:58.466980 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0330 10:28:06.879830 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.104.218.62"} W0330 10:28:06.915426 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.218.62:9443: connect: connection refused E0330 10:28:06.915474 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.218.62:9443: connect: connection refused I0330 10:28:19.162491 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0330 10:28:19.184010 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0330 10:28:19.225544 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0330 10:28:19.243910 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.98.199.150"} I0330 10:28:19.274570 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.103.206.17"} I0330 10:28:19.277155 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0330 10:28:19.337073 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0330 10:28:19.470604 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0330 10:28:30.955005 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0330 10:28:36.704393 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0330 10:28:51.148527 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.106.90.104"} I0330 10:28:51.156808 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.105.143.4"} I0330 10:28:51.164550 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.99.140.135"} I0330 10:28:51.174226 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.103.93.76"} I0330 10:28:57.213247 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.229799 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.254085 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.272174 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.289527 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.309917 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.361127 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.383123 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.407984 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.424103 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0330 10:28:57.449294 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.480988 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:57.495248 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:28:58.933725 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0330 10:29:02.433599 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0330 10:29:02.439998 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0330 10:29:02.490219 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.100.32.173"} I0330 10:29:02.517497 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0330 10:29:04.767066 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0330 10:29:04.802363 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0330 10:29:05.432335 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0330 10:29:05.432435 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0330 10:29:05.432524 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0330 10:29:11.878419 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0330 10:29:15.221434 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.111.133.254"} I0330 10:29:15.496503 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0330 10:29:15.646785 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.102.160.231"} I0330 10:29:15.664684 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.103.89.124"} I0330 10:29:18.134927 1 trace.go:236] Trace[1524843328]: "Get" accept:application/json, */*,audit-id:11012e79-3349-4bcb-879b-397b2788f059,client:10.0.0.216,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-bc5d1179-a275-4a96-be10-9fd6c324d85e,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:29:17.600) (total time: 534ms): Trace[1524843328]: ---"About to write a response" 534ms (10:29:18.134) Trace[1524843328]: [534.720574ms] [534.720574ms] END I0330 10:30:35.666943 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.103.14.122"} I0330 10:30:38.166057 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.106.142.105"} I0330 10:30:38.173271 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.104.243.227"} I0330 10:30:45.144926 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.98.186.86"} I0330 10:30:45.152148 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.105.220.159"} I0330 10:33:14.939369 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0330 10:33:18.890711 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0330 10:33:18.926225 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0330 10:33:22.995556 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0330 10:33:23.007591 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0330 10:33:23.024166 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0330 10:33:23.040294 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0330 10:33:23.074794 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0330 10:33:23.083673 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0330 10:33:23.096123 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0330 10:33:24.992991 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0330 10:33:42.238216 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0330 10:34:21.144601 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0330 10:34:35.438884 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0330 10:34:35.571132 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:35.605700 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:35.611860 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:35.873698 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0330 10:34:36.084491 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:36.105400 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:36.220935 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0330 10:34:36.250324 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:34:36.342227 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0330 10:35:15.056114 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.107.86.23"} I0330 10:35:15.066261 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.108.215.159"} I0330 10:35:15.074272 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.98.68.176"} I0330 10:35:15.083778 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.101.159.235"} I0330 10:35:15.091526 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.110.117.132"} I0330 10:35:15.099175 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.100.175.173"} I0330 10:35:15.138108 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0330 10:35:15.153113 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0330 10:35:15.196075 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0330 10:35:15.208292 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0330 10:35:15.230401 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0330 10:35:15.245297 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.245406 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.245486 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.245518 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.245700 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.245734 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.245751 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.245768 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.245792 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.245825 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.246015 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.246042 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.246263 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.246290 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.247368 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.247408 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.247775 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.247801 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.247809 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.247838 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.248053 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.248097 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.248457 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.248489 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.248491 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.248537 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.249649 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.249653 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.249674 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.249679 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused W0330 10:35:15.250240 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused E0330 10:35:15.250320 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.68.176:443: connect: connection refused I0330 10:35:25.823582 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.110.26.134"} I0330 10:35:25.844839 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.105.39.56"} I0330 10:35:30.801144 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.99.103.44"} I0330 10:35:33.555455 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.105.172.53"} I0330 10:35:38.061152 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.110.27.27"} I0330 10:35:38.965695 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.100.212.176"} I0330 10:35:45.551912 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0330 10:35:45.708520 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.108.201.210"} I0330 10:36:26.280765 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.102.26.234"} I0330 10:36:26.294381 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0330 10:37:38.907439 1 trace.go:236] Trace[374796574]: "Update" accept:application/json, */*,audit-id:f99b331d-ada7-4e06-ae6a-f9c5dd0fcf2c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (30-Mar-2026 10:37:37.967) (total time: 940ms): Trace[374796574]: ["GuaranteedUpdate etcd3" audit-id:f99b331d-ada7-4e06-ae6a-f9c5dd0fcf2c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 939ms (10:37:37.967) Trace[374796574]: ---"Txn call completed" 939ms (10:37:38.907)] Trace[374796574]: [940.117128ms] [940.117128ms] END I0330 10:37:38.907914 1 trace.go:236] Trace[459673730]: "Update" accept:application/json, */*,audit-id:7445c984-f302-4e16-ba79-67a105ead41d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (30-Mar-2026 10:37:37.967) (total time: 940ms): Trace[459673730]: ["GuaranteedUpdate etcd3" audit-id:7445c984-f302-4e16-ba79-67a105ead41d,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 940ms (10:37:37.967) Trace[459673730]: ---"Txn call completed" 939ms (10:37:38.907)] Trace[459673730]: [940.633879ms] [940.633879ms] END I0330 10:37:38.910362 1 trace.go:236] Trace[1307164270]: "Get" accept:application/json, */*,audit-id:19aff5ae-9973-4190-b988-37006af0f55a,client:10.0.0.92,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/keystone-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:37:37.989) (total time: 920ms): Trace[1307164270]: ---"About to write a response" 920ms (10:37:38.910) Trace[1307164270]: [920.611461ms] [920.611461ms] END I0330 10:37:38.910840 1 trace.go:236] Trace[888423666]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3b0c4a78-6c42-478b-bcfc-93217e2901e6,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:37:38.316) (total time: 594ms): Trace[888423666]: ---"About to write a response" 594ms (10:37:38.910) Trace[888423666]: [594.643997ms] [594.643997ms] END I0330 10:38:04.217454 1 trace.go:236] Trace[2074296485]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:488922b0-769d-4b77-8543-3939bda253e7,client:10.0.0.64,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:03.678) (total time: 538ms): Trace[2074296485]: ["GuaranteedUpdate etcd3" audit-id:488922b0-769d-4b77-8543-3939bda253e7,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 538ms (10:38:03.679) Trace[2074296485]: ---"Txn call completed" 537ms (10:38:04.217)] Trace[2074296485]: [538.446329ms] [538.446329ms] END E0330 10:38:14.006914 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:14.006940 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 24.021µs, panicked: false, err: context canceled, panic-reason: E0330 10:38:14.006960 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:14.008139 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:14.008221 1 trace.go:236] Trace[2030789254]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d0fa9eae-02eb-450b-bede-bb84038036b5,client:10.0.0.134,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:09.006) (total time: 5001ms): Trace[2030789254]: ["GuaranteedUpdate etcd3" audit-id:d0fa9eae-02eb-450b-bede-bb84038036b5,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (10:38:09.006) Trace[2030789254]: ---"Txn call failed" err:context canceled 4998ms (10:38:14.006)] Trace[2030789254]: [5.001496187s] [5.001496187s] END E0330 10:38:14.008387 1 timeout.go:142] post-timeout activity - time-elapsed: 1.63226ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0330 10:38:14.064500 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:14.064594 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:14.066609 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:14.066665 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:14.067910 1 trace.go:236] Trace[497615015]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8fe6ae19-696e-4e2b-b12e-cf282f8f379e,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:38:09.064) (total time: 5003ms): Trace[497615015]: [5.003050774s] [5.003050774s] END E0330 10:38:14.068062 1 timeout.go:142] post-timeout activity - time-elapsed: 3.597808ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0330 10:38:14.268487 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.87µs, panicked: false, err: context deadline exceeded, panic-reason: E0330 10:38:14.268597 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:14.269815 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:14.269892 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:14.271306 1 trace.go:236] Trace[975876042]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:29ced6f6-00dd-47e3-a28d-420483f73d0c,client:10.0.0.237,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:09.268) (total time: 5002ms): Trace[975876042]: ["GuaranteedUpdate etcd3" audit-id:29ced6f6-00dd-47e3-a28d-420483f73d0c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (10:38:09.268) Trace[975876042]: ---"Txn call failed" err:context deadline exceeded 4999ms (10:38:14.268)] Trace[975876042]: [5.002998694s] [5.002998694s] END E0330 10:38:14.271559 1 timeout.go:142] post-timeout activity - time-elapsed: 3.213412ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0330 10:38:14.582593 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:14.582624 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.091µs, panicked: false, err: context deadline exceeded, panic-reason: E0330 10:38:14.582642 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:14.584047 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:14.584133 1 trace.go:236] Trace[396736946]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:38d8fc63-b859-46ac-a673-79483901ffb1,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:09.582) (total time: 5001ms): Trace[396736946]: ["GuaranteedUpdate etcd3" audit-id:38d8fc63-b859-46ac-a673-79483901ffb1,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (10:38:09.582) Trace[396736946]: ---"Txn call failed" err:context deadline exceeded 4998ms (10:38:14.582)] Trace[396736946]: [5.00171112s] [5.00171112s] END E0330 10:38:14.584274 1 timeout.go:142] post-timeout activity - time-elapsed: 1.712052ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0330 10:38:15.241149 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:15.241189 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:15.241217 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.31µs, panicked: false, err: context deadline exceeded, panic-reason: E0330 10:38:15.242787 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:15.242961 1 trace.go:236] Trace[1978522186]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bf7e6a0e-1249-4bb2-ae0c-7ed9311a99e7,client:10.0.0.64,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:10.241) (total time: 5001ms): Trace[1978522186]: ["GuaranteedUpdate etcd3" audit-id:bf7e6a0e-1249-4bb2-ae0c-7ed9311a99e7,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (10:38:10.241) Trace[1978522186]: ---"Txn call failed" err:context deadline exceeded 4998ms (10:38:15.241)] Trace[1978522186]: [5.001327252s] [5.001327252s] END E0330 10:38:15.243210 1 timeout.go:142] post-timeout activity - time-elapsed: 2.005369ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0330 10:38:15.252928 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0330 10:38:15.253016 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:15.254043 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:15.254110 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:15.255186 1 trace.go:236] Trace[1480365645]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:29ab4117-2677-4397-b7a4-35013ad64b22,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:38:10.253) (total time: 5002ms): Trace[1480365645]: [5.002026764s] [5.002026764s] END E0330 10:38:15.255360 1 timeout.go:142] post-timeout activity - time-elapsed: 2.225562ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0330 10:38:15.266219 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded I0330 10:38:15.266352 1 trace.go:236] Trace[2138046648]: "Get" accept:application/json, */*,audit-id:3d6855d6-8066-46d2-9d6f-1523d5294edf,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:10.266) (total time: 4999ms): Trace[2138046648]: [4.999702252s] [4.999702252s] END E0330 10:38:15.266460 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock?timeout=5s" audit-ID="3d6855d6-8066-46d2-9d6f-1523d5294edf" E0330 10:38:15.266542 1 timeout.go:142] post-timeout activity - time-elapsed: 5.881µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0330 10:38:16.055218 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:16.055393 1 trace.go:236] Trace[1508448309]: "Get" accept:application/json, */*,audit-id:f25d6845-12b5-482a-924f-246f74fee183,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:09.053) (total time: 7002ms): Trace[1508448309]: [7.002219734s] [7.002219734s] END E0330 10:38:16.696193 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:16.696493 1 trace.go:236] Trace[2033315139]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:caa3b72f-4aa9-4222-b931-884b763de514,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:38:09.693) (total time: 7002ms): Trace[2033315139]: ["GuaranteedUpdate etcd3" audit-id:caa3b72f-4aa9-4222-b931-884b763de514,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (10:38:09.693) Trace[2033315139]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (10:38:16.696)] Trace[2033315139]: [7.002832505s] [7.002832505s] END E0330 10:38:19.006772 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.006870 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.007949 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.008009 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.009078 1 trace.go:236] Trace[575909682]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4663127f-00de-4ec5-b86b-170b23aead93,client:10.0.0.134,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:14.008) (total time: 5000ms): Trace[575909682]: [5.000853512s] [5.000853512s] END E0330 10:38:19.009228 1 timeout.go:142] post-timeout activity - time-elapsed: 2.468316ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0330 10:38:19.053071 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.053169 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.054236 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.054287 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.055361 1 trace.go:236] Trace[91200558]: "Get" accept:application/json, */*,audit-id:95c385e5-f7bb-4c68-8773-cccd45bd3e17,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:18.058) (total time: 996ms): Trace[91200558]: [996.710395ms] [996.710395ms] END E0330 10:38:19.055535 1 timeout.go:142] post-timeout activity - time-elapsed: 2.471886ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0330 10:38:19.064579 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.064644 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.065945 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.065993 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.067076 1 trace.go:236] Trace[174691720]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bf29bfe1-d068-40da-9ac1-fda46a18ab59,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:38:16.066) (total time: 3000ms): Trace[174691720]: [3.000758587s] [3.000758587s] END E0330 10:38:19.067227 1 timeout.go:142] post-timeout activity - time-elapsed: 2.590419ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0330 10:38:19.069235 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.069315 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.070432 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.070479 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.071578 1 trace.go:236] Trace[902866474]: "Get" accept:application/json, */*,audit-id:740b4b0c-0bf4-481e-bacc-b0e143dbe2b3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:09.069) (total time: 10001ms): Trace[902866474]: [10.001767618s] [10.001767618s] END E0330 10:38:19.071697 1 timeout.go:142] post-timeout activity - time-elapsed: 2.524018ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0330 10:38:19.267942 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.268055 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.269016 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.269233 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.270379 1 trace.go:236] Trace[1835860131]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9dacf46d-2554-452d-be7b-2f811577c0b4,client:10.0.0.237,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:14.270) (total time: 5000ms): Trace[1835860131]: [5.000011207s] [5.000011207s] END E0330 10:38:19.270628 1 timeout.go:142] post-timeout activity - time-elapsed: 2.700371ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0330 10:38:19.581786 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.581902 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.583032 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.583073 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.584216 1 trace.go:236] Trace[450021015]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:80f26091-345a-4b52-94ce-fb86e66efb7c,client:10.0.0.175,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:14.583) (total time: 5000ms): Trace[450021015]: [5.000422135s] [5.000422135s] END E0330 10:38:19.584404 1 timeout.go:142] post-timeout activity - time-elapsed: 2.63104ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0330 10:38:19.602305 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:19.602418 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:19.604181 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:19.604289 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:19.605496 1 trace.go:236] Trace[1682544491]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:99bbcefb-39a3-46f6-a0b3-f9fb83cb4b46,client:10.0.0.175,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:12.599) (total time: 7005ms): Trace[1682544491]: [7.005939205s] [7.005939205s] END E0330 10:38:19.605691 1 timeout.go:142] post-timeout activity - time-elapsed: 3.503945ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0330 10:38:20.205791 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:20.206042 1 trace.go:236] Trace[999167556]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5ef071dc-cde4-48ae-85f4-988b3d9b47bf,client:199.19.213.124,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (30-Mar-2026 10:38:13.203) (total time: 7002ms): Trace[999167556]: ["Create etcd3" audit-id:5ef071dc-cde4-48ae-85f4-988b3d9b47bf,key:/events/kube-system/kube-apiserver-instance.18a19837b5d0ae99,type:*core.Event,resource:events 7002ms (10:38:13.203)] Trace[999167556]: [7.002983857s] [7.002983857s] END E0330 10:38:20.241265 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:20.241472 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:20.242424 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:20.243599 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:20.243665 1 trace.go:236] Trace[834744738]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:27669f6d-afbe-41b1-8874-d9235393b908,client:10.0.0.64,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:15.242) (total time: 5001ms): Trace[834744738]: [5.001152769s] [5.001152769s] END E0330 10:38:20.243858 1 timeout.go:142] post-timeout activity - time-elapsed: 2.557049ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0330 10:38:20.253583 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:20.253667 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:20.254820 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:20.254865 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:20.255969 1 trace.go:236] Trace[974433406]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a75efc27-a959-4a9f-9a4f-2f50beafd91e,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (30-Mar-2026 10:38:17.254) (total time: 3001ms): Trace[974433406]: [3.001089723s] [3.001089723s] END E0330 10:38:20.256110 1 timeout.go:142] post-timeout activity - time-elapsed: 2.532788ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0330 10:38:20.266193 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0330 10:38:20.266284 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:20.267372 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:20.267445 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:20.268587 1 trace.go:236] Trace[1147657948]: "Get" accept:application/json, */*,audit-id:f2df0146-5280-4f12-aac9-d812eb5452a9,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:17.268) (total time: 3000ms): Trace[1147657948]: [3.000358479s] [3.000358479s] END E0330 10:38:20.268750 1 timeout.go:142] post-timeout activity - time-elapsed: 2.553729ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0330 10:38:20.537327 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:20.537531 1 trace.go:236] Trace[2083571013]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0bda772f-423d-4bcd-88a9-d10cbdeaf0bc,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (30-Mar-2026 10:38:13.534) (total time: 7003ms): Trace[2083571013]: ["GuaranteedUpdate etcd3" audit-id:0bda772f-423d-4bcd-88a9-d10cbdeaf0bc,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (10:38:13.534) Trace[2083571013]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (10:38:20.537)] Trace[2083571013]: [7.003214543s] [7.003214543s] END E0330 10:38:22.824907 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:22.825076 1 trace.go:236] Trace[1043527335]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:65ea4848-46fd-4130-a3f3-b0049bca9178,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:38:15.822) (total time: 7002ms): Trace[1043527335]: ["GuaranteedUpdate etcd3" audit-id:65ea4848-46fd-4130-a3f3-b0049bca9178,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (10:38:15.822) Trace[1043527335]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (10:38:22.824)] Trace[1043527335]: [7.002382856s] [7.002382856s] END E0330 10:38:22.825693 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0330 10:38:23.056325 1 trace.go:236] Trace[1348501771]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.124,type:*v1.Endpoints,resource:apiServerIPInfo (30-Mar-2026 10:38:13.056) (total time: 10000ms): Trace[1348501771]: [10.000235289s] [10.000235289s] END E0330 10:38:23.056379 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0330 10:38:23.056424 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0330 10:38:23.056347 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0330 10:38:23.056872 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0330 10:38:23.057511 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:23.057644 1 trace.go:236] Trace[729475527]: "Get" accept:application/json, */*,audit-id:6d5f3df3-3a7f-48b4-ba23-573a8baba067,client:10.0.0.92,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/keystone-api,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:10.983) (total time: 12073ms): Trace[729475527]: [12.073653367s] [12.073653367s] END I0330 10:38:23.057644 1 trace.go:236] Trace[860632084]: "Get" accept:application/json, */*,audit-id:8496a1eb-eb1f-49c1-90f0-7b66a39b6eb8,client:10.0.0.125,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (30-Mar-2026 10:38:10.424) (total time: 12633ms): Trace[860632084]: [12.633528399s] [12.633528399s] END I0330 10:38:23.057879 1 trace.go:236] Trace[489162809]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:39f5712f-2cfc-49f7-accc-f2e343217c58,client:199.19.213.124,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/storage-loki-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (30-Mar-2026 10:38:11.626) (total time: 11431ms): Trace[489162809]: [11.431756749s] [11.431756749s] END E0330 10:38:23.057948 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:23.058107 1 trace.go:236] Trace[757598734]: "Get" accept:application/json, */*,audit-id:826817e6-789e-4092-961c-8fe76c04b847,client:199.19.213.124,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-bzkx7,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (30-Mar-2026 10:38:10.273) (total time: 12784ms): Trace[757598734]: [12.784484545s] [12.784484545s] END I0330 10:38:23.058682 1 trace.go:236] Trace[2129012381]: "Get" accept:application/json, */*,audit-id:5ee5a5f8-2103-48aa-bd52-3dbebde12f11,client:10.0.0.18,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (30-Mar-2026 10:38:09.399) (total time: 13659ms): Trace[2129012381]: [13.659194161s] [13.659194161s] END E0330 10:38:23.700841 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0330 10:38:23.701019 1 trace.go:236] Trace[1079684544]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:76ead0af-a842-4324-8042-fef0ac8e7ed0,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:38:16.698) (total time: 7002ms): Trace[1079684544]: ["GuaranteedUpdate etcd3" audit-id:76ead0af-a842-4324-8042-fef0ac8e7ed0,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (10:38:16.698) Trace[1079684544]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (10:38:23.700)] Trace[1079684544]: [7.002466878s] [7.002466878s] END E0330 10:38:24.065665 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0330 10:38:24.065730 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0330 10:38:24.065756 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 12.93µs, panicked: false, err: context deadline exceeded, panic-reason: E0330 10:38:24.067020 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0330 10:38:24.067218 1 trace.go:236] Trace[503442221]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:44dd4bd3-d68b-45a8-829d-c819e3c89105,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (30-Mar-2026 10:38:19.065) (total time: 5001ms): Trace[503442221]: ["GuaranteedUpdate etcd3" audit-id:44dd4bd3-d68b-45a8-829d-c819e3c89105,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (10:38:19.066) Trace[503442221]: ---"Txn call failed" err:context deadline exceeded 4998ms (10:38:24.065)] Trace[503442221]: [5.00120535s] [5.00120535s] END E0330 10:38:24.067481 1 timeout.go:142] post-timeout activity - time-elapsed: 1.844594ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0330 10:38:24.588331 1 trace.go:236] Trace[309321672]: "Update" accept:application/json, */*,audit-id:da953d15-8aa6-4d14-adad-535869035786,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (30-Mar-2026 10:38:19.054) (total time: 5534ms): Trace[309321672]: ["GuaranteedUpdate etcd3" audit-id:da953d15-8aa6-4d14-adad-535869035786,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5533ms (10:38:19.054) Trace[309321672]: ---"Txn call completed" 5532ms (10:38:24.588)] Trace[309321672]: [5.534125273s] [5.534125273s] END I0330 10:38:24.591006 1 trace.go:236] Trace[838309157]: "Create" accept:application/json, */*,audit-id:24a603ab-8ee6-4199-b6c9-dbcd957d31ec,client:10.0.0.237,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (30-Mar-2026 10:38:19.270) (total time: 5320ms): Trace[838309157]: ["Create etcd3" audit-id:24a603ab-8ee6-4199-b6c9-dbcd957d31ec,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18a198391f640df8,type:*core.Event,resource:events 5319ms (10:38:19.271) Trace[838309157]: ---"TransformToStorage succeeded" 5316ms (10:38:24.587)] Trace[838309157]: [5.320664841s] [5.320664841s] END I0330 10:38:24.591234 1 trace.go:236] Trace[857683983]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:efff387b-5d8c-46b0-93c8-becaa0968986,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (30-Mar-2026 10:38:20.539) (total time: 4051ms): Trace[857683983]: ---"About to write a response" 4051ms (10:38:24.591) Trace[857683983]: [4.051984229s] [4.051984229s] END I0330 10:38:24.591248 1 trace.go:236] Trace[2118354293]: "Update" accept:application/json, */*,audit-id:bb5b160a-1d8f-4ed7-a38c-9c9c50320c57,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (30-Mar-2026 10:38:19.069) (total time: 5521ms): Trace[2118354293]: ["GuaranteedUpdate etcd3" audit-id:bb5b160a-1d8f-4ed7-a38c-9c9c50320c57,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5521ms (10:38:19.070) Trace[2118354293]: ---"Txn call completed" 5520ms (10:38:24.591)] Trace[2118354293]: [5.521352753s] [5.521352753s] END I0330 10:38:24.591474 1 trace.go:236] Trace[948899030]: "Update" accept:application/json, */*,audit-id:29b9eb4c-6224-4d29-a785-8231361a54ba,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (30-Mar-2026 10:38:20.267) (total time: 4324ms): Trace[948899030]: ["GuaranteedUpdate etcd3" audit-id:29b9eb4c-6224-4d29-a785-8231361a54ba,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 4324ms (10:38:20.267) Trace[948899030]: ---"Txn call completed" 4323ms (10:38:24.591)] Trace[948899030]: [4.324303712s] [4.324303712s] END I0330 10:38:24.591671 1 trace.go:236] Trace[561109642]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a050501e-f762-4197-81be-ca97e4282613,client:199.19.213.124,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (30-Mar-2026 10:38:21.219) (total time: 3372ms): Trace[561109642]: ---"About to write a response" 3372ms (10:38:24.591) Trace[561109642]: [3.372550803s] [3.372550803s] END I0330 10:38:24.591999 1 trace.go:236] Trace[1255098085]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f616b9c1-5d27-4656-870e-80c324f2fa95,client:199.19.213.124,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:38:23.702) (total time: 889ms): Trace[1255098085]: ["GuaranteedUpdate etcd3" audit-id:f616b9c1-5d27-4656-870e-80c324f2fa95,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 889ms (10:38:23.702) Trace[1255098085]: ---"Txn call completed" 888ms (10:38:24.591)] Trace[1255098085]: [889.651339ms] [889.651339ms] END I0330 10:38:24.592456 1 trace.go:236] Trace[832419474]: "List" accept:application/json, */*,audit-id:dbe51c03-d7c8-416d-9904-2d3e87870ad3,client:10.0.0.88,protocol:HTTP/2.0,resource:nodes,scope:cluster,url:/api/v1/nodes,user-agent:PrometheusOperator/0.74.0,verb:LIST (30-Mar-2026 10:38:20.537) (total time: 4054ms): Trace[832419474]: ["List(recursive=true) etcd3" audit-id:dbe51c03-d7c8-416d-9904-2d3e87870ad3,key:/minions,resourceVersion:,resourceVersionMatch:,limit:0,continue: 4054ms (10:38:20.537)] Trace[832419474]: [4.054599789s] [4.054599789s] END I0330 10:38:24.593041 1 trace.go:236] Trace[466777285]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a26c3aee-dc03-45f6-be41-445566520566,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:38:22.826) (total time: 1766ms): Trace[466777285]: ["GuaranteedUpdate etcd3" audit-id:a26c3aee-dc03-45f6-be41-445566520566,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1766ms (10:38:22.826) Trace[466777285]: ---"Txn call completed" 1763ms (10:38:24.591)] Trace[466777285]: [1.766397852s] [1.766397852s] END E0330 10:38:24.593939 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0330 10:38:24.597459 1 trace.go:236] Trace[1030309847]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:63e4a67c-8713-471c-8c6f-5c01fb62089b,client:199.19.213.124,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (30-Mar-2026 10:38:20.207) (total time: 4389ms): Trace[1030309847]: ["Create etcd3" audit-id:63e4a67c-8713-471c-8c6f-5c01fb62089b,key:/events/kube-system/kube-apiserver-instance.18a19837d3ac77d2,type:*core.Event,resource:events 4388ms (10:38:20.208) Trace[1030309847]: ---"TransformToStorage succeeded" 4379ms (10:38:24.588)] Trace[1030309847]: [4.38944607s] [4.38944607s] END I0330 10:38:24.604908 1 trace.go:236] Trace[1140732190]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.124,type:*v1.Endpoints,resource:apiServerIPInfo (30-Mar-2026 10:38:23.056) (total time: 1548ms): Trace[1140732190]: ---"initial value restored" 1534ms (10:38:24.590) Trace[1140732190]: [1.548461574s] [1.548461574s] END I0330 10:39:59.978493 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.96.206.98"} I0330 10:40:33.335516 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.96.60.35"} I0330 10:42:26.104260 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0330 10:42:26.117682 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.126036 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0330 10:42:26.147878 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.148141 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.149286 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.171444 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.178568 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.195971 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.217787 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.228749 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.234839 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.243581 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.262036 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.319728 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.339886 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.377115 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.424854 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:42:26.513617 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0330 10:43:07.295126 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0330 10:43:07.306076 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0330 10:43:12.663563 1 trace.go:236] Trace[491388743]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:874dafba-c28c-49c2-b14e-d78a6728722e,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (30-Mar-2026 10:43:12.003) (total time: 659ms): Trace[491388743]: ["GuaranteedUpdate etcd3" audit-id:874dafba-c28c-49c2-b14e-d78a6728722e,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 659ms (10:43:12.003) Trace[491388743]: ---"Txn call completed" 658ms (10:43:12.663)] Trace[491388743]: [659.88085ms] [659.88085ms] END I0330 10:43:25.581118 1 trace.go:236] Trace[750974506]: "Update" accept:application/json, */*,audit-id:81f7036e-4f71-4b7b-941f-0a7f3e407196,client:10.0.0.159,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (30-Mar-2026 10:43:25.011) (total time: 569ms): Trace[750974506]: ---"Conversion done" 37ms (10:43:25.050) Trace[750974506]: ---"Writing http response done" 25ms (10:43:25.581) Trace[750974506]: [569.397338ms] [569.397338ms] END I0330 10:43:40.957299 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.104.19.155"} I0330 10:43:42.157651 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.98.59.218"} I0330 10:44:10.942669 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.103.140.45"} E0330 10:44:41.892528 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc0381d51a0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc0323c3cc0), ResponseWriter:(*httpsnoop.rw)(0xc0323c3cc0), Flusher:(*httpsnoop.rw)(0xc0323c3cc0), CloseNotifier:(*httpsnoop.rw)(0xc0323c3cc0), Pusher:(*httpsnoop.rw)(0xc0323c3cc0)}}, encoder:(*versioning.codec)(0xc02c8eb720), memAllocator:(*runtime.Allocator)(0xc0057069c0)}) I0330 10:47:19.758374 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.103.138.237"}