I0407 09:42:44.285921 1 options.go:220] external host was not specified, using 199.204.45.210 I0407 09:42:44.286795 1 server.go:148] Version: v1.28.13 I0407 09:42:44.286847 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0407 09:42:45.198856 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0407 09:42:45.219527 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0407 09:42:45.219570 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0407 09:42:45.219891 1 instance.go:298] Using reconciler: lease I0407 09:42:45.268365 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0407 09:42:45.268395 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0407 09:42:45.540904 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0407 09:42:45.541315 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0407 09:42:45.983972 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0407 09:42:46.006269 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0407 09:42:46.006305 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.006312 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.006705 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0407 09:42:46.006720 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0407 09:42:46.007541 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0407 09:42:46.008151 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0407 09:42:46.008167 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0407 09:42:46.008171 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0407 09:42:46.009417 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0407 09:42:46.009433 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0407 09:42:46.010186 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0407 09:42:46.010202 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.010206 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.010726 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0407 09:42:46.010742 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.010774 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0407 09:42:46.011300 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0407 09:42:46.012721 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0407 09:42:46.012738 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.012742 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.013192 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0407 09:42:46.013207 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.013211 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.014107 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0407 09:42:46.014124 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0407 09:42:46.015914 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0407 09:42:46.015929 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.015934 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.016360 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0407 09:42:46.016376 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.016381 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.018191 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0407 09:42:46.018206 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.018210 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.019768 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0407 09:42:46.020703 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0407 09:42:46.020718 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.020723 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.023887 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0407 09:42:46.023905 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0407 09:42:46.023909 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0407 09:42:46.024889 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0407 09:42:46.024906 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0407 09:42:46.024911 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0407 09:42:46.025575 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0407 09:42:46.025594 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0407 09:42:46.071712 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0407 09:42:46.071756 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0407 09:42:46.509418 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:42:46.509445 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:42:46.509741 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0407 09:42:46.509843 1 secure_serving.go:213] Serving securely on [::]:6443 I0407 09:42:46.509880 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0407 09:42:46.510095 1 aggregator.go:164] waiting for initial CRD sync... I0407 09:42:46.510200 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0407 09:42:46.510220 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0407 09:42:46.510255 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:42:46.510256 1 controller.go:78] Starting OpenAPI AggregationController I0407 09:42:46.510612 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0407 09:42:46.510736 1 system_namespaces_controller.go:67] Starting system namespaces controller I0407 09:42:46.511029 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:42:46.511087 1 available_controller.go:423] Starting AvailableConditionController I0407 09:42:46.511102 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0407 09:42:46.511255 1 controller.go:80] Starting OpenAPI V3 AggregationController I0407 09:42:46.519361 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0407 09:42:46.519465 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0407 09:42:46.520010 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0407 09:42:46.520313 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0407 09:42:46.521049 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0407 09:42:46.521167 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0407 09:42:46.521439 1 controller.go:116] Starting legacy_token_tracking_controller I0407 09:42:46.521571 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0407 09:42:46.521741 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:42:46.521950 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:42:46.523003 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0407 09:42:46.523453 1 controller.go:134] Starting OpenAPI controller I0407 09:42:46.523563 1 controller.go:85] Starting OpenAPI V3 controller I0407 09:42:46.523634 1 naming_controller.go:291] Starting NamingConditionController I0407 09:42:46.523869 1 establishing_controller.go:76] Starting EstablishingController I0407 09:42:46.523928 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0407 09:42:46.523975 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0407 09:42:46.524029 1 crd_finalizer.go:266] Starting CRDFinalizer E0407 09:42:46.592282 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0407 09:42:46.599899 1 shared_informer.go:318] Caches are synced for node_authorizer I0407 09:42:46.610639 1 shared_informer.go:318] Caches are synced for crd-autoregister I0407 09:42:46.610689 1 aggregator.go:166] initial CRD sync complete... I0407 09:42:46.610703 1 autoregister_controller.go:141] Starting autoregister controller I0407 09:42:46.610716 1 cache.go:32] Waiting for caches to sync for autoregister controller I0407 09:42:46.610735 1 cache.go:39] Caches are synced for autoregister controller I0407 09:42:46.610761 1 apf_controller.go:379] Running API Priority and Fairness config worker I0407 09:42:46.610785 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0407 09:42:46.611152 1 cache.go:39] Caches are synced for AvailableConditionController controller I0407 09:42:46.613475 1 controller.go:624] quota admission added evaluator for: namespaces I0407 09:42:46.620210 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0407 09:42:46.621295 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0407 09:42:46.622424 1 shared_informer.go:318] Caches are synced for configmaps I0407 09:42:46.797773 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0407 09:42:47.516920 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0407 09:42:47.522399 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0407 09:42:47.522452 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0407 09:42:48.126597 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0407 09:42:48.174809 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0407 09:42:48.856474 1 trace.go:236] Trace[1230577649]: "GuaranteedUpdate etcd3" audit-id:,key:/ranges/serviceips,type:*core.RangeAllocation,resource:serviceipallocations (07-Apr-2026 09:42:48.319) (total time: 536ms): Trace[1230577649]: ---"initial value restored" 400ms (09:42:48.720) Trace[1230577649]: ---"Txn call completed" 135ms (09:42:48.856) Trace[1230577649]: [536.558488ms] [536.558488ms] END I0407 09:42:49.082403 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} I0407 09:42:49.083098 1 trace.go:236] Trace[535261843]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:68b47339-abf0-4b97-be2c-02e1aa7e8deb,client:::1,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/default/services,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (07-Apr-2026 09:42:48.318) (total time: 764ms): Trace[535261843]: [764.519679ms] [764.519679ms] END W0407 09:42:49.097905 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.210] I0407 09:42:49.099089 1 controller.go:624] quota admission added evaluator for: endpoints I0407 09:42:49.105978 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0407 09:42:50.568694 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0407 09:42:50.578176 1 controller.go:624] quota admission added evaluator for: deployments.apps I0407 09:42:50.616023 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0407 09:42:50.817853 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0407 09:42:56.086245 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0407 09:42:56.137134 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0407 09:43:17.571047 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:43:17.587769 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:43:17.606013 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:43:17.621908 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:43:17.621962 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:43:17.639542 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:43:17.639613 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:43:17.687658 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:43:17.687758 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:43:17.708298 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:43:17.726125 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:43:17.763515 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:43:17.833774 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:43:17.833858 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:43:17.868462 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:43:17.980899 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:18.094170 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:18.245987 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:43:18.246055 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:43:18.283810 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:18.322893 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:18.336848 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:19.026520 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:19.040806 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:19.140978 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:43:24.752344 1 controller.go:624] quota admission added evaluator for: jobs.batch I0407 09:43:26.560158 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:43:26.569019 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:43:26.578749 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:43:26.587088 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:43:26.596114 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:43:26.794400 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:43:27.808554 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:43:29.025463 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:43:29.175119 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:43:29.774282 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:43:30.001524 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0407 09:43:30.667856 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0407 09:43:30.667901 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0407 09:43:33.635113 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0407 09:43:42.993748 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.102.65.31"} W0407 09:43:43.029366 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.102.65.31:9443: connect: connection refused E0407 09:43:43.029476 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.102.65.31:9443: connect: connection refused I0407 09:43:52.203373 1 trace.go:236] Trace[1687263049]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bf6d2be3-13f3-4b9c-b263-f12e279acf5d,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:43:51.329) (total time: 874ms): Trace[1687263049]: ["GuaranteedUpdate etcd3" audit-id:bf6d2be3-13f3-4b9c-b263-f12e279acf5d,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 873ms (09:43:51.329) Trace[1687263049]: ---"Txn call completed" 872ms (09:43:52.203)] Trace[1687263049]: [874.071814ms] [874.071814ms] END I0407 09:43:52.341341 1 trace.go:236] Trace[1009675874]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:121808c8-6c28-4f95-9129-48c6f75b8ce2,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:43:51.444) (total time: 897ms): Trace[1009675874]: ---"About to write a response" 897ms (09:43:52.341) Trace[1009675874]: [897.189448ms] [897.189448ms] END I0407 09:44:18.040914 1 trace.go:236] Trace[849209235]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0fb6576f-96fa-48cc-8013-632b40213f77,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:44:16.416) (total time: 1623ms): Trace[849209235]: ["GuaranteedUpdate etcd3" audit-id:0fb6576f-96fa-48cc-8013-632b40213f77,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1623ms (09:44:16.416) Trace[849209235]: ---"Txn call completed" 1623ms (09:44:18.040)] Trace[849209235]: [1.623956054s] [1.623956054s] END I0407 09:44:18.046135 1 trace.go:236] Trace[553870394]: "Get" accept:application/json, */*,audit-id:e6e74c4f-a05b-4406-9e70-705fb5f39fc5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:16.749) (total time: 1296ms): Trace[553870394]: ---"About to write a response" 1296ms (09:44:18.046) Trace[553870394]: [1.296602158s] [1.296602158s] END I0407 09:44:18.046741 1 trace.go:236] Trace[106475129]: "Get" accept:application/json, */*,audit-id:140dc135-8b45-4e01-b490-dcc505a5cf5d,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:44:16.807) (total time: 1239ms): Trace[106475129]: ---"About to write a response" 1239ms (09:44:18.046) Trace[106475129]: [1.239407937s] [1.239407937s] END I0407 09:44:18.046996 1 trace.go:236] Trace[953757729]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:90b22d9d-174e-41a1-b4ba-124a3e81cf95,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:44:16.748) (total time: 1298ms): Trace[953757729]: ---"About to write a response" 1298ms (09:44:18.046) Trace[953757729]: [1.298594596s] [1.298594596s] END I0407 09:44:18.048418 1 trace.go:236] Trace[1300880990]: "Get" accept:application/json, */*,audit-id:78c7b788-7ca8-4b87-916f-3f35c86cee1c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:17.056) (total time: 992ms): Trace[1300880990]: ---"About to write a response" 991ms (09:44:18.048) Trace[1300880990]: [992.119106ms] [992.119106ms] END I0407 09:44:18.048464 1 trace.go:236] Trace[783441949]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dbefc040-3092-48cd-a902-c134eeec03b3,client:10.0.0.3,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:16.644) (total time: 1403ms): Trace[783441949]: ["GuaranteedUpdate etcd3" audit-id:dbefc040-3092-48cd-a902-c134eeec03b3,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1403ms (09:44:16.644) Trace[783441949]: ---"Txn call completed" 1402ms (09:44:18.048)] Trace[783441949]: [1.403985107s] [1.403985107s] END E0407 09:44:27.150159 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:27.150207 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:27.150254 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.481µs, panicked: false, err: context canceled, panic-reason: E0407 09:44:27.150569 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:27.150613 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.121µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 09:44:27.151822 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 09:44:27.151840 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0407 09:44:27.151891 1 trace.go:236] Trace[426962958]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d82ad340-539d-4295-b447-3f7b4eb9db68,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:44:22.150) (total time: 5000ms): Trace[426962958]: ["GuaranteedUpdate etcd3" audit-id:d82ad340-539d-4295-b447-3f7b4eb9db68,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:44:22.151) Trace[426962958]: ---"Txn call failed" err:context canceled 4998ms (09:44:27.150)] Trace[426962958]: [5.000885926s] [5.000885926s] END E0407 09:44:27.152011 1 timeout.go:142] post-timeout activity - time-elapsed: 1.845246ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:44:27.153018 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:27.153057 1 trace.go:236] Trace[317402768]: "Update" accept:application/json, */*,audit-id:034c67f4-7b1c-4f99-8979-9bee308f445c,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:22.150) (total time: 5002ms): Trace[317402768]: ["GuaranteedUpdate etcd3" audit-id:034c67f4-7b1c-4f99-8979-9bee308f445c,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:44:22.151) Trace[317402768]: ---"Txn call failed" err:context deadline exceeded 4998ms (09:44:27.150)] Trace[317402768]: [5.002041866s] [5.002041866s] END E0407 09:44:27.153122 1 timeout.go:142] post-timeout activity - time-elapsed: 2.571374ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 09:44:29.108720 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:29.108750 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:29.108845 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 52.281µs, panicked: false, err: context canceled, panic-reason: E0407 09:44:29.109862 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:29.109952 1 trace.go:236] Trace[664540643]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4415bfbe-6498-4c99-9118-097f88132872,client:10.0.0.3,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:24.109) (total time: 5000ms): Trace[664540643]: ["GuaranteedUpdate etcd3" audit-id:4415bfbe-6498-4c99-9118-097f88132872,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:44:24.109) Trace[664540643]: ---"Txn call failed" err:context canceled 4998ms (09:44:29.108)] Trace[664540643]: [5.000491616s] [5.000491616s] END E0407 09:44:29.110130 1 timeout.go:142] post-timeout activity - time-elapsed: 1.453437ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 09:44:29.151149 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded I0407 09:44:29.151272 1 trace.go:236] Trace[642382546]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3fd76c69-9ef2-4396-a4f3-08e5824090ba,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:44:24.151) (total time: 4999ms): Trace[642382546]: [4.999768689s] [4.999768689s] END E0407 09:44:29.151466 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s" audit-ID="3fd76c69-9ef2-4396-a4f3-08e5824090ba" E0407 09:44:29.151497 1 timeout.go:142] post-timeout activity - time-elapsed: 2.59µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 09:44:29.153470 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:29.153634 1 trace.go:236] Trace[549664450]: "Update" accept:application/json, */*,audit-id:35884a3a-efc2-4abe-bbf3-a28f66ae2f4a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:44:22.151) (total time: 7002ms): Trace[549664450]: ["GuaranteedUpdate etcd3" audit-id:35884a3a-efc2-4abe-bbf3-a28f66ae2f4a,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:44:22.151) Trace[549664450]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:29.153)] Trace[549664450]: [7.00256541s] [7.00256541s] END E0407 09:44:29.153918 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:29.155210 1 trace.go:236] Trace[700428264]: "Update" accept:application/json, */*,audit-id:ac99a6a7-9e10-411d-8369-48121194a16b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:44:22.150) (total time: 7004ms): Trace[700428264]: ["GuaranteedUpdate etcd3" audit-id:ac99a6a7-9e10-411d-8369-48121194a16b,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (09:44:22.151) Trace[700428264]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:44:29.153)] Trace[700428264]: [7.004363564s] [7.004363564s] END E0407 09:44:29.941656 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:29.941790 1 trace.go:236] Trace[1386558244]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95012e3b-64c7-4c88-8320-3afdacd09f99,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:22.938) (total time: 7003ms): Trace[1386558244]: ["GuaranteedUpdate etcd3" audit-id:95012e3b-64c7-4c88-8320-3afdacd09f99,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:44:22.938) Trace[1386558244]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:44:29.941)] Trace[1386558244]: [7.003266877s] [7.003266877s] END E0407 09:44:32.061205 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:32.061293 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:32.062321 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:32.062391 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:32.063555 1 trace.go:236] Trace[1947514982]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:aa135c12-4bc1-4923-9aae-1b4aecedd662,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:44:29.151) (total time: 2911ms): Trace[1947514982]: [2.911580932s] [2.911580932s] END E0407 09:44:32.063696 1 timeout.go:142] post-timeout activity - time-elapsed: 2.526912ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:44:32.063998 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:32.065171 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:32.065185 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:32.066347 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:32.066400 1 trace.go:236] Trace[317025301]: "Get" accept:application/json, */*,audit-id:13a09b34-50ed-44d6-86f6-7f10387b6fbc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:31.156) (total time: 909ms): Trace[317025301]: [909.54939ms] [909.54939ms] END E0407 09:44:32.066472 1 timeout.go:142] post-timeout activity - time-elapsed: 2.543983ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0407 09:44:32.075626 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:32.075673 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:32.075823 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:32.076659 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:32.076730 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:32.077070 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:32.078702 1 trace.go:236] Trace[850402155]: "Get" accept:application/json, */*,audit-id:14d952de-68f9-4522-ae2a-cd69061b9411,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:44:29.152) (total time: 2926ms): Trace[850402155]: [2.926115889s] [2.926115889s] END E0407 09:44:32.078763 1 timeout.go:142] post-timeout activity - time-elapsed: 3.075145ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 09:44:32.078775 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:32.079898 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:32.079929 1 trace.go:236] Trace[153562371]: "Get" accept:application/json, */*,audit-id:d6045fc0-ea21-4d1a-b0ae-380c2eb13f91,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:31.155) (total time: 923ms): Trace[153562371]: [923.914684ms] [923.914684ms] END E0407 09:44:32.079969 1 timeout.go:142] post-timeout activity - time-elapsed: 3.372194ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0407 09:44:34.058319 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:34.058522 1 trace.go:236] Trace[1849259148]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:614d6ffb-20c9-41ef-becd-ccbe4d06ed9e,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (07-Apr-2026 09:44:27.055) (total time: 7002ms): Trace[1849259148]: ["Create etcd3" audit-id:614d6ffb-20c9-41ef-becd-ccbe4d06ed9e,key:/events/kube-system/kube-apiserver-instance.18a409ed1af3533c,type:*core.Event,resource:events 7002ms (09:44:27.056) Trace[1849259148]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:34.058)] Trace[1849259148]: [7.002507399s] [7.002507399s] END E0407 09:44:34.109161 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:34.109313 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:34.110366 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:34.110440 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:34.111453 1 trace.go:236] Trace[1308598318]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8b5d2838-5d81-47cc-b812-eaa85b585291,client:10.0.0.3,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:44:29.109) (total time: 5001ms): Trace[1308598318]: [5.001845109s] [5.001845109s] END E0407 09:44:34.111685 1 timeout.go:142] post-timeout activity - time-elapsed: 2.332718ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 09:44:34.151304 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 09:44:34.151390 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:34.153380 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:34.153441 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:34.154564 1 trace.go:236] Trace[1596132761]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:67d8778b-4633-47b7-aec7-76593414176f,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:44:31.153) (total time: 3001ms): Trace[1596132761]: [3.001185731s] [3.001185731s] END E0407 09:44:34.154749 1 timeout.go:142] post-timeout activity - time-elapsed: 3.455435ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 09:44:36.101950 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:36.102084 1 trace.go:236] Trace[881452176]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b5e75395-c247-482e-931b-2e4e343fc347,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:29.099) (total time: 7002ms): Trace[881452176]: ["GuaranteedUpdate etcd3" audit-id:b5e75395-c247-482e-931b-2e4e343fc347,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:44:29.099) Trace[881452176]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:36.101)] Trace[881452176]: [7.002313152s] [7.002313152s] END E0407 09:44:36.102544 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0407 09:44:36.946407 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:36.946569 1 trace.go:236] Trace[1667446932]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8a1b2f44-c80f-4c8d-938b-06c94cdeb7be,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:29.943) (total time: 7002ms): Trace[1667446932]: ["GuaranteedUpdate etcd3" audit-id:8a1b2f44-c80f-4c8d-938b-06c94cdeb7be,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:44:29.944) Trace[1667446932]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:36.946)] Trace[1667446932]: [7.002700383s] [7.002700383s] END I0407 09:44:37.056413 1 trace.go:236] Trace[1994226880]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.210,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:44:28.324) (total time: 8732ms): Trace[1994226880]: [8.732055947s] [8.732055947s] END E0407 09:44:37.056462 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0407 09:44:37.062427 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:37.062459 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:37.062525 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 32.641µs, panicked: false, err: context canceled, panic-reason: E0407 09:44:37.063951 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:37.064039 1 trace.go:236] Trace[1255787946]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d941c6ee-5d72-4b32-8ca7-9c55f9313ba2,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:44:32.061) (total time: 5002ms): Trace[1255787946]: ["GuaranteedUpdate etcd3" audit-id:d941c6ee-5d72-4b32-8ca7-9c55f9313ba2,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:44:32.062) Trace[1255787946]: ---"Txn call failed" err:context canceled 4999ms (09:44:37.062)] Trace[1255787946]: [5.002037435s] [5.002037435s] END E0407 09:44:37.064187 1 timeout.go:142] post-timeout activity - time-elapsed: 1.730563ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 09:44:37.076672 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:37.076717 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:37.076813 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 75.141µs, panicked: false, err: context canceled, panic-reason: E0407 09:44:37.077843 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:37.077911 1 trace.go:236] Trace[1472084719]: "Update" accept:application/json, */*,audit-id:c6668437-a024-4f92-9268-c5d5fb57b307,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:32.077) (total time: 5000ms): Trace[1472084719]: ["GuaranteedUpdate etcd3" audit-id:c6668437-a024-4f92-9268-c5d5fb57b307,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (09:44:32.077) Trace[1472084719]: ---"Txn call failed" err:context canceled 4999ms (09:44:37.076)] Trace[1472084719]: [5.000821444s] [5.000821444s] END E0407 09:44:37.078008 1 timeout.go:142] post-timeout activity - time-elapsed: 1.16985ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 09:44:39.067083 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:39.067242 1 trace.go:236] Trace[1590038303]: "Update" accept:application/json, */*,audit-id:2c47f304-6375-4fd1-ac1c-cf7ce868a5c0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:44:32.064) (total time: 7002ms): Trace[1590038303]: ["GuaranteedUpdate etcd3" audit-id:2c47f304-6375-4fd1-ac1c-cf7ce868a5c0,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (09:44:32.064) Trace[1590038303]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:39.067)] Trace[1590038303]: [7.00263201s] [7.00263201s] END E0407 09:44:39.071897 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 09:44:39.071931 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 09:44:39.071998 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 48.971µs, panicked: false, err: context canceled, panic-reason: E0407 09:44:39.073332 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 09:44:39.073442 1 trace.go:236] Trace[686133366]: "Update" accept:application/json, */*,audit-id:8066197b-5456-48d8-8b27-68e37d200fb9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 09:44:32.076) (total time: 6997ms): Trace[686133366]: ["GuaranteedUpdate etcd3" audit-id:8066197b-5456-48d8-8b27-68e37d200fb9,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6997ms (09:44:32.076) Trace[686133366]: ---"Txn call failed" err:context canceled 6995ms (09:44:39.071)] Trace[686133366]: [6.997311179s] [6.997311179s] END E0407 09:44:39.073524 1 timeout.go:142] post-timeout activity - time-elapsed: 1.698251ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0407 09:44:41.114251 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:41.114417 1 trace.go:236] Trace[886330300]: "Create" accept:application/json, */*,audit-id:a6131bd1-7395-4302-ae3d-437a2f898437,client:10.0.0.3,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (07-Apr-2026 09:44:34.111) (total time: 7002ms): Trace[886330300]: ["Create etcd3" audit-id:a6131bd1-7395-4302-ae3d-437a2f898437,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18a409eebf688954,type:*core.Event,resource:events 7001ms (09:44:34.112) Trace[886330300]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (09:44:41.114)] Trace[886330300]: [7.00258912s] [7.00258912s] END E0407 09:44:43.106737 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 09:44:43.106856 1 trace.go:236] Trace[111008384]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a28fa189-810f-498d-80b2-9f274f9408cd,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:36.103) (total time: 7003ms): Trace[111008384]: ["GuaranteedUpdate etcd3" audit-id:a28fa189-810f-498d-80b2-9f274f9408cd,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (09:44:36.103) Trace[111008384]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (09:44:43.106)] Trace[111008384]: [7.003486152s] [7.003486152s] END E0407 09:44:43.107494 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0407 09:44:43.590118 1 trace.go:236] Trace[1537408540]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e7d821d8-3cda-4da8-99c9-0860ef5e5507,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:36.948) (total time: 6641ms): Trace[1537408540]: ["GuaranteedUpdate etcd3" audit-id:e7d821d8-3cda-4da8-99c9-0860ef5e5507,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6641ms (09:44:36.948) Trace[1537408540]: ---"Txn call completed" 6639ms (09:44:43.588)] Trace[1537408540]: [6.641429779s] [6.641429779s] END E0407 09:44:43.593645 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0407 09:44:43.594875 1 trace.go:236] Trace[850575783]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9832d990-0dbf-4813-9f8c-859bb13bd582,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 09:44:33.071) (total time: 10523ms): Trace[850575783]: ---"About to write a response" 10520ms (09:44:43.591) Trace[850575783]: [10.523048692s] [10.523048692s] END I0407 09:44:43.844982 1 trace.go:236] Trace[1798589683]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23c877b9-d7c0-4a8f-9949-c2c806dec991,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a409ed1af3533c,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:44:34.061) (total time: 9783ms): Trace[1798589683]: ["GuaranteedUpdate etcd3" audit-id:23c877b9-d7c0-4a8f-9949-c2c806dec991,key:/events/kube-system/kube-apiserver-instance.18a409ed1af3533c,type:*core.Event,resource:events 9783ms (09:44:34.061) Trace[1798589683]: ---"initial value restored" 9531ms (09:44:43.592) Trace[1798589683]: ---"Txn call completed" 246ms (09:44:43.844)] Trace[1798589683]: ---"Object stored in database" 246ms (09:44:43.844) Trace[1798589683]: [9.783778953s] [9.783778953s] END I0407 09:44:43.947073 1 trace.go:236] Trace[2128475962]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.210,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:44:38.324) (total time: 5622ms): Trace[2128475962]: ---"initial value restored" 5267ms (09:44:43.591) Trace[2128475962]: ---"Transaction prepared" 195ms (09:44:43.787) Trace[2128475962]: ---"Txn call completed" 159ms (09:44:43.947) Trace[2128475962]: [5.622511472s] [5.622511472s] END I0407 09:44:56.043899 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.97.52.152"} I0407 09:44:56.054366 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.110.43.9"} I0407 09:45:24.110388 1 trace.go:236] Trace[1063036370]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e8f7e23d-9545-405f-a78f-7f692086d250,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-6mgm2.18a409f0e58b14b6,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:45:23.387) (total time: 722ms): Trace[1063036370]: ["GuaranteedUpdate etcd3" audit-id:e8f7e23d-9545-405f-a78f-7f692086d250,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-6mgm2.18a409f0e58b14b6,type:*core.Event,resource:events 722ms (09:45:23.387) Trace[1063036370]: ---"Txn call completed" 719ms (09:45:24.109)] Trace[1063036370]: ---"Object stored in database" 720ms (09:45:24.110) Trace[1063036370]: [722.685542ms] [722.685542ms] END I0407 09:45:24.194140 1 trace.go:236] Trace[1631946024]: "Get" accept:application/json, */*,audit-id:77416cc2-9608-47ca-ac91-58d88b008207,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:45:23.587) (total time: 606ms): Trace[1631946024]: ---"About to write a response" 605ms (09:45:24.193) Trace[1631946024]: [606.118116ms] [606.118116ms] END I0407 09:45:24.195733 1 trace.go:236] Trace[1321530864]: "Get" accept:application/json, */*,audit-id:e0acddbf-5306-4b07-b994-37284f40871c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:45:23.600) (total time: 595ms): Trace[1321530864]: ---"About to write a response" 594ms (09:45:24.195) Trace[1321530864]: [595.090524ms] [595.090524ms] END