I0407 06:42:50.712244 1 options.go:220] external host was not specified, using 162.253.55.204 I0407 06:42:50.713119 1 server.go:148] Version: v1.28.13 I0407 06:42:50.713155 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0407 06:42:51.135843 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0407 06:42:51.142856 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0407 06:42:51.142875 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0407 06:42:51.143068 1 instance.go:298] Using reconciler: lease I0407 06:42:51.621671 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0407 06:42:51.621699 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0407 06:42:51.857312 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0407 06:42:51.857522 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0407 06:42:52.276507 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0407 06:42:52.289944 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0407 06:42:52.289990 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.290000 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.290539 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0407 06:42:52.290556 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0407 06:42:52.291362 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0407 06:42:52.292102 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0407 06:42:52.292119 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0407 06:42:52.292123 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0407 06:42:52.293689 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0407 06:42:52.293706 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0407 06:42:52.294643 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0407 06:42:52.294659 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.294664 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.295429 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0407 06:42:52.295450 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.295493 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0407 06:42:52.296019 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0407 06:42:52.297626 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0407 06:42:52.297648 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.297652 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.298038 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0407 06:42:52.298058 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.298063 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.298953 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0407 06:42:52.298973 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0407 06:42:52.300521 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0407 06:42:52.300539 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.300544 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.300888 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0407 06:42:52.300913 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.300917 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.302970 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0407 06:42:52.302989 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.302993 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.304132 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0407 06:42:52.304981 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0407 06:42:52.304998 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.305001 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.308150 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0407 06:42:52.308172 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0407 06:42:52.308176 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0407 06:42:52.308830 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0407 06:42:52.308843 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0407 06:42:52.308846 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0407 06:42:52.309224 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0407 06:42:52.309237 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0407 06:42:52.345308 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0407 06:42:52.345336 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0407 06:42:52.754090 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 06:42:52.754109 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 06:42:52.754425 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0407 06:42:52.754534 1 secure_serving.go:213] Serving securely on [::]:6443 I0407 06:42:52.754655 1 aggregator.go:164] waiting for initial CRD sync... I0407 06:42:52.754693 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0407 06:42:52.754751 1 system_namespaces_controller.go:67] Starting system namespaces controller I0407 06:42:52.754761 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0407 06:42:52.754820 1 controller.go:78] Starting OpenAPI AggregationController I0407 06:42:52.754823 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0407 06:42:52.754852 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0407 06:42:52.754860 1 controller.go:134] Starting OpenAPI controller I0407 06:42:52.754890 1 controller.go:85] Starting OpenAPI V3 controller I0407 06:42:52.754934 1 naming_controller.go:291] Starting NamingConditionController I0407 06:42:52.754956 1 establishing_controller.go:76] Starting EstablishingController I0407 06:42:52.755010 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0407 06:42:52.755024 1 controller.go:116] Starting legacy_token_tracking_controller I0407 06:42:52.755038 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0407 06:42:52.755028 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0407 06:42:52.755053 1 crd_finalizer.go:266] Starting CRDFinalizer I0407 06:42:52.755108 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0407 06:42:52.755119 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0407 06:42:52.755963 1 available_controller.go:423] Starting AvailableConditionController I0407 06:42:52.756004 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0407 06:42:52.756045 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 06:42:52.756374 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0407 06:42:52.756397 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0407 06:42:52.756438 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0407 06:42:52.756508 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0407 06:42:52.757047 1 controller.go:80] Starting OpenAPI V3 AggregationController I0407 06:42:52.757341 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 06:42:52.754826 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0407 06:42:52.757744 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 06:42:52.757856 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" E0407 06:42:52.829637 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0407 06:42:52.836802 1 shared_informer.go:318] Caches are synced for node_authorizer I0407 06:42:52.854944 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0407 06:42:52.855106 1 shared_informer.go:318] Caches are synced for configmaps I0407 06:42:52.855197 1 shared_informer.go:318] Caches are synced for crd-autoregister I0407 06:42:52.855242 1 aggregator.go:166] initial CRD sync complete... I0407 06:42:52.855253 1 autoregister_controller.go:141] Starting autoregister controller I0407 06:42:52.855278 1 cache.go:32] Waiting for caches to sync for autoregister controller I0407 06:42:52.855337 1 cache.go:39] Caches are synced for autoregister controller I0407 06:42:52.856167 1 cache.go:39] Caches are synced for AvailableConditionController controller I0407 06:42:52.856496 1 apf_controller.go:379] Running API Priority and Fairness config worker I0407 06:42:52.856740 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0407 06:42:52.856563 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0407 06:42:52.856607 1 controller.go:624] quota admission added evaluator for: namespaces I0407 06:42:53.033759 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0407 06:42:53.762640 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0407 06:42:53.770719 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0407 06:42:53.770733 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0407 06:42:54.351679 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0407 06:42:54.402335 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0407 06:42:54.476110 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0407 06:42:54.482738 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.204] I0407 06:42:54.484277 1 controller.go:624] quota admission added evaluator for: endpoints I0407 06:42:54.489714 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0407 06:42:56.249750 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0407 06:42:56.257773 1 controller.go:624] quota admission added evaluator for: deployments.apps I0407 06:42:56.288938 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0407 06:42:56.496354 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0407 06:43:00.989550 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0407 06:43:01.993742 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0407 06:43:19.994082 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 06:43:20.126004 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 06:43:20.206429 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 06:43:20.225473 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 06:43:20.242543 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 06:43:20.242584 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 06:43:20.264894 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 06:43:20.270145 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 06:43:20.296916 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 06:43:20.296986 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 06:43:20.353103 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 06:43:20.353167 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 06:43:20.369786 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 06:43:20.370619 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 06:43:20.414929 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 06:43:20.581106 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 06:43:20.581164 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 06:43:20.581731 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:20.641796 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:20.683036 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:20.727455 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:20.739925 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:21.355785 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:21.382011 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:21.449901 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 06:43:26.802927 1 trace.go:236] Trace[419781468]: "Update" accept:application/json, */*,audit-id:b8856651-bfdc-46d5-bece-e0b8e992212c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:43:26.152) (total time: 649ms): Trace[419781468]: ["GuaranteedUpdate etcd3" audit-id:b8856651-bfdc-46d5-bece-e0b8e992212c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 649ms (06:43:26.153) Trace[419781468]: ---"Txn call completed" 648ms (06:43:26.802)] Trace[419781468]: [649.863351ms] [649.863351ms] END I0407 06:43:27.310876 1 controller.go:624] quota admission added evaluator for: jobs.batch I0407 06:43:28.131290 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 06:43:28.147369 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 06:43:28.155739 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 06:43:28.329141 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 06:43:28.730078 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 06:43:28.927956 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 06:43:29.130446 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 06:43:29.986929 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 06:43:32.205401 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 06:43:32.409664 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 06:43:32.515892 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0407 06:43:43.323650 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0407 06:43:43.323946 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0407 06:43:43.731679 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0407 06:43:50.630892 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.184.90"} W0407 06:43:50.663737 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.184.90:9443: connect: connection refused E0407 06:43:50.663787 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.184.90:9443: connect: connection refused I0407 06:44:53.739183 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.100.1.208"} I0407 06:44:53.749422 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.108.197.110"} I0407 06:44:57.071762 1 trace.go:236] Trace[414384851]: "Get" accept:application/json, */*,audit-id:0c60a1b5-a42a-40d0-81bc-a78f7a3eb646,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:44:56.428) (total time: 643ms): Trace[414384851]: ---"About to write a response" 643ms (06:44:57.071) Trace[414384851]: [643.31666ms] [643.31666ms] END I0407 06:44:57.071769 1 trace.go:236] Trace[1824850255]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5071f207-d326-42e5-84b4-9f91fb7f9c8a,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:44:56.468) (total time: 603ms): Trace[1824850255]: ---"About to write a response" 603ms (06:44:57.071) Trace[1824850255]: [603.524922ms] [603.524922ms] END E0407 06:48:09.684969 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:09.685010 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 26.94µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 06:48:09.685027 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:09.686213 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:09.686415 1 trace.go:236] Trace[1402126353]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5723d09c-349e-44c2-8cd4-98b13232055a,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 06:48:04.685) (total time: 5000ms): Trace[1402126353]: ["GuaranteedUpdate etcd3" audit-id:5723d09c-349e-44c2-8cd4-98b13232055a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (06:48:04.685) Trace[1402126353]: ---"Txn call failed" err:context deadline exceeded 4998ms (06:48:09.684)] Trace[1402126353]: [5.000969159s] [5.000969159s] END E0407 06:48:09.686688 1 timeout.go:142] post-timeout activity - time-elapsed: 1.82452ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 06:48:09.692413 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:09.692527 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:09.693749 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:09.693846 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:09.695055 1 trace.go:236] Trace[1047463547]: "Get" accept:application/json, */*,audit-id:dddb9080-bae8-45dc-b574-d50f061c1688,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:04.691) (total time: 5003ms): Trace[1047463547]: [5.003460917s] [5.003460917s] END E0407 06:48:09.695302 1 timeout.go:142] post-timeout activity - time-elapsed: 2.744104ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 06:48:09.695759 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:09.696945 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:09.696967 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:09.698146 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:09.698286 1 trace.go:236] Trace[958743894]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:18e0df74-90d3-4174-abfd-8807dbef73b8,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:04.695) (total time: 5002ms): Trace[958743894]: [5.002430429s] [5.002430429s] END E0407 06:48:09.698563 1 timeout.go:142] post-timeout activity - time-elapsed: 2.866267ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 06:48:10.200386 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:10.200519 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:10.200593 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 94.693µs, panicked: false, err: context deadline exceeded, panic-reason: E0407 06:48:10.201816 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:10.201914 1 trace.go:236] Trace[1974095178]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:28c956f0-0fc6-4fe9-b7bc-a6c1c57516a7,client:10.0.0.212,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 06:48:05.200) (total time: 5000ms): Trace[1974095178]: ["GuaranteedUpdate etcd3" audit-id:28c956f0-0fc6-4fe9-b7bc-a6c1c57516a7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (06:48:05.201) Trace[1974095178]: ---"Txn call failed" err:context deadline exceeded 4998ms (06:48:10.200)] Trace[1974095178]: [5.00094845s] [5.00094845s] END E0407 06:48:10.202083 1 timeout.go:142] post-timeout activity - time-elapsed: 1.685596ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 06:48:11.689782 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:11.690145 1 trace.go:236] Trace[2143043157]: "Update" accept:application/json, */*,audit-id:f6710ea4-c94a-4648-a8cd-36079d1cb3a1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:48:04.688) (total time: 7001ms): Trace[2143043157]: ["GuaranteedUpdate etcd3" audit-id:f6710ea4-c94a-4648-a8cd-36079d1cb3a1,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7001ms (06:48:04.688) Trace[2143043157]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (06:48:11.689)] Trace[2143043157]: [7.00193206s] [7.00193206s] END E0407 06:48:11.690746 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:11.691645 1 trace.go:236] Trace[2138304483]: "Get" accept:application/json, */*,audit-id:0ee69bce-87de-4958-af4d-b3404381981b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:04.688) (total time: 7002ms): Trace[2138304483]: [7.002596707s] [7.002596707s] END E0407 06:48:14.681216 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.681341 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.682368 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.682470 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.684139 1 trace.go:236] Trace[1931453506]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6f727817-0d7c-4753-af14-2e5390c0c730,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:11.688) (total time: 2995ms): Trace[1931453506]: [2.995739955s] [2.995739955s] END E0407 06:48:14.684340 1 timeout.go:142] post-timeout activity - time-elapsed: 3.144706ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 06:48:14.686151 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.686237 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.687611 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.687657 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.688950 1 trace.go:236] Trace[65781285]: "Get" accept:application/json, */*,audit-id:46741023-7706-490f-b562-1477ae87d2af,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:13.693) (total time: 995ms): Trace[65781285]: [995.677299ms] [995.677299ms] END E0407 06:48:14.689154 1 timeout.go:142] post-timeout activity - time-elapsed: 3.055412ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0407 06:48:14.689517 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.690296 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.690668 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.691641 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.691814 1 trace.go:236] Trace[1995564989]: "Get" accept:application/json, */*,audit-id:550be878-ef7f-4e49-b62f-61847729433b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:13.694) (total time: 997ms): Trace[1995564989]: [997.627073ms] [997.627073ms] END E0407 06:48:14.691930 1 timeout.go:142] post-timeout activity - time-elapsed: 2.56185ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0407 06:48:14.692040 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.693357 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.693383 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.694541 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.694638 1 trace.go:236] Trace[1061705510]: "Get" accept:application/json, */*,audit-id:61f73606-2722-470e-9cf3-3a4523f733b8,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:11.694) (total time: 3000ms): Trace[1061705510]: [3.000291908s] [3.000291908s] END E0407 06:48:14.694823 1 timeout.go:142] post-timeout activity - time-elapsed: 2.863138ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 06:48:14.696056 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.696841 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.698215 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.698269 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.699345 1 trace.go:236] Trace[1408763743]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e3203be7-15f5-424c-9dfa-fa56b630d107,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:11.696) (total time: 3002ms): Trace[1408763743]: [3.002542829s] [3.002542829s] END E0407 06:48:14.699538 1 timeout.go:142] post-timeout activity - time-elapsed: 3.472034ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 06:48:14.707065 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.707356 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.709025 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.709126 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.710199 1 trace.go:236] Trace[2032492322]: "Get" accept:application/json, */*,audit-id:3b838886-3545-469c-834c-87914e6fe832,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:04.696) (total time: 10013ms): Trace[2032492322]: [10.013622026s] [10.013622026s] END E0407 06:48:14.710319 1 timeout.go:142] post-timeout activity - time-elapsed: 3.388622ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system" result: E0407 06:48:14.838182 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:14.838308 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:14.839666 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:14.839748 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:14.840804 1 trace.go:236] Trace[284671079]: "Get" accept:application/json, */*,audit-id:fb7c6e2a-3cdc-4f29-aa09-7c6a688099c9,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:04.834) (total time: 10006ms): Trace[284671079]: [10.006401419s] [10.006401419s] END E0407 06:48:14.840954 1 timeout.go:142] post-timeout activity - time-elapsed: 2.810786ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com" result: E0407 06:48:15.170845 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:15.171070 1 trace.go:236] Trace[1627695144]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:51cab238-2451-4e07-9dda-bf68e47b69a1,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 06:48:08.167) (total time: 7003ms): Trace[1627695144]: ["GuaranteedUpdate etcd3" audit-id:51cab238-2451-4e07-9dda-bf68e47b69a1,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (06:48:08.167) Trace[1627695144]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (06:48:15.170)] Trace[1627695144]: [7.003383478s] [7.003383478s] END E0407 06:48:15.171744 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0407 06:48:15.200018 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:15.200132 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:15.201212 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:15.201254 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:15.202407 1 trace.go:236] Trace[450813688]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:502f17fb-c76d-45c4-a2ca-527b4e5f8ffd,client:10.0.0.212,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:10.201) (total time: 5000ms): Trace[450813688]: [5.000832826s] [5.000832826s] END E0407 06:48:15.202581 1 timeout.go:142] post-timeout activity - time-elapsed: 2.56418ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0407 06:48:16.594084 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:16.594401 1 trace.go:236] Trace[1336766349]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:881ccfc0-9e2a-47a7-a198-6aa809177d96,client:162.253.55.204,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (07-Apr-2026 06:48:09.591) (total time: 7003ms): Trace[1336766349]: ["Create etcd3" audit-id:881ccfc0-9e2a-47a7-a198-6aa809177d96,key:/events/kube-system/kube-apiserver-instance.18a4004e58dee78c,type:*core.Event,resource:events 7002ms (06:48:09.591)] Trace[1336766349]: [7.00308466s] [7.00308466s] END E0407 06:48:17.381878 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:17.382023 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:17.383207 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:17.383272 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:17.384405 1 trace.go:236] Trace[1621243334]: "Get" accept:application/json, */*,audit-id:9cce8127-b5b3-43d9-9a2a-5ba915aea4b2,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:07.382) (total time: 10001ms): Trace[1621243334]: [10.001781456s] [10.001781456s] END E0407 06:48:17.384544 1 timeout.go:142] post-timeout activity - time-elapsed: 2.595441ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com" result: I0407 06:48:18.031869 1 trace.go:236] Trace[1423878988]: "Get" accept:application/json, */*,audit-id:2fc788b9-bf3d-4926-b723-9d6264bc4cdc,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:08.113) (total time: 9918ms): Trace[1423878988]: ---"About to write a response" 9918ms (06:48:18.031) Trace[1423878988]: [9.918755825s] [9.918755825s] END I0407 06:48:18.032117 1 trace.go:236] Trace[596846350]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:43ecd02a-ef1a-4a2b-983c-a08c278cf925,client:162.253.55.204,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a4004e58dee78c,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 06:48:16.596) (total time: 1435ms): Trace[596846350]: ["GuaranteedUpdate etcd3" audit-id:43ecd02a-ef1a-4a2b-983c-a08c278cf925,key:/events/kube-system/kube-apiserver-instance.18a4004e58dee78c,type:*core.Event,resource:events 1435ms (06:48:16.597) Trace[596846350]: ---"initial value restored" 1434ms (06:48:18.031)] Trace[596846350]: [1.435156822s] [1.435156822s] END I0407 06:48:18.032174 1 trace.go:236] Trace[1005456426]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b8ab4a44-0e4f-4131-a346-8e98995b4e11,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 06:48:12.582) (total time: 5449ms): Trace[1005456426]: ["GuaranteedUpdate etcd3" audit-id:b8ab4a44-0e4f-4131-a346-8e98995b4e11,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5449ms (06:48:12.582) Trace[1005456426]: ---"Txn call completed" 5448ms (06:48:18.031)] Trace[1005456426]: [5.4495221s] [5.4495221s] END I0407 06:48:18.032481 1 trace.go:236] Trace[74413950]: "Update" accept:application/json, */*,audit-id:e3810fff-9310-4977-bcb6-468d7287d6cb,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 06:48:14.693) (total time: 3339ms): Trace[74413950]: ["GuaranteedUpdate etcd3" audit-id:e3810fff-9310-4977-bcb6-468d7287d6cb,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3338ms (06:48:14.693) Trace[74413950]: ---"Txn call completed" 3338ms (06:48:18.032)] Trace[74413950]: [3.339197465s] [3.339197465s] END I0407 06:48:18.032774 1 trace.go:236] Trace[669656408]: "Get" accept:application/json, */*,audit-id:31187d35-a304-440a-a641-3de02e85fb34,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:08.669) (total time: 9363ms): Trace[669656408]: ---"About to write a response" 9363ms (06:48:18.032) Trace[669656408]: [9.363633917s] [9.363633917s] END I0407 06:48:18.032805 1 trace.go:236] Trace[462625269]: "Update" accept:application/json, */*,audit-id:6a02ef3e-a53c-4a57-95e6-baa80c41ac25,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:48:14.690) (total time: 3342ms): Trace[462625269]: ["GuaranteedUpdate etcd3" audit-id:6a02ef3e-a53c-4a57-95e6-baa80c41ac25,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3342ms (06:48:14.690) Trace[462625269]: ---"Txn call completed" 3341ms (06:48:18.032)] Trace[462625269]: [3.342609948s] [3.342609948s] END I0407 06:48:18.032884 1 trace.go:236] Trace[388632926]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:df7c5d1c-98ad-4926-9a8e-30df50a7e799,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 06:48:14.682) (total time: 3350ms): Trace[388632926]: ["GuaranteedUpdate etcd3" audit-id:df7c5d1c-98ad-4926-9a8e-30df50a7e799,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3350ms (06:48:14.682) Trace[388632926]: ---"Txn call completed" 3349ms (06:48:18.032)] Trace[388632926]: [3.350602675s] [3.350602675s] END I0407 06:48:18.033518 1 trace.go:236] Trace[431506590]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b62d9fbf-7476-4b27-a2d0-cbe782c6ad27,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 06:48:15.172) (total time: 2860ms): Trace[431506590]: ["GuaranteedUpdate etcd3" audit-id:b62d9fbf-7476-4b27-a2d0-cbe782c6ad27,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2860ms (06:48:15.172) Trace[431506590]: ---"Txn call completed" 2858ms (06:48:18.032)] Trace[431506590]: [2.860827898s] [2.860827898s] END E0407 06:48:18.034004 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0407 06:48:18.035314 1 trace.go:236] Trace[883903347]: "Update" accept:application/json, */*,audit-id:e8ff8f74-9378-470e-b5a1-dcaee0c6a7cb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:48:14.687) (total time: 3347ms): Trace[883903347]: ["GuaranteedUpdate etcd3" audit-id:e8ff8f74-9378-470e-b5a1-dcaee0c6a7cb,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3347ms (06:48:14.688) Trace[883903347]: ---"Txn call completed" 3343ms (06:48:18.032)] Trace[883903347]: [3.347607744s] [3.347607744s] END I0407 06:48:18.037223 1 trace.go:236] Trace[2136590380]: "Create" accept:application/json, */*,audit-id:e90d591a-c465-406c-9670-aba585aaf608,client:10.0.0.212,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (07-Apr-2026 06:48:15.203) (total time: 2834ms): Trace[2136590380]: ["Create etcd3" audit-id:e90d591a-c465-406c-9670-aba585aaf608,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18a4004fa74e6fa7,type:*core.Event,resource:events 2832ms (06:48:15.204) Trace[2136590380]: ---"TransformToStorage succeeded" 2827ms (06:48:18.031)] Trace[2136590380]: [2.834039413s] [2.834039413s] END I0407 06:48:18.046359 1 trace.go:236] Trace[1632455715]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.204,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 06:48:14.487) (total time: 3558ms): Trace[1632455715]: ---"initial value restored" 3543ms (06:48:18.031) Trace[1632455715]: [3.558542811s] [3.558542811s] END E0407 06:48:45.393377 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:45.393561 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:45.394702 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:45.394741 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:45.395913 1 trace.go:236] Trace[550445263]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9f04c2b5-c136-4349-9c39-40ecd5d1fc78,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:40.393) (total time: 5002ms): Trace[550445263]: [5.002560621s] [5.002560621s] END E0407 06:48:45.396086 1 timeout.go:142] post-timeout activity - time-elapsed: 2.631293ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 06:48:45.618939 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0407 06:48:45.619210 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:45.620217 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:45.620319 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:45.621559 1 trace.go:236] Trace[782464678]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ea63f021-31a6-4369-9336-cb8739de4b91,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:40.619) (total time: 5001ms): Trace[782464678]: [5.001948893s] [5.001948893s] END E0407 06:48:45.621873 1 timeout.go:142] post-timeout activity - time-elapsed: 2.806426ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 06:48:46.053395 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0407 06:48:46.053582 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:46.054598 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:46.055793 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:46.055860 1 trace.go:236] Trace[321427288]: "Get" accept:application/json, */*,audit-id:1a8c1cd4-6294-4f09-9938-a381e4a554db,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:41.053) (total time: 5002ms): Trace[321427288]: [5.002342114s] [5.002342114s] END E0407 06:48:46.056088 1 timeout.go:142] post-timeout activity - time-elapsed: 2.695253ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 06:48:46.197183 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:46.197359 1 trace.go:236] Trace[13043388]: "Update" accept:application/json, */*,audit-id:58620432-51e2-432c-94c1-75c9debf6129,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 06:48:39.193) (total time: 7003ms): Trace[13043388]: ["GuaranteedUpdate etcd3" audit-id:58620432-51e2-432c-94c1-75c9debf6129,key:/leases/kube-system/rbd.csi.ceph.com-kube-system,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (06:48:39.193) Trace[13043388]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (06:48:46.197)] Trace[13043388]: [7.00376442s] [7.00376442s] END E0407 06:48:49.188387 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:49.188526 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:49.190345 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:49.190528 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:49.192369 1 trace.go:236] Trace[1653040377]: "Get" accept:application/json, */*,audit-id:d60fc002-0b51-4112-8398-0305b6b28709,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:48.200) (total time: 991ms): Trace[1653040377]: [991.507942ms] [991.507942ms] END E0407 06:48:49.192611 1 timeout.go:142] post-timeout activity - time-elapsed: 4.037239ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system" result: E0407 06:48:50.393927 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:50.394076 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:50.395050 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:50.395206 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:50.396904 1 trace.go:236] Trace[257113367]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d0a2e781-8a5d-42ce-b9ff-3b1faa6e71f1,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:47.395) (total time: 3001ms): Trace[257113367]: [3.001126114s] [3.001126114s] END E0407 06:48:50.397157 1 timeout.go:142] post-timeout activity - time-elapsed: 3.260988ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0407 06:48:50.618698 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:50.618847 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:50.620182 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:50.620229 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:50.621308 1 trace.go:236] Trace[734738918]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f3164788-2084-45f1-a830-541753a34559,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 06:48:47.621) (total time: 3000ms): Trace[734738918]: [3.000169196s] [3.000169196s] END E0407 06:48:50.621416 1 timeout.go:142] post-timeout activity - time-elapsed: 2.649372ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0407 06:48:50.935068 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:50.935348 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:50.935733 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:50.936468 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:50.936487 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:50.936913 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 06:48:50.937634 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0407 06:48:50.937663 1 trace.go:236] Trace[192221406]: "Get" accept:application/json, */*,audit-id:e65f01b7-559c-4107-8572-f7ec0215463a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:40.934) (total time: 10002ms): Trace[192221406]: [10.00261096s] [10.00261096s] END E0407 06:48:50.937812 1 timeout.go:142] post-timeout activity - time-elapsed: 2.772685ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0407 06:48:50.938005 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:50.939947 1 trace.go:236] Trace[1529236408]: "Get" accept:application/json, */*,audit-id:b2afb4a7-1580-49b5-bc43-eaee43045161,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:40.935) (total time: 10004ms): Trace[1529236408]: [10.00476732s] [10.00476732s] END E0407 06:48:50.940491 1 timeout.go:142] post-timeout activity - time-elapsed: 4.39484ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0407 06:48:51.053554 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:51.053755 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:51.055004 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:51.055111 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:51.056387 1 trace.go:236] Trace[1019569110]: "Get" accept:application/json, */*,audit-id:d4cdcd3f-a7ad-46c7-b612-7b1ef6986522,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 06:48:48.054) (total time: 3001ms): Trace[1019569110]: [3.001792301s] [3.001792301s] END E0407 06:48:51.056655 1 timeout.go:142] post-timeout activity - time-elapsed: 3.250998ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0407 06:48:53.112927 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:53.113210 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:53.114070 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:53.115367 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:53.115493 1 trace.go:236] Trace[902001974]: "Get" accept:application/json, */*,audit-id:c8cd61b4-8167-4208-b70b-4ffbb05b5caf,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:43.112) (total time: 10002ms): Trace[902001974]: [10.002975491s] [10.002975491s] END E0407 06:48:53.115780 1 timeout.go:142] post-timeout activity - time-elapsed: 3.043523ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com" result: E0407 06:48:53.125078 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0407 06:48:53.125177 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:53.127115 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:53.127276 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0407 06:48:53.128524 1 trace.go:236] Trace[215703702]: "Get" accept:application/json, */*,audit-id:bf4d06d8-5078-47ca-8cc1-8dc26629128a,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:43.125) (total time: 10003ms): Trace[215703702]: [10.003343191s] [10.003343191s] END E0407 06:48:53.128791 1 timeout.go:142] post-timeout activity - time-elapsed: 3.538476ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com" result: E0407 06:48:53.141529 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0407 06:48:53.141561 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0407 06:48:53.141589 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.58µs, panicked: false, err: context canceled, panic-reason: E0407 06:48:53.142900 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0407 06:48:53.143187 1 timeout.go:142] post-timeout activity - time-elapsed: 1.613155ms, POST "/api/v1/namespaces/kube-system/events" result: E0407 06:48:53.588261 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:53.588607 1 trace.go:236] Trace[1859872658]: "Get" accept:application/json, */*,audit-id:a186984f-43b8-4b9f-a8bf-fad8be600140,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:43.829) (total time: 9759ms): Trace[1859872658]: [9.759160552s] [9.759160552s] END I0407 06:48:53.589316 1 trace.go:236] Trace[1380229734]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.204,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 06:48:44.489) (total time: 9099ms): Trace[1380229734]: [9.099309869s] [9.099309869s] END E0407 06:48:53.589390 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0407 06:48:53.589449 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0407 06:48:53.589571 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0407 06:48:53.589624 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0407 06:48:53.589679 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0407 06:48:53.590847 1 trace.go:236] Trace[1261192844]: "Get" accept:application/json,audit-id:96f7716b-e43a-49d5-807b-8e3fe785d74c,client:162.253.55.204,protocol:HTTP/1.1,resource:pods,scope:resource,url:/api/v1/namespaces/default/pods/test-pvc-pod,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (07-Apr-2026 06:48:41.314) (total time: 12276ms): Trace[1261192844]: [12.276475519s] [12.276475519s] END I0407 06:48:53.591025 1 trace.go:236] Trace[1626410757]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:96a81f12-0528-4327-a221-81957c1292b2,client:162.253.55.204,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-78446f96c9-wcmff,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 06:48:40.973) (total time: 12617ms): Trace[1626410757]: [12.617031581s] [12.617031581s] END I0407 06:48:53.591274 1 trace.go:236] Trace[467391512]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:512c7019-c344-4390-8b7a-00f285b40e55,client:162.253.55.204,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events/envoy-gateway-78446f96c9-wcmff.18a40050ff5d865f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 06:48:40.973) (total time: 12617ms): Trace[467391512]: ["GuaranteedUpdate etcd3" audit-id:512c7019-c344-4390-8b7a-00f285b40e55,key:/events/envoy-gateway-system/envoy-gateway-78446f96c9-wcmff.18a40050ff5d865f,type:*core.Event,resource:events 12617ms (06:48:40.974)] Trace[467391512]: [12.617218536s] [12.617218536s] END I0407 06:48:53.591328 1 trace.go:236] Trace[1348986637]: "Get" accept:application/json, */*,audit-id:d73bc052-b765-49d6-a671-387eb91dbe97,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 06:48:43.934) (total time: 9656ms): Trace[1348986637]: [9.656422105s] [9.656422105s] END I0407 06:48:53.966595 1 trace.go:236] Trace[35460484]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ca019513-436d-4f0e-af2c-7208524005aa,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 06:48:48.839) (total time: 5126ms): Trace[35460484]: ["GuaranteedUpdate etcd3" audit-id:ca019513-436d-4f0e-af2c-7208524005aa,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5126ms (06:48:48.839) Trace[35460484]: ---"Txn call completed" 5125ms (06:48:53.966)] Trace[35460484]: [5.126935077s] [5.126935077s] END I0407 06:48:53.966965 1 trace.go:236] Trace[1407107398]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8a8245c1-6f2f-472f-9f4e-a5f0df6a3eb6,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 06:48:48.724) (total time: 5242ms): Trace[1407107398]: ["GuaranteedUpdate etcd3" audit-id:8a8245c1-6f2f-472f-9f4e-a5f0df6a3eb6,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 5242ms (06:48:48.724) Trace[1407107398]: ---"Txn call completed" 5240ms (06:48:53.966)] Trace[1407107398]: [5.242184145s] [5.242184145s] END I0407 06:48:53.968505 1 trace.go:236] Trace[2029813697]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2994accc-8125-42ec-b389-ca46dd9745ff,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 06:48:50.620) (total time: 3348ms): Trace[2029813697]: ["GuaranteedUpdate etcd3" audit-id:2994accc-8125-42ec-b389-ca46dd9745ff,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3348ms (06:48:50.620) Trace[2029813697]: ---"Txn call completed" 3347ms (06:48:53.968)] Trace[2029813697]: [3.348344047s] [3.348344047s] END I0407 06:48:53.968680 1 trace.go:236] Trace[117145826]: "Update" accept:application/json, */*,audit-id:c3db11a5-a78a-41af-8e8d-9612af6874d0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:48:50.936) (total time: 3032ms): Trace[117145826]: ["GuaranteedUpdate etcd3" audit-id:c3db11a5-a78a-41af-8e8d-9612af6874d0,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3031ms (06:48:50.936) Trace[117145826]: ---"Txn call completed" 3030ms (06:48:53.968)] Trace[117145826]: [3.032307264s] [3.032307264s] END I0407 06:48:53.970785 1 trace.go:236] Trace[248780204]: "Update" accept:application/json, */*,audit-id:e3f0d278-4b3a-4f41-a13d-3988fc105896,client:162.253.55.204,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 06:48:51.054) (total time: 2915ms): Trace[248780204]: ["GuaranteedUpdate etcd3" audit-id:e3f0d278-4b3a-4f41-a13d-3988fc105896,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 2915ms (06:48:51.055) Trace[248780204]: ---"Txn call completed" 2914ms (06:48:53.970)] Trace[248780204]: [2.915862474s] [2.915862474s] END I0407 06:48:53.971199 1 trace.go:236] Trace[1311035169]: "Update" accept:application/json, */*,audit-id:596d9966-25b8-47f2-b687-28212990ef97,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (07-Apr-2026 06:48:50.936) (total time: 3034ms): Trace[1311035169]: ["GuaranteedUpdate etcd3" audit-id:596d9966-25b8-47f2-b687-28212990ef97,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3033ms (06:48:50.937) Trace[1311035169]: ---"Txn call completed" 3032ms (06:48:53.970)] Trace[1311035169]: [3.034301899s] [3.034301899s] END