I0529 02:07:37.788762       1 options.go:220] external host was not specified, using 199.204.45.222
I0529 02:07:37.790159       1 server.go:148] Version: v1.28.13
I0529 02:07:37.790177       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0529 02:07:38.175792       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0529 02:07:38.183127       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0529 02:07:38.183143       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0529 02:07:38.183327       1 instance.go:298] Using reconciler: lease
I0529 02:07:38.592546       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0529 02:07:38.592576       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0529 02:07:38.852719       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0529 02:07:38.852860       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0529 02:07:39.311893       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0529 02:07:39.324689       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0529 02:07:39.324721       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.324728       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.325115       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0529 02:07:39.325131       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0529 02:07:39.325893       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0529 02:07:39.326642       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0529 02:07:39.326659       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0529 02:07:39.326664       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0529 02:07:39.327974       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0529 02:07:39.327989       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0529 02:07:39.328741       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0529 02:07:39.328757       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.328762       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.329240       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0529 02:07:39.329254       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.329284       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0529 02:07:39.329778       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0529 02:07:39.331280       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0529 02:07:39.331296       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.331300       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.331600       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0529 02:07:39.331612       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.331615       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.332147       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0529 02:07:39.332159       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0529 02:07:39.333290       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0529 02:07:39.333304       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.333308       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.333598       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0529 02:07:39.333611       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.333614       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.336579       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0529 02:07:39.336597       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.336603       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.338964       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0529 02:07:39.341878       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0529 02:07:39.343329       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.343355       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.347408       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0529 02:07:39.347431       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0529 02:07:39.347437       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0529 02:07:39.348214       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0529 02:07:39.348227       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0529 02:07:39.348231       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0529 02:07:39.348619       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0529 02:07:39.348632       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0529 02:07:39.385912       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0529 02:07:39.386000       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0529 02:07:39.751898       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0529 02:07:39.751916       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0529 02:07:39.752124       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0529 02:07:39.752368       1 secure_serving.go:213] Serving securely on [::]:6443
I0529 02:07:39.752430       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0529 02:07:39.752564       1 controller.go:78] Starting OpenAPI AggregationController
I0529 02:07:39.752587       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0529 02:07:39.752595       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0529 02:07:39.752615       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0529 02:07:39.752629       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0529 02:07:39.752691       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0529 02:07:39.752733       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0529 02:07:39.752694       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0529 02:07:39.752762       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0529 02:07:39.752768       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0529 02:07:39.752786       1 available_controller.go:423] Starting AvailableConditionController
I0529 02:07:39.752805       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0529 02:07:39.752808       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0529 02:07:39.752795       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0529 02:07:39.752879       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0529 02:07:39.753239       1 controller.go:85] Starting OpenAPI V3 controller
I0529 02:07:39.753270       1 naming_controller.go:291] Starting NamingConditionController
I0529 02:07:39.753286       1 establishing_controller.go:76] Starting EstablishingController
I0529 02:07:39.753301       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0529 02:07:39.753321       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0529 02:07:39.753340       1 crd_finalizer.go:266] Starting CRDFinalizer
I0529 02:07:39.753583       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0529 02:07:39.754076       1 controller.go:134] Starting OpenAPI controller
I0529 02:07:39.753600       1 controller.go:116] Starting legacy_token_tracking_controller
I0529 02:07:39.754585       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0529 02:07:39.755319       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0529 02:07:39.755344       1 aggregator.go:164] waiting for initial CRD sync...
I0529 02:07:39.775940       1 shared_informer.go:318] Caches are synced for node_authorizer
I0529 02:07:39.776115       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0529 02:07:39.776131       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0529 02:07:39.776139       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0529 02:07:39.776156       1 aggregator.go:166] initial CRD sync complete...
I0529 02:07:39.776167       1 autoregister_controller.go:141] Starting autoregister controller
I0529 02:07:39.776173       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0529 02:07:39.776184       1 cache.go:39] Caches are synced for autoregister controller
E0529 02:07:39.823012       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0529 02:07:39.852896       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0529 02:07:39.852913       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0529 02:07:39.853042       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0529 02:07:39.853130       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0529 02:07:39.852932       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0529 02:07:39.854483       1 controller.go:624] quota admission added evaluator for: namespaces
I0529 02:07:39.854857       1 shared_informer.go:318] Caches are synced for configmaps
I0529 02:07:40.025794       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0529 02:07:40.759310       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0529 02:07:40.764885       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0529 02:07:40.764905       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0529 02:07:41.296528       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0529 02:07:41.341672       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0529 02:07:41.465958       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0529 02:07:41.472713       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.222]
I0529 02:07:41.474090       1 controller.go:624] quota admission added evaluator for: endpoints
I0529 02:07:41.478699       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0529 02:07:43.015404       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0529 02:07:43.399343       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0529 02:07:43.411835       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0529 02:07:43.419959       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0529 02:07:47.967468       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0529 02:07:48.168865       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0529 02:08:13.381762       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0529 02:08:13.404772       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0529 02:08:13.444379       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0529 02:08:13.466919       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0529 02:08:13.476926       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0529 02:08:13.486459       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0529 02:08:13.486494       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0529 02:08:13.512247       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0529 02:08:13.512280       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0529 02:08:13.522379       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0529 02:08:13.581699       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0529 02:08:13.581758       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0529 02:08:13.607097       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0529 02:08:13.607134       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0529 02:08:13.644986       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0529 02:08:13.768971       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0529 02:08:13.769010       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0529 02:08:13.777569       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:13.839909       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:13.887679       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:13.917730       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:13.928391       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:14.485502       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:14.496380       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:14.601149       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0529 02:08:20.290923       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0529 02:08:21.090762       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0529 02:08:21.103667       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0529 02:08:21.109262       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0529 02:08:21.292987       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0529 02:08:21.488092       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0529 02:08:21.720373       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0529 02:08:22.107907       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0529 02:08:23.693436       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0529 02:08:24.314469       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0529 02:08:24.700372       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0529 02:08:25.118541       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0529 02:08:33.816256       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0529 02:08:33.816296       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0529 02:08:34.279578       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0529 02:08:40.783287       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.111.185.78"}
W0529 02:08:40.816197       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.185.78:9443: connect: connection refused
E0529 02:08:40.816315       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.111.185.78:9443: connect: connection refused
I0529 02:09:47.925577       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.110.45.237"}
I0529 02:09:47.934108       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.104.182.111"}
E0529 02:11:03.496387       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:03.496432       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:03.496493       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 25.09µs, panicked: false, err: context canceled, panic-reason: <nil>
E0529 02:11:03.497852       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:03.497942       1 trace.go:236] Trace[1401785433]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:533978ed-9f6c-4a36-bd6b-8481bee9923f,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 02:10:58.496) (total time: 5001ms):
Trace[1401785433]: ["GuaranteedUpdate etcd3" audit-id:533978ed-9f6c-4a36-bd6b-8481bee9923f,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (02:10:58.496)
Trace[1401785433]:  ---"Txn call failed" err:context canceled 4998ms (02:11:03.496)]
Trace[1401785433]: [5.001251308s] [5.001251308s] END
E0529 02:11:03.498094       1 timeout.go:142] post-timeout activity - time-elapsed: 1.392926ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0529 02:11:03.578144       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:03.578231       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:03.579257       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:03.579303       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:03.580406       1 trace.go:236] Trace[229351780]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0ad91e2c-b934-4da8-ac76-c0be94e1c42a,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 02:10:58.578) (total time: 5001ms):
Trace[229351780]: [5.001735367s] [5.001735367s] END
E0529 02:11:03.580561       1 timeout.go:142] post-timeout activity - time-elapsed: 2.405835ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0529 02:11:03.902325       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:03.902491       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:03.903617       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:03.903677       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:03.904751       1 trace.go:236] Trace[2125815346]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:68bc4c48-ef10-419f-8266-4a48a6cf77cb,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 02:10:58.901) (total time: 5002ms):
Trace[2125815346]: [5.002870869s] [5.002870869s] END
E0529 02:11:03.904906       1 timeout.go:142] post-timeout activity - time-elapsed: 2.579248ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0529 02:11:04.958822       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0529 02:11:04.958913       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:04.960088       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:04.960142       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:04.961254       1 trace.go:236] Trace[1597479486]: "Get" accept:application/json, */*,audit-id:d280924d-d2d5-4213-8a95-9dc10989b5af,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 02:10:59.958) (total time: 5002ms):
Trace[1597479486]: [5.002641723s] [5.002641723s] END
E0529 02:11:04.961421       1 timeout.go:142] post-timeout activity - time-elapsed: 2.525568ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0529 02:11:05.550643       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0529 02:11:05.550792       1 trace.go:236] Trace[501053509]: "Get" accept:application/json, */*,audit-id:6d86c917-301e-4aca-9ce9-061332e375b1,client:10.0.0.113,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:10:58.548) (total time: 7001ms):
Trace[501053509]: [7.001769592s] [7.001769592s] END
E0529 02:11:08.496867       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:08.497109       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:08.497973       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:08.498291       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:08.499164       1 trace.go:236] Trace[464988845]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d12e7245-cf6f-4684-9dbe-fd75b9a06293,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 02:11:03.497) (total time: 5001ms):
Trace[464988845]: [5.001484701s] [5.001484701s] END
E0529 02:11:08.499309       1 timeout.go:142] post-timeout activity - time-elapsed: 2.423306ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0529 02:11:08.578008       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:08.578110       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:08.579831       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:08.579925       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:08.581069       1 trace.go:236] Trace[1567504305]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8a70ae1c-fbf9-479e-af58-d2f77394c036,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 02:11:05.579) (total time: 3001ms):
Trace[1567504305]: [3.001039498s] [3.001039498s] END
E0529 02:11:08.581164       1 timeout.go:142] post-timeout activity - time-elapsed: 3.063658ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0529 02:11:08.678461       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:08.678559       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:08.679577       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:08.679631       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:08.680743       1 trace.go:236] Trace[142745141]: "Get" accept:application/json, */*,audit-id:9d1d9105-cab8-4536-a3ca-f559c14a43f2,client:10.0.0.113,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 02:10:58.678) (total time: 10002ms):
Trace[142745141]: [10.002382911s] [10.002382911s] END
E0529 02:11:08.680877       1 timeout.go:142] post-timeout activity - time-elapsed: 2.566417ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system" result: <nil>
E0529 02:11:08.901853       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:08.902010       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:08.902959       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:08.903416       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:08.904562       1 trace.go:236] Trace[985948461]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1ea63923-b947-4565-8c61-4322ac01a12a,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 02:11:05.904) (total time: 3000ms):
Trace[985948461]: [3.000228572s] [3.000228572s] END
E0529 02:11:08.904680       1 timeout.go:142] post-timeout activity - time-elapsed: 2.874914ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0529 02:11:09.094536       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:09.094672       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:09.095611       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:09.096193       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:09.096720       1 trace.go:236] Trace[1894050060]: "Get" accept:application/json, */*,audit-id:a1868595-cee3-4794-bff9-188db2941358,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:10:59.093) (total time: 10002ms):
Trace[1894050060]: [10.002988154s] [10.002988154s] END
E0529 02:11:09.096965       1 timeout.go:142] post-timeout activity - time-elapsed: 2.441476ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0529 02:11:09.161913       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:09.162019       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:09.162994       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:09.163184       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:09.164338       1 trace.go:236] Trace[1238867201]: "Get" accept:application/json, */*,audit-id:38288759-dabb-443f-87e5-162d5bf6e5e8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:10:59.161) (total time: 10002ms):
Trace[1238867201]: [10.002332621s] [10.002332621s] END
E0529 02:11:09.164571       1 timeout.go:142] post-timeout activity - time-elapsed: 2.638799ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0529 02:11:09.959013       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:09.959132       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:09.960171       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:09.960217       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:09.961278       1 trace.go:236] Trace[1765973834]: "Get" accept:application/json, */*,audit-id:567f3df6-1fcc-4950-a404-2a069781ff23,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 02:11:06.960) (total time: 3000ms):
Trace[1765973834]: [3.000897516s] [3.000897516s] END
E0529 02:11:09.961459       1 timeout.go:142] post-timeout activity - time-elapsed: 2.449636ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0529 02:11:10.014494       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:10.014620       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:10.016371       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:10.016460       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:10.017507       1 trace.go:236] Trace[517009208]: "Get" accept:application/json, */*,audit-id:21b42a5e-79ef-4206-b723-9e15e82cf474,client:10.0.0.113,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:11:00.014) (total time: 10002ms):
Trace[517009208]: [10.00277952s] [10.00277952s] END
E0529 02:11:10.017635       1 timeout.go:142] post-timeout activity - time-elapsed: 3.038938ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com" result: <nil>
E0529 02:11:10.883798       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0529 02:11:10.884051       1 trace.go:236] Trace[1675468629]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:85123619-8ab4-4e67-804a-911427f25f12,client:199.204.45.222,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-May-2026 02:11:03.881) (total time: 7002ms):
Trace[1675468629]: ["Create etcd3" audit-id:85123619-8ab4-4e67-804a-911427f25f12,key:/events/kube-system/kube-apiserver-instance.18b3e75ce369b3a8,type:*core.Event,resource:events 7002ms (02:11:03.881)]
Trace[1675468629]: [7.002836832s] [7.002836832s] END
E0529 02:11:11.145168       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:11.145355       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:11.146255       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:11.146591       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:11.147633       1 trace.go:236] Trace[450314884]: "Get" accept:application/json, */*,audit-id:2d261d04-9584-4f65-be6d-639009af71e2,client:10.0.0.113,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:11:01.144) (total time: 10003ms):
Trace[450314884]: [10.003137036s] [10.003137036s] END
E0529 02:11:11.147787       1 timeout.go:142] post-timeout activity - time-elapsed: 2.704911ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com" result: <nil>
E0529 02:11:11.149962       1 wrap.go:54] timeout or abort while handling: method=POST URI="/api/v1/namespaces/kube-system/events" audit-ID="0cc889fc-e5ce-42c5-ab95-42ae2659ff06"
E0529 02:11:11.150076       1 timeout.go:142] post-timeout activity - time-elapsed: 46.291µs, POST "/api/v1/namespaces/kube-system/events" result: <nil>
E0529 02:11:11.267921       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0529 02:11:11.268099       1 trace.go:236] Trace[879337672]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d1aa7cdf-b1be-4741-9257-8d7472faa9c6,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 02:11:04.264) (total time: 7003ms):
Trace[879337672]: ["GuaranteedUpdate etcd3" audit-id:d1aa7cdf-b1be-4741-9257-8d7472faa9c6,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (02:11:04.264)
Trace[879337672]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (02:11:11.267)]
Trace[879337672]: [7.003453034s] [7.003453034s] END
E0529 02:11:11.268727       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
E0529 02:11:12.458237       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0529 02:11:12.458350       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0529 02:11:12.459657       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0529 02:11:12.459723       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0529 02:11:12.461004       1 trace.go:236] Trace[1897355394]: "Get" accept:application/json, */*,audit-id:238a78b2-65f0-4908-a513-8d88b7b81c5b,client:10.0.0.113,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 02:11:02.457) (total time: 10002ms):
Trace[1897355394]: [10.002988433s] [10.002988433s] END
E0529 02:11:12.461174       1 timeout.go:142] post-timeout activity - time-elapsed: 2.982246ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com" result: <nil>
I0529 02:11:12.552251       1 trace.go:236] Trace[2146066194]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.222,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 02:11:01.471) (total time: 11080ms):
Trace[2146066194]: [11.080315019s] [11.080315019s] END
E0529 02:11:12.552355       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
I0529 02:11:13.537152       1 trace.go:236] Trace[1390269484]: "Update" accept:application/json, */*,audit-id:fdd91d56-f58b-401f-bba1-9f9e27ad23a0,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 02:11:09.959) (total time: 3577ms):
Trace[1390269484]: ["GuaranteedUpdate etcd3" audit-id:fdd91d56-f58b-401f-bba1-9f9e27ad23a0,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3576ms (02:11:09.960)
Trace[1390269484]:  ---"Txn call completed" 3575ms (02:11:13.536)]
Trace[1390269484]: [3.577167415s] [3.577167415s] END
I0529 02:11:13.537291       1 trace.go:236] Trace[1919371965]: "Update" accept:application/json, */*,audit-id:3b931e0e-ca59-4bd7-870c-46ebc85bdb1c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 02:11:09.162) (total time: 4374ms):
Trace[1919371965]: ["GuaranteedUpdate etcd3" audit-id:3b931e0e-ca59-4bd7-870c-46ebc85bdb1c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 4374ms (02:11:09.163)
Trace[1919371965]:  ---"Txn call completed" 4373ms (02:11:13.537)]
Trace[1919371965]: [4.374393996s] [4.374393996s] END
I0529 02:11:13.537353       1 trace.go:236] Trace[904194719]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:30b45182-c190-4bad-86b4-ca1ad3485045,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 02:11:06.766) (total time: 6770ms):
Trace[904194719]: ["GuaranteedUpdate etcd3" audit-id:30b45182-c190-4bad-86b4-ca1ad3485045,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6770ms (02:11:06.766)
Trace[904194719]:  ---"Txn call completed" 6769ms (02:11:13.537)]
Trace[904194719]: [6.770733971s] [6.770733971s] END
I0529 02:11:13.537561       1 trace.go:236] Trace[2048453095]: "Update" accept:application/json, */*,audit-id:162c0c62-dfd6-4611-83a7-8827fba1c9ea,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 02:11:09.096) (total time: 4441ms):
Trace[2048453095]: ["GuaranteedUpdate etcd3" audit-id:162c0c62-dfd6-4611-83a7-8827fba1c9ea,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 4440ms (02:11:09.096)
Trace[2048453095]:  ---"Txn call completed" 4439ms (02:11:13.537)]
Trace[2048453095]: [4.441250862s] [4.441250862s] END
E0529 02:11:13.538343       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 2.388316982s, panicked: false, err: context canceled, panic-reason: <nil>
I0529 02:11:13.539880       1 trace.go:236] Trace[890150617]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a3a0ba6f-62b7-4b16-82ff-b3a375cf0069,client:199.204.45.222,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 02:11:08.902) (total time: 4636ms):
Trace[890150617]: ["GuaranteedUpdate etcd3" audit-id:a3a0ba6f-62b7-4b16-82ff-b3a375cf0069,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 4636ms (02:11:08.902)
Trace[890150617]:  ---"Txn call completed" 4633ms (02:11:13.536)]
Trace[890150617]: [4.63692525s] [4.63692525s] END
I0529 02:11:13.553311       1 trace.go:236] Trace[1875175350]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:49c8e784-0b86-4667-b13b-07321f049f22,client:199.204.45.222,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18b3e75ce369b3a8,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-May-2026 02:11:10.886) (total time: 2666ms):
Trace[1875175350]: ["GuaranteedUpdate etcd3" audit-id:49c8e784-0b86-4667-b13b-07321f049f22,key:/events/kube-system/kube-apiserver-instance.18b3e75ce369b3a8,type:*core.Event,resource:events 2666ms (02:11:10.886)
Trace[1875175350]:  ---"initial value restored" 2666ms (02:11:13.553)]
Trace[1875175350]: [2.666898498s] [2.666898498s] END
I0529 02:11:13.553702       1 trace.go:236] Trace[1843726786]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e87dd418-a640-4388-807d-38bcc0653f04,client:199.204.45.222,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 02:11:11.899) (total time: 1654ms):
Trace[1843726786]: ---"About to write a response" 1654ms (02:11:13.553)
Trace[1843726786]: [1.654626105s] [1.654626105s] END
I0529 02:11:13.553870       1 trace.go:236] Trace[746931711]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a2df4d0b-fe02-4af2-b41a-500a188ea535,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 02:11:11.269) (total time: 2284ms):
Trace[746931711]: ["GuaranteedUpdate etcd3" audit-id:a2df4d0b-fe02-4af2-b41a-500a188ea535,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2284ms (02:11:11.269)
Trace[746931711]:  ---"Txn call completed" 2283ms (02:11:13.553)]
Trace[746931711]: [2.284384919s] [2.284384919s] END
E0529 02:11:13.554183       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0529 02:11:13.565620       1 trace.go:236] Trace[1870064576]: "Create" accept:application/json, */*,audit-id:241fdcdb-1062-4572-9646-5cede7d3d512,client:10.0.0.107,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (29-May-2026 02:11:08.499) (total time: 5066ms):
Trace[1870064576]: ["Create etcd3" audit-id:241fdcdb-1062-4572-9646-5cede7d3d512,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18b3e75df697a4d5,type:*core.Event,resource:events 5065ms (02:11:08.500)
Trace[1870064576]:  ---"TransformToStorage succeeded" 5037ms (02:11:13.538)]
Trace[1870064576]: [5.066409102s] [5.066409102s] END
I0529 02:11:13.570711       1 trace.go:236] Trace[301731435]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.222,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 02:11:12.552) (total time: 1018ms):
Trace[301731435]: ---"initial value restored" 1012ms (02:11:13.565)
Trace[301731435]: [1.018264956s] [1.018264956s] END