I0227 01:23:44.722671       1 options.go:220] external host was not specified, using 199.204.45.22
I0227 01:23:44.724137       1 server.go:148] Version: v1.28.13
I0227 01:23:44.724200       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0227 01:23:45.161673       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0227 01:23:45.169204       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0227 01:23:45.169224       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0227 01:23:45.169394       1 instance.go:298] Using reconciler: lease
I0227 01:23:45.222570       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0227 01:23:45.222603       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0227 01:23:45.484308       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0227 01:23:45.484498       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0227 01:23:45.956766       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0227 01:23:45.975064       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0227 01:23:45.975092       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.975111       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.975558       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0227 01:23:45.975573       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0227 01:23:45.976559       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0227 01:23:45.977524       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0227 01:23:45.977541       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0227 01:23:45.977546       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0227 01:23:45.979029       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0227 01:23:45.979047       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0227 01:23:45.979702       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0227 01:23:45.979715       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.979718       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.980152       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0227 01:23:45.980165       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.980189       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0227 01:23:45.980618       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0227 01:23:45.981695       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0227 01:23:45.981707       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.981711       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.982011       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0227 01:23:45.982021       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.982024       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.985830       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0227 01:23:45.985851       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0227 01:23:45.989909       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0227 01:23:45.989925       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.989939       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.991143       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0227 01:23:45.991177       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.991184       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.995571       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0227 01:23:45.995590       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.995596       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:45.996682       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0227 01:23:45.997731       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0227 01:23:45.997749       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0227 01:23:45.997755       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:46.001193       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0227 01:23:46.001207       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0227 01:23:46.001211       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0227 01:23:46.001963       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0227 01:23:46.001976       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0227 01:23:46.001980       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0227 01:23:46.002417       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0227 01:23:46.002429       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0227 01:23:46.040772       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0227 01:23:46.040815       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0227 01:23:46.435502       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0227 01:23:46.435558       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0227 01:23:46.435756       1 secure_serving.go:213] Serving securely on [::]:6443
I0227 01:23:46.435870       1 controller.go:78] Starting OpenAPI AggregationController
I0227 01:23:46.435971       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0227 01:23:46.436120       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0227 01:23:46.436261       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0227 01:23:46.436338       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0227 01:23:46.436363       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0227 01:23:46.436409       1 controller.go:134] Starting OpenAPI controller
I0227 01:23:46.435826       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0227 01:23:46.436474       1 controller.go:116] Starting legacy_token_tracking_controller
I0227 01:23:46.436555       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0227 01:23:46.436570       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0227 01:23:46.436592       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0227 01:23:46.436606       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0227 01:23:46.436621       1 available_controller.go:423] Starting AvailableConditionController
I0227 01:23:46.436626       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0227 01:23:46.436805       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0227 01:23:46.436886       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0227 01:23:46.436893       1 controller.go:85] Starting OpenAPI V3 controller
I0227 01:23:46.436942       1 naming_controller.go:291] Starting NamingConditionController
I0227 01:23:46.436971       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0227 01:23:46.437025       1 crd_finalizer.go:266] Starting CRDFinalizer
I0227 01:23:46.437145       1 aggregator.go:164] waiting for initial CRD sync...
I0227 01:23:46.437166       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0227 01:23:46.437550       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0227 01:23:46.437579       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0227 01:23:46.438511       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0227 01:23:46.438531       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0227 01:23:46.435518       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0227 01:23:46.436980       1 establishing_controller.go:76] Starting EstablishingController
I0227 01:23:46.436995       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0227 01:23:46.437011       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0227 01:23:46.537265       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0227 01:23:46.537281       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0227 01:23:46.537346       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0227 01:23:46.537396       1 shared_informer.go:318] Caches are synced for configmaps
I0227 01:23:46.537741       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0227 01:23:46.537762       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0227 01:23:46.538764       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0227 01:23:46.538808       1 aggregator.go:166] initial CRD sync complete...
I0227 01:23:46.538820       1 autoregister_controller.go:141] Starting autoregister controller
I0227 01:23:46.538830       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0227 01:23:46.538840       1 cache.go:39] Caches are synced for autoregister controller
I0227 01:23:46.542446       1 controller.go:624] quota admission added evaluator for: namespaces
I0227 01:23:46.562362       1 shared_informer.go:318] Caches are synced for node_authorizer
I0227 01:23:46.572091       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0227 01:23:47.448217       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0227 01:23:47.453000       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0227 01:23:47.453044       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0227 01:23:48.050136       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0227 01:23:48.100691       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0227 01:23:48.158950       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0227 01:23:48.166018       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.22]
I0227 01:23:48.167228       1 controller.go:624] quota admission added evaluator for: endpoints
I0227 01:23:48.171321       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0227 01:23:48.627015       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0227 01:23:49.901827       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0227 01:23:49.963513       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0227 01:23:50.165004       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0227 01:23:53.467675       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0227 01:23:53.517156       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0227 01:24:22.872923       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0227 01:24:22.881624       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:23.068529       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0227 01:24:23.315344       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0227 01:24:23.664580       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:23.873015       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0227 01:24:24.074321       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0227 01:24:24.294822       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:25.278483       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:26.488537       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:26.867796       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0227 01:24:36.510676       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0227 01:25:13.517711       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.98.114.251"}
I0227 01:25:13.524207       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.106.203.112"}
I0227 01:26:19.426785       1 trace.go:236] Trace[1616782074]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 01:26:18.158) (total time: 1267ms):
Trace[1616782074]: ---"Transaction prepared" 1230ms (01:26:19.390)
Trace[1616782074]: [1.267746052s] [1.267746052s] END
I0227 01:26:19.427712       1 trace.go:236] Trace[238453106]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:870c50dc-f593-45d4-8246-4d5fe0df609b,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:26:18.208) (total time: 1218ms):
Trace[238453106]: ---"About to write a response" 1218ms (01:26:19.427)
Trace[238453106]: [1.218933424s] [1.218933424s] END
I0227 01:26:33.176990       1 trace.go:236] Trace[1145548159]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:61bd030c-77ea-4c5d-a863-139115aa0230,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:26:30.016) (total time: 3160ms):
Trace[1145548159]: ---"About to write a response" 3160ms (01:26:33.176)
Trace[1145548159]: [3.160388146s] [3.160388146s] END
I0227 01:26:33.176993       1 trace.go:236] Trace[1761610108]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:735c4dd8-3c6e-4ef2-a31f-ab038d768d73,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 01:26:29.776) (total time: 3400ms):
Trace[1761610108]: ["GuaranteedUpdate etcd3" audit-id:735c4dd8-3c6e-4ef2-a31f-ab038d768d73,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3400ms (01:26:29.776)
Trace[1761610108]:  ---"Txn call completed" 3400ms (01:26:33.176)]
Trace[1761610108]: [3.400845635s] [3.400845635s] END
I0227 01:26:33.177840       1 trace.go:236] Trace[1759486147]: "Get" accept:application/json, */*,audit-id:d8b37aba-4590-484c-baf9-5c72afd2104c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:26:31.488) (total time: 1689ms):
Trace[1759486147]: ---"About to write a response" 1688ms (01:26:33.177)
Trace[1759486147]: [1.689016096s] [1.689016096s] END
I0227 01:26:33.177893       1 trace.go:236] Trace[973891429]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7a3e34cb-9a75-4c7c-b778-8e2b879cdd7e,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:26:31.491) (total time: 1686ms):
Trace[973891429]: ---"About to write a response" 1686ms (01:26:33.177)
Trace[973891429]: [1.686597573s] [1.686597573s] END
I0227 01:26:33.177974       1 trace.go:236] Trace[224284959]: "Get" accept:application/json, */*,audit-id:d4c234eb-8e6f-47e8-ac2d-59e094abe152,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:26:31.491) (total time: 1686ms):
Trace[224284959]: ---"About to write a response" 1686ms (01:26:33.177)
Trace[224284959]: [1.686178774s] [1.686178774s] END
I0227 01:26:33.178440       1 trace.go:236] Trace[838673908]: "Get" accept:application/json, */*,audit-id:373269e4-7094-46fe-8c23-747c594edd4f,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:26:31.626) (total time: 1551ms):
Trace[838673908]: ---"About to write a response" 1551ms (01:26:33.178)
Trace[838673908]: [1.551719725s] [1.551719725s] END
I0227 01:26:33.178458       1 trace.go:236] Trace[1381974691]: "Get" accept:application/json, */*,audit-id:b79f83be-7b8d-4064-8547-41324619b564,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:26:31.934) (total time: 1244ms):
Trace[1381974691]: ---"About to write a response" 1244ms (01:26:33.178)
Trace[1381974691]: [1.244134248s] [1.244134248s] END
I0227 01:26:33.178608       1 trace.go:236] Trace[2029146094]: "Get" accept:application/json, */*,audit-id:c6878bfd-6247-4c95-85b6-e3bedb3136c4,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:26:31.491) (total time: 1687ms):
Trace[2029146094]: ---"About to write a response" 1686ms (01:26:33.177)
Trace[2029146094]: [1.687399525s] [1.687399525s] END
I0227 01:26:48.781597       1 trace.go:236] Trace[104181180]: "Update" accept:application/json, */*,audit-id:db1e0612-8d3f-4515-9bfe-17855612c86b,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:48.250) (total time: 531ms):
Trace[104181180]: ["GuaranteedUpdate etcd3" audit-id:db1e0612-8d3f-4515-9bfe-17855612c86b,key:/leases/kube-system/external-snapshotter-leader-rbd-csi-ceph-com,type:*coordination.Lease,resource:leases.coordination.k8s.io 531ms (01:26:48.250)
Trace[104181180]:  ---"Txn call completed" 530ms (01:26:48.781)]
Trace[104181180]: [531.253287ms] [531.253287ms] END
I0227 01:26:49.879936       1 trace.go:236] Trace[1764880369]: "Update" accept:application/json, */*,audit-id:32686bd6-d7d8-4a96-9361-d3b572ccaec0,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:48.250) (total time: 1629ms):
Trace[1764880369]: ["GuaranteedUpdate etcd3" audit-id:32686bd6-d7d8-4a96-9361-d3b572ccaec0,key:/leases/kube-system/external-resizer-rbd-csi-ceph-com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1629ms (01:26:48.250)
Trace[1764880369]:  ---"Txn call completed" 1628ms (01:26:49.879)]
Trace[1764880369]: [1.629329489s] [1.629329489s] END
I0227 01:26:51.500489       1 trace.go:236] Trace[1340732708]: "Update" accept:application/json, */*,audit-id:9c2a1e5a-dc88-45e8-a345-177bef37976a,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:49.883) (total time: 1616ms):
Trace[1340732708]: ["GuaranteedUpdate etcd3" audit-id:9c2a1e5a-dc88-45e8-a345-177bef37976a,key:/leases/kube-system/external-attacher-leader-rbd-csi-ceph-com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1616ms (01:26:49.883)
Trace[1340732708]:  ---"Txn call completed" 1615ms (01:26:51.500)]
Trace[1340732708]: [1.616630164s] [1.616630164s] END
I0227 01:26:51.500589       1 trace.go:236] Trace[270307523]: "Update" accept:application/json, */*,audit-id:396593ba-81e8-470c-908e-d6203ae88aec,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:49.882) (total time: 1618ms):
Trace[270307523]: ["GuaranteedUpdate etcd3" audit-id:396593ba-81e8-470c-908e-d6203ae88aec,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1617ms (01:26:49.882)
Trace[270307523]:  ---"Txn call completed" 1616ms (01:26:51.500)]
Trace[270307523]: [1.618070953s] [1.618070953s] END
I0227 01:26:51.500766       1 trace.go:236] Trace[1194290697]: "Update" accept:application/json, */*,audit-id:94724865-cbe7-4a5b-aebb-d788c7a23f30,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 01:26:49.882) (total time: 1618ms):
Trace[1194290697]: ["GuaranteedUpdate etcd3" audit-id:94724865-cbe7-4a5b-aebb-d788c7a23f30,key:/leases/kube-system/rbd.csi.ceph.com-kube-system,type:*coordination.Lease,resource:leases.coordination.k8s.io 1617ms (01:26:49.882)
Trace[1194290697]:  ---"Txn call completed" 1615ms (01:26:51.500)]
Trace[1194290697]: [1.618051411s] [1.618051411s] END
I0227 01:26:51.500995       1 trace.go:236] Trace[295218209]: "Update" accept:application/json, */*,audit-id:481fbedb-2f80-4645-bf9c-f88ce24469b9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:49.897) (total time: 1602ms):
Trace[295218209]: ["GuaranteedUpdate etcd3" audit-id:481fbedb-2f80-4645-bf9c-f88ce24469b9,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1602ms (01:26:49.898)
Trace[295218209]:  ---"Txn call completed" 1602ms (01:26:51.500)]
Trace[295218209]: [1.602980627s] [1.602980627s] END
I0227 01:26:51.501895       1 trace.go:236] Trace[1640267469]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:efb8194f-dfa5-4dd7-8e47-5372c168526d,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Feb-2026 01:26:49.898) (total time: 1603ms):
Trace[1640267469]: ["GuaranteedUpdate etcd3" audit-id:efb8194f-dfa5-4dd7-8e47-5372c168526d,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1602ms (01:26:49.898)
Trace[1640267469]:  ---"Txn call completed" 1602ms (01:26:51.501)]
Trace[1640267469]: [1.603004856s] [1.603004856s] END
I0227 01:26:51.501975       1 trace.go:236] Trace[40196372]: "Update" accept:application/json, */*,audit-id:ff65923b-552f-4387-8fbf-eddd4822b7d2,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:26:49.898) (total time: 1602ms):
Trace[40196372]: ["GuaranteedUpdate etcd3" audit-id:ff65923b-552f-4387-8fbf-eddd4822b7d2,key:/leases/kube-system/rbd-csi-ceph-com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1602ms (01:26:49.899)
Trace[40196372]:  ---"Txn call completed" 1602ms (01:26:51.501)]
Trace[40196372]: [1.602989987s] [1.602989987s] END
I0227 01:26:51.501982       1 trace.go:236] Trace[1513057118]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:66b9ea79-77bb-4ca0-a93f-7ad039f997f3,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Feb-2026 01:26:49.897) (total time: 1604ms):
Trace[1513057118]: ["GuaranteedUpdate etcd3" audit-id:66b9ea79-77bb-4ca0-a93f-7ad039f997f3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1604ms (01:26:49.897)
Trace[1513057118]:  ---"Txn call completed" 1602ms (01:26:51.501)]
Trace[1513057118]: [1.604136227s] [1.604136227s] END
I0227 01:26:51.502270       1 trace.go:236] Trace[842373743]: "Update" accept:application/json, */*,audit-id:fb6c740b-3561-4152-9a36-7c911ed02c21,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 01:26:49.898) (total time: 1603ms):
Trace[842373743]: ["GuaranteedUpdate etcd3" audit-id:fb6c740b-3561-4152-9a36-7c911ed02c21,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1603ms (01:26:49.898)
Trace[842373743]:  ---"Txn call completed" 1603ms (01:26:51.501)]
Trace[842373743]: [1.603989602s] [1.603989602s] END
E0227 01:27:38.727658       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 80.422µs, panicked: false, err: context canceled, panic-reason: <nil>
E0227 01:27:38.727702       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:38.729019       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:38.729200       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:38.730234       1 trace.go:236] Trace[1615308623]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d1577341-f666-4b3a-8672-3dff17212488,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Feb-2026 01:27:33.727) (total time: 5002ms):
Trace[1615308623]: ["GuaranteedUpdate etcd3" audit-id:d1577341-f666-4b3a-8672-3dff17212488,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (01:27:33.727)
Trace[1615308623]:  ---"Txn call failed" err:context canceled 4999ms (01:27:38.727)]
Trace[1615308623]: [5.002807004s] [5.002807004s] END
E0227 01:27:38.730426       1 timeout.go:142] post-timeout activity - time-elapsed: 2.706269ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0227 01:27:38.730753       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:38.731866       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:38.731902       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:38.732990       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:38.733196       1 trace.go:236] Trace[734963921]: "Get" accept:application/json, */*,audit-id:4c41ff93-129a-4a45-893e-06b63602b353,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:27:33.730) (total time: 5002ms):
Trace[734963921]: [5.002614589s] [5.002614589s] END
E0227 01:27:38.733602       1 timeout.go:142] post-timeout activity - time-elapsed: 3.195831ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0227 01:27:40.689656       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
I0227 01:27:40.689814       1 trace.go:236] Trace[615975557]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e64e01f9-fc35-4458-9e84-d30228254ce6,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:27:35.689) (total time: 4999ms):
Trace[615975557]: [4.999907889s] [4.999907889s] END
E0227 01:27:40.690057       1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s" audit-ID="e64e01f9-fc35-4458-9e84-d30228254ce6"
E0227 01:27:40.690103       1 timeout.go:142] post-timeout activity - time-elapsed: 5.01µs, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0227 01:27:40.731657       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
E0227 01:27:40.731731       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:40.731833       1 trace.go:236] Trace[928474662]: "Get" accept:application/json, */*,audit-id:6f751eae-def5-4b09-b9a7-9a93c9466016,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:27:33.729) (total time: 7001ms):
Trace[928474662]: [7.00193537s] [7.00193537s] END
I0227 01:27:40.733831       1 trace.go:236] Trace[132284907]: "Update" accept:application/json, */*,audit-id:92a4dd94-d707-4de7-8a4d-cfec075f8fb0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:27:33.729) (total time: 7004ms):
Trace[132284907]: ["GuaranteedUpdate etcd3" audit-id:92a4dd94-d707-4de7-8a4d-cfec075f8fb0,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (01:27:33.729)
Trace[132284907]:  ---"Txn call failed" err:etcdserver: request timed out 7000ms (01:27:40.731)]
Trace[132284907]: [7.004432104s] [7.004432104s] END
E0227 01:27:41.284765       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:41.284887       1 trace.go:236] Trace[68886434]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05cbcf13-ed37-4aeb-a94d-6aa9d52f5284,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 01:27:34.281) (total time: 7003ms):
Trace[68886434]: ["GuaranteedUpdate etcd3" audit-id:05cbcf13-ed37-4aeb-a94d-6aa9d52f5284,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (01:27:34.281)
Trace[68886434]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (01:27:41.284)]
Trace[68886434]: [7.0030853s] [7.0030853s] END
E0227 01:27:43.724100       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:43.724216       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:43.725565       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:43.725595       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0227 01:27:43.726522       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
I0227 01:27:43.726629       1 trace.go:236] Trace[1433974320]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b59885ef-2a6d-4be8-b68c-d3590ec9377e,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:27:40.729) (total time: 2997ms):
Trace[1433974320]: [2.997517659s] [2.997517659s] END
E0227 01:27:43.726708       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:43.726710       1 timeout.go:142] post-timeout activity - time-elapsed: 2.534515ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0227 01:27:43.728881       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:43.728911       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0227 01:27:43.729359       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:43.730762       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:43.730774       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
I0227 01:27:43.730775       1 trace.go:236] Trace[968773328]: "Get" accept:application/json, */*,audit-id:b61dddd7-eaff-4ac8-94ce-712b41c68543,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:42.736) (total time: 994ms):
Trace[968773328]: [994.544084ms] [994.544084ms] END
E0227 01:27:43.730852       1 timeout.go:142] post-timeout activity - time-elapsed: 4.398972ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0227 01:27:43.731891       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:43.731949       1 trace.go:236] Trace[2107317953]: "Get" accept:application/json, */*,audit-id:a38f02e8-fe5f-494f-b1ab-11cd7b73c607,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:27:40.731) (total time: 3000ms):
Trace[2107317953]: [3.000256121s] [3.000256121s] END
E0227 01:27:43.732071       1 timeout.go:142] post-timeout activity - time-elapsed: 2.632048ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0227 01:27:43.735393       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:43.735474       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:43.736795       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:43.736957       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:43.738040       1 trace.go:236] Trace[202116195]: "Get" accept:application/json, */*,audit-id:c7eaa524-5dc7-4805-ba22-4b063283b229,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 01:27:42.734) (total time: 1003ms):
Trace[202116195]: [1.003585755s] [1.003585755s] END
E0227 01:27:43.738181       1 timeout.go:142] post-timeout activity - time-elapsed: 2.851972ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system" result: <nil>
E0227 01:27:43.904136       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:43.904678       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:43.905935       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:43.906234       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:43.908310       1 trace.go:236] Trace[1183525097]: "Get" accept:application/json, */*,audit-id:aacc86b2-992b-48f4-81cc-aec1bd89cb32,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:33.904) (total time: 10004ms):
Trace[1183525097]: [10.004156521s] [10.004156521s] END
E0227 01:27:43.908417       1 timeout.go:142] post-timeout activity - time-elapsed: 4.347011ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com" result: <nil>
E0227 01:27:44.983490       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:44.984268       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:44.985620       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:44.985862       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:44.987232       1 trace.go:236] Trace[909752356]: "Get" accept:application/json, */*,audit-id:0cb7c5ca-9919-4c3e-8a92-325cdb5b65d9,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:34.983) (total time: 10003ms):
Trace[909752356]: [10.00373528s] [10.00373528s] END
E0227 01:27:44.987554       1 timeout.go:142] post-timeout activity - time-elapsed: 3.958781ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com" result: <nil>
E0227 01:27:45.690538       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:45.690627       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:45.691557       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:45.691610       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:45.691725       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:45.692725       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:45.692760       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0227 01:27:45.692775       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:45.693913       1 trace.go:236] Trace[1378374545]: "Get" accept:application/json, */*,audit-id:29bfd378-1419-46f5-adbe-6508116698fb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:35.691) (total time: 10002ms):
Trace[1378374545]: [10.002499288s] [10.002499288s] END
E0227 01:27:45.694041       1 timeout.go:142] post-timeout activity - time-elapsed: 2.408071ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
I0227 01:27:45.694071       1 trace.go:236] Trace[809433037]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8777d395-e220-44fb-9f65-99e0b3bca787,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 01:27:42.692) (total time: 3001ms):
Trace[809433037]: [3.001709866s] [3.001709866s] END
E0227 01:27:45.694128       1 timeout.go:142] post-timeout activity - time-elapsed: 3.473368ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0227 01:27:46.576541       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:46.576702       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:46.577957       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:46.578060       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:46.579272       1 trace.go:236] Trace[934124016]: "Get" accept:application/json, */*,audit-id:dffe7fed-77f9-4f14-98c0-990e461cb2db,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:36.576) (total time: 10003ms):
Trace[934124016]: [10.003007971s] [10.003007971s] END
E0227 01:27:46.579393       1 timeout.go:142] post-timeout activity - time-elapsed: 2.808632ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com" result: <nil>
E0227 01:27:46.585464       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0227 01:27:46.585573       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:46.586862       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:46.586913       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:46.588689       1 trace.go:236] Trace[1491747553]: "Get" accept:application/json, */*,audit-id:63e1cf65-0a13-4404-a0ea-9a450c4285c5,client:10.0.0.183,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 01:27:36.580) (total time: 10007ms):
Trace[1491747553]: [10.007884216s] [10.007884216s] END
E0227 01:27:46.588763       1 timeout.go:142] post-timeout activity - time-elapsed: 3.318034ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com" result: <nil>
E0227 01:27:46.598306       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:46.598352       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:46.598424       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.96µs, panicked: false, err: context canceled, panic-reason: <nil>
E0227 01:27:46.599569       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0227 01:27:46.599711       1 timeout.go:142] post-timeout activity - time-elapsed: 1.476867ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>
I0227 01:27:47.732864       1 trace.go:236] Trace[1006230875]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 01:27:38.161) (total time: 9571ms):
Trace[1006230875]: [9.571050815s] [9.571050815s] END
E0227 01:27:47.732918       1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out
E0227 01:27:47.733177       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:47.735126       1 trace.go:236] Trace[1883784076]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1521b08c-d003-4dd1-a483-344b47c9a6a3,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.1897f61f6a1af574,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 01:27:39.334) (total time: 8400ms):
Trace[1883784076]: ["GuaranteedUpdate etcd3" audit-id:1521b08c-d003-4dd1-a483-344b47c9a6a3,key:/events/kube-system/kube-apiserver-instance.1897f61f6a1af574,type:*core.Event,resource:events 8400ms (01:27:39.334)]
Trace[1883784076]: [8.400841977s] [8.400841977s] END
E0227 01:27:48.289019       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:48.289220       1 trace.go:236] Trace[442733352]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:942ee104-06dc-4daa-86f9-dfb3bbd4e9d5,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 01:27:41.286) (total time: 7002ms):
Trace[442733352]: ["GuaranteedUpdate etcd3" audit-id:942ee104-06dc-4daa-86f9-dfb3bbd4e9d5,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (01:27:41.286)
Trace[442733352]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (01:27:48.288)]
Trace[442733352]: [7.00267338s] [7.00267338s] END
E0227 01:27:48.725929       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:48.725977       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:48.727291       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0227 01:27:48.727324       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 1.319024ms, panicked: false, err: context canceled, panic-reason: <nil>
I0227 01:27:48.727378       1 trace.go:236] Trace[1665710002]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5f64e45e-b617-4f0f-994d-188086572b1a,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Feb-2026 01:27:43.725) (total time: 5001ms):
Trace[1665710002]: ["GuaranteedUpdate etcd3" audit-id:5f64e45e-b617-4f0f-994d-188086572b1a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (01:27:43.725)
Trace[1665710002]:  ---"Txn call failed" err:context canceled 5000ms (01:27:48.727)]
Trace[1665710002]: [5.001789448s] [5.001789448s] END
E0227 01:27:48.727502       1 timeout.go:142] post-timeout activity - time-elapsed: 1.466038ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0227 01:27:48.730742       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:48.730761       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:48.730773       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 2.96µs, panicked: false, err: context canceled, panic-reason: <nil>
E0227 01:27:48.732290       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:48.732458       1 trace.go:236] Trace[2054675316]: "Update" accept:application/json, */*,audit-id:ada3dc20-0e4d-4b4a-bc47-aa337949cfbc,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 01:27:43.731) (total time: 5001ms):
Trace[2054675316]: ["GuaranteedUpdate etcd3" audit-id:ada3dc20-0e4d-4b4a-bc47-aa337949cfbc,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (01:27:43.731)
Trace[2054675316]:  ---"Txn call failed" err:context canceled 4998ms (01:27:48.730)]
Trace[2054675316]: [5.001343186s] [5.001343186s] END
E0227 01:27:48.733344       1 timeout.go:142] post-timeout activity - time-elapsed: 2.600506ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0227 01:27:50.730117       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:50.730323       1 trace.go:236] Trace[85640032]: "Update" accept:application/json, */*,audit-id:c9679809-2077-4ca9-8140-d5c30d5255d5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:27:43.727) (total time: 7003ms):
Trace[85640032]: ["GuaranteedUpdate etcd3" audit-id:c9679809-2077-4ca9-8140-d5c30d5255d5,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (01:27:43.727)
Trace[85640032]:  ---"Txn call failed" err:etcdserver: request timed out 7002ms (01:27:50.730)]
Trace[85640032]: [7.003227554s] [7.003227554s] END
E0227 01:27:50.736134       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0227 01:27:50.736177       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0227 01:27:50.736174       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.901µs, panicked: false, err: context canceled, panic-reason: <nil>
E0227 01:27:50.738039       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0227 01:27:50.738107       1 trace.go:236] Trace[1756430268]: "Update" accept:application/json, */*,audit-id:887db524-be4e-4cc0-b436-3c794fcc2c8f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 01:27:45.691) (total time: 5046ms):
Trace[1756430268]: ["GuaranteedUpdate etcd3" audit-id:887db524-be4e-4cc0-b436-3c794fcc2c8f,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5045ms (01:27:45.692)
Trace[1756430268]:  ---"Txn call failed" err:context canceled 5043ms (01:27:50.735)]
Trace[1756430268]: [5.046150194s] [5.046150194s] END
E0227 01:27:50.738210       1 timeout.go:142] post-timeout activity - time-elapsed: 2.150925ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0227 01:27:50.908358       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0227 01:27:50.908530       1 trace.go:236] Trace[2040727767]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:faea3945-53a4-4e0e-a3e8-c605975c28a1,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 01:27:43.905) (total time: 7003ms):
Trace[2040727767]: ["GuaranteedUpdate etcd3" audit-id:faea3945-53a4-4e0e-a3e8-c605975c28a1,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (01:27:43.905)
Trace[2040727767]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (01:27:50.908)]
Trace[2040727767]: [7.003466731s] [7.003466731s] END
E0227 01:27:50.909116       1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out"
I0227 01:27:50.939760       1 trace.go:236] Trace[1437574973]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b70e8993-ee85-4792-a213-e72016610a01,client:199.204.45.22,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 01:27:48.291) (total time: 2648ms):
Trace[1437574973]: ["GuaranteedUpdate etcd3" audit-id:b70e8993-ee85-4792-a213-e72016610a01,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2648ms (01:27:48.291)
Trace[1437574973]:  ---"Txn call completed" 2646ms (01:27:50.939)]
Trace[1437574973]: [2.648270749s] [2.648270749s] END
I0227 01:27:50.940900       1 trace.go:236] Trace[744540109]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:91a1b81f-6a44-4e19-99eb-c141cb44d358,client:199.204.45.22,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 01:27:47.348) (total time: 3592ms):
Trace[744540109]: ---"About to write a response" 3592ms (01:27:50.940)
Trace[744540109]: [3.592348933s] [3.592348933s] END
E0227 01:27:50.943373       1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again"
I0227 01:27:50.943499       1 trace.go:236] Trace[1978397405]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:acfe63a3-7aac-4a9a-97af-76b662094f10,client:199.204.45.22,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (27-Feb-2026 01:27:47.737) (total time: 3206ms):
Trace[1978397405]: ["Create etcd3" audit-id:acfe63a3-7aac-4a9a-97af-76b662094f10,key:/events/kube-system/kube-apiserver-instance.1897f62fbc365199,type:*core.Event,resource:events 3205ms (01:27:47.737)
Trace[1978397405]:  ---"TransformToStorage succeeded" 3200ms (01:27:50.938)]
Trace[1978397405]: [3.206118595s] [3.206118595s] END
I0227 01:27:50.945964       1 trace.go:236] Trace[770978218]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.22,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 01:27:48.162) (total time: 2783ms):
Trace[770978218]: ---"initial value restored" 2777ms (01:27:50.940)
Trace[770978218]: [2.783369654s] [2.783369654s] END