I0227 21:02:05.524334 1 options.go:220] external host was not specified, using 162.253.55.195 I0227 21:02:05.525407 1 server.go:148] Version: v1.28.13 I0227 21:02:05.525477 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0227 21:02:05.941704 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0227 21:02:05.962187 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0227 21:02:05.962211 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0227 21:02:05.962526 1 instance.go:298] Using reconciler: lease I0227 21:02:06.001798 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0227 21:02:06.003752 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0227 21:02:06.272545 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0227 21:02:06.272771 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0227 21:02:06.755456 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0227 21:02:06.768579 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0227 21:02:06.768606 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.768613 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.769209 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0227 21:02:06.769226 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0227 21:02:06.770941 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0227 21:02:06.771520 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0227 21:02:06.771534 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0227 21:02:06.771537 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0227 21:02:06.772677 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0227 21:02:06.772692 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0227 21:02:06.773449 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0227 21:02:06.773463 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.773470 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.774050 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0227 21:02:06.774062 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.774105 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0227 21:02:06.774615 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0227 21:02:06.776147 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0227 21:02:06.776161 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.776165 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.776590 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0227 21:02:06.776603 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.776607 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.777365 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0227 21:02:06.777379 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0227 21:02:06.779171 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0227 21:02:06.779186 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.779190 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.779547 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0227 21:02:06.779563 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.779566 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.781517 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0227 21:02:06.781536 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.781540 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.782455 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0227 21:02:06.783382 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0227 21:02:06.783396 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.783399 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.788996 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0227 21:02:06.789027 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0227 21:02:06.789038 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0227 21:02:06.793278 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0227 21:02:06.793300 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0227 21:02:06.793309 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0227 21:02:06.795861 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0227 21:02:06.795896 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0227 21:02:06.830045 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0227 21:02:06.830080 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0227 21:02:07.272502 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0227 21:02:07.272548 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0227 21:02:07.272768 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0227 21:02:07.272869 1 secure_serving.go:213] Serving securely on [::]:6443 I0227 21:02:07.272945 1 controller.go:80] Starting OpenAPI V3 AggregationController I0227 21:02:07.273001 1 controller.go:78] Starting OpenAPI AggregationController I0227 21:02:07.273128 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0227 21:02:07.273177 1 gc_controller.go:78] Starting apiserver lease garbage collector I0227 21:02:07.273352 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0227 21:02:07.273471 1 aggregator.go:164] waiting for initial CRD sync... I0227 21:02:07.273387 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0227 21:02:07.273780 1 controller.go:116] Starting legacy_token_tracking_controller I0227 21:02:07.273801 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0227 21:02:07.273835 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0227 21:02:07.273850 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0227 21:02:07.273900 1 available_controller.go:423] Starting AvailableConditionController I0227 21:02:07.273913 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0227 21:02:07.273779 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0227 21:02:07.274050 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0227 21:02:07.274198 1 gc_controller.go:78] Starting apiserver lease garbage collector I0227 21:02:07.274295 1 system_namespaces_controller.go:67] Starting system namespaces controller I0227 21:02:07.274331 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0227 21:02:07.274343 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0227 21:02:07.274591 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0227 21:02:07.274612 1 naming_controller.go:291] Starting NamingConditionController I0227 21:02:07.274627 1 controller.go:134] Starting OpenAPI controller I0227 21:02:07.274637 1 controller.go:85] Starting OpenAPI V3 controller I0227 21:02:07.274607 1 crd_finalizer.go:266] Starting CRDFinalizer I0227 21:02:07.274680 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0227 21:02:07.274637 1 establishing_controller.go:76] Starting EstablishingController I0227 21:02:07.310078 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0227 21:02:07.310099 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0227 21:02:07.310108 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0227 21:02:07.310588 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0227 21:02:07.344162 1 shared_informer.go:318] Caches are synced for node_authorizer E0227 21:02:07.345596 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0227 21:02:07.373903 1 shared_informer.go:318] Caches are synced for configmaps I0227 21:02:07.374058 1 apf_controller.go:379] Running API Priority and Fairness config worker I0227 21:02:07.374119 1 cache.go:39] Caches are synced for AvailableConditionController controller I0227 21:02:07.374146 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0227 21:02:07.374124 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0227 21:02:07.374417 1 shared_informer.go:318] Caches are synced for crd-autoregister I0227 21:02:07.374472 1 aggregator.go:166] initial CRD sync complete... I0227 21:02:07.374488 1 autoregister_controller.go:141] Starting autoregister controller I0227 21:02:07.374507 1 cache.go:32] Waiting for caches to sync for autoregister controller I0227 21:02:07.374519 1 cache.go:39] Caches are synced for autoregister controller I0227 21:02:07.376829 1 controller.go:624] quota admission added evaluator for: namespaces I0227 21:02:07.410310 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0227 21:02:07.549621 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0227 21:02:08.281314 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0227 21:02:08.285955 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0227 21:02:08.286006 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0227 21:02:08.896780 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0227 21:02:08.948439 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0227 21:02:09.086860 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0227 21:02:09.095081 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.195] I0227 21:02:09.096815 1 controller.go:624] quota admission added evaluator for: endpoints I0227 21:02:09.104021 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0227 21:02:10.861421 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0227 21:02:10.872307 1 controller.go:624] quota admission added evaluator for: deployments.apps I0227 21:02:10.885995 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0227 21:02:11.083409 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0227 21:02:16.129315 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0227 21:02:16.379488 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0227 21:02:44.890963 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0227 21:02:44.901101 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0227 21:02:44.927431 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.96.23.138"} I0227 21:02:44.933719 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0227 21:02:44.934939 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.101.131.243"} I0227 21:02:44.945088 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0227 21:02:45.022662 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0227 21:02:45.055174 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0227 21:02:45.422683 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:45.434398 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0227 21:02:45.441367 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0227 21:02:45.626448 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:45.629716 1 controller.go:624] quota admission added evaluator for: jobs.batch I0227 21:02:45.828576 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0227 21:02:46.234734 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0227 21:02:46.637618 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0227 21:02:47.858011 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:48.451942 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:49.042889 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:49.261118 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0227 21:02:53.601550 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io W0227 21:03:02.699343 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.96.23.138:443: connect: connection refused I0227 21:03:07.694965 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0227 21:03:13.123642 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0227 21:03:26.469261 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.99.114.47"} I0227 21:03:26.480810 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.8.59"} I0227 21:03:26.494780 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.102.244.88"} I0227 21:03:26.506905 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.97.129.247"} I0227 21:03:32.966381 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:32.979195 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.000402 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.018858 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.033822 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.053335 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.073088 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.092395 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.119254 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.130391 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0227 21:03:33.159216 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.199906 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:33.223313 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:34.630008 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0227 21:03:37.645297 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0227 21:03:37.651471 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0227 21:03:37.713364 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.107.73.152"} I0227 21:03:37.743950 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0227 21:03:40.008740 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0227 21:03:40.036377 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0227 21:03:40.704906 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0227 21:03:40.704967 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0227 21:03:40.705011 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0227 21:03:47.480438 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0227 21:03:50.803383 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.105.68.69"} I0227 21:03:51.184185 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0227 21:03:51.450595 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.97.177.135"} I0227 21:03:51.474505 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.106.168.47"} I0227 21:03:57.796332 1 trace.go:236] Trace[163366384]: "Update" accept:application/json, */*,audit-id:43ec05cf-8cb3-4197-a9f2-3331e83e0cef,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 21:03:57.008) (total time: 787ms): Trace[163366384]: ["GuaranteedUpdate etcd3" audit-id:43ec05cf-8cb3-4197-a9f2-3331e83e0cef,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 787ms (21:03:57.009) Trace[163366384]: ---"Txn call completed" 785ms (21:03:57.795)] Trace[163366384]: [787.338323ms] [787.338323ms] END I0227 21:03:59.149068 1 trace.go:236] Trace[238183903]: "Get" accept:application/json, */*,audit-id:30abc3c9-e780-4162-a629-19db2f3ac722,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:03:58.048) (total time: 1100ms): Trace[238183903]: ---"About to write a response" 1100ms (21:03:59.148) Trace[238183903]: [1.100908009s] [1.100908009s] END I0227 21:03:59.149510 1 trace.go:236] Trace[1845031286]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:702bf474-e585-422d-9edb-2449a086429a,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:03:58.637) (total time: 511ms): Trace[1845031286]: ["GuaranteedUpdate etcd3" audit-id:702bf474-e585-422d-9edb-2449a086429a,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 511ms (21:03:58.638) Trace[1845031286]: ---"Txn call completed" 510ms (21:03:59.149)] Trace[1845031286]: [511.498009ms] [511.498009ms] END I0227 21:03:59.150273 1 trace.go:236] Trace[577137589]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d8663ccc-6257-4d1b-8c88-c74a835553bc,client:10.0.0.83,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:03:58.038) (total time: 1112ms): Trace[577137589]: ["GuaranteedUpdate etcd3" audit-id:d8663ccc-6257-4d1b-8c88-c74a835553bc,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1111ms (21:03:58.038) Trace[577137589]: ---"Txn call completed" 1109ms (21:03:59.148)] Trace[577137589]: [1.112111375s] [1.112111375s] END I0227 21:03:59.150615 1 trace.go:236] Trace[520633388]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:56e1545a-1bd6-46e8-a354-231ab5e599e8,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:03:58.291) (total time: 859ms): Trace[520633388]: ---"About to write a response" 859ms (21:03:59.150) Trace[520633388]: [859.266715ms] [859.266715ms] END I0227 21:03:59.150635 1 trace.go:236] Trace[577078693]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5bf9bce3-5a83-4ebe-8293-5679732adf31,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:03:58.378) (total time: 772ms): Trace[577078693]: ---"About to write a response" 772ms (21:03:59.150) Trace[577078693]: [772.275112ms] [772.275112ms] END I0227 21:03:59.150651 1 trace.go:236] Trace[1360479150]: "Get" accept:application/json, */*,audit-id:ca2db565-9c26-455d-9d72-65a9e940a94b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 21:03:58.373) (total time: 777ms): Trace[1360479150]: ---"About to write a response" 777ms (21:03:59.150) Trace[1360479150]: [777.346354ms] [777.346354ms] END I0227 21:03:59.150613 1 trace.go:236] Trace[863398493]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6741b3d6-2efb-4cf9-8835-c065d137d4b2,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:03:58.035) (total time: 1115ms): Trace[863398493]: ["GuaranteedUpdate etcd3" audit-id:6741b3d6-2efb-4cf9-8835-c065d137d4b2,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1114ms (21:03:58.035) Trace[863398493]: ---"Txn call completed" 1113ms (21:03:59.150)] Trace[863398493]: [1.115150331s] [1.115150331s] END I0227 21:04:16.457030 1 trace.go:236] Trace[1058399172]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4cb7358a-9d03-4237-92ec-48d63aefdaeb,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:15.222) (total time: 1234ms): Trace[1058399172]: ["GuaranteedUpdate etcd3" audit-id:4cb7358a-9d03-4237-92ec-48d63aefdaeb,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1233ms (21:04:15.223) Trace[1058399172]: ---"Txn call completed" 1232ms (21:04:16.456)] Trace[1058399172]: [1.234096363s] [1.234096363s] END I0227 21:04:16.460899 1 trace.go:236] Trace[1226129712]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bfa621a7-1665-4a27-9e9a-e18729df167b,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:15.231) (total time: 1229ms): Trace[1226129712]: ["GuaranteedUpdate etcd3" audit-id:bfa621a7-1665-4a27-9e9a-e18729df167b,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1229ms (21:04:15.231) Trace[1226129712]: ---"Txn call completed" 1228ms (21:04:16.460)] Trace[1226129712]: [1.229580115s] [1.229580115s] END I0227 21:04:16.461229 1 trace.go:236] Trace[419849930]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9d12886e-af41-45d2-9580-41c3a64fd2e1,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:15.284) (total time: 1177ms): Trace[419849930]: ---"About to write a response" 1177ms (21:04:16.461) Trace[419849930]: [1.17708649s] [1.17708649s] END I0227 21:04:16.461328 1 trace.go:236] Trace[1245845294]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cf122bed-2008-4745-bc8c-d2a083046166,client:10.0.0.83,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:15.226) (total time: 1234ms): Trace[1245845294]: ["GuaranteedUpdate etcd3" audit-id:cf122bed-2008-4745-bc8c-d2a083046166,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1234ms (21:04:15.227) Trace[1245845294]: ---"Txn call completed" 1233ms (21:04:16.461)] Trace[1245845294]: [1.234364901s] [1.234364901s] END I0227 21:04:16.462076 1 trace.go:236] Trace[321153831]: "Get" accept:application/json, */*,audit-id:3e279b2c-034b-4959-8b62-56bfd20a21d1,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:15.252) (total time: 1209ms): Trace[321153831]: ---"About to write a response" 1209ms (21:04:16.461) Trace[321153831]: [1.209864512s] [1.209864512s] END I0227 21:04:16.462206 1 trace.go:236] Trace[584447490]: "Get" accept:application/json, */*,audit-id:ae1f5a02-b56e-44ff-a267-fa1ded93eeed,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 21:04:15.292) (total time: 1169ms): Trace[584447490]: ---"About to write a response" 1169ms (21:04:16.462) Trace[584447490]: [1.169836191s] [1.169836191s] END I0227 21:04:16.462218 1 trace.go:236] Trace[1076752088]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c153a88f-038a-47fb-9bf4-75291068610a,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:15.293) (total time: 1168ms): Trace[1076752088]: ---"About to write a response" 1168ms (21:04:16.461) Trace[1076752088]: [1.168614395s] [1.168614395s] END I0227 21:04:16.463183 1 trace.go:236] Trace[1774311790]: "Get" accept:application/json,audit-id:c43601f5-4c00-455d-af97-dbbeafc720f7,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:04:15.698) (total time: 765ms): Trace[1774311790]: ---"About to write a response" 764ms (21:04:16.462) Trace[1774311790]: [765.060902ms] [765.060902ms] END I0227 21:04:46.052372 1 trace.go:236] Trace[1829552347]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ac335315-d6e5-455d-95b4-75c062725ce0,client:10.0.0.83,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:42.652) (total time: 3400ms): Trace[1829552347]: ["GuaranteedUpdate etcd3" audit-id:ac335315-d6e5-455d-95b4-75c062725ce0,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3399ms (21:04:42.652) Trace[1829552347]: ---"Txn call completed" 3398ms (21:04:46.051)] Trace[1829552347]: [3.40006276s] [3.40006276s] END I0227 21:04:46.052956 1 trace.go:236] Trace[1886422615]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a875c38e-aba0-46f8-a62d-d820551595db,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:42.651) (total time: 3401ms): Trace[1886422615]: ["GuaranteedUpdate etcd3" audit-id:a875c38e-aba0-46f8-a62d-d820551595db,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3401ms (21:04:42.651) Trace[1886422615]: ---"Txn call completed" 3400ms (21:04:46.052)] Trace[1886422615]: [3.401693946s] [3.401693946s] END I0227 21:04:46.053797 1 trace.go:236] Trace[135433455]: "Get" accept:application/json,audit-id:8797c65d-c75a-41fa-ad63-0f0dc206ce57,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:04:42.667) (total time: 3386ms): Trace[135433455]: ---"About to write a response" 3385ms (21:04:46.053) Trace[135433455]: [3.386149373s] [3.386149373s] END E0227 21:04:47.702227 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0227 21:04:47.702307 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:47.703553 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:47.703592 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:47.704801 1 trace.go:236] Trace[585405064]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ba0b4467-94c6-4b74-bd71-eeea440aaa85,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:42.702) (total time: 5002ms): Trace[585405064]: [5.002464817s] [5.002464817s] END E0227 21:04:47.704891 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:47.704929 1 timeout.go:142] post-timeout activity - time-elapsed: 2.511684ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0227 21:04:47.704954 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:47.704989 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0227 21:04:47.706357 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:47.706376 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:47.706389 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:47.707606 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:47.707663 1 trace.go:236] Trace[720414786]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:edf0dbd8-598c-4990-86b9-b2d957d22e70,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:42.705) (total time: 5002ms): Trace[720414786]: [5.002545037s] [5.002545037s] END E0227 21:04:47.707688 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:47.707760 1 timeout.go:142] post-timeout activity - time-elapsed: 2.723159ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0227 21:04:47.708855 1 trace.go:236] Trace[1988231351]: "Get" accept:application/json, */*,audit-id:b18f2126-5cf5-4e46-990d-0adfaf1bb7bd,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:42.704) (total time: 5003ms): Trace[1988231351]: [5.003955407s] [5.003955407s] END E0227 21:04:47.708959 1 timeout.go:142] post-timeout activity - time-elapsed: 4.005606ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0227 21:04:49.872326 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.991µs, panicked: false, err: context canceled, panic-reason: E0227 21:04:49.872533 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:49.873436 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:49.873996 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:49.875205 1 trace.go:236] Trace[878303902]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:709d92de-0037-4033-b6a9-2e7ee12a738c,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:44.872) (total time: 5002ms): Trace[878303902]: ["GuaranteedUpdate etcd3" audit-id:709d92de-0037-4033-b6a9-2e7ee12a738c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (21:04:44.873) Trace[878303902]: ---"Txn call failed" err:context canceled 4998ms (21:04:49.872)] Trace[878303902]: [5.002262793s] [5.002262793s] END E0227 21:04:49.875373 1 timeout.go:142] post-timeout activity - time-elapsed: 2.7922ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0227 21:04:50.434883 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:50.435047 1 trace.go:236] Trace[2085869628]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:29e9ad9a-1ebc-47f0-9480-f8ec71cd339c,client:162.253.55.195,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:04:43.426) (total time: 7008ms): Trace[2085869628]: ["GuaranteedUpdate etcd3" audit-id:29e9ad9a-1ebc-47f0-9480-f8ec71cd339c,key:/minions/instance,type:*core.Node,resource:nodes 7008ms (21:04:43.426) Trace[2085869628]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:04:50.434)] Trace[2085869628]: [7.008877521s] [7.008877521s] END E0227 21:04:50.719854 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:50.720095 1 trace.go:236] Trace[714046297]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e38d1ee2-13c3-4591-9c6a-445b67464234,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:04:43.716) (total time: 7003ms): Trace[714046297]: ["GuaranteedUpdate etcd3" audit-id:e38d1ee2-13c3-4591-9c6a-445b67464234,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:04:43.716) Trace[714046297]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:04:50.719)] Trace[714046297]: [7.003697932s] [7.003697932s] END E0227 21:04:52.679907 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:52.680057 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:52.681148 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:52.681249 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:52.682373 1 trace.go:236] Trace[1927696388]: "Get" accept:application/json, */*,audit-id:ae7dcb01-99a7-4058-958b-2b28e69d993a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 21:04:42.679) (total time: 10003ms): Trace[1927696388]: [10.003177899s] [10.003177899s] END E0227 21:04:52.682556 1 timeout.go:142] post-timeout activity - time-elapsed: 2.80212ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0227 21:04:52.701947 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:52.702027 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:52.702735 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:52.703441 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:52.703464 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:52.704846 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:52.704860 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0227 21:04:52.704940 1 trace.go:236] Trace[992578164]: "Get" accept:application/json, */*,audit-id:d48f9100-a5fe-4be1-a3ae-8617f87e9d69,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 21:04:42.702) (total time: 10002ms): Trace[992578164]: [10.002297888s] [10.002297888s] END E0227 21:04:52.705123 1 timeout.go:142] post-timeout activity - time-elapsed: 3.29701ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0227 21:04:52.705462 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:52.705517 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:52.706269 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:52.706347 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:52.706602 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:52.706609 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:52.707395 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0227 21:04:52.707408 1 trace.go:236] Trace[2075409613]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4115458f-d0e2-4f8d-b0b6-166ea7e43c74,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:49.704) (total time: 3002ms): Trace[2075409613]: [3.002793665s] [3.002793665s] END E0227 21:04:52.707518 1 timeout.go:142] post-timeout activity - time-elapsed: 4.744952ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0227 21:04:52.707736 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:52.707778 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:52.708618 1 trace.go:236] Trace[1637875437]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c82b5ff0-1d87-4910-a167-f031b69aac0e,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Feb-2026 21:04:49.707) (total time: 3001ms): Trace[1637875437]: [3.001404864s] [3.001404864s] END E0227 21:04:52.708765 1 timeout.go:142] post-timeout activity - time-elapsed: 3.315781ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0227 21:04:52.708864 1 trace.go:236] Trace[1244200086]: "Get" accept:application/json, */*,audit-id:7d6b42a4-e47f-47c4-97cc-014b32ad9695,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:49.706) (total time: 3002ms): Trace[1244200086]: [3.002619931s] [3.002619931s] END E0227 21:04:52.709022 1 timeout.go:142] post-timeout activity - time-elapsed: 3.458434ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0227 21:04:53.055817 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:53.055845 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:53.055850 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:53.055884 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.37µs, panicked: false, err: context canceled, panic-reason: E0227 21:04:53.055927 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 67.692µs, panicked: false, err: context canceled, panic-reason: E0227 21:04:53.057092 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:53.057115 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:53.057220 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:53.058292 1 trace.go:236] Trace[1113509878]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a2028dfa-9afd-487e-b8eb-771b7009b9b0,client:10.0.0.83,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:48.056) (total time: 5001ms): Trace[1113509878]: ["GuaranteedUpdate etcd3" audit-id:a2028dfa-9afd-487e-b8eb-771b7009b9b0,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (21:04:48.056) Trace[1113509878]: ---"Txn call failed" err:context canceled 4998ms (21:04:53.055)] Trace[1113509878]: [5.001890825s] [5.001890825s] END E0227 21:04:53.058400 1 timeout.go:142] post-timeout activity - time-elapsed: 2.531634ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: I0227 21:04:53.058403 1 trace.go:236] Trace[1937267417]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d44558de-3fa4-45f4-bdd1-9a809db2abf4,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:48.056) (total time: 5001ms): Trace[1937267417]: ["GuaranteedUpdate etcd3" audit-id:d44558de-3fa4-45f4-bdd1-9a809db2abf4,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (21:04:48.056) Trace[1937267417]: ---"Txn call failed" err:context canceled 4998ms (21:04:53.055)] Trace[1937267417]: [5.001829974s] [5.001829974s] END E0227 21:04:53.058623 1 timeout.go:142] post-timeout activity - time-elapsed: 2.708778ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0227 21:04:54.197767 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:54.198078 1 trace.go:236] Trace[2074841050]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aedc0fdb-62c6-45ad-91e0-1d02f1b2184b,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (27-Feb-2026 21:04:47.194) (total time: 7003ms): Trace[2074841050]: ["Create etcd3" audit-id:aedc0fdb-62c6-45ad-91e0-1d02f1b2184b,key:/events/kube-system/kube-apiserver-instance.1898366b25c5ba2c,type:*core.Event,resource:events 7002ms (21:04:47.195) Trace[2074841050]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:04:54.197)] Trace[2074841050]: [7.003224823s] [7.003224823s] END E0227 21:04:54.687654 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:54.687886 1 trace.go:236] Trace[1410818386]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:270d0916-aa20-4dec-9ec1-abff88642e64,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:04:47.685) (total time: 7002ms): Trace[1410818386]: ["GuaranteedUpdate etcd3" audit-id:270d0916-aa20-4dec-9ec1-abff88642e64,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:04:47.685) Trace[1410818386]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:04:54.687)] Trace[1410818386]: [7.002791734s] [7.002791734s] END E0227 21:04:54.872043 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:54.872180 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:54.873314 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:54.873391 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:54.874483 1 trace.go:236] Trace[1316776275]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:743abefd-4a57-42e5-aaa2-5b2100529e2a,client:10.0.0.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:49.873) (total time: 5001ms): Trace[1316776275]: [5.0011818s] [5.0011818s] END E0227 21:04:54.874706 1 timeout.go:142] post-timeout activity - time-elapsed: 2.573936ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0227 21:04:54.898708 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:54.898776 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:54.900415 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:54.900488 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:54.901694 1 trace.go:236] Trace[804180913]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6abdfa1c-a922-4da2-9a7d-b6fadc2b1d2c,client:10.0.0.227,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Feb-2026 21:04:47.130) (total time: 7771ms): Trace[804180913]: [7.771396646s] [7.771396646s] END E0227 21:04:54.901891 1 timeout.go:142] post-timeout activity - time-elapsed: 3.140828ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0227 21:04:57.451629 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:57.451858 1 trace.go:236] Trace[805457937]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f0c839ef-fc80-489a-ae72-762a4088e9e3,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:04:50.448) (total time: 7003ms): Trace[805457937]: ["GuaranteedUpdate etcd3" audit-id:f0c839ef-fc80-489a-ae72-762a4088e9e3,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:04:50.448) Trace[805457937]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:04:57.451)] Trace[805457937]: [7.003344176s] [7.003344176s] END E0227 21:04:57.452722 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0227 21:04:57.706401 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 59.031µs, panicked: false, err: context canceled, panic-reason: E0227 21:04:57.706456 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:57.706824 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:57.706883 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.921µs, panicked: false, err: context deadline exceeded, panic-reason: E0227 21:04:57.707563 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:57.707672 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:57.708010 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:57.708810 1 trace.go:236] Trace[802251785]: "Update" accept:application/json, */*,audit-id:d0b793d7-b213-4687-90af-bd45f98fa2cb,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:04:52.706) (total time: 5001ms): Trace[802251785]: ["GuaranteedUpdate etcd3" audit-id:d0b793d7-b213-4687-90af-bd45f98fa2cb,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (21:04:52.706) Trace[802251785]: ---"Txn call failed" err:context canceled 4998ms (21:04:57.706)] Trace[802251785]: [5.001966148s] [5.001966148s] END E0227 21:04:57.708877 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:57.709143 1 timeout.go:142] post-timeout activity - time-elapsed: 2.532674ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0227 21:04:57.709260 1 trace.go:236] Trace[1225308508]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f59ba6bd-0234-4af8-8934-ccf0f7a941ef,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Feb-2026 21:04:52.707) (total time: 5002ms): Trace[1225308508]: ["GuaranteedUpdate etcd3" audit-id:f59ba6bd-0234-4af8-8934-ccf0f7a941ef,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (21:04:52.707) Trace[1225308508]: ---"Txn call failed" err:context deadline exceeded 4999ms (21:04:57.706)] Trace[1225308508]: [5.00211061s] [5.00211061s] END E0227 21:04:57.709596 1 timeout.go:142] post-timeout activity - time-elapsed: 2.619436ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0227 21:04:57.725805 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:57.725975 1 trace.go:236] Trace[1446372216]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ea5b536d-5339-4e84-89e4-fa0044656efe,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:04:50.722) (total time: 7003ms): Trace[1446372216]: ["GuaranteedUpdate etcd3" audit-id:ea5b536d-5339-4e84-89e4-fa0044656efe,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:04:50.722) Trace[1446372216]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:04:57.725)] Trace[1446372216]: [7.00353535s] [7.00353535s] END E0227 21:04:58.055313 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:58.055453 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:58.056066 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:04:58.057548 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:58.057598 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0227 21:04:58.057681 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:58.058810 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:58.058867 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:58.058926 1 trace.go:236] Trace[1439628249]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6708c38a-4c3f-4445-8e1c-1266080f1484,client:10.0.0.83,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:53.056) (total time: 5002ms): Trace[1439628249]: [5.002038048s] [5.002038048s] END E0227 21:04:58.059160 1 timeout.go:142] post-timeout activity - time-elapsed: 3.917704ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: I0227 21:04:58.060012 1 trace.go:236] Trace[1513154949]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3e1dd5e5-9242-40a2-867b-0a39821b8402,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:53.056) (total time: 5003ms): Trace[1513154949]: [5.003712703s] [5.003712703s] END E0227 21:04:58.060271 1 timeout.go:142] post-timeout activity - time-elapsed: 4.197019ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0227 21:04:59.684009 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:04:59.684228 1 trace.go:236] Trace[1284760138]: "Update" accept:application/json, */*,audit-id:0af8a95d-87b1-4bc8-ad76-9f7de671d305,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 21:04:52.680) (total time: 7003ms): Trace[1284760138]: ["GuaranteedUpdate etcd3" audit-id:0af8a95d-87b1-4bc8-ad76-9f7de671d305,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:04:52.681) Trace[1284760138]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:04:59.683)] Trace[1284760138]: [7.003331185s] [7.003331185s] END E0227 21:04:59.690268 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:04:59.690308 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:04:59.690323 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 19.57µs, panicked: false, err: context canceled, panic-reason: E0227 21:04:59.691430 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:04:59.691530 1 trace.go:236] Trace[1124598208]: "Update" accept:application/json, */*,audit-id:6bdfc654-bcf3-4ff7-ba70-4ab4c6c0c070,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Feb-2026 21:04:52.702) (total time: 6989ms): Trace[1124598208]: ["GuaranteedUpdate etcd3" audit-id:6bdfc654-bcf3-4ff7-ba70-4ab4c6c0c070,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 6988ms (21:04:52.702) Trace[1124598208]: ---"Txn call failed" err:context canceled 6986ms (21:04:59.690)] Trace[1124598208]: [6.989009669s] [6.989009669s] END E0227 21:04:59.691721 1 timeout.go:142] post-timeout activity - time-elapsed: 1.517093ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0227 21:05:00.436523 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:05:00.436640 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:00.437945 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:00.438077 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:00.439303 1 trace.go:236] Trace[1436894521]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c0b80d3f-89d5-4f59-82d1-0758c6e53920,client:162.253.55.195,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:04:50.437) (total time: 10002ms): Trace[1436894521]: [10.002002902s] [10.002002902s] END E0227 21:05:00.439509 1 timeout.go:142] post-timeout activity - time-elapsed: 2.990714ms, GET "/api/v1/nodes/instance" result: E0227 21:05:02.684965 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:05:02.685083 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:02.686456 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:02.686523 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:02.687670 1 trace.go:236] Trace[9958880]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4d0d8658-f6b0-4cfa-9acb-d120bf3fa3a0,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (27-Feb-2026 21:04:54.689) (total time: 7997ms): Trace[9958880]: [7.997907744s] [7.997907744s] END E0227 21:05:02.687809 1 timeout.go:142] post-timeout activity - time-elapsed: 2.696587ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0227 21:05:04.457555 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:04.457746 1 trace.go:236] Trace[2004701517]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fe6a065e-5c4c-4841-b949-a7fe3ca88262,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:04:57.453) (total time: 7003ms): Trace[2004701517]: ["GuaranteedUpdate etcd3" audit-id:fe6a065e-5c4c-4841-b949-a7fe3ca88262,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:04:57.454) Trace[2004701517]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:05:04.457)] Trace[2004701517]: [7.003887926s] [7.003887926s] END E0227 21:05:04.458481 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0227 21:05:04.729807 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:04.730014 1 trace.go:236] Trace[496894392]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:34f459d6-6fc5-47c7-8290-3639da4f9846,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:04:57.727) (total time: 7002ms): Trace[496894392]: ["GuaranteedUpdate etcd3" audit-id:34f459d6-6fc5-47c7-8290-3639da4f9846,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:04:57.727) Trace[496894392]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:04.729)] Trace[496894392]: [7.002429505s] [7.002429505s] END E0227 21:05:09.689751 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:09.689968 1 trace.go:236] Trace[769639350]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9cfd5aef-edd7-41f5-bacf-4d846da7d9af,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:05:02.686) (total time: 7003ms): Trace[769639350]: ["GuaranteedUpdate etcd3" audit-id:9cfd5aef-edd7-41f5-bacf-4d846da7d9af,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:05:02.687) Trace[769639350]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:09.689)] Trace[769639350]: [7.003028069s] [7.003028069s] END E0227 21:05:10.436903 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0227 21:05:10.437045 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:10.437999 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:10.439172 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:10.439234 1 trace.go:236] Trace[989772698]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:65ebc7d8-9c79-404c-9f0a-c07a550f5c83,client:162.253.55.195,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:00.437) (total time: 10001ms): Trace[989772698]: [10.001658353s] [10.001658353s] END E0227 21:05:10.439445 1 timeout.go:142] post-timeout activity - time-elapsed: 2.666187ms, GET "/api/v1/nodes/instance" result: E0227 21:05:11.462318 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:11.462443 1 trace.go:236] Trace[1735666469]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8095b9b2-34e8-4c1a-9ad1-a48a1002b83c,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:04.459) (total time: 7002ms): Trace[1735666469]: ["GuaranteedUpdate etcd3" audit-id:8095b9b2-34e8-4c1a-9ad1-a48a1002b83c,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:05:04.459) Trace[1735666469]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:11.462)] Trace[1735666469]: [7.002812033s] [7.002812033s] END E0227 21:05:11.462983 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0227 21:05:11.734647 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:11.735027 1 trace.go:236] Trace[1611575602]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83bd173e-4d89-44e8-ac8a-cf234ccd76a2,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:04.732) (total time: 7002ms): Trace[1611575602]: ["GuaranteedUpdate etcd3" audit-id:83bd173e-4d89-44e8-ac8a-cf234ccd76a2,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:05:04.732) Trace[1611575602]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:11.734)] Trace[1611575602]: [7.002929047s] [7.002929047s] END E0227 21:05:18.467334 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:18.467560 1 trace.go:236] Trace[1220226867]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7db872fa-279b-46cd-b97f-5eecb665f8a9,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:11.463) (total time: 7003ms): Trace[1220226867]: ["GuaranteedUpdate etcd3" audit-id:7db872fa-279b-46cd-b97f-5eecb665f8a9,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:11.463) Trace[1220226867]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:05:18.467)] Trace[1220226867]: [7.003638782s] [7.003638782s] END E0227 21:05:18.468315 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0227 21:05:20.437536 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0227 21:05:20.437660 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:20.438851 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:20.438934 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:20.439994 1 trace.go:236] Trace[123632383]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8db9b35f-99bf-470b-884f-c4db65e2410f,client:162.253.55.195,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:10.437) (total time: 10002ms): Trace[123632383]: [10.002204605s] [10.002204605s] END E0227 21:05:20.440198 1 timeout.go:142] post-timeout activity - time-elapsed: 2.620996ms, GET "/api/v1/nodes/instance" result: E0227 21:05:21.736810 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:21.736855 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 24.48µs, panicked: false, err: context deadline exceeded, panic-reason: E0227 21:05:21.736876 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:21.738132 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:21.738216 1 trace.go:236] Trace[451650661]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:10dc307f-037d-4860-997b-c5b957192128,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:11.736) (total time: 10001ms): Trace[451650661]: ["GuaranteedUpdate etcd3" audit-id:10dc307f-037d-4860-997b-c5b957192128,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 10001ms (21:05:11.737)] Trace[451650661]: [10.001167653s] [10.001167653s] END E0227 21:05:21.738359 1 timeout.go:142] post-timeout activity - time-elapsed: 1.585724ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance" result: I0227 21:05:24.923747 1 trace.go:236] Trace[1262468043]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:74cacd1f-799d-481f-8045-65c7c477748f,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:04:55.214) (total time: 29709ms): Trace[1262468043]: ---"About to write a response" 29709ms (21:05:24.923) Trace[1262468043]: [29.709618398s] [29.709618398s] END I0227 21:05:24.924297 1 trace.go:236] Trace[1602031716]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6f7b94d6-67f9-4ecb-afb5-f9cf24695001,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:18.469) (total time: 6455ms): Trace[1602031716]: ["GuaranteedUpdate etcd3" audit-id:6f7b94d6-67f9-4ecb-afb5-f9cf24695001,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 6454ms (21:05:18.469)] Trace[1602031716]: [6.455061208s] [6.455061208s] END I0227 21:05:24.924318 1 trace.go:236] Trace[1815937394]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:95415efe-9c15-41db-8966-1fd0bd7e2fc7,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (27-Feb-2026 21:05:09.691) (total time: 15232ms): Trace[1815937394]: ---"About to write a response" 15232ms (21:05:24.924) Trace[1815937394]: [15.232273624s] [15.232273624s] END I0227 21:05:24.924375 1 trace.go:236] Trace[1540698174]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f2443358-a6fe-4881-9393-d9c41d550b5c,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:21.737) (total time: 3186ms): Trace[1540698174]: ---"About to write a response" 3186ms (21:05:24.924) Trace[1540698174]: [3.18678001s] [3.18678001s] END I0227 21:05:24.924488 1 trace.go:236] Trace[910211341]: "Get" accept:application/json, */*,audit-id:2b0b27a4-6a38-4348-bdb9-4dbcbdea9771,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (27-Feb-2026 21:04:47.004) (total time: 37919ms): Trace[910211341]: ---"About to write a response" 37919ms (21:05:24.924) Trace[910211341]: [37.919799534s] [37.919799534s] END I0227 21:05:24.924492 1 trace.go:236] Trace[1662773479]: "Get" accept:application/json, */*,audit-id:cfc968ef-8295-4d8a-bb5e-1529141140c2,client:10.0.0.216,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Feb-2026 21:04:56.780) (total time: 28144ms): Trace[1662773479]: ---"About to write a response" 28143ms (21:05:24.924) Trace[1662773479]: [28.144060645s] [28.144060645s] END I0227 21:05:24.924770 1 trace.go:236] Trace[1143636335]: "Get" accept:application/json,audit-id:37f8c6cd-bf8b-4435-a1bc-42d12fa7a013,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:04:47.058) (total time: 37866ms): Trace[1143636335]: ---"About to write a response" 37865ms (21:05:24.924) Trace[1143636335]: [37.866510121s] [37.866510121s] END E0227 21:05:24.925555 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0227 21:05:24.926202 1 trace.go:236] Trace[636923510]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eda4d8ee-3770-4b67-a194-a21642acca5c,client:162.253.55.195,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:20.438) (total time: 4487ms): Trace[636923510]: ---"About to write a response" 4486ms (21:05:24.924) Trace[636923510]: [4.487481984s] [4.487481984s] END E0227 21:05:27.004654 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 149.874µs, panicked: false, err: context canceled, panic-reason: E0227 21:05:27.004694 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:05:27.005897 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:05:27.005981 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:05:27.007027 1 trace.go:236] Trace[1515125857]: "Update" accept:application/json, */*,audit-id:31b21d0c-6750-43ea-b0a9-17a768075f5f,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (27-Feb-2026 21:05:24.928) (total time: 2078ms): Trace[1515125857]: ["GuaranteedUpdate etcd3" audit-id:31b21d0c-6750-43ea-b0a9-17a768075f5f,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 2078ms (21:05:24.928) Trace[1515125857]: ---"Txn call failed" err:context canceled 2075ms (21:05:27.004)] Trace[1515125857]: [2.078902102s] [2.078902102s] END E0227 21:05:27.007180 1 timeout.go:142] post-timeout activity - time-elapsed: 2.81739ms, PUT "/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller" result: I0227 21:05:28.201405 1 trace.go:236] Trace[1193543845]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f211879e-fca9-404d-9ebc-352fe058d3db,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.189836669c07ed87,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:04:54.200) (total time: 34000ms): Trace[1193543845]: ["GuaranteedUpdate etcd3" audit-id:f211879e-fca9-404d-9ebc-352fe058d3db,key:/events/openstack/percona-xtradb-haproxy-0.189836669c07ed87,type:*core.Event,resource:events 34000ms (21:04:54.201) Trace[1193543845]: ---"initial value restored" 30724ms (21:05:24.925)] Trace[1193543845]: [34.000391793s] [34.000391793s] END E0227 21:05:28.201408 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 32.361µs, panicked: false, err: context deadline exceeded, panic-reason: E0227 21:05:31.929845 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0227 21:05:31.930054 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0227 21:05:31.930127 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:31.930141 1 trace.go:236] Trace[616408395]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:99136638-d228-4072-81c1-043501c5928d,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:24.926) (total time: 7003ms): Trace[616408395]: ["GuaranteedUpdate etcd3" audit-id:99136638-d228-4072-81c1-043501c5928d,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:24.926) Trace[616408395]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:05:31.929)] Trace[616408395]: [7.003456968s] [7.003456968s] END I0227 21:05:31.931498 1 trace.go:236] Trace[1036375166]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4c5e0a43-3354-4f64-b96a-ba6cf417a020,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:05:24.927) (total time: 7003ms): Trace[1036375166]: ["GuaranteedUpdate etcd3" audit-id:4c5e0a43-3354-4f64-b96a-ba6cf417a020,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:24.927) Trace[1036375166]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:31.929)] Trace[1036375166]: [7.003661093s] [7.003661093s] END I0227 21:05:31.931524 1 trace.go:236] Trace[535739764]: "Update" accept:application/json, */*,audit-id:2078a1e5-763a-4ff4-aa3a-eb2dadf33da2,client:10.0.0.216,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:05:24.927) (total time: 7003ms): Trace[535739764]: ["GuaranteedUpdate etcd3" audit-id:2078a1e5-763a-4ff4-aa3a-eb2dadf33da2,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:24.928) Trace[535739764]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:31.930)] Trace[535739764]: [7.003589691s] [7.003589691s] END E0227 21:05:31.931930 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:31.932107 1 trace.go:236] Trace[2082952193]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9c6141af-e9ce-4347-a788-e859c716580d,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:05:24.926) (total time: 7005ms): Trace[2082952193]: ["GuaranteedUpdate etcd3" audit-id:9c6141af-e9ce-4347-a788-e859c716580d,key:/pods/kube-system/kube-apiserver-instance,type:*core.Pod,resource:pods 7005ms (21:05:24.926) Trace[2082952193]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:31.931)] Trace[2082952193]: [7.005774448s] [7.005774448s] END E0227 21:05:34.009153 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:34.009410 1 trace.go:236] Trace[994347571]: "Update" accept:application/json, */*,audit-id:d28576fd-206d-49b9-ab17-88f94b13e4a4,client:10.0.0.137,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (27-Feb-2026 21:05:27.005) (total time: 7003ms): Trace[994347571]: ["GuaranteedUpdate etcd3" audit-id:d28576fd-206d-49b9-ab17-88f94b13e4a4,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:27.006) Trace[994347571]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:34.009)] Trace[994347571]: [7.003390286s] [7.003390286s] END I0227 21:05:37.719397 1 trace.go:236] Trace[1310629836]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.195,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 21:04:49.089) (total time: 48629ms): Trace[1310629836]: ---"initial value restored" 35832ms (21:05:24.922) Trace[1310629836]: ---"Transaction prepared" 5794ms (21:05:30.717) Trace[1310629836]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:05:37.719) Trace[1310629836]: [48.62943923s] [48.62943923s] END E0227 21:05:37.719437 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0227 21:05:38.937194 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:38.937380 1 trace.go:236] Trace[1744703694]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3b404d40-952b-4463-b0d5-64a44e6dc304,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:31.933) (total time: 7004ms): Trace[1744703694]: ["GuaranteedUpdate etcd3" audit-id:3b404d40-952b-4463-b0d5-64a44e6dc304,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (21:05:31.933) Trace[1744703694]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (21:05:38.937)] Trace[1744703694]: [7.004032209s] [7.004032209s] END E0227 21:05:43.783679 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:43.783993 1 trace.go:236] Trace[1164600213]: "Update" accept:application/json, */*,audit-id:d72e7779-df10-4144-8382-bd98a015d05d,client:10.0.0.216,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Feb-2026 21:05:36.780) (total time: 7002ms): Trace[1164600213]: ["GuaranteedUpdate etcd3" audit-id:d72e7779-df10-4144-8382-bd98a015d05d,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:05:36.781) Trace[1164600213]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:43.783)] Trace[1164600213]: [7.002879556s] [7.002879556s] END E0227 21:05:45.942658 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:45.942843 1 trace.go:236] Trace[57861466]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9227f7b0-b1a6-484c-a2bc-c5ba10cc49ea,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:38.939) (total time: 7003ms): Trace[57861466]: ["GuaranteedUpdate etcd3" audit-id:9227f7b0-b1a6-484c-a2bc-c5ba10cc49ea,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:05:38.939) Trace[57861466]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:45.942)] Trace[57861466]: [7.003173442s] [7.003173442s] END I0227 21:05:48.117907 1 trace.go:236] Trace[1806043641]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0b3f7fb1-51d3-4d97-ae33-8b1fff72708e,client:162.253.55.195,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:41.010) (total time: 7106ms): Trace[1806043641]: ---"About to write a response" 7106ms (21:05:48.117) Trace[1806043641]: [7.106912557s] [7.106912557s] END I0227 21:05:48.118469 1 trace.go:236] Trace[1847499195]: "GuaranteedUpdate etcd3" audit-id:,key:/ranges/servicenodeports,type:*core.RangeAllocation,resource:servicenodeportallocations (27-Feb-2026 21:05:24.926) (total time: 23191ms): Trace[1847499195]: ---"initial value restored" 23191ms (21:05:48.118) Trace[1847499195]: [23.191744233s] [23.191744233s] END I0227 21:05:48.118708 1 trace.go:236] Trace[741856452]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f3583f78-b8d2-42dc-bf34-7b7bde1d1c13,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:24.926) (total time: 23192ms): Trace[741856452]: ---"About to write a response" 23192ms (21:05:48.118) Trace[741856452]: [23.192384096s] [23.192384096s] END I0227 21:05:48.119304 1 controller.go:116] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" I0227 21:05:48.121063 1 trace.go:236] Trace[490064356]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:46656841-5f68-43d1-850f-9750845cde6c,client:::1,protocol:HTTP/2.0,resource:services,scope:cluster,url:/api/v1/services,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (27-Feb-2026 21:05:24.926) (total time: 23195ms): Trace[490064356]: ["List(recursive=true) etcd3" audit-id:46656841-5f68-43d1-850f-9750845cde6c,key:/services/specs,resourceVersion:,resourceVersionMatch:,limit:0,continue: 23194ms (21:05:24.926)] Trace[490064356]: [23.195033902s] [23.195033902s] END I0227 21:05:48.121078 1 trace.go:236] Trace[1883223845]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fcf3300b-87c6-4909-b365-bf1291269c12,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:31.935) (total time: 16185ms): Trace[1883223845]: ---"About to write a response" 16185ms (21:05:48.120) Trace[1883223845]: [16.185909173s] [16.185909173s] END I0227 21:05:48.121832 1 trace.go:236] Trace[942133542]: "Get" accept:application/json,audit-id:2e1f352d-9df8-4e10-88aa-0e1bc2112388,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:05:25.929) (total time: 22192ms): Trace[942133542]: ---"About to write a response" 22191ms (21:05:48.121) Trace[942133542]: [22.192245439s] [22.192245439s] END I0227 21:05:53.351846 1 trace.go:236] Trace[1070626367]: "Create" accept:application/json, */*,audit-id:eb7324b5-7022-44bd-aff4-008111f51f3c,client:10.0.0.216,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/cert-manager/events,user-agent:cert-manager-cainjector/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (27-Feb-2026 21:05:43.786) (total time: 9565ms): Trace[1070626367]: ["Create etcd3" audit-id:eb7324b5-7022-44bd-aff4-008111f51f3c,key:/events/cert-manager/cert-manager-cainjector-leader-election.1898367852e3c8f9,type:*core.Event,resource:events 9564ms (21:05:43.787) Trace[1070626367]: ---"TransformToStorage succeeded" 4329ms (21:05:48.117) Trace[1070626367]: ---"Txn call succeeded" 5234ms (21:05:53.351)] Trace[1070626367]: [9.565057794s] [9.565057794s] END I0227 21:05:55.121487 1 trace.go:236] Trace[770720977]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.195,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 21:05:37.719) (total time: 17401ms): Trace[770720977]: ---"initial value restored" 10399ms (21:05:48.118) Trace[770720977]: [17.401938236s] [17.401938236s] END E0227 21:05:55.121534 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out E0227 21:05:55.123002 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:05:55.123187 1 trace.go:236] Trace[1277665467]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:290ab441-632a-4808-8877-17e371513383,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.1898366b25c5ba2c,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:05:28.203) (total time: 26919ms): Trace[1277665467]: ["GuaranteedUpdate etcd3" audit-id:290ab441-632a-4808-8877-17e371513383,key:/events/kube-system/kube-apiserver-instance.1898366b25c5ba2c,type:*core.Event,resource:events 26919ms (21:05:28.203) Trace[1277665467]: ---"initial value restored" 19916ms (21:05:48.120) Trace[1277665467]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:05:55.122)] Trace[1277665467]: [26.919528788s] [26.919528788s] END I0227 21:05:55.720360 1 trace.go:236] Trace[1104470559]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:692178f6-7ee2-4af5-97c3-f7d5bcbceb60,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:05:45.944) (total time: 9775ms): Trace[1104470559]: ["GuaranteedUpdate etcd3" audit-id:692178f6-7ee2-4af5-97c3-f7d5bcbceb60,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 9775ms (21:05:45.944)] Trace[1104470559]: [9.775635617s] [9.775635617s] END I0227 21:05:55.720485 1 trace.go:236] Trace[1961908402]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1f2aae86-f1eb-4ee4-9729-a7bc5a09732b,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:05:45.128) (total time: 10591ms): Trace[1961908402]: ["GuaranteedUpdate etcd3" audit-id:1f2aae86-f1eb-4ee4-9729-a7bc5a09732b,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 10591ms (21:05:45.128)] Trace[1961908402]: [10.591975894s] [10.591975894s] END I0227 21:05:59.518397 1 controller.go:128] Shutting down kubernetes service endpoint reconciler I0227 21:06:01.397351 1 trace.go:236] Trace[1893623704]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d3fbf0da-7971-4084-9b77-a3cc725ebed9,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (27-Feb-2026 21:05:55.722) (total time: 5674ms): Trace[1893623704]: ---"About to write a response" 5674ms (21:06:01.397) Trace[1893623704]: [5.674741846s] [5.674741846s] END I0227 21:06:01.397379 1 trace.go:236] Trace[645360136]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f5dc48eb-7877-4464-9b90-0c8ad84858d7,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (27-Feb-2026 21:05:55.125) (total time: 6272ms): Trace[645360136]: ["Create etcd3" audit-id:f5dc48eb-7877-4464-9b90-0c8ad84858d7,key:/events/kube-system/kube-apiserver-instance.1898366c270c8333,type:*core.Event,resource:events 6271ms (21:05:55.125) Trace[645360136]: ---"Txn call succeeded" 6271ms (21:06:01.396)] Trace[645360136]: [6.272126372s] [6.272126372s] END I0227 21:06:01.397402 1 trace.go:236] Trace[1168695093]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ee393603-f05d-494a-8449-37571a7c50ed,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:55.722) (total time: 5675ms): Trace[1168695093]: ---"About to write a response" 5675ms (21:06:01.397) Trace[1168695093]: [5.675310067s] [5.675310067s] END I0227 21:06:01.397404 1 trace.go:236] Trace[626416201]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d450222b-5381-417a-9c0a-4264cdb938b6,client:162.253.55.195,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-943ec55e-8f26-4140-a548-8824a71b3edd,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:48.119) (total time: 13277ms): Trace[626416201]: ---"About to write a response" 13277ms (21:06:01.397) Trace[626416201]: [13.277732961s] [13.277732961s] END I0227 21:06:01.397451 1 trace.go:236] Trace[1557943858]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:687c2f5d-2bfc-4f98-b296-535bca35a9e3,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-v85nk,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:48.122) (total time: 13274ms): Trace[1557943858]: ---"About to write a response" 13274ms (21:06:01.397) Trace[1557943858]: [13.274809167s] [13.274809167s] END I0227 21:06:01.397450 1 trace.go:236] Trace[308594409]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e3cb7676-9cb8-4157-a885-d106d5d3aca1,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:05:48.120) (total time: 13277ms): Trace[308594409]: ---"About to write a response" 13277ms (21:06:01.397) Trace[308594409]: [13.277291031s] [13.277291031s] END I0227 21:06:01.397494 1 trace.go:236] Trace[1157746979]: "GuaranteedUpdate etcd3" audit-id:,key:/ranges/serviceips,type:*core.RangeAllocation,resource:serviceipallocations (27-Feb-2026 21:05:48.122) (total time: 13275ms): Trace[1157746979]: ---"initial value restored" 13274ms (21:06:01.397) Trace[1157746979]: [13.275071503s] [13.275071503s] END I0227 21:06:01.398748 1 trace.go:236] Trace[1153015878]: "Get" accept:application/json,audit-id:0b5bf4da-86d8-4c87-a75b-204e4bc52c07,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:05:49.126) (total time: 12272ms): Trace[1153015878]: ---"About to write a response" 12272ms (21:06:01.398) Trace[1153015878]: [12.27251475s] [12.27251475s] END I0227 21:06:04.997727 1 trace.go:236] Trace[983188133]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b38c1369-31ba-450d-af70-9f35c04e6a3e,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:06:01.399) (total time: 3597ms): Trace[983188133]: ["GuaranteedUpdate etcd3" audit-id:b38c1369-31ba-450d-af70-9f35c04e6a3e,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 3597ms (21:06:01.400) Trace[983188133]: ---"Txn call completed" 3596ms (21:06:04.997)] Trace[983188133]: [3.59775394s] [3.59775394s] END I0227 21:06:04.997811 1 trace.go:236] Trace[1613062429]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a8c2ab67-33e6-4495-8f75-3938446ac249,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:06:01.400) (total time: 3597ms): Trace[1613062429]: ["GuaranteedUpdate etcd3" audit-id:a8c2ab67-33e6-4495-8f75-3938446ac249,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 3597ms (21:06:01.400) Trace[1613062429]: ---"Txn call completed" 3595ms (21:06:04.997)] Trace[1613062429]: [3.597396823s] [3.597396823s] END I0227 21:06:04.998047 1 trace.go:236] Trace[2121913499]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ff090f44-ff29-40ea-80d8-8a22f15ab4a8,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:06:01.399) (total time: 3598ms): Trace[2121913499]: ["GuaranteedUpdate etcd3" audit-id:ff090f44-ff29-40ea-80d8-8a22f15ab4a8,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 3598ms (21:06:01.399) Trace[2121913499]: ---"Txn call completed" 3597ms (21:06:04.997)] Trace[2121913499]: [3.598414506s] [3.598414506s] END I0227 21:06:04.998054 1 trace.go:236] Trace[573882229]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:71eb8432-27ee-485f-8bc2-6de35d636223,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-v85nk/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:06:01.404) (total time: 3593ms): Trace[573882229]: ["GuaranteedUpdate etcd3" audit-id:71eb8432-27ee-485f-8bc2-6de35d636223,key:/pods/kube-system/cilium-operator-869df985b8-v85nk,type:*core.Pod,resource:pods 3593ms (21:06:01.404) Trace[573882229]: ---"Txn call completed" 3590ms (21:06:04.997)] Trace[573882229]: ---"Object stored in database" 3590ms (21:06:04.997) Trace[573882229]: [3.593867078s] [3.593867078s] END I0227 21:06:09.452492 1 trace.go:236] Trace[316188189]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1044b0eb-00d2-4b93-9f59-fdb48795b203,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.189836669c07ed87,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:06:01.403) (total time: 8048ms): Trace[316188189]: ["GuaranteedUpdate etcd3" audit-id:1044b0eb-00d2-4b93-9f59-fdb48795b203,key:/events/openstack/percona-xtradb-haproxy-0.189836669c07ed87,type:*core.Event,resource:events 8048ms (21:06:01.403) Trace[316188189]: ---"initial value restored" 3593ms (21:06:04.997) Trace[316188189]: ---"Txn call completed" 4451ms (21:06:09.452)] Trace[316188189]: ---"Object stored in database" 4452ms (21:06:09.452) Trace[316188189]: [8.048539099s] [8.048539099s] END I0227 21:06:09.452535 1 trace.go:236] Trace[1107774609]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.195,type:*v1.Endpoints,resource:apiServerIPInfo (27-Feb-2026 21:05:55.121) (total time: 14330ms): Trace[1107774609]: ---"initial value restored" 6275ms (21:06:01.396) Trace[1107774609]: ---"Transaction prepared" 1510ms (21:06:02.907) Trace[1107774609]: ---"Txn call completed" 6544ms (21:06:09.452) Trace[1107774609]: [14.33087489s] [14.33087489s] END I0227 21:06:09.453609 1 trace.go:236] Trace[1313407793]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2636b790-7b40-45d0-8fd8-923ee09eb11d,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:06:05.000) (total time: 4453ms): Trace[1313407793]: ["GuaranteedUpdate etcd3" audit-id:2636b790-7b40-45d0-8fd8-923ee09eb11d,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 4453ms (21:06:05.000) Trace[1313407793]: ---"Txn call completed" 4451ms (21:06:09.453)] Trace[1313407793]: [4.453402584s] [4.453402584s] END I0227 21:06:09.455256 1 trace.go:236] Trace[1682873012]: "Get" accept:application/json,audit-id:44169407-e442-4bc8-8af3-feede753ce52,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:06:02.402) (total time: 7052ms): Trace[1682873012]: ---"About to write a response" 7052ms (21:06:09.454) Trace[1682873012]: [7.052500702s] [7.052500702s] END W0227 21:06:19.518768 1 controller.go:141] RemoveEndpoints() timed out I0227 21:06:19.518896 1 controller.go:86] Shutting down OpenAPI V3 AggregationController I0227 21:06:19.519040 1 establishing_controller.go:87] Shutting down EstablishingController I0227 21:06:19.519065 1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController I0227 21:06:19.519086 1 controller.go:162] Shutting down OpenAPI controller I0227 21:06:19.519101 1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController I0227 21:06:19.519122 1 controller.go:115] Shutting down OpenAPI V3 controller I0227 21:06:19.519136 1 naming_controller.go:302] Shutting down NamingConditionController I0227 21:06:19.519142 1 storage_flowcontrol.go:187] APF bootstrap ensurer is exiting I0227 21:06:19.519170 1 autoregister_controller.go:165] Shutting down autoregister controller I0227 21:06:19.519157 1 crd_finalizer.go:278] Shutting down CRDFinalizer I0227 21:06:19.519201 1 system_namespaces_controller.go:77] Shutting down system namespaces controller I0227 21:06:19.519220 1 gc_controller.go:91] Shutting down apiserver lease garbage collector I0227 21:06:19.519232 1 apiservice_controller.go:131] Shutting down APIServiceRegistrationController I0227 21:06:19.519249 1 customresource_discovery_controller.go:325] Shutting down DiscoveryController I0227 21:06:19.519268 1 apf_controller.go:386] Shutting down API Priority and Fairness config worker I0227 21:06:19.519284 1 available_controller.go:439] Shutting down AvailableConditionController I0227 21:06:19.519318 1 gc_controller.go:91] Shutting down apiserver lease garbage collector I0227 21:06:19.519351 1 controller.go:129] Ending legacy_token_tracking_controller I0227 21:06:19.519359 1 controller.go:130] Shutting down legacy_token_tracking_controller I0227 21:06:19.519360 1 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller I0227 21:06:19.519376 1 dynamic_cafile_content.go:171] "Shutting down controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0227 21:06:19.519190 1 crdregistration_controller.go:142] Shutting down crd-autoregister controller I0227 21:06:19.519438 1 dynamic_cafile_content.go:171] "Shutting down controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" E0227 21:06:19.519194 1 controller.go:193] "Failed to update lease" err="Put \"https://[::1]:6443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te\": context canceled" I0227 21:06:19.519473 1 dynamic_serving_content.go:146] "Shutting down controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0227 21:06:19.519495 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController" I0227 21:06:19.519519 1 controller.go:84] Shutting down OpenAPI AggregationController I0227 21:06:19.519539 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0227 21:06:19.519566 1 secure_serving.go:258] Stopped listening on [::]:6443 I0227 21:06:19.519576 1 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0227 21:06:19.519592 1 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" E0227 21:06:19.519654 1 controller.go:193] "Failed to update lease" err="context canceled" I0227 21:06:19.519701 1 dynamic_serving_content.go:146] "Shutting down controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" E0227 21:06:19.519823 1 controller.go:193] "Failed to update lease" err="context canceled" E0227 21:06:19.519944 1 controller.go:193] "Failed to update lease" err="context canceled" E0227 21:06:19.519990 1 controller.go:193] "Failed to update lease" err="context canceled" I0227 21:06:19.520014 1 controller.go:116] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" E0227 21:06:19.520050 1 controller.go:146] "Failed to ensure lease exists, will retry" err="context canceled" interval="200ms" E0227 21:06:19.520370 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0227 21:06:19.520416 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0227 21:06:19.520453 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.16µs, panicked: false, err: context canceled, panic-reason: E0227 21:06:19.521458 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0227 21:06:19.521560 1 trace.go:236] Trace[339325017]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a7250dfb-ea32-4364-be48-fbb096ca04cc,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:06:15.209) (total time: 4311ms): Trace[339325017]: ["GuaranteedUpdate etcd3" audit-id:a7250dfb-ea32-4364-be48-fbb096ca04cc,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 4311ms (21:06:15.210) Trace[339325017]: ---"Txn call failed" err:context canceled 4309ms (21:06:19.520)] Trace[339325017]: [4.311683852s] [4.311683852s] END E0227 21:06:19.521689 1 timeout.go:142] post-timeout activity - time-elapsed: 1.354338ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te" result: I0227 21:06:21.111506 1 trace.go:236] Trace[707271735]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7bef681a-7ee4-428c-9b00-debb4b0cba45,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Feb-2026 21:06:15.384) (total time: 5727ms): Trace[707271735]: ["GuaranteedUpdate etcd3" audit-id:7bef681a-7ee4-428c-9b00-debb4b0cba45,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5726ms (21:06:15.384) Trace[707271735]: ---"Txn call completed" 5725ms (21:06:21.111)] Trace[707271735]: [5.72700626s] [5.72700626s] END I0227 21:06:21.111602 1 trace.go:236] Trace[2035492612]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e4b8c04f-4bd7-4603-a07f-e049e5aa1bd4,client:162.253.55.195,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services/ingress-nginx-controller,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (27-Feb-2026 21:06:05.000) (total time: 16111ms): Trace[2035492612]: ---"About to write a response" 16111ms (21:06:21.111) Trace[2035492612]: [16.111417124s] [16.111417124s] END I0227 21:06:21.112941 1 trace.go:236] Trace[1633564277]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2eb0726e-aa5b-4081-85fb-1caa17fbab41,client:162.253.55.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-operator-869df985b8-v85nk,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:06:05.002) (total time: 16110ms): Trace[1633564277]: ---"About to write a response" 16110ms (21:06:21.112) Trace[1633564277]: [16.110896224s] [16.110896224s] END E0227 21:06:23.959331 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0227 21:06:23.959489 1 trace.go:236] Trace[413047183]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:13427f4f-1be1-42a0-a626-1c6ddf436e55,client:162.253.55.195,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Feb-2026 21:06:16.956) (total time: 7002ms): Trace[413047183]: ["GuaranteedUpdate etcd3" audit-id:13427f4f-1be1-42a0-a626-1c6ddf436e55,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (21:06:16.956) Trace[413047183]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (21:06:23.959)] Trace[413047183]: [7.002829412s] [7.002829412s] END I0227 21:06:25.721197 1 trace.go:236] Trace[1762962948]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c99b8a1f-1297-4e82-98f6-1e4e13e24187,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Feb-2026 21:06:09.453) (total time: 16267ms): Trace[1762962948]: ---"About to write a response" 16267ms (21:06:25.720) Trace[1762962948]: [16.267629095s] [16.267629095s] END I0227 21:06:25.722022 1 trace.go:236] Trace[1888068460]: "Get" accept:application/json,audit-id:0bb0057b-c0d2-45b4-9759-5f5ff8e8eaed,client:162.253.55.195,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (27-Feb-2026 21:06:10.459) (total time: 15262ms): Trace[1888068460]: ---"About to write a response" 15261ms (21:06:25.721) Trace[1888068460]: [15.262150867s] [15.262150867s] END I0227 21:06:26.441248 1 trace.go:236] Trace[884664566]: "List(recursive=true) etcd3" audit-id:,key:/masterleases/,resourceVersion:0,resourceVersionMatch:NotOlderThan,limit:0,continue: (27-Feb-2026 21:06:25.722) (total time: 719ms): Trace[884664566]: [719.146183ms] [719.146183ms] END W0227 21:06:26.441283 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [] E0227 21:06:26.441817 1 controller.go:159] unable to sync kubernetes service: Put "https://[::1]:6443/api/v1/namespaces/default/endpoints/kubernetes": dial tcp [::1]:6443: connect: connection refused I0227 21:06:26.441885 1 trace.go:236] Trace[1961194499]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a4e792ca-610a-429a-9c2b-550f599bc921,client:162.253.55.195,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.1898366b25c5ba2c,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Feb-2026 21:06:09.454) (total time: 16986ms): Trace[1961194499]: ["GuaranteedUpdate etcd3" audit-id:a4e792ca-610a-429a-9c2b-550f599bc921,key:/events/kube-system/kube-apiserver-instance.1898366b25c5ba2c,type:*core.Event,resource:events 16986ms (21:06:09.454) Trace[1961194499]: ---"initial value restored" 16265ms (21:06:25.720) Trace[1961194499]: ---"Txn call completed" 719ms (21:06:26.441)] Trace[1961194499]: ---"Object stored in database" 720ms (21:06:26.441) Trace[1961194499]: [16.986993223s] [16.986993223s] END I0227 21:06:26.442272 1 controller.go:159] Shutting down quota evaluator I0227 21:06:26.442353 1 controller.go:178] quota evaluator worker shutdown I0227 21:06:26.442397 1 controller.go:178] quota evaluator worker shutdown I0227 21:06:26.442405 1 controller.go:178] quota evaluator worker shutdown E0227 21:06:26.442906 1 controller.go:131] Unable to remove endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/162.253.55.195, ResourceVersion: 0, AdditionalErrorMsg: I0227 21:06:26.442416 1 controller.go:178] quota evaluator worker shutdown I0227 21:06:26.442426 1 controller.go:178] quota evaluator worker shutdown