I0511 10:47:07.074416 1 options.go:220] external host was not specified, using 199.204.45.210 I0511 10:47:07.076323 1 server.go:148] Version: v1.28.13 I0511 10:47:07.076366 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0511 10:47:07.509089 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0511 10:47:07.515872 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0511 10:47:07.515896 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0511 10:47:07.516161 1 instance.go:298] Using reconciler: lease I0511 10:47:07.936301 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0511 10:47:07.936331 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0511 10:47:08.199414 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0511 10:47:08.199597 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0511 10:47:08.665587 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0511 10:47:08.680498 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0511 10:47:08.680570 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.680578 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.681141 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0511 10:47:08.681156 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0511 10:47:08.682301 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0511 10:47:08.683343 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0511 10:47:08.683361 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0511 10:47:08.683366 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0511 10:47:08.684900 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0511 10:47:08.684912 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0511 10:47:08.685732 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0511 10:47:08.685746 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.685749 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.686337 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0511 10:47:08.686349 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.686381 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0511 10:47:08.687112 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0511 10:47:08.688536 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0511 10:47:08.688550 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.688554 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.688938 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0511 10:47:08.688949 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.688953 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.689640 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0511 10:47:08.689653 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0511 10:47:08.691346 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0511 10:47:08.691359 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.691364 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.691753 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0511 10:47:08.691767 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.691770 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.693672 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0511 10:47:08.693686 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.693691 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.694824 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0511 10:47:08.695673 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0511 10:47:08.695686 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.695690 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.698717 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0511 10:47:08.698731 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0511 10:47:08.698735 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0511 10:47:08.699411 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0511 10:47:08.699472 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0511 10:47:08.699476 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0511 10:47:08.699909 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0511 10:47:08.699957 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0511 10:47:08.731821 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0511 10:47:08.731856 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0511 10:47:09.164984 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0511 10:47:09.165008 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0511 10:47:09.165274 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0511 10:47:09.165402 1 secure_serving.go:213] Serving securely on [::]:6443 I0511 10:47:09.165616 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0511 10:47:09.165655 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0511 10:47:09.165785 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0511 10:47:09.165814 1 aggregator.go:164] waiting for initial CRD sync... I0511 10:47:09.165849 1 controller.go:78] Starting OpenAPI AggregationController I0511 10:47:09.165872 1 controller.go:80] Starting OpenAPI V3 AggregationController I0511 10:47:09.165888 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0511 10:47:09.165951 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0511 10:47:09.165963 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0511 10:47:09.165965 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0511 10:47:09.165790 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0511 10:47:09.165985 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0511 10:47:09.165987 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0511 10:47:09.165849 1 gc_controller.go:78] Starting apiserver lease garbage collector I0511 10:47:09.166082 1 available_controller.go:423] Starting AvailableConditionController I0511 10:47:09.166103 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0511 10:47:09.166152 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0511 10:47:09.165891 1 controller.go:134] Starting OpenAPI controller I0511 10:47:09.166566 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0511 10:47:09.166628 1 controller.go:85] Starting OpenAPI V3 controller I0511 10:47:09.166677 1 naming_controller.go:291] Starting NamingConditionController I0511 10:47:09.166704 1 establishing_controller.go:76] Starting EstablishingController I0511 10:47:09.166724 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0511 10:47:09.166802 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0511 10:47:09.166829 1 crd_finalizer.go:266] Starting CRDFinalizer I0511 10:47:09.167233 1 controller.go:116] Starting legacy_token_tracking_controller I0511 10:47:09.167259 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0511 10:47:09.167675 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0511 10:47:09.167972 1 gc_controller.go:78] Starting apiserver lease garbage collector I0511 10:47:09.168957 1 system_namespaces_controller.go:67] Starting system namespaces controller I0511 10:47:09.209429 1 shared_informer.go:318] Caches are synced for node_authorizer E0511 10:47:09.245304 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0511 10:47:09.265758 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0511 10:47:09.266053 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0511 10:47:09.266078 1 shared_informer.go:318] Caches are synced for crd-autoregister I0511 10:47:09.266122 1 aggregator.go:166] initial CRD sync complete... I0511 10:47:09.266140 1 autoregister_controller.go:141] Starting autoregister controller I0511 10:47:09.266150 1 cache.go:32] Waiting for caches to sync for autoregister controller I0511 10:47:09.266159 1 cache.go:39] Caches are synced for autoregister controller I0511 10:47:09.266183 1 cache.go:39] Caches are synced for AvailableConditionController controller I0511 10:47:09.266664 1 apf_controller.go:379] Running API Priority and Fairness config worker I0511 10:47:09.266689 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0511 10:47:09.267435 1 shared_informer.go:318] Caches are synced for configmaps I0511 10:47:09.270375 1 controller.go:624] quota admission added evaluator for: namespaces I0511 10:47:09.448296 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0511 10:47:10.174100 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0511 10:47:10.180500 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0511 10:47:10.180523 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0511 10:47:10.779909 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0511 10:47:10.828668 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0511 10:47:10.886247 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0511 10:47:10.894817 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.210] I0511 10:47:10.895845 1 controller.go:624] quota admission added evaluator for: endpoints I0511 10:47:10.903141 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0511 10:47:11.499045 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0511 10:47:12.434515 1 controller.go:624] quota admission added evaluator for: deployments.apps I0511 10:47:12.481229 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0511 10:47:12.680718 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0511 10:47:16.490997 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0511 10:47:16.739056 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0511 10:47:36.963911 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0511 10:47:36.998117 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0511 10:47:37.037716 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0511 10:47:37.037750 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0511 10:47:37.056548 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0511 10:47:37.073009 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0511 10:47:37.089603 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0511 10:47:37.089661 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0511 10:47:37.100964 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0511 10:47:37.142979 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0511 10:47:37.143050 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0511 10:47:37.182319 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0511 10:47:37.255571 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0511 10:47:37.255633 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0511 10:47:37.305224 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0511 10:47:37.415334 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:37.477868 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:37.627863 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0511 10:47:37.627914 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0511 10:47:37.656000 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:37.707236 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:37.726492 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:38.592294 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:38.595035 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:38.665465 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0511 10:47:44.246320 1 controller.go:624] quota admission added evaluator for: jobs.batch I0511 10:47:45.107787 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0511 10:47:45.297971 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0511 10:47:45.510042 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0511 10:47:45.702264 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0511 10:47:47.001401 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0511 10:47:47.125273 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0511 10:47:47.139527 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0511 10:47:47.155248 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0511 10:47:47.161546 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0511 10:47:48.954636 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0511 10:47:49.323754 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0511 10:47:53.743919 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0511 10:47:53.743959 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0511 10:47:54.160928 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0511 10:48:02.861604 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.109.89.45"} W0511 10:48:02.898979 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.89.45:9443: connect: connection refused E0511 10:48:02.899027 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.89.45:9443: connect: connection refused I0511 10:49:08.521905 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.105.136.125"} I0511 10:49:08.535934 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.104.52.248"} I0511 10:49:32.016145 1 trace.go:236] Trace[1176184495]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:63ab31ab-76b0-473b-8b1f-fabbc1184fd4,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (11-May-2026 10:49:30.834) (total time: 1181ms): Trace[1176184495]: ["GuaranteedUpdate etcd3" audit-id:63ab31ab-76b0-473b-8b1f-fabbc1184fd4,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1181ms (10:49:30.834) Trace[1176184495]: ---"Txn call completed" 1180ms (10:49:32.015)] Trace[1176184495]: [1.181325197s] [1.181325197s] END I0511 10:49:32.016149 1 trace.go:236] Trace[1920865033]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1f71842c-3b00-45d3-9f11-3798874f57ba,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (11-May-2026 10:49:30.834) (total time: 1181ms): Trace[1920865033]: ["GuaranteedUpdate etcd3" audit-id:1f71842c-3b00-45d3-9f11-3798874f57ba,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1181ms (10:49:30.834) Trace[1920865033]: ---"Txn call completed" 1180ms (10:49:32.015)] Trace[1920865033]: [1.18180437s] [1.18180437s] END I0511 10:49:32.016157 1 trace.go:236] Trace[1354064232]: "Update" accept:application/json, */*,audit-id:3bc3ff25-411b-4c3a-981a-22c9e9c83e50,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (11-May-2026 10:49:30.835) (total time: 1180ms): Trace[1354064232]: ["GuaranteedUpdate etcd3" audit-id:3bc3ff25-411b-4c3a-981a-22c9e9c83e50,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1180ms (10:49:30.835) Trace[1354064232]: ---"Txn call completed" 1179ms (10:49:32.015)] Trace[1354064232]: [1.180786962s] [1.180786962s] END I0511 10:49:32.824129 1 trace.go:236] Trace[2123075910]: "Update" accept:application/json, */*,audit-id:01e3bc99-82a7-47bb-adfa-063223aff86b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (11-May-2026 10:49:32.017) (total time: 806ms): Trace[2123075910]: ["GuaranteedUpdate etcd3" audit-id:01e3bc99-82a7-47bb-adfa-063223aff86b,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 805ms (10:49:32.018) Trace[2123075910]: ---"Txn call completed" 804ms (10:49:32.823)] Trace[2123075910]: [806.225414ms] [806.225414ms] END I0511 10:49:32.832615 1 trace.go:236] Trace[1891758013]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.210,type:*v1.Endpoints,resource:apiServerIPInfo (11-May-2026 10:49:30.887) (total time: 1945ms): Trace[1891758013]: ---"initial value restored" 1127ms (10:49:32.014) Trace[1891758013]: ---"Transaction prepared" 751ms (10:49:32.766) Trace[1891758013]: ---"Txn call completed" 66ms (10:49:32.832) Trace[1891758013]: [1.945554354s] [1.945554354s] END I0511 10:53:39.040074 1 trace.go:236] Trace[719432627]: "Get" accept:application/json, */*,audit-id:7a11f950-0ab5-42f1-a69e-2b0dc9c3571e,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (11-May-2026 10:53:38.539) (total time: 500ms): Trace[719432627]: ---"About to write a response" 499ms (10:53:39.039) Trace[719432627]: [500.073082ms] [500.073082ms] END I0511 10:53:39.040915 1 trace.go:236] Trace[1355053057]: "Get" accept:application/json, */*,audit-id:8ecbbae2-b740-4cfd-a3cd-e47c33338221,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/ceph-csi-rbd-provisioner-69cb97fb6-b7t9t,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (11-May-2026 10:53:38.381) (total time: 659ms): Trace[1355053057]: ---"About to write a response" 658ms (10:53:39.040) Trace[1355053057]: [659.623103ms] [659.623103ms] END E0511 10:53:44.268393 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0511 10:53:44.268549 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0511 10:53:44.269723 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0511 10:53:44.269818 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0511 10:53:44.271082 1 trace.go:236] Trace[447214455]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e1c2b840-e696-43e3-865e-0d55a1849e1b,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (11-May-2026 10:53:39.268) (total time: 5002ms): Trace[447214455]: [5.002397895s] [5.002397895s] END E0511 10:53:44.271330 1 timeout.go:142] post-timeout activity - time-elapsed: 2.885119ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0511 10:53:44.274016 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0511 10:53:44.274207 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0511 10:53:44.275130 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0511 10:53:44.276269 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0511 10:53:44.276338 1 trace.go:236] Trace[1243276323]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2baaf969-01e7-4b8e-92ee-f77aa6b0bc78,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (11-May-2026 10:53:39.273) (total time: 5002ms): Trace[1243276323]: [5.002509088s] [5.002509088s] END E0511 10:53:44.276507 1 timeout.go:142] post-timeout activity - time-elapsed: 2.55651ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0511 10:53:45.134915 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0511 10:53:45.134959 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0511 10:53:45.135043 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 69.682µs, panicked: false, err: context canceled, panic-reason: E0511 10:53:45.136611 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0511 10:53:45.136706 1 trace.go:236] Trace[1179379172]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:19753da2-8201-4142-8144-3c158d31b8a2,client:10.0.0.215,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (11-May-2026 10:53:40.135) (total time: 5000ms): Trace[1179379172]: ["GuaranteedUpdate etcd3" audit-id:19753da2-8201-4142-8144-3c158d31b8a2,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (10:53:40.136) Trace[1179379172]: ---"Txn call failed" err:context canceled 4997ms (10:53:45.134)] Trace[1179379172]: [5.000801162s] [5.000801162s] END E0511 10:53:45.136837 1 timeout.go:142] post-timeout activity - time-elapsed: 1.927143ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0511 10:53:46.136406 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0511 10:53:46.136550 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0511 10:53:46.137708 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0511 10:53:46.137770 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0511 10:53:46.138930 1 trace.go:236] Trace[1869894808]: "Get" accept:application/json, */*,audit-id:bb6e87c6-54ed-4ca9-ad79-44d75882854c,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (11-May-2026 10:53:41.136) (total time: 5002ms): Trace[1869894808]: [5.002240481s] [5.002240481s] END E0511 10:53:46.139192 1 timeout.go:142] post-timeout activity - time-elapsed: 2.725425ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0511 10:53:47.261821 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0511 10:53:47.261998 1 trace.go:236] Trace[423589713]: "Get" accept:application/json, */*,audit-id:09281b38-137f-489d-ac58-9657a5c982e2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:40.259) (total time: 7002ms): Trace[423589713]: [7.002868984s] [7.002868984s] END E0511 10:53:48.121931 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0511 10:53:48.122126 1 trace.go:236] Trace[799310027]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:21db4de3-1198-4dca-866e-b133756bf743,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (11-May-2026 10:53:41.117) (total time: 7004ms): Trace[799310027]: ["GuaranteedUpdate etcd3" audit-id:21db4de3-1198-4dca-866e-b133756bf743,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (10:53:41.118) Trace[799310027]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (10:53:48.121)] Trace[799310027]: [7.00414267s] [7.00414267s] END I0511 10:53:48.724284 1 trace.go:236] Trace[760196352]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ae5cdf9d-f8b3-47eb-81f5-50ca424b3303,client:199.204.45.210,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (11-May-2026 10:53:43.300) (total time: 5423ms): Trace[760196352]: ["Create etcd3" audit-id:ae5cdf9d-f8b3-47eb-81f5-50ca424b3303,key:/events/kube-system/kube-apiserver-instance.18ae7d701add2683,type:*core.Event,resource:events 5423ms (10:53:43.301) Trace[760196352]: ---"Txn call succeeded" 5422ms (10:53:48.723)] Trace[760196352]: [5.423798108s] [5.423798108s] END I0511 10:53:48.724355 1 trace.go:236] Trace[951211794]: "Get" accept:application/json, */*,audit-id:e129577f-993b-4400-b5e6-d893e92fae65,client:10.0.0.19,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-snapshotter-leader-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:39.277) (total time: 9446ms): Trace[951211794]: ---"About to write a response" 9446ms (10:53:48.724) Trace[951211794]: [9.446355797s] [9.446355797s] END I0511 10:53:48.724819 1 trace.go:236] Trace[1502323802]: "Get" accept:application/json, */*,audit-id:ba7bd1db-9de4-4a73-8bf6-9d1b8ef236f9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:39.305) (total time: 9418ms): Trace[1502323802]: ---"About to write a response" 9418ms (10:53:48.724) Trace[1502323802]: [9.418905244s] [9.418905244s] END I0511 10:53:48.724962 1 trace.go:236] Trace[1069414213]: "Get" accept:application/json, */*,audit-id:2c95daf6-7a4b-4f50-ba8b-fe4d8dc161ae,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/ceph-csi-rbd-provisioner-69cb97fb6-b7t9t,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (11-May-2026 10:53:39.223) (total time: 9501ms): Trace[1069414213]: ---"About to write a response" 9500ms (10:53:48.724) Trace[1069414213]: [9.501201483s] [9.501201483s] END I0511 10:53:48.727245 1 trace.go:236] Trace[274561705]: "Get" accept:application/json, */*,audit-id:86392e5c-fd07-482d-a57b-ee8406b9b36d,client:10.0.0.19,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd.csi.ceph.com-kube-system,user-agent:cephcsi/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (11-May-2026 10:53:39.863) (total time: 8863ms): Trace[274561705]: ---"About to write a response" 8863ms (10:53:48.727) Trace[274561705]: [8.863202294s] [8.863202294s] END I0511 10:53:48.730030 1 trace.go:236] Trace[1658559063]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1d1288f8-184d-48fb-a865-46091a3a9a43,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (11-May-2026 10:53:48.124) (total time: 605ms): Trace[1658559063]: ["GuaranteedUpdate etcd3" audit-id:1d1288f8-184d-48fb-a865-46091a3a9a43,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 605ms (10:53:48.124) Trace[1658559063]: ---"Txn call completed" 603ms (10:53:48.729)] Trace[1658559063]: [605.348023ms] [605.348023ms] END I0511 10:53:48.730420 1 trace.go:236] Trace[1367927602]: "Get" accept:application/json, */*,audit-id:e4022128-3fc7-4bd8-a91e-f8e4753f1fb4,client:10.0.0.19,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:40.512) (total time: 8218ms): Trace[1367927602]: ---"About to write a response" 8218ms (10:53:48.730) Trace[1367927602]: [8.218249496s] [8.218249496s] END I0511 10:53:48.730449 1 trace.go:236] Trace[1087089977]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:500b634b-fad1-4751-9b90-7ea717a51bed,client:10.0.0.215,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (11-May-2026 10:53:45.136) (total time: 3593ms): Trace[1087089977]: ---"About to write a response" 3593ms (10:53:48.730) Trace[1087089977]: [3.593939492s] [3.593939492s] END I0511 10:53:48.730546 1 trace.go:236] Trace[1507067311]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cab9ad2b-4232-4899-9c56-60232fb42758,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (11-May-2026 10:53:46.276) (total time: 2454ms): Trace[1507067311]: ---"About to write a response" 2454ms (10:53:48.730) Trace[1507067311]: [2.454419724s] [2.454419724s] END I0511 10:53:48.730782 1 trace.go:236] Trace[194759740]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5a6d3e40-7342-42d5-a3bd-452ccec911bb,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (11-May-2026 10:53:46.270) (total time: 2460ms): Trace[194759740]: ---"About to write a response" 2459ms (10:53:48.730) Trace[194759740]: [2.460090509s] [2.460090509s] END I0511 10:53:48.730856 1 trace.go:236] Trace[50781198]: "Get" accept:application/json, */*,audit-id:1af8693d-77c9-4c17-b327-409afec6d3b6,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (11-May-2026 10:53:48.137) (total time: 592ms): Trace[50781198]: ---"About to write a response" 592ms (10:53:48.730) Trace[50781198]: [592.864619ms] [592.864619ms] END I0511 10:53:48.730951 1 trace.go:236] Trace[1188163556]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:efa77d34-be8c-4711-9456-6e96582aa07d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (11-May-2026 10:53:47.827) (total time: 903ms): Trace[1188163556]: ["GuaranteedUpdate etcd3" audit-id:efa77d34-be8c-4711-9456-6e96582aa07d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 903ms (10:53:47.827) Trace[1188163556]: ---"Txn call completed" 902ms (10:53:48.730)] Trace[1188163556]: [903.457428ms] [903.457428ms] END I0511 10:53:48.731077 1 trace.go:236] Trace[2128806906]: "Get" accept:application/json, */*,audit-id:5fec74f5-bba5-4cfe-b7ad-ea9333c579b4,client:10.0.0.19,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:40.896) (total time: 7834ms): Trace[2128806906]: ---"About to write a response" 7834ms (10:53:48.731) Trace[2128806906]: [7.834124649s] [7.834124649s] END I0511 10:53:48.731228 1 trace.go:236] Trace[339823090]: "Get" accept:application/json, */*,audit-id:2457e849-e952-493b-b6b0-e70b363ecbe4,client:10.0.0.19,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-resizer-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (11-May-2026 10:53:41.668) (total time: 7062ms): Trace[339823090]: ---"About to write a response" 7062ms (10:53:48.731) Trace[339823090]: [7.062577093s] [7.062577093s] END I0511 10:53:48.772296 1 trace.go:236] Trace[1238060727]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.210,type:*v1.Endpoints,resource:apiServerIPInfo (11-May-2026 10:53:40.901) (total time: 7870ms): Trace[1238060727]: ---"initial value restored" 7829ms (10:53:48.730) Trace[1238060727]: [7.870620512s] [7.870620512s] END