I0331 11:06:03.789805       1 options.go:220] external host was not specified, using 199.204.45.49
I0331 11:06:03.790471       1 server.go:148] Version: v1.28.13
I0331 11:06:03.790521       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0331 11:06:04.125657       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0331 11:06:04.139570       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0331 11:06:04.139597       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0331 11:06:04.139928       1 instance.go:298] Using reconciler: lease
I0331 11:06:04.177962       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0331 11:06:04.178030       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0331 11:06:04.438465       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0331 11:06:04.438776       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0331 11:06:04.910892       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0331 11:06:04.929343       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0331 11:06:04.929374       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.929380       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.929946       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0331 11:06:04.929967       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0331 11:06:04.930880       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0331 11:06:04.931746       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0331 11:06:04.931763       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0331 11:06:04.931769       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0331 11:06:04.932923       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0331 11:06:04.932937       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0331 11:06:04.933562       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0331 11:06:04.933575       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.933579       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.934035       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0331 11:06:04.934049       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.934073       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0331 11:06:04.934616       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0331 11:06:04.936033       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0331 11:06:04.936048       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.936052       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.936446       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0331 11:06:04.936461       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.936465       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.937217       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0331 11:06:04.937231       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0331 11:06:04.938900       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0331 11:06:04.938915       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.938919       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.939253       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0331 11:06:04.939269       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.939273       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.941029       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0331 11:06:04.941044       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.941048       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.942043       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0331 11:06:04.943091       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0331 11:06:04.943105       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.943108       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.946244       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0331 11:06:04.946262       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0331 11:06:04.946266       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0331 11:06:04.946966       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0331 11:06:04.946980       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0331 11:06:04.946984       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0331 11:06:04.947463       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0331 11:06:04.947476       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0331 11:06:04.987036       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0331 11:06:04.987069       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0331 11:06:05.385595       1 secure_serving.go:213] Serving securely on [::]:6443
I0331 11:06:05.385754       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 11:06:05.385865       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0331 11:06:05.385952       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0331 11:06:05.396016       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0331 11:06:05.396041       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0331 11:06:05.396069       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0331 11:06:05.396300       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0331 11:06:05.396392       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0331 11:06:05.396416       1 aggregator.go:164] waiting for initial CRD sync...
I0331 11:06:05.396430       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0331 11:06:05.396802       1 controller.go:116] Starting legacy_token_tracking_controller
I0331 11:06:05.396823       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0331 11:06:05.397059       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 11:06:05.397350       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 11:06:05.397516       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0331 11:06:05.397535       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0331 11:06:05.397579       1 available_controller.go:423] Starting AvailableConditionController
I0331 11:06:05.397589       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0331 11:06:05.398074       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0331 11:06:05.398227       1 controller.go:78] Starting OpenAPI AggregationController
I0331 11:06:05.398264       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0331 11:06:05.398294       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 11:06:05.401412       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0331 11:06:05.401425       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0331 11:06:05.402287       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 11:06:05.402409       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 11:06:05.403153       1 controller.go:134] Starting OpenAPI controller
I0331 11:06:05.403204       1 controller.go:85] Starting OpenAPI V3 controller
I0331 11:06:05.403233       1 naming_controller.go:291] Starting NamingConditionController
I0331 11:06:05.403257       1 establishing_controller.go:76] Starting EstablishingController
I0331 11:06:05.403302       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0331 11:06:05.403331       1 crd_finalizer.go:266] Starting CRDFinalizer
I0331 11:06:05.403637       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0331 11:06:05.426211       1 shared_informer.go:318] Caches are synced for node_authorizer
E0331 11:06:05.467998       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0331 11:06:05.496283       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0331 11:06:05.497369       1 shared_informer.go:318] Caches are synced for configmaps
I0331 11:06:05.497620       1 controller.go:624] quota admission added evaluator for: namespaces
I0331 11:06:05.497691       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0331 11:06:05.497716       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0331 11:06:05.498643       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0331 11:06:05.498683       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0331 11:06:05.501524       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0331 11:06:05.501556       1 aggregator.go:166] initial CRD sync complete...
I0331 11:06:05.501565       1 autoregister_controller.go:141] Starting autoregister controller
I0331 11:06:05.501572       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0331 11:06:05.501579       1 cache.go:39] Caches are synced for autoregister controller
I0331 11:06:05.672248       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0331 11:06:06.406388       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0331 11:06:06.413928       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0331 11:06:06.413946       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0331 11:06:07.000148       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0331 11:06:07.049276       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0331 11:06:07.110487       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0331 11:06:07.118113       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.49]
I0331 11:06:07.119207       1 controller.go:624] quota admission added evaluator for: endpoints
I0331 11:06:07.125026       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0331 11:06:09.768506       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0331 11:06:10.485857       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0331 11:06:10.649550       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0331 11:06:10.762973       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0331 11:06:14.503854       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0331 11:06:14.556797       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0331 11:06:38.213659       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 11:06:38.244896       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 11:06:38.244979       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 11:06:38.260743       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 11:06:38.279383       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 11:06:38.300033       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 11:06:38.323370       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 11:06:38.323438       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 11:06:38.339711       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 11:06:38.360400       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 11:06:38.390470       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 11:06:38.390611       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 11:06:38.489407       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 11:06:38.489459       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 11:06:38.532525       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 11:06:38.670078       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 11:06:38.670148       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 11:06:38.676883       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:38.714625       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:38.742522       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:38.776686       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:38.791995       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:39.511939       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:39.583729       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:39.729851       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 11:06:44.862260       1 trace.go:236] Trace[1113351492]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:75a83450-6b8f-47f1-b6d5-d6ff24d6011d,client:199.204.45.49,protocol:HTTP/2.0,resource:clienttrafficpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/clienttrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 11:06:44.335) (total time: 526ms):
Trace[1113351492]: ["List(recursive=true) etcd3" audit-id:75a83450-6b8f-47f1-b6d5-d6ff24d6011d,key:/gateway.envoyproxy.io/clienttrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 526ms (11:06:44.336)]
Trace[1113351492]: [526.224903ms] [526.224903ms] END
I0331 11:06:44.883908       1 trace.go:236] Trace[1362347634]: "Update" accept:application/json, */*,audit-id:2d292950-63e6-4277-9a6e-ffa3052f67b4,client:199.204.45.49,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (31-Mar-2026 11:06:44.361) (total time: 522ms):
Trace[1362347634]: ---"Conversion done" 17ms (11:06:44.383)
Trace[1362347634]: ---"Writing http response done" 27ms (11:06:44.883)
Trace[1362347634]: [522.666449ms] [522.666449ms] END
I0331 11:06:45.920046       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0331 11:06:47.146262       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 11:06:47.159077       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 11:06:47.341276       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 11:06:47.722085       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 11:06:47.736674       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 11:06:47.955876       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 11:06:48.137682       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 11:06:48.356005       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 11:06:50.370299       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 11:06:51.001561       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 11:06:51.333767       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0331 11:06:52.170083       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0331 11:06:52.170151       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0331 11:06:55.102854       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0331 11:07:04.527269       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.105.145.85"}
W0331 11:07:04.559737       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.145.85:9443: connect: connection refused
E0331 11:07:04.559772       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.145.85:9443: connect: connection refused
I0331 11:07:37.169043       1 trace.go:236] Trace[589779590]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e1d6fa75-8eb3-4f06-9a13-8fc37df0ce2f,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 11:07:33.410) (total time: 3758ms):
Trace[589779590]: ---"About to write a response" 3758ms (11:07:37.168)
Trace[589779590]: [3.758172558s] [3.758172558s] END
I0331 11:07:37.169478       1 trace.go:236] Trace[1095782364]: "Get" accept:application/json, */*,audit-id:499de422-049c-4a12-8c72-b85384d1fc99,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 11:07:33.332) (total time: 3837ms):
Trace[1095782364]: ---"About to write a response" 3836ms (11:07:37.169)
Trace[1095782364]: [3.837022388s] [3.837022388s] END
I0331 11:07:37.348976       1 trace.go:236] Trace[1450280529]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:60e4bb41-d354-40a5-a133-b548a01239ec,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 11:07:33.631) (total time: 3717ms):
Trace[1450280529]: ["GuaranteedUpdate etcd3" audit-id:60e4bb41-d354-40a5-a133-b548a01239ec,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 3717ms (11:07:33.631)
Trace[1450280529]:  ---"Txn call completed" 3716ms (11:07:37.348)]
Trace[1450280529]: [3.717372263s] [3.717372263s] END
I0331 11:07:37.832500       1 trace.go:236] Trace[1057215056]: "Update" accept:application/json, */*,audit-id:f2376934-a896-4f06-ad64-4a10e673bab5,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 11:07:37.171) (total time: 661ms):
Trace[1057215056]: ["GuaranteedUpdate etcd3" audit-id:f2376934-a896-4f06-ad64-4a10e673bab5,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 661ms (11:07:37.171)
Trace[1057215056]:  ---"Txn call completed" 658ms (11:07:37.830)]
Trace[1057215056]: [661.336488ms] [661.336488ms] END
I0331 11:07:37.833009       1 trace.go:236] Trace[794187057]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1820138b-2a08-4826-a9b3-eea9e74e0e8b,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 11:07:37.171) (total time: 661ms):
Trace[794187057]: ["GuaranteedUpdate etcd3" audit-id:1820138b-2a08-4826-a9b3-eea9e74e0e8b,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 661ms (11:07:37.171)
Trace[794187057]:  ---"Txn call completed" 660ms (11:07:37.832)]
Trace[794187057]: [661.426391ms] [661.426391ms] END
I0331 11:07:37.833788       1 trace.go:236] Trace[1942099364]: "Get" accept:application/json, */*,audit-id:2a6f0c5c-0d87-4ef2-9604-44a1540eb655,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 11:07:34.206) (total time: 3627ms):
Trace[1942099364]: ---"About to write a response" 3627ms (11:07:37.833)
Trace[1942099364]: [3.627570505s] [3.627570505s] END
I0331 11:07:37.833795       1 trace.go:236] Trace[1564880518]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bdef8ac1-116a-4c50-acf9-c68dd248b8a6,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 11:07:35.589) (total time: 2243ms):
Trace[1564880518]: ---"About to write a response" 2243ms (11:07:37.833)
Trace[1564880518]: [2.243755676s] [2.243755676s] END
I0331 11:07:37.834094       1 trace.go:236] Trace[1297568115]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c25d9723-5a20-4add-a8b4-51cac9e45f1d,client:199.204.45.49,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts/ttl-after-finished-controller,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/kube-controller-manager,verb:GET (31-Mar-2026 11:07:34.002) (total time: 3831ms):
Trace[1297568115]: ---"About to write a response" 3831ms (11:07:37.833)
Trace[1297568115]: [3.831976854s] [3.831976854s] END
I0331 11:07:37.834324       1 trace.go:236] Trace[1451910124]: "Get" accept:application/json, */*,audit-id:1a1a8f20-66ca-48be-9af7-889ea0650d0c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 11:07:34.279) (total time: 3554ms):
Trace[1451910124]: ---"About to write a response" 3554ms (11:07:37.834)
Trace[1451910124]: [3.554705654s] [3.554705654s] END
I0331 11:07:38.067127       1 trace.go:236] Trace[930406394]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.49,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 11:07:37.109) (total time: 957ms):
Trace[930406394]: ---"initial value restored" 723ms (11:07:37.833)
Trace[930406394]: ---"Transaction prepared" 223ms (11:07:38.056)
Trace[930406394]: [957.661153ms] [957.661153ms] END
I0331 11:07:56.398751       1 trace.go:236] Trace[90057359]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e74435af-cbd5-49fd-a3e9-a2a0e061d13f,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 11:07:51.397) (total time: 5000ms):
Trace[90057359]: ---"Write to database call failed" len:463,err:Timeout: request did not complete within requested timeout - context canceled 5000ms (11:07:56.398)
Trace[90057359]: [5.000783922s] [5.000783922s] END
E0331 11:07:56.398974       1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io?timeout=5s" audit-ID="e74435af-cbd5-49fd-a3e9-a2a0e061d13f"
E0331 11:07:56.399035       1 timeout.go:142] post-timeout activity - time-elapsed: 4.93µs, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: <nil>
E0331 11:07:56.399398       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 473.843µs, panicked: false, err: etcdserver: request timed out, panic-reason: <nil>
E0331 11:07:56.897232       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0331 11:07:56.897389       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 11:07:56.898521       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 11:07:56.898592       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 11:07:56.899666       1 trace.go:236] Trace[1957829801]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c4acf321-51d1-4d75-956a-b7d943cbb55d,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 11:07:51.897) (total time: 5002ms):
Trace[1957829801]: [5.0022198s] [5.0022198s] END
E0331 11:07:56.899861       1 timeout.go:142] post-timeout activity - time-elapsed: 2.558748ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0331 11:07:56.900008       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0331 11:07:56.901224       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 11:07:56.901264       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 11:07:56.902325       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 11:07:56.902403       1 trace.go:236] Trace[2044514891]: "Get" accept:application/json, */*,audit-id:347dfabc-b7c9-4982-a046-6d619e7fbe6d,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 11:07:51.900) (total time: 5002ms):
Trace[2044514891]: [5.002073907s] [5.002073907s] END
E0331 11:07:56.902631       1 timeout.go:142] post-timeout activity - time-elapsed: 2.563978ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0331 11:07:57.128083       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 11:07:57.128193       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 11:07:57.129326       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 11:07:57.129388       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 11:07:57.130635       1 trace.go:236] Trace[49828621]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5f6f4929-1564-437f-80e0-bc43369230ff,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 11:07:52.127) (total time: 5003ms):
Trace[49828621]: [5.003275688s] [5.003275688s] END
E0331 11:07:57.130788       1 timeout.go:142] post-timeout activity - time-elapsed: 2.728272ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
I0331 11:07:57.446671       1 trace.go:236] Trace[575897267]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:151a4315-4b00-4f2e-a870-21433f9bcc7c,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 11:07:52.284) (total time: 5161ms):
Trace[575897267]: ["GuaranteedUpdate etcd3" audit-id:151a4315-4b00-4f2e-a870-21433f9bcc7c,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5161ms (11:07:52.285)
Trace[575897267]:  ---"Txn call completed" 5160ms (11:07:57.446)]
Trace[575897267]: [5.161641494s] [5.161641494s] END
I0331 11:07:57.452051       1 trace.go:236] Trace[176081784]: "Get" accept:application/json, */*,audit-id:801b96d4-4fd2-42ae-aec1-6461ab2cafc2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 11:07:52.127) (total time: 5324ms):
Trace[176081784]: ---"About to write a response" 5324ms (11:07:57.451)
Trace[176081784]: [5.324818507s] [5.324818507s] END
I0331 11:07:57.452573       1 trace.go:236] Trace[2137645496]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1a74087b-b242-4b6e-a665-db15c3276347,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 11:07:56.399) (total time: 1053ms):
Trace[2137645496]: ---"About to write a response" 1053ms (11:07:57.452)
Trace[2137645496]: [1.053453929s] [1.053453929s] END
I0331 11:07:57.452553       1 trace.go:236] Trace[1506826152]: "Get" accept:application/json, */*,audit-id:2452910b-52ec-4672-8bd7-1fb3c99c40f8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 11:07:52.132) (total time: 5320ms):
Trace[1506826152]: ---"About to write a response" 5319ms (11:07:57.452)
Trace[1506826152]: [5.320137694s] [5.320137694s] END
I0331 11:08:10.658652       1 trace.go:236] Trace[875068798]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9f9ca56b-51bb-493d-be84-9d595173b828,client:199.204.45.49,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 11:08:09.680) (total time: 977ms):
Trace[875068798]: ---"About to write a response" 977ms (11:08:10.658)
Trace[875068798]: [977.846214ms] [977.846214ms] END
I0331 11:08:10.658730       1 trace.go:236] Trace[198588317]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6accb69f-6977-4971-be63-d6960c2d360f,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 11:08:09.252) (total time: 1406ms):
Trace[198588317]: ["GuaranteedUpdate etcd3" audit-id:6accb69f-6977-4971-be63-d6960c2d360f,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1406ms (11:08:09.252)
Trace[198588317]:  ---"Txn call completed" 1405ms (11:08:10.658)]
Trace[198588317]: [1.406396595s] [1.406396595s] END
I0331 11:08:10.658858       1 trace.go:236] Trace[1101851614]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:25eeda95-7a64-48fb-8a24-aaad4665c366,client:10.0.0.107,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 11:08:09.692) (total time: 966ms):
Trace[1101851614]: ["GuaranteedUpdate etcd3" audit-id:25eeda95-7a64-48fb-8a24-aaad4665c366,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 966ms (11:08:09.692)
Trace[1101851614]:  ---"Txn call completed" 965ms (11:08:10.658)]
Trace[1101851614]: [966.504496ms] [966.504496ms] END
I0331 11:08:17.836758       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.107.239.56"}
I0331 11:08:17.845995       1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.96.39.214"}