I0428 03:24:38.446817 1 options.go:220] external host was not specified, using 199.204.45.33 I0428 03:24:38.447888 1 server.go:148] Version: v1.28.13 I0428 03:24:38.447976 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0428 03:24:38.692691 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0428 03:24:38.702065 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0428 03:24:38.702085 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0428 03:24:38.702382 1 instance.go:298] Using reconciler: lease I0428 03:24:39.384893 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0428 03:24:39.384942 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0428 03:24:39.643054 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0428 03:24:39.643232 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0428 03:24:40.119081 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0428 03:24:40.131153 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0428 03:24:40.131269 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.131289 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.131779 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0428 03:24:40.131820 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0428 03:24:40.132558 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0428 03:24:40.133177 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0428 03:24:40.133217 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0428 03:24:40.133231 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0428 03:24:40.134360 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0428 03:24:40.134403 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0428 03:24:40.135182 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0428 03:24:40.135224 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.135239 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.135838 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0428 03:24:40.135882 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.135955 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0428 03:24:40.136694 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0428 03:24:40.137976 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0428 03:24:40.138023 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.138039 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.138419 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0428 03:24:40.138469 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.138483 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.139129 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0428 03:24:40.139182 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0428 03:24:40.140588 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0428 03:24:40.140633 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.140708 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.141055 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0428 03:24:40.141098 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.141115 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.142858 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0428 03:24:40.142905 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.142921 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.143701 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0428 03:24:40.144506 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0428 03:24:40.144552 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.144568 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.160734 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0428 03:24:40.160763 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0428 03:24:40.160770 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0428 03:24:40.161689 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0428 03:24:40.161704 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0428 03:24:40.161708 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0428 03:24:40.162306 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0428 03:24:40.162321 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0428 03:24:40.198781 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0428 03:24:40.198819 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0428 03:24:40.649294 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 03:24:40.649314 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 03:24:40.649803 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0428 03:24:40.650493 1 secure_serving.go:213] Serving securely on [::]:6443 I0428 03:24:40.650620 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0428 03:24:40.650685 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0428 03:24:40.650747 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0428 03:24:40.650883 1 available_controller.go:423] Starting AvailableConditionController I0428 03:24:40.650923 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0428 03:24:40.651018 1 controller.go:78] Starting OpenAPI AggregationController I0428 03:24:40.651127 1 controller.go:116] Starting legacy_token_tracking_controller I0428 03:24:40.651157 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0428 03:24:40.651178 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0428 03:24:40.651257 1 controller.go:134] Starting OpenAPI controller I0428 03:24:40.651307 1 controller.go:85] Starting OpenAPI V3 controller I0428 03:24:40.651327 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0428 03:24:40.651341 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0428 03:24:40.651367 1 establishing_controller.go:76] Starting EstablishingController I0428 03:24:40.651398 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0428 03:24:40.651433 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0428 03:24:40.651454 1 system_namespaces_controller.go:67] Starting system namespaces controller I0428 03:24:40.651460 1 crd_finalizer.go:266] Starting CRDFinalizer I0428 03:24:40.651570 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0428 03:24:40.651751 1 controller.go:80] Starting OpenAPI V3 AggregationController I0428 03:24:40.652168 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 03:24:40.652542 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 03:24:40.652596 1 aggregator.go:164] waiting for initial CRD sync... I0428 03:24:40.653042 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0428 03:24:40.653057 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0428 03:24:40.655270 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 03:24:40.655500 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 03:24:40.651347 1 naming_controller.go:291] Starting NamingConditionController I0428 03:24:40.657466 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0428 03:24:40.657500 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0428 03:24:40.692877 1 shared_informer.go:318] Caches are synced for node_authorizer E0428 03:24:40.728559 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0428 03:24:40.750900 1 apf_controller.go:379] Running API Priority and Fairness config worker I0428 03:24:40.750935 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0428 03:24:40.751259 1 shared_informer.go:318] Caches are synced for configmaps I0428 03:24:40.751326 1 cache.go:39] Caches are synced for AvailableConditionController controller I0428 03:24:40.751562 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0428 03:24:40.753110 1 shared_informer.go:318] Caches are synced for crd-autoregister I0428 03:24:40.753147 1 aggregator.go:166] initial CRD sync complete... I0428 03:24:40.753155 1 autoregister_controller.go:141] Starting autoregister controller I0428 03:24:40.753162 1 cache.go:32] Waiting for caches to sync for autoregister controller I0428 03:24:40.753168 1 cache.go:39] Caches are synced for autoregister controller I0428 03:24:40.753195 1 controller.go:624] quota admission added evaluator for: namespaces I0428 03:24:40.757639 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0428 03:24:40.932730 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0428 03:24:41.658903 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0428 03:24:41.665061 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0428 03:24:41.665092 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0428 03:24:42.292043 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0428 03:24:42.345260 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0428 03:24:42.469603 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0428 03:24:42.477874 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.33] I0428 03:24:42.478842 1 controller.go:624] quota admission added evaluator for: endpoints I0428 03:24:42.484378 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0428 03:24:44.059318 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0428 03:24:44.069812 1 controller.go:624] quota admission added evaluator for: deployments.apps I0428 03:24:44.112318 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0428 03:24:44.316181 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0428 03:24:48.912544 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0428 03:24:49.259548 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0428 03:24:55.509697 1 trace.go:236] Trace[2103265596]: "Update" accept:application/json, */*,audit-id:020cbe49-a8d0-4442-b6e2-7fac8a9c252e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 03:24:54.853) (total time: 655ms): Trace[2103265596]: ["GuaranteedUpdate etcd3" audit-id:020cbe49-a8d0-4442-b6e2-7fac8a9c252e,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 655ms (03:24:54.854) Trace[2103265596]: ---"Txn call completed" 654ms (03:24:55.509)] Trace[2103265596]: [655.748767ms] [655.748767ms] END I0428 03:24:56.736828 1 trace.go:236] Trace[72819508]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5cf75174-8a95-4351-8453-c2f6784a1b26,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Apr-2026 03:24:55.512) (total time: 1224ms): Trace[72819508]: ["GuaranteedUpdate etcd3" audit-id:5cf75174-8a95-4351-8453-c2f6784a1b26,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1224ms (03:24:55.512) Trace[72819508]: ---"Txn call completed" 1223ms (03:24:56.736)] Trace[72819508]: [1.224517974s] [1.224517974s] END I0428 03:24:57.558885 1 trace.go:236] Trace[360257663]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5a826bf6-bd3b-4bf0-9136-7c5ff73478d6,client:199.204.45.33,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (28-Apr-2026 03:24:55.515) (total time: 2043ms): Trace[360257663]: ["GuaranteedUpdate etcd3" audit-id:5a826bf6-bd3b-4bf0-9136-7c5ff73478d6,key:/pods/kube-system/kube-apiserver-instance,type:*core.Pod,resource:pods 2043ms (03:24:55.515) Trace[360257663]: ---"Txn call completed" 2037ms (03:24:57.558)] Trace[360257663]: ---"Object stored in database" 2037ms (03:24:57.558) Trace[360257663]: [2.04339108s] [2.04339108s] END I0428 03:24:57.559470 1 trace.go:236] Trace[1400021085]: "Get" accept:application/json, */*,audit-id:1acbde96-6f01-4fa4-b95a-5772c2ed4d82,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:24:56.273) (total time: 1286ms): Trace[1400021085]: ---"About to write a response" 1285ms (03:24:57.559) Trace[1400021085]: [1.286044396s] [1.286044396s] END I0428 03:24:57.559640 1 trace.go:236] Trace[659440851]: "Get" accept:application/json,audit-id:705bbdcb-c0bf-4944-b75d-a5dcaf0fdc9f,client:199.204.45.33,protocol:HTTP/1.1,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (28-Apr-2026 03:24:55.635) (total time: 1923ms): Trace[659440851]: ---"About to write a response" 1923ms (03:24:57.559) Trace[659440851]: [1.923788221s] [1.923788221s] END I0428 03:24:57.559983 1 trace.go:236] Trace[1918712810]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:04d798e6-674d-4cae-8d55-ba6b2e6f28d4,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Apr-2026 03:24:56.210) (total time: 1349ms): Trace[1918712810]: ---"About to write a response" 1348ms (03:24:57.559) Trace[1918712810]: [1.349002221s] [1.349002221s] END I0428 03:25:11.930956 1 trace.go:236] Trace[1214403962]: "Create" accept:application/json,audit-id:c1bc3805-4f68-40fb-a779-7e60d44a31c6,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.271) (total time: 659ms): Trace[1214403962]: ["Create etcd3" audit-id:c1bc3805-4f68-40fb-a779-7e60d44a31c6,key:/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 648ms (03:25:11.282) Trace[1214403962]: ---"Txn call succeeded" 645ms (03:25:11.928)] Trace[1214403962]: [659.487751ms] [659.487751ms] END I0428 03:25:12.119582 1 trace.go:236] Trace[1671773745]: "Create" accept:application/json,audit-id:91a80116-bd46-4316-a814-f38a2bf3a2b7,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.271) (total time: 847ms): Trace[1671773745]: ---"limitedReadBody succeeded" len:53425 14ms (03:25:11.286) Trace[1671773745]: ["Create etcd3" audit-id:91a80116-bd46-4316-a814-f38a2bf3a2b7,key:/apiextensions.k8s.io/customresourcedefinitions/backendtlspolicies.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 785ms (03:25:11.333) Trace[1671773745]: ---"Txn call succeeded" 780ms (03:25:12.114)] Trace[1671773745]: [847.936094ms] [847.936094ms] END I0428 03:25:12.119709 1 trace.go:236] Trace[1645866919]: "Create" accept:application/json,audit-id:2a3b7f50-0e10-4e94-9ecc-bccb82699c11,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.271) (total time: 848ms): Trace[1645866919]: ["Create etcd3" audit-id:2a3b7f50-0e10-4e94-9ecc-bccb82699c11,key:/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 838ms (03:25:11.280) Trace[1645866919]: ---"Txn call succeeded" 835ms (03:25:12.116)] Trace[1645866919]: [848.590679ms] [848.590679ms] END I0428 03:25:12.119796 1 trace.go:236] Trace[388273636]: "Create" accept:application/json,audit-id:a0a1db28-edaf-4054-8087-ac4afd1d8cfc,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.267) (total time: 852ms): Trace[388273636]: ["Create etcd3" audit-id:a0a1db28-edaf-4054-8087-ac4afd1d8cfc,key:/apiextensions.k8s.io/customresourcedefinitions/xmeshes.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 825ms (03:25:11.293) Trace[388273636]: ---"Txn call succeeded" 823ms (03:25:12.117)] Trace[388273636]: [852.005915ms] [852.005915ms] END I0428 03:25:12.119876 1 trace.go:236] Trace[1367293017]: "Create" accept:application/json,audit-id:44cf0340-2da3-467e-8113-805223aae61a,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.273) (total time: 846ms): Trace[1367293017]: ["Create etcd3" audit-id:44cf0340-2da3-467e-8113-805223aae61a,key:/apiextensions.k8s.io/customresourcedefinitions/xbackendtrafficpolicies.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 802ms (03:25:11.317) Trace[1367293017]: ---"Txn call succeeded" 800ms (03:25:12.118)] Trace[1367293017]: [846.078803ms] [846.078803ms] END I0428 03:25:12.120856 1 trace.go:236] Trace[1975937096]: "Create" accept:application/json,audit-id:3ef55fdc-5120-466b-b8b5-8858f538bac8,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.273) (total time: 847ms): Trace[1975937096]: ["Create etcd3" audit-id:3ef55fdc-5120-466b-b8b5-8858f538bac8,key:/apiextensions.k8s.io/customresourcedefinitions/xlistenersets.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 785ms (03:25:11.335) Trace[1975937096]: ---"Txn call succeeded" 781ms (03:25:12.117)] Trace[1975937096]: [847.576697ms] [847.576697ms] END I0428 03:25:12.122659 1 trace.go:236] Trace[1391127171]: "Create" accept:application/json,audit-id:23d8330b-5c7d-4275-8de4-6cdc1a44fb58,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.271) (total time: 850ms): Trace[1391127171]: ["Create etcd3" audit-id:23d8330b-5c7d-4275-8de4-6cdc1a44fb58,key:/apiextensions.k8s.io/customresourcedefinitions/tcproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 790ms (03:25:11.332) Trace[1391127171]: ---"Txn call succeeded" 787ms (03:25:12.120)] Trace[1391127171]: [850.895189ms] [850.895189ms] END I0428 03:25:12.123195 1 trace.go:236] Trace[1128632717]: "Create" accept:application/json,audit-id:74479536-83ca-4c00-88fc-497618d3729a,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.272) (total time: 851ms): Trace[1128632717]: ["Create etcd3" audit-id:74479536-83ca-4c00-88fc-497618d3729a,key:/apiextensions.k8s.io/customresourcedefinitions/udproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 792ms (03:25:11.330) Trace[1128632717]: ---"Txn call succeeded" 789ms (03:25:12.119)] Trace[1128632717]: [851.075964ms] [851.075964ms] END I0428 03:25:12.126462 1 trace.go:236] Trace[1944091124]: "Create" accept:application/json,audit-id:8f1bb9c3-6894-47ca-a7dd-cb6e2ce69728,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.272) (total time: 854ms): Trace[1944091124]: ---"Conversion done" 20ms (03:25:11.305) Trace[1944091124]: ["Create etcd3" audit-id:8f1bb9c3-6894-47ca-a7dd-cb6e2ce69728,key:/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 763ms (03:25:11.362) Trace[1944091124]: ---"Txn call succeeded" 753ms (03:25:12.117)] Trace[1944091124]: [854.258905ms] [854.258905ms] END I0428 03:25:12.126650 1 trace.go:236] Trace[1349404594]: "Create" accept:application/json,audit-id:30a78618-6154-40ac-9abd-4ba062129075,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.277) (total time: 849ms): Trace[1349404594]: ---"limitedReadBody succeeded" len:114160 16ms (03:25:11.293) Trace[1349404594]: ["Create etcd3" audit-id:30a78618-6154-40ac-9abd-4ba062129075,key:/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 782ms (03:25:11.344) Trace[1349404594]: ---"Txn call succeeded" 773ms (03:25:12.118)] Trace[1349404594]: [849.329405ms] [849.329405ms] END I0428 03:25:12.130031 1 trace.go:236] Trace[1749417484]: "Create" accept:application/json,audit-id:1246b01d-4bb5-4ca6-8fc9-82814f75f8bc,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.272) (total time: 857ms): Trace[1749417484]: ---"limitedReadBody succeeded" len:63207 18ms (03:25:11.291) Trace[1749417484]: ---"Conversion done" 18ms (03:25:11.309) Trace[1749417484]: ["Create etcd3" audit-id:1246b01d-4bb5-4ca6-8fc9-82814f75f8bc,key:/apiextensions.k8s.io/customresourcedefinitions/tlsroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 786ms (03:25:11.343) Trace[1749417484]: ---"Txn call succeeded" 773ms (03:25:12.117)] Trace[1749417484]: [857.241881ms] [857.241881ms] END I0428 03:25:12.167039 1 trace.go:236] Trace[1932882036]: "Create" accept:application/json,audit-id:ff4d5b25-549e-4e57-bf16-c8258d701388,client:199.204.45.33,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:11.282) (total time: 884ms): Trace[1932882036]: ---"limitedReadBody succeeded" len:297475 33ms (03:25:11.316) Trace[1932882036]: ---"Conversion done" 17ms (03:25:11.334) Trace[1932882036]: ["Create etcd3" audit-id:ff4d5b25-549e-4e57-bf16-c8258d701388,key:/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 704ms (03:25:11.462) Trace[1932882036]: ---"Txn call succeeded" 658ms (03:25:12.123)] Trace[1932882036]: ---"Writing http response done" 33ms (03:25:12.166) Trace[1932882036]: [884.177771ms] [884.177771ms] END I0428 03:25:12.230263 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:25:12.243468 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:25:12.260661 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:25:12.276093 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:25:12.296935 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:25:12.325171 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:25:12.325218 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 03:25:12.365479 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 03:25:12.382410 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 03:25:12.382483 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 03:25:12.411395 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:25:12.411490 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:25:12.476752 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:25:12.566009 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:25:12.566217 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:25:12.599581 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 03:25:12.599700 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 03:25:12.614488 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:12.658783 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:12.679139 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:12.741254 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:12.775917 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:13.375714 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:13.390585 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:13.482093 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 03:25:19.222523 1 trace.go:236] Trace[137144963]: "Update" accept:application/json, */*,audit-id:bed12928-681f-40b2-8f3d-6680681b9451,client:199.204.45.33,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (28-Apr-2026 03:25:18.572) (total time: 649ms): Trace[137144963]: ---"Conversion done" 24ms (03:25:18.600) Trace[137144963]: ["GuaranteedUpdate etcd3" audit-id:bed12928-681f-40b2-8f3d-6680681b9451,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 621ms (03:25:18.600) Trace[137144963]: ---"Txn call completed" 585ms (03:25:19.191)] Trace[137144963]: ---"Writing http response done" 30ms (03:25:19.222) Trace[137144963]: [649.95701ms] [649.95701ms] END I0428 03:25:19.251931 1 controller.go:624] quota admission added evaluator for: jobs.batch I0428 03:25:20.676850 1 trace.go:236] Trace[209243139]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.596) (total time: 1080ms): Trace[209243139]: [1.080199255s] [1.080199255s] END I0428 03:25:20.676982 1 trace.go:236] Trace[718942073]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/envoyextensionpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.293) (total time: 1383ms): Trace[718942073]: [1.383806025s] [1.383806025s] END I0428 03:25:20.677124 1 trace.go:236] Trace[1731800793]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:44f692f4-4b88-4eca-a611-c727091bfeeb,client:199.204.45.33,protocol:HTTP/2.0,resource:envoyextensionpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/envoyextensionpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.293) (total time: 1383ms): Trace[1731800793]: ["List(recursive=true) etcd3" audit-id:44f692f4-4b88-4eca-a611-c727091bfeeb,key:/gateway.envoyproxy.io/envoyextensionpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1383ms (03:25:19.293)] Trace[1731800793]: [1.383234793s] [1.383234793s] END I0428 03:25:20.677199 1 trace.go:236] Trace[1365475783]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.665) (total time: 1011ms): Trace[1365475783]: [1.011812949s] [1.011812949s] END I0428 03:25:20.677201 1 trace.go:236] Trace[824264286]: "Create" accept:application/json,audit-id:814f2a23-796c-43cb-bca2-973daa44f663,client:199.204.45.33,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs,user-agent:Helm/3.11.2,verb:POST (28-Apr-2026 03:25:19.249) (total time: 1427ms): Trace[824264286]: ["Create etcd3" audit-id:814f2a23-796c-43cb-bca2-973daa44f663,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 1425ms (03:25:19.251) Trace[824264286]: ---"Txn call succeeded" 1424ms (03:25:20.676)] Trace[824264286]: [1.427400325s] [1.427400325s] END I0428 03:25:20.676883 1 trace.go:236] Trace[421929602]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xmeshes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.722) (total time: 954ms): Trace[421929602]: [954.166155ms] [954.166155ms] END I0428 03:25:20.677368 1 trace.go:236] Trace[674912783]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.690) (total time: 986ms): Trace[674912783]: [986.743115ms] [986.743115ms] END I0428 03:25:20.677429 1 trace.go:236] Trace[629352754]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:1d8da0bf-a858-47e1-bfcd-d5d31197329b,client:199.204.45.33,protocol:HTTP/2.0,resource:gatewayclasses,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/gatewayclasses,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.705) (total time: 971ms): Trace[629352754]: ["List(recursive=true) etcd3" audit-id:1d8da0bf-a858-47e1-bfcd-d5d31197329b,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 971ms (03:25:19.705)] Trace[629352754]: [971.80632ms] [971.80632ms] END I0428 03:25:20.677547 1 trace.go:236] Trace[5224465]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:500b8e55-ad96-4036-9658-3281c69f2036,client:199.204.45.33,protocol:HTTP/2.0,resource:xmeshes,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xmeshes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.723) (total time: 953ms): Trace[5224465]: ["List(recursive=true) etcd3" audit-id:500b8e55-ad96-4036-9658-3281c69f2036,key:/gateway.networking.x-k8s.io/xmeshes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 953ms (03:25:19.723)] Trace[5224465]: [953.814505ms] [953.814505ms] END I0428 03:25:20.677883 1 trace.go:236] Trace[1947508443]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.704) (total time: 972ms): Trace[1947508443]: [972.956826ms] [972.956826ms] END I0428 03:25:20.677903 1 trace.go:236] Trace[2091438127]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.464) (total time: 1213ms): Trace[2091438127]: [1.213861467s] [1.213861467s] END I0428 03:25:20.678026 1 trace.go:236] Trace[156134230]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:31236a9e-c36f-49d9-a5ea-6cec1645bddd,client:199.204.45.33,protocol:HTTP/2.0,resource:httproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/httproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.597) (total time: 1080ms): Trace[156134230]: ["List(recursive=true) etcd3" audit-id:31236a9e-c36f-49d9-a5ea-6cec1645bddd,key:/gateway.networking.k8s.io/httproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1080ms (03:25:19.597)] Trace[156134230]: [1.080913531s] [1.080913531s] END I0428 03:25:20.678082 1 trace.go:236] Trace[2118338202]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:f351478d-650d-42f6-84f8-8c08c729be62,client:199.204.45.33,protocol:HTTP/2.0,resource:grpcroutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/grpcroutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.666) (total time: 1011ms): Trace[2118338202]: ["List(recursive=true) etcd3" audit-id:f351478d-650d-42f6-84f8-8c08c729be62,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1011ms (03:25:19.666)] Trace[2118338202]: [1.011854009s] [1.011854009s] END I0428 03:25:20.678276 1 trace.go:236] Trace[252515899]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (28-Apr-2026 03:25:19.616) (total time: 1061ms): Trace[252515899]: [1.061849813s] [1.061849813s] END I0428 03:25:20.678462 1 trace.go:236] Trace[97379474]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:8d028d16-67fa-45ba-91cd-7f72bc81bb47,client:199.204.45.33,protocol:HTTP/2.0,resource:envoypatchpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/envoypatchpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (28-Apr-2026 03:25:19.617) (total time: 1061ms): Trace[97379474]: ["List(recursive=true) etcd3" audit-id:8d028d16-67fa-45ba-91cd-7f72bc81bb47,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1061ms (03:25:19.617)] Trace[97379474]: [1.061252108s] [1.061252108s] END I0428 03:25:22.226790 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:25:22.233487 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:25:22.414668 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:25:22.780596 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:25:22.811266 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:25:23.021594 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:25:23.452523 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:25:23.638798 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:25:24.838905 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 03:25:25.804868 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 03:25:26.215774 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0428 03:25:27.123739 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0428 03:25:27.123786 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0428 03:25:30.127237 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0428 03:25:40.551023 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.109.165.47"} W0428 03:25:40.582676 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.165.47:9443: connect: connection refused E0428 03:25:40.582712 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.165.47:9443: connect: connection refused I0428 03:26:12.229900 1 trace.go:236] Trace[1729022311]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1abceafe-f229-4a4a-bbc4-1f768fd0c666,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Apr-2026 03:26:11.595) (total time: 634ms): Trace[1729022311]: ["GuaranteedUpdate etcd3" audit-id:1abceafe-f229-4a4a-bbc4-1f768fd0c666,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 634ms (03:26:11.595) Trace[1729022311]: ---"Txn call completed" 633ms (03:26:12.229)] Trace[1729022311]: [634.809491ms] [634.809491ms] END I0428 03:26:12.835964 1 trace.go:236] Trace[538157370]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4427b078-b942-4eab-82b9-e968a18f7cc8,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Apr-2026 03:26:11.596) (total time: 1239ms): Trace[538157370]: ["GuaranteedUpdate etcd3" audit-id:4427b078-b942-4eab-82b9-e968a18f7cc8,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1239ms (03:26:11.596) Trace[538157370]: ---"Txn call completed" 1238ms (03:26:12.835)] Trace[538157370]: [1.23974989s] [1.23974989s] END I0428 03:26:12.836024 1 trace.go:236] Trace[974865496]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:729723e9-dbef-4906-9583-d92cba4b5ea7,client:10.0.0.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:26:12.269) (total time: 566ms): Trace[974865496]: ["GuaranteedUpdate etcd3" audit-id:729723e9-dbef-4906-9583-d92cba4b5ea7,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 566ms (03:26:12.269) Trace[974865496]: ---"Txn call completed" 565ms (03:26:12.835)] Trace[974865496]: [566.329992ms] [566.329992ms] END I0428 03:26:14.676740 1 trace.go:236] Trace[265285768]: "Get" accept:application/json, */*,audit-id:e349059c-8353-4c29-a612-567d0c3c0229,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Apr-2026 03:26:13.022) (total time: 1653ms): Trace[265285768]: ---"About to write a response" 1653ms (03:26:14.676) Trace[265285768]: [1.653785441s] [1.653785441s] END I0428 03:26:14.682974 1 trace.go:236] Trace[2044466695]: "Get" accept:application/json, */*,audit-id:523b64d0-7aab-49b5-a339-a4ced3e5fc4b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:26:13.297) (total time: 1385ms): Trace[2044466695]: ---"About to write a response" 1385ms (03:26:14.682) Trace[2044466695]: [1.385247449s] [1.385247449s] END I0428 03:26:14.683395 1 trace.go:236] Trace[1195213591]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:482c532d-bec8-47e0-b282-68cfb1994ee0,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (28-Apr-2026 03:26:13.661) (total time: 1022ms): Trace[1195213591]: ["GuaranteedUpdate etcd3" audit-id:482c532d-bec8-47e0-b282-68cfb1994ee0,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1022ms (03:26:13.661) Trace[1195213591]: ---"Txn call completed" 1021ms (03:26:14.683)] Trace[1195213591]: [1.022233933s] [1.022233933s] END I0428 03:26:14.683556 1 trace.go:236] Trace[1734167050]: "Get" accept:application/json, */*,audit-id:c3c721ac-08bc-497e-8a32-5d2474e61827,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:26:13.293) (total time: 1389ms): Trace[1734167050]: ---"About to write a response" 1389ms (03:26:14.683) Trace[1734167050]: [1.389939436s] [1.389939436s] END I0428 03:26:14.713493 1 trace.go:236] Trace[1223810137]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.33,type:*v1.Endpoints,resource:apiServerIPInfo (28-Apr-2026 03:26:12.465) (total time: 2248ms): Trace[1223810137]: ---"initial value restored" 371ms (03:26:12.837) Trace[1223810137]: ---"Transaction prepared" 1839ms (03:26:14.676) Trace[1223810137]: [2.248017702s] [2.248017702s] END I0428 03:26:15.318694 1 trace.go:236] Trace[837957473]: "Update" accept:application/json, */*,audit-id:b5733fa6-2145-4435-88f0-6272c830fc6e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 03:26:14.685) (total time: 633ms): Trace[837957473]: ["GuaranteedUpdate etcd3" audit-id:b5733fa6-2145-4435-88f0-6272c830fc6e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 633ms (03:26:14.685) Trace[837957473]: ---"Txn call completed" 632ms (03:26:15.318)] Trace[837957473]: [633.350708ms] [633.350708ms] END I0428 03:26:15.318800 1 trace.go:236] Trace[1997005551]: "Update" accept:application/json, */*,audit-id:32f4b544-ff34-4ac3-a246-69332ebf16d9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 03:26:14.685) (total time: 633ms): Trace[1997005551]: ["GuaranteedUpdate etcd3" audit-id:32f4b544-ff34-4ac3-a246-69332ebf16d9,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 633ms (03:26:14.685) Trace[1997005551]: ---"Txn call completed" 632ms (03:26:15.318)] Trace[1997005551]: [633.448289ms] [633.448289ms] END I0428 03:26:15.319225 1 trace.go:236] Trace[1244621074]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b0e2036f-e664-47ab-9cbd-103617e4f489,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Apr-2026 03:26:14.684) (total time: 634ms): Trace[1244621074]: ["GuaranteedUpdate etcd3" audit-id:b0e2036f-e664-47ab-9cbd-103617e4f489,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 634ms (03:26:14.684) Trace[1244621074]: ---"Txn call completed" 634ms (03:26:15.319)] Trace[1244621074]: [634.611136ms] [634.611136ms] END I0428 03:26:15.323172 1 trace.go:236] Trace[389157789]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3c9723cb-0192-4783-94cd-ae998ef4497b,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (28-Apr-2026 03:26:14.714) (total time: 608ms): Trace[389157789]: ---"About to write a response" 608ms (03:26:15.322) Trace[389157789]: [608.975971ms] [608.975971ms] END I0428 03:26:37.726811 1 trace.go:236] Trace[1901253376]: "Get" accept:application/json, */*,audit-id:15d68634-f7ec-420a-b41c-a169243f3d12,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (28-Apr-2026 03:26:36.828) (total time: 898ms): Trace[1901253376]: ---"About to write a response" 898ms (03:26:37.726) Trace[1901253376]: [898.727498ms] [898.727498ms] END I0428 03:26:51.084885 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.97.81.96"} I0428 03:26:51.158465 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.99.139.75"} I0428 03:26:55.911115 1 trace.go:236] Trace[1078130513]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8ed622b-7d15-4638-9675-cac0ce8e25f2,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (28-Apr-2026 03:26:54.300) (total time: 1610ms): Trace[1078130513]: ---"About to write a response" 1610ms (03:26:55.910) Trace[1078130513]: [1.610221893s] [1.610221893s] END I0428 03:26:55.912191 1 trace.go:236] Trace[1023195825]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d9928946-94ee-4c2f-8af4-c8dd76f74932,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (28-Apr-2026 03:26:55.082) (total time: 829ms): Trace[1023195825]: ["GuaranteedUpdate etcd3" audit-id:d9928946-94ee-4c2f-8af4-c8dd76f74932,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 829ms (03:26:55.082) Trace[1023195825]: ---"Txn call completed" 827ms (03:26:55.911)] Trace[1023195825]: [829.47133ms] [829.47133ms] END I0428 03:26:55.912614 1 trace.go:236] Trace[660394636]: "Get" accept:application/json, */*,audit-id:b86e3abc-5593-4a62-ac7e-643b6e3682bc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:26:54.472) (total time: 1440ms): Trace[660394636]: ---"About to write a response" 1439ms (03:26:55.912) Trace[660394636]: [1.440058743s] [1.440058743s] END I0428 03:26:55.912688 1 trace.go:236] Trace[629323232]: "Get" accept:application/json, */*,audit-id:a3024e42-1ca6-4bb1-88d3-a0ec9138b78e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:26:54.473) (total time: 1438ms): Trace[629323232]: ---"About to write a response" 1438ms (03:26:55.912) Trace[629323232]: [1.438855507s] [1.438855507s] END I0428 03:27:12.869304 1 trace.go:236] Trace[794318352]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f4290961-2786-436b-b49e-7088f83b0e94,client:199.204.45.33,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (28-Apr-2026 03:27:12.007) (total time: 861ms): Trace[794318352]: ["GuaranteedUpdate etcd3" audit-id:f4290961-2786-436b-b49e-7088f83b0e94,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 861ms (03:27:12.007) Trace[794318352]: ---"Txn call completed" 860ms (03:27:12.869)] Trace[794318352]: [861.559333ms] [861.559333ms] END I0428 03:27:12.869851 1 trace.go:236] Trace[1415391288]: "Get" accept:application/json, */*,audit-id:ff14d290-773b-4b7a-803a-a5e1e41b083c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:27:12.009) (total time: 860ms): Trace[1415391288]: ---"About to write a response" 860ms (03:27:12.869) Trace[1415391288]: [860.703643ms] [860.703643ms] END I0428 03:27:12.869939 1 trace.go:236] Trace[1444483843]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:631e93d3-453a-466e-b278-d7e6b7d3e7cd,client:10.0.0.248,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (28-Apr-2026 03:27:12.026) (total time: 843ms): Trace[1444483843]: ["GuaranteedUpdate etcd3" audit-id:631e93d3-453a-466e-b278-d7e6b7d3e7cd,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 842ms (03:27:12.026) Trace[1444483843]: ---"Txn call completed" 841ms (03:27:12.869)] Trace[1444483843]: [843.035205ms] [843.035205ms] END I0428 03:27:13.034830 1 trace.go:236] Trace[421341941]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.33,type:*v1.Endpoints,resource:apiServerIPInfo (28-Apr-2026 03:27:12.468) (total time: 566ms): Trace[421341941]: ---"initial value restored" 400ms (03:27:12.869) Trace[421341941]: ---"Txn call completed" 153ms (03:27:13.034) Trace[421341941]: [566.535922ms] [566.535922ms] END I0428 03:27:16.103150 1 trace.go:236] Trace[1626475285]: "Create" accept:application/json, */*,audit-id:60a6e831-2607-4641-a1bf-0959a5baac65,client:10.0.0.68,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (28-Apr-2026 03:27:15.444) (total time: 659ms): Trace[1626475285]: ["Create etcd3" audit-id:60a6e831-2607-4641-a1bf-0959a5baac65,key:/events/kube-system/rbd-csi-ceph-com.18aa6787b1349009,type:*core.Event,resource:events 658ms (03:27:15.444) Trace[1626475285]: ---"Txn call succeeded" 657ms (03:27:16.102)] Trace[1626475285]: [659.073965ms] [659.073965ms] END I0428 03:27:16.103598 1 trace.go:236] Trace[2048070786]: "Update" accept:application/json, */*,audit-id:4e2954f2-db04-42d7-9315-24ab534031f1,client:10.0.0.68,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/rbd-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (28-Apr-2026 03:27:15.518) (total time: 585ms): Trace[2048070786]: ["GuaranteedUpdate etcd3" audit-id:4e2954f2-db04-42d7-9315-24ab534031f1,key:/leases/kube-system/rbd-csi-ceph-com,type:*coordination.Lease,resource:leases.coordination.k8s.io 585ms (03:27:15.518) Trace[2048070786]: ---"Txn call completed" 584ms (03:27:16.103)] Trace[2048070786]: [585.53998ms] [585.53998ms] END I0428 03:27:26.948278 1 trace.go:236] Trace[903086442]: "Get" accept:application/json, */*,audit-id:7fbb2166-4f7c-4811-8518-1fad39fae7c5,client:10.0.0.68,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/external-attacher-leader-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (28-Apr-2026 03:27:26.422) (total time: 525ms): Trace[903086442]: ---"About to write a response" 525ms (03:27:26.948) Trace[903086442]: [525.847972ms] [525.847972ms] END