I0329 01:51:41.205877       1 options.go:220] external host was not specified, using 199.204.45.156
I0329 01:51:41.208050       1 server.go:148] Version: v1.28.13
I0329 01:51:41.208095       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0329 01:51:41.377418       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0329 01:51:41.385034       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0329 01:51:41.385053       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0329 01:51:41.385287       1 instance.go:298] Using reconciler: lease
I0329 01:51:42.353329       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0329 01:51:42.353360       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0329 01:51:42.633230       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0329 01:51:42.633463       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0329 01:51:43.112358       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0329 01:51:43.123325       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0329 01:51:43.123359       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.123366       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.123873       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0329 01:51:43.123887       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0329 01:51:43.124787       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0329 01:51:43.125517       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0329 01:51:43.125532       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0329 01:51:43.125537       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0329 01:51:43.127014       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0329 01:51:43.127025       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0329 01:51:43.127899       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0329 01:51:43.127915       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.127920       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.128496       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0329 01:51:43.128511       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.128579       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0329 01:51:43.129104       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0329 01:51:43.130784       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0329 01:51:43.130800       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.130805       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.131301       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0329 01:51:43.131315       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.131319       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.132046       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0329 01:51:43.132060       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0329 01:51:43.135628       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0329 01:51:43.135656       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.135666       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.136966       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0329 01:51:43.137002       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.137011       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.143666       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0329 01:51:43.143691       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.143699       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.146533       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0329 01:51:43.147890       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0329 01:51:43.147907       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.147913       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.152432       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0329 01:51:43.152450       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0329 01:51:43.152456       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0329 01:51:43.153784       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0329 01:51:43.153799       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0329 01:51:43.153803       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0329 01:51:43.154534       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0329 01:51:43.154548       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0329 01:51:43.186733       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0329 01:51:43.186768       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0329 01:51:43.624992       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0329 01:51:43.625041       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0329 01:51:43.625254       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0329 01:51:43.625403       1 secure_serving.go:213] Serving securely on [::]:6443
I0329 01:51:43.625444       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0329 01:51:43.625587       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0329 01:51:43.625726       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0329 01:51:43.625758       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0329 01:51:43.625800       1 available_controller.go:423] Starting AvailableConditionController
I0329 01:51:43.625812       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0329 01:51:43.625842       1 aggregator.go:164] waiting for initial CRD sync...
I0329 01:51:43.625733       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0329 01:51:43.625884       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0329 01:51:43.625897       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0329 01:51:43.626139       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0329 01:51:43.626209       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0329 01:51:43.626393       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0329 01:51:43.626424       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0329 01:51:43.626448       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0329 01:51:43.626462       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0329 01:51:43.627165       1 controller.go:116] Starting legacy_token_tracking_controller
I0329 01:51:43.627187       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0329 01:51:43.627407       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0329 01:51:43.627462       1 controller.go:134] Starting OpenAPI controller
I0329 01:51:43.627505       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0329 01:51:43.627564       1 controller.go:78] Starting OpenAPI AggregationController
I0329 01:51:43.627586       1 naming_controller.go:291] Starting NamingConditionController
I0329 01:51:43.627632       1 establishing_controller.go:76] Starting EstablishingController
I0329 01:51:43.627671       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0329 01:51:43.627703       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0329 01:51:43.627750       1 crd_finalizer.go:266] Starting CRDFinalizer
I0329 01:51:43.633501       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0329 01:51:43.633595       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0329 01:51:43.627568       1 controller.go:85] Starting OpenAPI V3 controller
I0329 01:51:43.677594       1 shared_informer.go:318] Caches are synced for node_authorizer
I0329 01:51:43.726330       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0329 01:51:43.726382       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0329 01:51:43.726404       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0329 01:51:43.726420       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0329 01:51:43.726593       1 aggregator.go:166] initial CRD sync complete...
I0329 01:51:43.726610       1 autoregister_controller.go:141] Starting autoregister controller
I0329 01:51:43.726618       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0329 01:51:43.726633       1 cache.go:39] Caches are synced for autoregister controller
I0329 01:51:43.726718       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0329 01:51:43.728320       1 controller.go:624] quota admission added evaluator for: namespaces
I0329 01:51:43.729031       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0329 01:51:43.729054       1 shared_informer.go:318] Caches are synced for configmaps
E0329 01:51:44.025588       1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found
E0329 01:51:44.025593       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0329 01:51:44.431822       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0329 01:51:44.715110       1 trace.go:236] Trace[1840116062]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f2761edd-7235-4c45-8c3d-278217e08cda,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.025) (total time: 689ms):
Trace[1840116062]: ---"Write to database call failed" len:62,err:namespaces "kube-system" already exists 331ms (01:51:44.714)
Trace[1840116062]: [689.865279ms] [689.865279ms] END
I0329 01:51:44.715365       1 trace.go:236] Trace[370166563]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4f7d997b-cefa-4a20-b3c6-07c1241e36df,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.030) (total time: 684ms):
Trace[370166563]: [684.433262ms] [684.433262ms] END
I0329 01:51:45.453399       1 trace.go:236] Trace[65399098]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c0687609-534f-4b4f-b1b1-82ee8719ede5,client:::1,protocol:HTTP/2.0,resource:clusterrolebindings,scope:cluster,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (29-Mar-2026 01:51:44.716) (total time: 736ms):
Trace[65399098]: ["List(recursive=true) etcd3" audit-id:c0687609-534f-4b4f-b1b1-82ee8719ede5,key:/clusterrolebindings,resourceVersion:,resourceVersionMatch:,limit:0,continue: 736ms (01:51:44.716)]
Trace[65399098]: [736.691166ms] [736.691166ms] END
I0329 01:51:45.453616       1 trace.go:236] Trace[224978505]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a6e98c79-c963-4c5d-8806-e31b36d8c381,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.716) (total time: 737ms):
Trace[224978505]: ["Create etcd3" audit-id:a6e98c79-c963-4c5d-8806-e31b36d8c381,key:/apiregistration.k8s.io/apiservices/v1.networking.k8s.io,type:*apiregistration.APIService,resource:apiservices.apiregistration.k8s.io 736ms (01:51:44.717)
Trace[224978505]:  ---"Txn call succeeded" 735ms (01:51:45.453)]
Trace[224978505]: [737.068483ms] [737.068483ms] END
I0329 01:51:45.499390       1 trace.go:236] Trace[466549106]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4f5a874c-e113-47dd-a866-47e8ee485193,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.718) (total time: 780ms):
Trace[466549106]: ["Create etcd3" audit-id:4f5a874c-e113-47dd-a866-47e8ee485193,key:/apiregistration.k8s.io/apiservices/v1.policy,type:*apiregistration.APIService,resource:apiservices.apiregistration.k8s.io 780ms (01:51:44.719)
Trace[466549106]:  ---"Txn call succeeded" 779ms (01:51:45.498)]
Trace[466549106]: [780.657861ms] [780.657861ms] END
I0329 01:51:45.499418       1 trace.go:236] Trace[784129163]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8cd162e6-8b63-485d-aa56-7558f81a8932,client:::1,protocol:HTTP/2.0,resource:resourcequotas,scope:namespace,url:/api/v1/namespaces/kube-node-lease/resourcequotas,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (29-Mar-2026 01:51:44.719) (total time: 779ms):
Trace[784129163]: ["List(recursive=true) etcd3" audit-id:8cd162e6-8b63-485d-aa56-7558f81a8932,key:/resourcequotas/kube-node-lease,resourceVersion:,resourceVersionMatch:,limit:0,continue: 779ms (01:51:44.719)]
Trace[784129163]: [779.511139ms] [779.511139ms] END
I0329 01:51:45.499474       1 trace.go:236] Trace[808911289]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:42481e95-da4c-413d-8c89-b93dd02779c6,client:::1,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/kube-system/configmaps/extension-apiserver-authentication,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:51:44.717) (total time: 781ms):
Trace[808911289]: ["GuaranteedUpdate etcd3" audit-id:42481e95-da4c-413d-8c89-b93dd02779c6,key:/configmaps/kube-system/extension-apiserver-authentication,type:*core.ConfigMap,resource:configmaps 781ms (01:51:44.718)
Trace[808911289]:  ---"initial value restored" 781ms (01:51:45.499)]
Trace[808911289]: [781.658511ms] [781.658511ms] END
I0329 01:51:45.499631       1 trace.go:236] Trace[21507569]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2e726783-c1d7-4a39-a234-521ead62260a,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:44.770) (total time: 729ms):
Trace[21507569]: [729.07273ms] [729.07273ms] END
I0329 01:51:45.499695       1 trace.go:236] Trace[1781532180]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4931f234-6bf7-42c0-9654-240b66788622,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.719) (total time: 780ms):
Trace[1781532180]: ["Create etcd3" audit-id:4931f234-6bf7-42c0-9654-240b66788622,key:/apiregistration.k8s.io/apiservices/v1.rbac.authorization.k8s.io,type:*apiregistration.APIService,resource:apiservices.apiregistration.k8s.io 779ms (01:51:44.719)
Trace[1781532180]:  ---"Txn call succeeded" 779ms (01:51:45.499)]
Trace[1781532180]: [780.394676ms] [780.394676ms] END
I0329 01:51:45.499890       1 trace.go:236] Trace[936033450]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f3a92529-e732-44d3-8c4a-099b20b18ab1,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.721) (total time: 778ms):
Trace[936033450]: ["Create etcd3" audit-id:f3a92529-e732-44d3-8c4a-099b20b18ab1,key:/apiregistration.k8s.io/apiservices/v1.scheduling.k8s.io,type:*apiregistration.APIService,resource:apiservices.apiregistration.k8s.io 777ms (01:51:44.722)
Trace[936033450]:  ---"Txn call succeeded" 777ms (01:51:45.499)]
Trace[936033450]: [778.54547ms] [778.54547ms] END
I0329 01:51:45.500074       1 trace.go:236] Trace[988584150]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9523cf4e-5191-4030-af58-afd84c8d3131,client:::1,protocol:HTTP/2.0,resource:prioritylevelconfigurations,scope:resource,url:/apis/flowcontrol.apiserver.k8s.io/v1beta3/prioritylevelconfigurations,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.719) (total time: 780ms):
Trace[988584150]: ["Create etcd3" audit-id:9523cf4e-5191-4030-af58-afd84c8d3131,key:/prioritylevelconfigurations/workload-high,type:*flowcontrol.PriorityLevelConfiguration,resource:prioritylevelconfigurations.flowcontrol.apiserver.k8s.io 780ms (01:51:44.719)
Trace[988584150]:  ---"Txn call succeeded" 779ms (01:51:45.499)]
Trace[988584150]: [780.890366ms] [780.890366ms] END
I0329 01:51:45.500125       1 trace.go:236] Trace[739232382]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9977f479-4af1-4903-8acf-81ba170b4ed6,client:::1,protocol:HTTP/2.0,resource:apiservices,scope:resource,url:/apis/apiregistration.k8s.io/v1/apiservices,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.718) (total time: 781ms):
Trace[739232382]: ["Create etcd3" audit-id:9977f479-4af1-4903-8acf-81ba170b4ed6,key:/apiregistration.k8s.io/apiservices/v1.node.k8s.io,type:*apiregistration.APIService,resource:apiservices.apiregistration.k8s.io 780ms (01:51:44.719)
Trace[739232382]:  ---"Txn call succeeded" 780ms (01:51:45.499)]
Trace[739232382]: [781.419616ms] [781.419616ms] END
I0329 01:51:45.500546       1 trace.go:236] Trace[75430500]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ca7837dc-fc41-4351-8d4d-aa07b23dbd20,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/default/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.718) (total time: 782ms):
Trace[75430500]: ---"Write to database call failed" len:259,err:namespaces "default" not found 781ms (01:51:45.500)
Trace[75430500]: [782.06976ms] [782.06976ms] END
I0329 01:51:45.501152       1 trace.go:236] Trace[1134528694]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fec64eda-1489-49e4-831e-80edda56552b,client:::1,protocol:HTTP/2.0,resource:limitranges,scope:namespace,url:/api/v1/namespaces/kube-system/limitranges,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (29-Mar-2026 01:51:44.778) (total time: 722ms):
Trace[1134528694]: ["List(recursive=true) etcd3" audit-id:fec64eda-1489-49e4-831e-80edda56552b,key:/limitranges/kube-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 722ms (01:51:44.778)]
Trace[1134528694]: [722.949111ms] [722.949111ms] END
I0329 01:51:45.501573       1 trace.go:236] Trace[40991500]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d807663e-7367-48f5-a899-4b5b9b908f1d,client:::1,protocol:HTTP/2.0,resource:priorityclasses,scope:resource,url:/apis/scheduling.k8s.io/v1/priorityclasses,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.717) (total time: 783ms):
Trace[40991500]: ["Create etcd3" audit-id:d807663e-7367-48f5-a899-4b5b9b908f1d,key:/priorityclasses/system-node-critical,type:*scheduling.PriorityClass,resource:priorityclasses.scheduling.k8s.io 782ms (01:51:44.719)
Trace[40991500]:  ---"Txn call succeeded" 780ms (01:51:45.499)]
Trace[40991500]: [783.956017ms] [783.956017ms] END
I0329 01:51:45.502174       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0329 01:51:46.269905       1 trace.go:236] Trace[110672765]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6f653836-0af6-480d-8d78-4f3551fa0caf,client:::1,protocol:HTTP/2.0,resource:configmaps,scope:resource,url:/api/v1/namespaces/kube-system/configmaps,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:45.500) (total time: 768ms):
Trace[110672765]: ["Create etcd3" audit-id:6f653836-0af6-480d-8d78-4f3551fa0caf,key:/configmaps/kube-system/extension-apiserver-authentication,type:*core.ConfigMap,resource:configmaps 768ms (01:51:45.501)
Trace[110672765]:  ---"Txn call succeeded" 767ms (01:51:46.268)]
Trace[110672765]: [768.916911ms] [768.916911ms] END
I0329 01:51:46.270127       1 trace.go:236] Trace[181588002]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4b125097-c587-4de8-af6e-efd3044b3272,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.718) (total time: 1551ms):
Trace[181588002]: ["Create etcd3" audit-id:4b125097-c587-4de8-af6e-efd3044b3272,key:/namespaces/kube-node-lease,type:*core.Namespace,resource:namespaces 769ms (01:51:45.500)
Trace[181588002]:  ---"Txn call succeeded" 769ms (01:51:46.269)]
Trace[181588002]: [1.551668033s] [1.551668033s] END
I0329 01:51:46.269996       1 trace.go:236] Trace[1584756580]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2f045e44-fa07-41cd-9d8c-781afba78d0f,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/admin,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:45.539) (total time: 730ms):
Trace[1584756580]: [730.769797ms] [730.769797ms] END
I0329 01:51:46.270315       1 trace.go:236] Trace[1687890330]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b57b171c-282d-4690-8e86-673c7e30de7c,client:::1,protocol:HTTP/2.0,resource:prioritylevelconfigurations,scope:resource,url:/apis/flowcontrol.apiserver.k8s.io/v1beta3/prioritylevelconfigurations,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:45.501) (total time: 768ms):
Trace[1687890330]: ["Create etcd3" audit-id:b57b171c-282d-4690-8e86-673c7e30de7c,key:/prioritylevelconfigurations/workload-low,type:*flowcontrol.PriorityLevelConfiguration,resource:prioritylevelconfigurations.flowcontrol.apiserver.k8s.io 767ms (01:51:45.502)
Trace[1687890330]:  ---"Txn call succeeded" 767ms (01:51:46.270)]
Trace[1687890330]: [768.923101ms] [768.923101ms] END
I0329 01:51:46.270752       1 trace.go:236] Trace[536469894]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aa8195ec-cf7a-4acb-b404-5574414425ea,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.774) (total time: 1496ms):
Trace[536469894]: ["Create etcd3" audit-id:aa8195ec-cf7a-4acb-b404-5574414425ea,key:/pods/kube-system/kube-scheduler-instance,type:*core.Pod,resource:pods 767ms (01:51:45.502)
Trace[536469894]:  ---"Txn call succeeded" 767ms (01:51:46.270)]
Trace[536469894]: [1.496233197s] [1.496233197s] END
I0329 01:51:46.270761       1 trace.go:236] Trace[1352310838]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8af4c799-b24b-4a6f-9566-dbd278f38ae9,client:::1,protocol:HTTP/2.0,resource:priorityclasses,scope:resource,url:/apis/scheduling.k8s.io/v1/priorityclasses/system-cluster-critical,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:45.503) (total time: 767ms):
Trace[1352310838]: [767.509793ms] [767.509793ms] END
I0329 01:51:46.270828       1 trace.go:236] Trace[1250122114]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5a751d34-2809-413a-aafc-37019cb71b77,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:45.553) (total time: 717ms):
Trace[1250122114]: [717.673423ms] [717.673423ms] END
I0329 01:51:46.271346       1 trace.go:236] Trace[430492859]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d4d005f0-9605-4107-9c50-6391a7e94140,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:44.823) (total time: 1447ms):
Trace[430492859]: ["Create etcd3" audit-id:d4d005f0-9605-4107-9c50-6391a7e94140,key:/pods/kube-system/kube-controller-manager-instance,type:*core.Pod,resource:pods 768ms (01:51:45.502)
Trace[430492859]:  ---"Txn call succeeded" 767ms (01:51:46.270)]
Trace[430492859]: [1.447727126s] [1.447727126s] END
I0329 01:51:46.271601       1 trace.go:236] Trace[2033600046]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f5c20d81-ebe1-4309-9eb2-e50308ebaf49,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/default/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:45.502) (total time: 769ms):
Trace[2033600046]: ---"Write to database call failed" len:257,err:namespaces "default" not found 769ms (01:51:46.271)
Trace[2033600046]: [769.176056ms] [769.176056ms] END
I0329 01:51:46.284805       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0329 01:51:46.284822       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0329 01:51:47.411788       1 trace.go:236] Trace[1570977429]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:29375696-d1d6-471e-852a-cdbf2245abed,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:46.272) (total time: 1139ms):
Trace[1570977429]: ["Create etcd3" audit-id:29375696-d1d6-471e-852a-cdbf2245abed,key:/namespaces/default,type:*core.Namespace,resource:namespaces 1127ms (01:51:46.284)
Trace[1570977429]:  ---"Txn call succeeded" 1126ms (01:51:47.411)]
Trace[1570977429]: [1.139189112s] [1.139189112s] END
I0329 01:51:47.412175       1 trace.go:236] Trace[293835172]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:029c2a4b-5757-403d-ac82-a314db2bb526,client:::1,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:46.410) (total time: 1002ms):
Trace[293835172]: ---"About to write a response" 1001ms (01:51:47.412)
Trace[293835172]: [1.002041605s] [1.002041605s] END
I0329 01:51:47.412582       1 trace.go:236] Trace[283127377]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c728c9e8-141e-49b7-80fb-2b991dacc65b,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:aggregate-to-view,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:46.357) (total time: 1055ms):
Trace[283127377]: [1.055324517s] [1.055324517s] END
I0329 01:51:47.412788       1 trace.go:236] Trace[1437298016]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c97455b8-3ffc-4064-92c1-7c4b3439fcb8,client:::1,protocol:HTTP/2.0,resource:flowschemas,scope:resource,url:/apis/flowcontrol.apiserver.k8s.io/v1beta3/flowschemas,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:46.358) (total time: 1053ms):
Trace[1437298016]: ["Create etcd3" audit-id:c97455b8-3ffc-4064-92c1-7c4b3439fcb8,key:/flowschemas/system-nodes,type:*flowcontrol.FlowSchema,resource:flowschemas.flowcontrol.apiserver.k8s.io 1052ms (01:51:46.360)
Trace[1437298016]:  ---"Txn call succeeded" 1051ms (01:51:47.411)]
Trace[1437298016]: [1.053888838s] [1.053888838s] END
I0329 01:51:47.686922       1 trace.go:236] Trace[211521034]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23bd070e-97dd-4c4d-ba2b-a5b81a15afb3,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/default/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:46.357) (total time: 1328ms):
Trace[211521034]: [1.328921886s] [1.328921886s] END
I0329 01:51:50.592282       1 trace.go:236] Trace[1960381316]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3bbc8947-ad9e-41dd-8174-366e4c8f351f,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:49.894) (total time: 696ms):
Trace[1960381316]: ["Create etcd3" audit-id:3bbc8947-ad9e-41dd-8174-366e4c8f351f,key:/clusterroles/system:controller:endpointslicemirroring-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 696ms (01:51:49.895)
Trace[1960381316]:  ---"Txn call succeeded" 695ms (01:51:50.591)]
Trace[1960381316]: [696.959482ms] [696.959482ms] END
I0329 01:51:52.183417       1 trace.go:236] Trace[1206836123]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:913967ab-22c7-4c07-a3d9-d83e7730d2ef,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:51.293) (total time: 890ms):
Trace[1206836123]: ["Create etcd3" audit-id:913967ab-22c7-4c07-a3d9-d83e7730d2ef,key:/clusterroles/system:controller:job-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 889ms (01:51:51.293)
Trace[1206836123]:  ---"Txn call succeeded" 889ms (01:51:52.183)]
Trace[1206836123]: [890.189458ms] [890.189458ms] END
I0329 01:51:52.244288       1 trace.go:236] Trace[1622946956]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aa83ea19-1205-40ec-92da-ff5c19299f95,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:51.441) (total time: 802ms):
Trace[1622946956]: ["Create etcd3" audit-id:aa83ea19-1205-40ec-92da-ff5c19299f95,key:/pods/kube-system/etcd-instance,type:*core.Pod,resource:pods 800ms (01:51:51.443)
Trace[1622946956]:  ---"Txn call succeeded" 800ms (01:51:52.244)]
Trace[1622946956]: [802.523891ms] [802.523891ms] END
I0329 01:51:52.977088       1 trace.go:236] Trace[2078371558]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:980c28f5-655c-4d4c-becf-77628014036e,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:52.247) (total time: 729ms):
Trace[2078371558]: ["Create etcd3" audit-id:980c28f5-655c-4d4c-becf-77628014036e,key:/clusterroles/system:controller:namespace-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 729ms (01:51:52.247)
Trace[2078371558]:  ---"Txn call succeeded" 728ms (01:51:52.976)]
Trace[2078371558]: [729.72091ms] [729.72091ms] END
I0329 01:51:52.980721       1 trace.go:236] Trace[1841331298]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e7b5b5d7-63dd-4d96-be69-3704d43943a3,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:51:52.246) (total time: 733ms):
Trace[1841331298]: ["GuaranteedUpdate etcd3" audit-id:e7b5b5d7-63dd-4d96-be69-3704d43943a3,key:/pods/kube-system/kube-apiserver-instance,type:*core.Pod,resource:pods 733ms (01:51:52.246)
Trace[1841331298]:  ---"Txn call completed" 730ms (01:51:52.980)]
Trace[1841331298]: ---"Object stored in database" 731ms (01:51:52.980)
Trace[1841331298]: [733.931909ms] [733.931909ms] END
I0329 01:51:53.689223       1 trace.go:236] Trace[2032372398]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:23827af7-4b46-4983-a54f-6fe139aeb5a1,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/etcd-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:52.983) (total time: 705ms):
Trace[2032372398]: ---"About to write a response" 705ms (01:51:53.689)
Trace[2032372398]: [705.840334ms] [705.840334ms] END
I0329 01:51:53.689440       1 trace.go:236] Trace[394600238]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:da23bad7-946c-4dd0-8dfc-07b44d36a4b4,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:52.982) (total time: 706ms):
Trace[394600238]: ["Create etcd3" audit-id:da23bad7-946c-4dd0-8dfc-07b44d36a4b4,key:/clusterroles/system:controller:node-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 705ms (01:51:52.983)
Trace[394600238]:  ---"Txn call succeeded" 705ms (01:51:53.689)]
Trace[394600238]: [706.303942ms] [706.303942ms] END
I0329 01:51:53.689739       1 trace.go:236] Trace[309553016]: "Update" accept:application/json, */*,audit-id:0b33be75-b5e0-4831-aa3d-b14c9bceedfc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:51:52.981) (total time: 708ms):
Trace[309553016]: ["GuaranteedUpdate etcd3" audit-id:0b33be75-b5e0-4831-aa3d-b14c9bceedfc,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 707ms (01:51:52.981)
Trace[309553016]:  ---"Txn call completed" 707ms (01:51:53.689)]
Trace[309553016]: [708.194058ms] [708.194058ms] END
I0329 01:51:54.410804       1 trace.go:236] Trace[176380181]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7dc3cf55-dcc2-4e19-9f7c-1be26cdf866d,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:controller:pod-garbage-collector,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:53.737) (total time: 673ms):
Trace[176380181]: [673.268384ms] [673.268384ms] END
I0329 01:51:54.410959       1 trace.go:236] Trace[1134483184]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:06adbffa-cc98-490c-b1db-757d61825a79,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:53.694) (total time: 716ms):
Trace[1134483184]: ["Create etcd3" audit-id:06adbffa-cc98-490c-b1db-757d61825a79,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 716ms (01:51:53.694)
Trace[1134483184]:  ---"Txn call succeeded" 715ms (01:51:54.410)]
Trace[1134483184]: [716.631252ms] [716.631252ms] END
I0329 01:51:54.411976       1 trace.go:236] Trace[2048386160]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:94c9530e-522d-4767-8fd4-8f566371dd7c,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/etcd-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:51:53.691) (total time: 719ms):
Trace[2048386160]: ["GuaranteedUpdate etcd3" audit-id:94c9530e-522d-4767-8fd4-8f566371dd7c,key:/pods/kube-system/etcd-instance,type:*core.Pod,resource:pods 719ms (01:51:53.692)
Trace[2048386160]:  ---"Txn call completed" 715ms (01:51:54.410)]
Trace[2048386160]: ---"Object stored in database" 716ms (01:51:54.411)
Trace[2048386160]: [719.927143ms] [719.927143ms] END
I0329 01:51:56.048592       1 trace.go:236] Trace[1416833410]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dd3629ae-6936-41d8-8048-474db82706ec,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:54.875) (total time: 1172ms):
Trace[1416833410]: ["Create etcd3" audit-id:dd3629ae-6936-41d8-8048-474db82706ec,key:/clusterroles/system:controller:replicaset-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 1171ms (01:51:54.876)
Trace[1416833410]:  ---"Txn call succeeded" 1171ms (01:51:56.048)]
Trace[1416833410]: [1.172580486s] [1.172580486s] END
I0329 01:51:56.094207       1 trace.go:236] Trace[352615902]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a5ef7626-8b27-4a59-8cd4-69a538cd20ec,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-scheduler-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:51:54.933) (total time: 1160ms):
Trace[352615902]: ["GuaranteedUpdate etcd3" audit-id:a5ef7626-8b27-4a59-8cd4-69a538cd20ec,key:/pods/kube-system/kube-scheduler-instance,type:*core.Pod,resource:pods 1160ms (01:51:54.933)
Trace[352615902]:  ---"Txn call completed" 1156ms (01:51:56.093)]
Trace[352615902]: ---"Object stored in database" 1157ms (01:51:56.093)
Trace[352615902]: [1.160755519s] [1.160755519s] END
I0329 01:51:56.094344       1 trace.go:236] Trace[718444857]: "Get" accept:application/json, */*,audit-id:7cfb08ef-43e6-4935-8479-c9a173b54213,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:51:55.065) (total time: 1028ms):
Trace[718444857]: ---"About to write a response" 1028ms (01:51:56.094)
Trace[718444857]: [1.028689806s] [1.028689806s] END
I0329 01:51:56.926724       1 trace.go:236] Trace[322647689]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:22ff403d-067f-4074-97ef-46b226c61526,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:56.094) (total time: 831ms):
Trace[322647689]: ["Create etcd3" audit-id:22ff403d-067f-4074-97ef-46b226c61526,key:/clusterroles/system:controller:replication-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 831ms (01:51:56.095)
Trace[322647689]:  ---"Txn call succeeded" 830ms (01:51:56.926)]
Trace[322647689]: [831.831145ms] [831.831145ms] END
I0329 01:51:56.927647       1 trace.go:236] Trace[940348107]: "Update" accept:application/json, */*,audit-id:190e3032-10aa-4f5f-8f49-412d44fec2f3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:51:56.096) (total time: 831ms):
Trace[940348107]: ["GuaranteedUpdate etcd3" audit-id:190e3032-10aa-4f5f-8f49-412d44fec2f3,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 831ms (01:51:56.096)
Trace[940348107]:  ---"Txn call completed" 830ms (01:51:56.927)]
Trace[940348107]: [831.323777ms] [831.323777ms] END
I0329 01:51:56.928983       1 trace.go:236] Trace[1076141569]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7496ffc6-ac21-4be9-9ba8-da6f07c7fa3b,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:56.095) (total time: 833ms):
Trace[1076141569]: ---"About to write a response" 832ms (01:51:56.928)
Trace[1076141569]: [833.285062ms] [833.285062ms] END
I0329 01:51:56.929859       1 trace.go:236] Trace[910356931]: "Update" accept:application/json, */*,audit-id:9b2223aa-8c04-4b2f-80b8-2f854ee00649,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:51:56.097) (total time: 832ms):
Trace[910356931]: ["GuaranteedUpdate etcd3" audit-id:9b2223aa-8c04-4b2f-80b8-2f854ee00649,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 832ms (01:51:56.097)
Trace[910356931]:  ---"Txn call completed" 831ms (01:51:56.929)]
Trace[910356931]: [832.528189ms] [832.528189ms] END
I0329 01:51:58.135603       1 trace.go:236] Trace[1109329317]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9396b10f-e690-4b63-a097-70e6be326777,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:51:56.931) (total time: 1203ms):
Trace[1109329317]: ["GuaranteedUpdate etcd3" audit-id:9396b10f-e690-4b63-a097-70e6be326777,key:/pods/kube-system/kube-controller-manager-instance,type:*core.Pod,resource:pods 1203ms (01:51:56.931)
Trace[1109329317]:  ---"Txn call completed" 1199ms (01:51:58.134)]
Trace[1109329317]: ---"Object stored in database" 1199ms (01:51:58.135)
Trace[1109329317]: [1.203827549s] [1.203827549s] END
I0329 01:51:58.136303       1 trace.go:236] Trace[1285979323]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ccba4121-0975-454a-9cc7-25624f35e62b,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:controller:route-controller,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:51:56.987) (total time: 1148ms):
Trace[1285979323]: [1.148397002s] [1.148397002s] END
I0329 01:51:58.649971       1 trace.go:236] Trace[1631752564]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e4fbe9a4-fd66-4cdb-b05a-77585162126c,client:::1,protocol:HTTP/2.0,resource:clusterroles,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:51:58.147) (total time: 502ms):
Trace[1631752564]: ["Create etcd3" audit-id:e4fbe9a4-fd66-4cdb-b05a-77585162126c,key:/clusterroles/system:controller:service-account-controller,type:*rbac.ClusterRole,resource:clusterroles.rbac.authorization.k8s.io 501ms (01:51:58.148)
Trace[1631752564]:  ---"Txn call succeeded" 501ms (01:51:58.649)]
Trace[1631752564]: [502.185177ms] [502.185177ms] END
I0329 01:52:03.933901       1 trace.go:236] Trace[2058358027]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1dc8e91b-03e3-498b-a3ff-0064f28c3116,client:::1,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:52:03.359) (total time: 572ms):
Trace[2058358027]: ["Create etcd3" audit-id:1dc8e91b-03e3-498b-a3ff-0064f28c3116,key:/clusterrolebindings/system:controller:cronjob-controller,type:*rbac.ClusterRoleBinding,resource:clusterrolebindings.rbac.authorization.k8s.io 572ms (01:52:03.359)
Trace[2058358027]:  ---"Txn call succeeded" 572ms (01:52:03.931)]
Trace[2058358027]: [572.873415ms] [572.873415ms] END
I0329 01:52:07.042340       1 trace.go:236] Trace[913440928]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bf431969-3e8b-4c50-a8be-94425a92ef9f,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:04.801) (total time: 2240ms):
Trace[913440928]: ["GuaranteedUpdate etcd3" audit-id:bf431969-3e8b-4c50-a8be-94425a92ef9f,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2240ms (01:52:04.802)
Trace[913440928]:  ---"Txn call completed" 2239ms (01:52:07.042)]
Trace[913440928]: [2.240374977s] [2.240374977s] END
I0329 01:52:07.042391       1 trace.go:236] Trace[782218750]: "Update" accept:application/json, */*,audit-id:fbdf1454-43ba-4eff-b5c1-8c788bfc33bb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:03.935) (total time: 3107ms):
Trace[782218750]: ["GuaranteedUpdate etcd3" audit-id:fbdf1454-43ba-4eff-b5c1-8c788bfc33bb,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3107ms (01:52:03.935)
Trace[782218750]:  ---"Txn call completed" 3106ms (01:52:07.042)]
Trace[782218750]: [3.107293542s] [3.107293542s] END
I0329 01:52:07.042469       1 trace.go:236] Trace[799056132]: "Get" accept:application/json, */*,audit-id:3c7f3cde-fce2-4452-b81d-4f1f77d06161,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:04.156) (total time: 2885ms):
Trace[799056132]: ---"About to write a response" 2885ms (01:52:07.042)
Trace[799056132]: [2.885748132s] [2.885748132s] END
I0329 01:52:07.042344       1 trace.go:236] Trace[1272761246]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:abecd405-fd84-4fbf-953e-47c285ec01e3,client:::1,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:52:03.936) (total time: 3105ms):
Trace[1272761246]: ["Create etcd3" audit-id:abecd405-fd84-4fbf-953e-47c285ec01e3,key:/clusterrolebindings/system:controller:daemon-set-controller,type:*rbac.ClusterRoleBinding,resource:clusterrolebindings.rbac.authorization.k8s.io 3105ms (01:52:03.936)
Trace[1272761246]:  ---"Txn call succeeded" 3105ms (01:52:07.042)]
Trace[1272761246]: [3.105935308s] [3.105935308s] END
I0329 01:52:07.043100       1 trace.go:236] Trace[241836217]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3d288891-08c3-410c-9a78-035cf5e3a79d,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:05.140) (total time: 1903ms):
Trace[241836217]: ["GuaranteedUpdate etcd3" audit-id:3d288891-08c3-410c-9a78-035cf5e3a79d,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1902ms (01:52:05.140)
Trace[241836217]:  ---"Txn call completed" 1901ms (01:52:07.042)]
Trace[241836217]: [1.903037603s] [1.903037603s] END
I0329 01:52:07.043702       1 trace.go:236] Trace[72996805]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5f2be938-8480-4258-b4ab-22762e0ccb27,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:04.672) (total time: 2371ms):
Trace[72996805]: [2.37160155s] [2.37160155s] END
I0329 01:52:07.486211       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0329 01:52:07.603185       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0329 01:52:07.728325       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0329 01:52:07.746327       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.156]
I0329 01:52:07.747535       1 controller.go:624] quota admission added evaluator for: endpoints
I0329 01:52:07.755939       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0329 01:52:08.097172       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0329 01:52:09.747986       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0329 01:52:09.764942       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0329 01:52:09.955905       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0329 01:52:13.100812       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0329 01:52:13.151088       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0329 01:52:18.042965       1 trace.go:236] Trace[844717765]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bc77f14b-b39b-4fc2-b369-7943d5413675,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:52:17.173) (total time: 869ms):
Trace[844717765]: ["GuaranteedUpdate etcd3" audit-id:bc77f14b-b39b-4fc2-b369-7943d5413675,key:/pods/kube-system/kube-controller-manager-instance,type:*core.Pod,resource:pods 869ms (01:52:17.173)
Trace[844717765]:  ---"Txn call completed" 865ms (01:52:18.042)]
Trace[844717765]: ---"Object stored in database" 866ms (01:52:18.042)
Trace[844717765]: [869.25188ms] [869.25188ms] END
I0329 01:52:18.046628       1 trace.go:236] Trace[1719786450]: "Get" accept:application/json, */*,audit-id:44f035df-b85d-40f2-85c7-8f9ef75816ec,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:17.217) (total time: 828ms):
Trace[1719786450]: ---"About to write a response" 828ms (01:52:18.046)
Trace[1719786450]: [828.749986ms] [828.749986ms] END
I0329 01:52:18.047109       1 trace.go:236] Trace[1163259884]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:765c35ba-12c5-4dfc-88b1-922601b72a5f,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:17.218) (total time: 828ms):
Trace[1163259884]: ---"About to write a response" 828ms (01:52:18.047)
Trace[1163259884]: [828.925119ms] [828.925119ms] END
I0329 01:52:18.047382       1 trace.go:236] Trace[1924334168]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3f851383-4321-4fe6-b8cf-d06137a8c0b9,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:17.329) (total time: 717ms):
Trace[1924334168]: ["GuaranteedUpdate etcd3" audit-id:3f851383-4321-4fe6-b8cf-d06137a8c0b9,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 717ms (01:52:17.329)
Trace[1924334168]:  ---"Txn call completed" 716ms (01:52:18.047)]
Trace[1924334168]: [717.646616ms] [717.646616ms] END
I0329 01:52:18.047659       1 trace.go:236] Trace[351103018]: "Get" accept:application/json, */*,audit-id:7ba43b39-1e4d-4309-8513-494374ba3916,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:17.197) (total time: 850ms):
Trace[351103018]: ---"About to write a response" 850ms (01:52:18.047)
Trace[351103018]: [850.270524ms] [850.270524ms] END
I0329 01:52:19.341447       1 trace.go:236] Trace[968547449]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3eb33e6b-615b-48ce-8a7b-42ef15fca4af,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/etcd-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:52:18.840) (total time: 500ms):
Trace[968547449]: ---"About to write a response" 500ms (01:52:19.340)
Trace[968547449]: [500.708136ms] [500.708136ms] END
I0329 01:52:23.505599       1 trace.go:236] Trace[924251725]: "Update" accept:application/json, */*,audit-id:02344304-d2d6-4451-a6ad-4e108581e868,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:22.450) (total time: 1054ms):
Trace[924251725]: ["GuaranteedUpdate etcd3" audit-id:02344304-d2d6-4451-a6ad-4e108581e868,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1054ms (01:52:22.451)
Trace[924251725]:  ---"Txn call completed" 1053ms (01:52:23.505)]
Trace[924251725]: [1.054654219s] [1.054654219s] END
I0329 01:52:26.188314       1 trace.go:236] Trace[1897258471]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:118ac3e5-55cd-4222-88d4-49f0a3e6eba4,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:25.666) (total time: 521ms):
Trace[1897258471]: [521.975974ms] [521.975974ms] END
I0329 01:52:26.737474       1 trace.go:236] Trace[1198554670]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:97169654-7010-49e9-a8cd-67cf2dfa098b,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:26.226) (total time: 511ms):
Trace[1198554670]: ["Create etcd3" audit-id:97169654-7010-49e9-a8cd-67cf2dfa098b,key:/events/kube-system/kube-scheduler.18a12cf20a1ff7c7,type:*core.Event,resource:events 510ms (01:52:26.227)
Trace[1198554670]:  ---"Txn call succeeded" 510ms (01:52:26.737)]
Trace[1198554670]: [511.034609ms] [511.034609ms] END
I0329 01:52:27.319445       1 trace.go:236] Trace[90000729]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2043dead-0981-4820-aff0-79c23c89af32,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:52:26.228) (total time: 1090ms):
Trace[90000729]: ["GuaranteedUpdate etcd3" audit-id:2043dead-0981-4820-aff0-79c23c89af32,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1090ms (01:52:26.228)
Trace[90000729]:  ---"Txn call completed" 1089ms (01:52:27.319)]
Trace[90000729]: [1.090607233s] [1.090607233s] END
I0329 01:52:27.319701       1 trace.go:236] Trace[1796004374]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:797da703-58e0-4060-a1a0-83419523c59d,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-k4btl/status,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:PATCH (29-Mar-2026 01:52:26.228) (total time: 1090ms):
Trace[1796004374]: ["GuaranteedUpdate etcd3" audit-id:797da703-58e0-4060-a1a0-83419523c59d,key:/pods/kube-system/coredns-7c96b6546b-k4btl,type:*core.Pod,resource:pods 1090ms (01:52:26.228)
Trace[1796004374]:  ---"Txn call completed" 1085ms (01:52:27.319)]
Trace[1796004374]: ---"Object stored in database" 1086ms (01:52:27.319)
Trace[1796004374]: [1.090807626s] [1.090807626s] END
I0329 01:52:27.320013       1 trace.go:236] Trace[168992126]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:28df3024-63f6-4a7b-afc5-097205fb8232,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:26.738) (total time: 581ms):
Trace[168992126]: ["Create etcd3" audit-id:28df3024-63f6-4a7b-afc5-097205fb8232,key:/events/kube-system/coredns-7c96b6546b-k4btl.18a12cf20a3dce4c,type:*core.Event,resource:events 580ms (01:52:26.739)
Trace[168992126]:  ---"Txn call succeeded" 580ms (01:52:27.319)]
Trace[168992126]: [581.24442ms] [581.24442ms] END
I0329 01:52:27.320136       1 trace.go:236] Trace[1002929429]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1ae121bc-092c-4aa5-a33d-daf9377d7d58,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:26.575) (total time: 744ms):
Trace[1002929429]: ---"About to write a response" 744ms (01:52:27.319)
Trace[1002929429]: [744.34152ms] [744.34152ms] END
I0329 01:52:27.320164       1 trace.go:236] Trace[732772946]: "Get" accept:application/json, */*,audit-id:566e7a55-c8fa-488d-a1fe-91c630389801,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:26.490) (total time: 829ms):
Trace[732772946]: ---"About to write a response" 829ms (01:52:27.320)
Trace[732772946]: [829.758582ms] [829.758582ms] END
I0329 01:52:27.320190       1 trace.go:236] Trace[864607016]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:43680639-c8c4-4174-af6d-25fde13d97ff,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-proxy-hdd4j/binding,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:26.226) (total time: 1093ms):
Trace[864607016]: ["GuaranteedUpdate etcd3" audit-id:43680639-c8c4-4174-af6d-25fde13d97ff,key:/pods/kube-system/kube-proxy-hdd4j,type:*core.Pod,resource:pods 1092ms (01:52:26.227)
Trace[864607016]:  ---"Txn call completed" 1091ms (01:52:27.319)]
Trace[864607016]: [1.093305216s] [1.093305216s] END
I0329 01:52:28.202064       1 trace.go:236] Trace[683468177]: "Update" accept:application/json, */*,audit-id:361e9390-0afb-483c-9196-4ec9dc05d03f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:27.321) (total time: 880ms):
Trace[683468177]: ["GuaranteedUpdate etcd3" audit-id:361e9390-0afb-483c-9196-4ec9dc05d03f,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 879ms (01:52:27.322)
Trace[683468177]:  ---"Txn call completed" 878ms (01:52:28.201)]
Trace[683468177]: [880.126916ms] [880.126916ms] END
I0329 01:52:28.300685       1 trace.go:236] Trace[1146745512]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e999fa4e-e0eb-4916-adfa-23446c429d77,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:52:27.324) (total time: 975ms):
Trace[1146745512]: ["GuaranteedUpdate etcd3" audit-id:e999fa4e-e0eb-4916-adfa-23446c429d77,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 975ms (01:52:27.325)
Trace[1146745512]:  ---"Txn call completed" 974ms (01:52:28.300)]
Trace[1146745512]: [975.66539ms] [975.66539ms] END
I0329 01:52:28.300812       1 trace.go:236] Trace[122118584]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2f9c64ef-b230-4037-8469-df78b1bddf9c,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:27.323) (total time: 977ms):
Trace[122118584]: ["Create etcd3" audit-id:2f9c64ef-b230-4037-8469-df78b1bddf9c,key:/events/kube-system/coredns-7c96b6546b-d8pkh.18a12cf24b84253b,type:*core.Event,resource:events 976ms (01:52:27.324)
Trace[122118584]:  ---"Txn call succeeded" 976ms (01:52:28.300)]
Trace[122118584]: [977.191135ms] [977.191135ms] END
I0329 01:52:28.301601       1 trace.go:236] Trace[884346336]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d3f3e33c-5f91-47b0-980c-4058330d4b2d,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-d8pkh/status,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:PATCH (29-Mar-2026 01:52:27.323) (total time: 978ms):
Trace[884346336]: ["GuaranteedUpdate etcd3" audit-id:d3f3e33c-5f91-47b0-980c-4058330d4b2d,key:/pods/kube-system/coredns-7c96b6546b-d8pkh,type:*core.Pod,resource:pods 978ms (01:52:27.323)
Trace[884346336]:  ---"Txn call completed" 974ms (01:52:28.301)]
Trace[884346336]: ---"Object stored in database" 975ms (01:52:28.301)
Trace[884346336]: [978.296902ms] [978.296902ms] END
I0329 01:52:28.301736       1 trace.go:236] Trace[2050677870]: "Patch" accept:application/json,audit-id:c58b125e-de65-46f0-bf69-6e6df8052b4e,client:199.204.45.156,protocol:HTTP/1.1,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns,user-agent:OpenAPI-Generator/35.0.0/python,verb:PATCH (29-Mar-2026 01:52:27.326) (total time: 975ms):
Trace[2050677870]: ["GuaranteedUpdate etcd3" audit-id:c58b125e-de65-46f0-bf69-6e6df8052b4e,key:/deployments/kube-system/coredns,type:*apps.Deployment,resource:deployments.apps 975ms (01:52:27.326)
Trace[2050677870]:  ---"Txn call completed" 966ms (01:52:28.301)]
Trace[2050677870]: ---"Object stored in database" 967ms (01:52:28.301)
Trace[2050677870]: [975.261873ms] [975.261873ms] END
I0329 01:52:28.301836       1 trace.go:236] Trace[1741601109]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ce032ab6-4c40-4623-8e0d-b6ced05e821e,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-proxy-hdd4j/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:52:27.327) (total time: 974ms):
Trace[1741601109]: ["GuaranteedUpdate etcd3" audit-id:ce032ab6-4c40-4623-8e0d-b6ced05e821e,key:/pods/kube-system/kube-proxy-hdd4j,type:*core.Pod,resource:pods 974ms (01:52:27.327)
Trace[1741601109]:  ---"Txn call completed" 967ms (01:52:28.301)]
Trace[1741601109]: ---"Object stored in database" 968ms (01:52:28.301)
Trace[1741601109]: [974.46841ms] [974.46841ms] END
I0329 01:52:29.081890       1 trace.go:236] Trace[153488888]: "Get" accept:application/json, */*,audit-id:668fa762-06db-475b-afe2-6c1d7a9faa7a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:27.520) (total time: 1561ms):
Trace[153488888]: ---"About to write a response" 1560ms (01:52:29.081)
Trace[153488888]: [1.56108256s] [1.56108256s] END
I0329 01:52:29.083275       1 trace.go:236] Trace[1226714021]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a40d8c89-1aa8-4b11-8fea-5fb1b4f36bdc,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:28.110) (total time: 973ms):
Trace[1226714021]: ["GuaranteedUpdate etcd3" audit-id:a40d8c89-1aa8-4b11-8fea-5fb1b4f36bdc,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 973ms (01:52:28.110)
Trace[1226714021]:  ---"Txn call completed" 972ms (01:52:29.083)]
Trace[1226714021]: [973.186036ms] [973.186036ms] END
I0329 01:52:30.335494       1 trace.go:236] Trace[1753189249]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:05f21fe7-38b0-4c40-94e6-b2cf3298de1c,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:28.303) (total time: 2032ms):
Trace[1753189249]: ["Create etcd3" audit-id:05f21fe7-38b0-4c40-94e6-b2cf3298de1c,key:/events/kube-system/kube-proxy-hdd4j.18a12cf24b91e5f4,type:*core.Event,resource:events 2031ms (01:52:28.303)
Trace[1753189249]:  ---"Txn call succeeded" 2031ms (01:52:30.335)]
Trace[1753189249]: [2.032114862s] [2.032114862s] END
I0329 01:52:30.335836       1 trace.go:236] Trace[415324433]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cd274d10-7a83-41ef-a880-b77242e86946,client:199.204.45.156,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:POST (29-Mar-2026 01:52:28.306) (total time: 2029ms):
Trace[415324433]: ["Create etcd3" audit-id:cd274d10-7a83-41ef-a880-b77242e86946,key:/replicasets/kube-system/coredns-67659f764b,type:*apps.ReplicaSet,resource:replicasets.apps 2027ms (01:52:28.308)
Trace[415324433]:  ---"Txn call succeeded" 2027ms (01:52:30.335)]
Trace[415324433]: [2.029517081s] [2.029517081s] END
I0329 01:52:30.335838       1 trace.go:236] Trace[66669348]: "Update" accept:application/json, */*,audit-id:3944020d-5425-4ae1-a9b0-cc58aca60102,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:29.083) (total time: 1251ms):
Trace[66669348]: ["GuaranteedUpdate etcd3" audit-id:3944020d-5425-4ae1-a9b0-cc58aca60102,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1251ms (01:52:29.084)
Trace[66669348]:  ---"Txn call completed" 1250ms (01:52:30.335)]
Trace[66669348]: [1.251985894s] [1.251985894s] END
I0329 01:52:32.262012       1 trace.go:236] Trace[493083165]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b683e068-22ab-4c70-b8a3-d60bc03138ee,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:52:30.330) (total time: 1931ms):
Trace[493083165]: ["Create etcd3" audit-id:b683e068-22ab-4c70-b8a3-d60bc03138ee,key:/events/kube-system/kube-apiserver-instance.18a12cf2fec9a6f9,type:*core.Event,resource:events 1931ms (01:52:30.330)
Trace[493083165]:  ---"Txn call succeeded" 1930ms (01:52:32.261)]
Trace[493083165]: [1.931712655s] [1.931712655s] END
I0329 01:52:32.641468       1 trace.go:236] Trace[927118502]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c87465cd-dd51-41c0-a04e-8987bab8582c,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:POST (29-Mar-2026 01:52:30.337) (total time: 2303ms):
Trace[927118502]: ["Create etcd3" audit-id:c87465cd-dd51-41c0-a04e-8987bab8582c,key:/events/kube-system/coredns.18a12cf2ff453f79,type:*core.Event,resource:events 2303ms (01:52:30.338)
Trace[927118502]:  ---"Txn call succeeded" 2303ms (01:52:32.641)]
Trace[927118502]: [2.303578521s] [2.303578521s] END
I0329 01:52:32.641872       1 trace.go:236] Trace[2141679588]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a024cf48-8b6e-4a1d-a9d2-bace5ca12f8c,client:::1,protocol:HTTP/2.0,resource:limitranges,scope:namespace,url:/api/v1/namespaces/kube-system/limitranges,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (29-Mar-2026 01:52:30.339) (total time: 2302ms):
Trace[2141679588]: ["List(recursive=true) etcd3" audit-id:a024cf48-8b6e-4a1d-a9d2-bace5ca12f8c,key:/limitranges/kube-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 2302ms (01:52:30.339)]
Trace[2141679588]: [2.302678186s] [2.302678186s] END
I0329 01:52:32.642600       1 trace.go:236] Trace[2131026505]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:198e5e49-2871-48ae-981e-4cb9f7210ed0,client:199.204.45.156,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (29-Mar-2026 01:52:30.338) (total time: 2304ms):
Trace[2131026505]: ["GuaranteedUpdate etcd3" audit-id:198e5e49-2871-48ae-981e-4cb9f7210ed0,key:/deployments/kube-system/coredns,type:*apps.Deployment,resource:deployments.apps 2304ms (01:52:30.338)
Trace[2131026505]:  ---"Txn call completed" 2299ms (01:52:32.641)]
Trace[2131026505]: [2.304369393s] [2.304369393s] END
I0329 01:52:32.643207       1 trace.go:236] Trace[299843930]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6c78943d-996d-45c9-948f-78a59336698a,client:199.204.45.156,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts/kube-proxy/token,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-Mar-2026 01:52:27.492) (total time: 5151ms):
Trace[299843930]: ---"Write to database call succeeded" len:148 5151ms (01:52:32.643)
Trace[299843930]: [5.151156058s] [5.151156058s] END
I0329 01:52:32.643399       1 trace.go:236] Trace[620693523]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (29-Mar-2026 01:52:27.687) (total time: 4956ms):
Trace[620693523]: ---"initial value restored" 1395ms (01:52:29.082)
Trace[620693523]: ---"Transaction prepared" 1253ms (01:52:30.335)
Trace[620693523]: ---"Txn call completed" 2307ms (01:52:32.643)
Trace[620693523]: [4.956314969s] [4.956314969s] END
I0329 01:52:32.643622       1 trace.go:236] Trace[159261765]: "Get" accept:application/json, */*,audit-id:ef4053f7-102a-4db0-9911-ab154773d5c6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:30.204) (total time: 2438ms):
Trace[159261765]: ---"About to write a response" 2438ms (01:52:32.643)
Trace[159261765]: [2.438681858s] [2.438681858s] END
I0329 01:52:32.644166       1 trace.go:236] Trace[1676262646]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ca78e89b-3b56-4918-82ec-99425ce2d6ef,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:29.324) (total time: 3319ms):
Trace[1676262646]: ---"About to write a response" 3319ms (01:52:32.644)
Trace[1676262646]: [3.319420882s] [3.319420882s] END
I0329 01:52:32.644173       1 trace.go:236] Trace[1057973686]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:af303082-0cc8-47d8-b4b4-8e7586726aeb,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:52:30.304) (total time: 2340ms):
Trace[1057973686]: ---"About to write a response" 2340ms (01:52:32.644)
Trace[1057973686]: [2.340138028s] [2.340138028s] END
I0329 01:52:35.774185       1 trace.go:236] Trace[589617029]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4673b52a-4869-410a-8e3f-339a6870e2c8,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:POST (29-Mar-2026 01:52:30.337) (total time: 5436ms):
Trace[589617029]: ["Create etcd3" audit-id:4673b52a-4869-410a-8e3f-339a6870e2c8,key:/pods/kube-system/coredns-67659f764b-v2qkt,type:*core.Pod,resource:pods 3130ms (01:52:32.643)
Trace[589617029]:  ---"Txn call succeeded" 3130ms (01:52:35.773)]
Trace[589617029]: [5.43636285s] [5.43636285s] END
E0329 01:52:37.646917       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:52:37.647052       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:52:37.647138       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:52:37.647250       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.32µs, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:37.648388       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:52:37.648440       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 1.358572ms, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:37.648467       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0329 01:52:37.649686       1 trace.go:236] Trace[1955646598]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e21124bc-8a46-445d-b85b-aa5da9720b78,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:52:32.646) (total time: 5003ms):
Trace[1955646598]: ["GuaranteedUpdate etcd3" audit-id:e21124bc-8a46-445d-b85b-aa5da9720b78,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (01:52:32.646)
Trace[1955646598]:  ---"Txn call failed" err:context canceled 4995ms (01:52:37.647)]
Trace[1955646598]: [5.003253051s] [5.003253051s] END
E0329 01:52:37.649809       1 timeout.go:142] post-timeout activity - time-elapsed: 2.658171ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
E0329 01:52:37.650529       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0329 01:52:37.650968       1 trace.go:236] Trace[508490362]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:40068acc-1aa2-4212-ad83-f56a7405f1ca,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:52:32.647) (total time: 5003ms):
Trace[508490362]: ["GuaranteedUpdate etcd3" audit-id:40068acc-1aa2-4212-ad83-f56a7405f1ca,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (01:52:32.647)
Trace[508490362]:  ---"Txn call failed" err:context canceled 5000ms (01:52:37.648)]
Trace[508490362]: [5.003340811s] [5.003340811s] END
E0329 01:52:37.651040       1 timeout.go:142] post-timeout activity - time-elapsed: 3.971552ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
I0329 01:52:38.343755       1 trace.go:236] Trace[357010175]: "List(recursive=true) etcd3" audit-id:,key:/masterleases/,resourceVersion:0,resourceVersionMatch:NotOlderThan,limit:0,continue: (29-Mar-2026 01:52:32.645) (total time: 5698ms):
Trace[357010175]: [5.698219242s] [5.698219242s] END
I0329 01:52:38.344319       1 trace.go:236] Trace[467237976]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:01ab0a7d-897f-41ac-934a-16b2f2b8fecd,client:199.204.45.156,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets/coredns-7c96b6546b,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (29-Mar-2026 01:52:32.644) (total time: 5699ms):
Trace[467237976]: ["GuaranteedUpdate etcd3" audit-id:01ab0a7d-897f-41ac-934a-16b2f2b8fecd,key:/replicasets/kube-system/coredns-7c96b6546b,type:*apps.ReplicaSet,resource:replicasets.apps 5699ms (01:52:32.645)
Trace[467237976]:  ---"Txn call completed" 5695ms (01:52:38.343)]
Trace[467237976]: [5.699600373s] [5.699600373s] END
I0329 01:52:38.344320       1 trace.go:236] Trace[1883415262]: "Update" accept:application/json, */*,audit-id:f7f2d5bf-8066-481f-8520-6420804cba51,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:32.650) (total time: 5693ms):
Trace[1883415262]: ["GuaranteedUpdate etcd3" audit-id:f7f2d5bf-8066-481f-8520-6420804cba51,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5693ms (01:52:32.651)
Trace[1883415262]:  ---"Txn call completed" 5692ms (01:52:38.343)]
Trace[1883415262]: [5.693253633s] [5.693253633s] END
I0329 01:52:38.344702       1 trace.go:236] Trace[1982764900]: "Update" accept:application/json, */*,audit-id:e84cd713-25f2-407e-a89e-93641232a64e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:32.649) (total time: 5694ms):
Trace[1982764900]: ["GuaranteedUpdate etcd3" audit-id:e84cd713-25f2-407e-a89e-93641232a64e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5694ms (01:52:32.650)
Trace[1982764900]:  ---"Txn call completed" 5693ms (01:52:38.343)]
Trace[1982764900]: [5.694579493s] [5.694579493s] END
I0329 01:52:40.014179       1 trace.go:236] Trace[362744156]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:cd53afd5-db8a-48a3-ae0f-9f654485756e,client:199.204.45.156,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets/coredns-67659f764b/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:PUT (29-Mar-2026 01:52:35.775) (total time: 4238ms):
Trace[362744156]: ["GuaranteedUpdate etcd3" audit-id:cd53afd5-db8a-48a3-ae0f-9f654485756e,key:/replicasets/kube-system/coredns-67659f764b,type:*apps.ReplicaSet,resource:replicasets.apps 4237ms (01:52:35.776)
Trace[362744156]:  ---"Txn call completed" 4236ms (01:52:40.013)]
Trace[362744156]: [4.238105467s] [4.238105467s] END
I0329 01:52:40.014687       1 trace.go:236] Trace[1018855834]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0c36c9d4-5c96-4f5d-88ad-4d558eaed936,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:39.370) (total time: 643ms):
Trace[1018855834]: ["GuaranteedUpdate etcd3" audit-id:0c36c9d4-5c96-4f5d-88ad-4d558eaed936,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 643ms (01:52:39.370)
Trace[1018855834]:  ---"Txn call completed" 642ms (01:52:40.014)]
Trace[1018855834]: [643.874004ms] [643.874004ms] END
I0329 01:52:40.015459       1 trace.go:236] Trace[1990005602]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:228dea0b-20ba-48cc-8943-460ad3a1315b,client:199.204.45.156,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (29-Mar-2026 01:52:38.347) (total time: 1668ms):
Trace[1990005602]: ["GuaranteedUpdate etcd3" audit-id:228dea0b-20ba-48cc-8943-460ad3a1315b,key:/deployments/kube-system/coredns,type:*apps.Deployment,resource:deployments.apps 1667ms (01:52:38.347)]
Trace[1990005602]: [1.668220237s] [1.668220237s] END
I0329 01:52:40.015813       1 trace.go:236] Trace[2067956403]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bb6b6af6-5d61-4ccb-9005-a5cfbcb64a2f,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (29-Mar-2026 01:52:35.776) (total time: 4239ms):
Trace[2067956403]: ["Create etcd3" audit-id:bb6b6af6-5d61-4ccb-9005-a5cfbcb64a2f,key:/events/kube-system/coredns-67659f764b-v2qkt.18a12cf4436607e6,type:*core.Event,resource:events 4238ms (01:52:35.777)
Trace[2067956403]:  ---"Txn call succeeded" 4238ms (01:52:40.015)]
Trace[2067956403]: [4.239081511s] [4.239081511s] END
I0329 01:52:40.015882       1 trace.go:236] Trace[851795456]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0d33c8eb-50ea-4107-9f55-7ba3d0d7dee3,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:POST (29-Mar-2026 01:52:35.776) (total time: 4239ms):
Trace[851795456]: ["Create etcd3" audit-id:0d33c8eb-50ea-4107-9f55-7ba3d0d7dee3,key:/events/kube-system/coredns-67659f764b.18a12cf44362057a,type:*core.Event,resource:events 4238ms (01:52:35.777)
Trace[851795456]:  ---"Txn call succeeded" 4237ms (01:52:40.015)]
Trace[851795456]: [4.239251094s] [4.239251094s] END
I0329 01:52:40.016173       1 trace.go:236] Trace[1076090262]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:31ef6f9a-d4e6-4b49-9996-ce0d4b65312d,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:POST (29-Mar-2026 01:52:38.347) (total time: 1668ms):
Trace[1076090262]: ["Create etcd3" audit-id:31ef6f9a-d4e6-4b49-9996-ce0d4b65312d,key:/events/kube-system/coredns.18a12cf4dc98b807,type:*core.Event,resource:events 1667ms (01:52:38.348)
Trace[1076090262]:  ---"Txn call succeeded" 1667ms (01:52:40.016)]
Trace[1076090262]: [1.668560862s] [1.668560862s] END
I0329 01:52:40.016472       1 trace.go:236] Trace[1815278489]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0650d2bf-697c-41d4-b7e2-edb8caf4bf42,client:::1,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:52:38.345) (total time: 1671ms):
Trace[1815278489]: ---"About to write a response" 1671ms (01:52:40.016)
Trace[1815278489]: [1.671255513s] [1.671255513s] END
I0329 01:52:40.016598       1 trace.go:236] Trace[109363650]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e7bfa206-be52-440a-b5a1-c777fa75d4be,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-67659f764b-v2qkt/status,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:PATCH (29-Mar-2026 01:52:35.776) (total time: 4239ms):
Trace[109363650]: ["GuaranteedUpdate etcd3" audit-id:e7bfa206-be52-440a-b5a1-c777fa75d4be,key:/pods/kube-system/coredns-67659f764b-v2qkt,type:*core.Pod,resource:pods 4239ms (01:52:35.777)
Trace[109363650]:  ---"Txn call completed" 4234ms (01:52:40.016)]
Trace[109363650]: ---"Object stored in database" 4235ms (01:52:40.016)
Trace[109363650]: [4.239684971s] [4.239684971s] END
I0329 01:52:40.016604       1 trace.go:236] Trace[1907513090]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:61a88033-4856-4d0f-9287-247b9a5262b4,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:52:36.652) (total time: 3364ms):
Trace[1907513090]: ---"About to write a response" 3363ms (01:52:40.016)
Trace[1907513090]: [3.364184204s] [3.364184204s] END
I0329 01:52:40.016678       1 trace.go:236] Trace[1940713430]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:99ccf835-7f55-4727-9fb6-cacf7720169a,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:52:39.326) (total time: 690ms):
Trace[1940713430]: ["GuaranteedUpdate etcd3" audit-id:99ccf835-7f55-4727-9fb6-cacf7720169a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 690ms (01:52:39.326)]
Trace[1940713430]: [690.433399ms] [690.433399ms] END
E0329 01:52:40.304775       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:52:40.304817       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:52:40.304839       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 28.05µs, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:40.305966       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0329 01:52:40.306117       1 timeout.go:142] post-timeout activity - time-elapsed: 1.27586ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
I0329 01:52:40.419876       1 trace.go:236] Trace[1898810661]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a9269c35-078b-4746-9bf1-6ba72a1113c2,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-k4btl,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:DELETE (29-Mar-2026 01:52:38.347) (total time: 2072ms):
Trace[1898810661]: [2.072582022s] [2.072582022s] END
E0329 01:52:40.419885       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.35µs, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:40.420119       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:52:40.420170       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.28µs, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:40.420175       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.32µs, panicked: false, err: context canceled, panic-reason: <nil>
E0329 01:52:40.420227       1 wrap.go:54] timeout or abort while handling: method=DELETE URI="/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-k4btl" audit-ID="a9269c35-078b-4746-9bf1-6ba72a1113c2"
E0329 01:52:40.420376       1 timeout.go:142] post-timeout activity - time-elapsed: 6.55µs, DELETE "/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-k4btl" result: <nil>
E0329 01:52:40.420950       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:52:40.421483       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0329 01:52:40.422387       1 timeout.go:142] post-timeout activity - time-elapsed: 2.659131ms, PUT "/apis/apps/v1/namespaces/kube-system/replicasets/coredns-67659f764b/status" result: <nil>
E0329 01:52:40.423841       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:52:40.423924       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:52:40.425082       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0329 01:52:40.425200       1 timeout.go:142] post-timeout activity - time-elapsed: 3.762907ms, PUT "/apis/apps/v1/namespaces/kube-system/replicasets/coredns-67659f764b" result: <nil>
I0329 01:52:41.381338       1 trace.go:236] Trace[677800592]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c8f1b528-1a82-4a56-a3fd-d6c022b3b7ce,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a12cf2fec9a6f9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:52:32.650) (total time: 8730ms):
Trace[677800592]: ["GuaranteedUpdate etcd3" audit-id:c8f1b528-1a82-4a56-a3fd-d6c022b3b7ce,key:/events/kube-system/kube-apiserver-instance.18a12cf2fec9a6f9,type:*core.Event,resource:events 8730ms (01:52:32.650)
Trace[677800592]:  ---"initial value restored" 7364ms (01:52:40.014)
Trace[677800592]:  ---"Txn call completed" 1365ms (01:52:41.381)]
Trace[677800592]: ---"Object stored in database" 1366ms (01:52:41.381)
Trace[677800592]: [8.730888743s] [8.730888743s] END
I0329 01:52:41.381662       1 trace.go:236] Trace[682875394]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2e0f8e21-3be0-4d39-bb89-35812a9998ed,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:52:40.020) (total time: 1361ms):
Trace[682875394]: ["GuaranteedUpdate etcd3" audit-id:2e0f8e21-3be0-4d39-bb89-35812a9998ed,key:/pods/kube-system/kube-apiserver-instance,type:*core.Pod,resource:pods 1361ms (01:52:40.020)
Trace[682875394]:  ---"Txn call completed" 1358ms (01:52:41.381)]
Trace[682875394]: ---"Object stored in database" 1358ms (01:52:41.381)
Trace[682875394]: [1.361613584s] [1.361613584s] END
I0329 01:52:41.764917       1 trace.go:236] Trace[2005230325]: "Get" accept:application/json, */*,audit-id:40e67147-ff43-47f9-8acb-2b56eeb76eb8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:40.348) (total time: 1416ms):
Trace[2005230325]: ---"About to write a response" 1416ms (01:52:41.764)
Trace[2005230325]: [1.416627558s] [1.416627558s] END
I0329 01:52:41.764938       1 trace.go:236] Trace[104993576]: "Get" accept:application/json, */*,audit-id:f8306efb-3d10-4ce3-9a1f-da8d1692f9b9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:52:40.348) (total time: 1416ms):
Trace[104993576]: ---"About to write a response" 1416ms (01:52:41.764)
Trace[104993576]: [1.416724519s] [1.416724519s] END
I0329 01:52:41.764997       1 trace.go:236] Trace[72693151]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7d3dd77f-142e-4216-8dd7-c701eefb0169,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:52:40.626) (total time: 1138ms):
Trace[72693151]: ["GuaranteedUpdate etcd3" audit-id:7d3dd77f-142e-4216-8dd7-c701eefb0169,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1138ms (01:52:40.626)
Trace[72693151]:  ---"Txn call completed" 1137ms (01:52:41.764)]
Trace[72693151]: [1.138563177s] [1.138563177s] END
I0329 01:52:41.795814       1 trace.go:236] Trace[356443676]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (29-Mar-2026 01:52:40.016) (total time: 1778ms):
Trace[356443676]: ---"initial value restored" 1364ms (01:52:41.381)
Trace[356443676]: ---"Transaction prepared" 382ms (01:52:41.764)
Trace[356443676]: [1.778918657s] [1.778918657s] END
I0329 01:52:45.682232       1 trace.go:236] Trace[1990384591]: "Create" accept:application/json,audit-id:8aa86242-561a-4201-a2d8-8875b25dfc84,client:199.204.45.156,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts,user-agent:Helm/3.11.2,verb:POST (29-Mar-2026 01:52:45.129) (total time: 552ms):
Trace[1990384591]: ["Create etcd3" audit-id:8aa86242-561a-4201-a2d8-8875b25dfc84,key:/serviceaccounts/kube-system/cilium-operator,type:*core.ServiceAccount,resource:serviceaccounts 551ms (01:52:45.130)
Trace[1990384591]:  ---"Txn call succeeded" 551ms (01:52:45.681)]
Trace[1990384591]: [552.491479ms] [552.491479ms] END
I0329 01:52:45.682648       1 trace.go:236] Trace[1267583910]: "Create" accept:application/json,audit-id:31391884-00b4-48e4-979b-c5491f7e43fa,client:199.204.45.156,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts,user-agent:Helm/3.11.2,verb:POST (29-Mar-2026 01:52:45.129) (total time: 552ms):
Trace[1267583910]: ["Create etcd3" audit-id:31391884-00b4-48e4-979b-c5491f7e43fa,key:/serviceaccounts/kube-system/cilium,type:*core.ServiceAccount,resource:serviceaccounts 551ms (01:52:45.130)
Trace[1267583910]:  ---"Txn call succeeded" 551ms (01:52:45.682)]
Trace[1267583910]: [552.53095ms] [552.53095ms] END
I0329 01:52:46.727451       1 trace.go:236] Trace[1534395739]: "Create" accept:application/json,audit-id:4dce7848-d025-4a88-a26c-91a36e34b0b9,client:199.204.45.156,protocol:HTTP/2.0,resource:daemonsets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/daemonsets,user-agent:Helm/3.11.2,verb:POST (29-Mar-2026 01:52:46.216) (total time: 510ms):
Trace[1534395739]: ["Create etcd3" audit-id:4dce7848-d025-4a88-a26c-91a36e34b0b9,key:/daemonsets/kube-system/cilium,type:*apps.DaemonSet,resource:daemonsets.apps 505ms (01:52:46.222)
Trace[1534395739]:  ---"Txn call succeeded" 503ms (01:52:46.726)]
Trace[1534395739]: [510.729306ms] [510.729306ms] END
I0329 01:52:47.787416       1 trace.go:236] Trace[308404240]: "Update" accept:application/json, */*,audit-id:f512428f-7c10-4170-81c9-023959e214b9,client:199.204.45.156,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/kube-system/secrets/sh.helm.release.v1.cilium.v1,user-agent:Helm/3.11.2,verb:PUT (29-Mar-2026 01:52:47.182) (total time: 604ms):
Trace[308404240]: ["GuaranteedUpdate etcd3" audit-id:f512428f-7c10-4170-81c9-023959e214b9,key:/secrets/kube-system/sh.helm.release.v1.cilium.v1,type:*core.Secret,resource:secrets 591ms (01:52:47.195)
Trace[308404240]:  ---"Txn call completed" 572ms (01:52:47.770)]
Trace[308404240]: ---"Writing http response done" 16ms (01:52:47.787)
Trace[308404240]: [604.598701ms] [604.598701ms] END
I0329 01:52:49.963451       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0329 01:52:50.053707       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0329 01:52:50.053756       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0329 01:52:50.074733       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0329 01:52:50.105613       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0329 01:52:50.188196       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0329 01:52:50.275928       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0329 01:52:50.276001       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0329 01:52:50.315803       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0329 01:52:50.330064       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0329 01:52:50.401611       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0329 01:52:50.401679       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0329 01:52:50.560171       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0329 01:52:50.560266       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0329 01:52:50.621319       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0329 01:52:50.767771       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0329 01:52:50.767838       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0329 01:52:50.810033       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:50.901202       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:50.975195       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:51.052798       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:51.076339       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:51.445854       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:51.460611       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:51.632690       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0329 01:52:58.849292       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0329 01:52:59.300256       1 trace.go:236] Trace[1080350508]: "Update" accept:application/json, */*,audit-id:2c560420-54ca-4cd8-85da-0dc85730b443,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:52:58.793) (total time: 507ms):
Trace[1080350508]: ["GuaranteedUpdate etcd3" audit-id:2c560420-54ca-4cd8-85da-0dc85730b443,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 506ms (01:52:58.793)
Trace[1080350508]:  ---"Txn call completed" 505ms (01:52:59.299)]
Trace[1080350508]: [507.081999ms] [507.081999ms] END
I0329 01:53:06.290617       1 trace.go:236] Trace[146929153]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:26ea0142-1c21-4569-b97a-658ccf202f94,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:53:05.270) (total time: 1020ms):
Trace[146929153]: ["GuaranteedUpdate etcd3" audit-id:26ea0142-1c21-4569-b97a-658ccf202f94,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1020ms (01:53:05.270)
Trace[146929153]:  ---"Txn call completed" 1019ms (01:53:06.290)]
Trace[146929153]: [1.020391507s] [1.020391507s] END
I0329 01:53:09.319945       1 trace.go:236] Trace[1951427573]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:93a46642-771f-4586-9f2c-0c76be0c7de2,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:05.864) (total time: 3455ms):
Trace[1951427573]: ---"About to write a response" 3454ms (01:53:09.319)
Trace[1951427573]: [3.455072782s] [3.455072782s] END
I0329 01:53:09.320122       1 trace.go:236] Trace[843906802]: "Get" accept:application/json, */*,audit-id:b5a121c6-3541-4da2-b2f2-c229dbeefbe1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:05.560) (total time: 3760ms):
Trace[843906802]: ---"About to write a response" 3759ms (01:53:09.319)
Trace[843906802]: [3.760010842s] [3.760010842s] END
I0329 01:53:09.319959       1 trace.go:236] Trace[1664800233]: "Get" accept:application/json, */*,audit-id:07294671-a6c8-4f9a-a883-b8d0314c568f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:05.777) (total time: 3542ms):
Trace[1664800233]: ---"About to write a response" 3542ms (01:53:09.319)
Trace[1664800233]: [3.542587095s] [3.542587095s] END
I0329 01:53:09.319969       1 trace.go:236] Trace[549959982]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b45d8a14-33d0-4440-8648-fb9b09a3d827,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:08.294) (total time: 1025ms):
Trace[549959982]: ---"About to write a response" 1025ms (01:53:09.319)
Trace[549959982]: [1.025870471s] [1.025870471s] END
I0329 01:53:09.655079       1 trace.go:236] Trace[1447580601]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:47370399-011b-435a-aa7a-6b12e897302d,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a12cf49510d930,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:53:09.138) (total time: 516ms):
Trace[1447580601]: ["GuaranteedUpdate etcd3" audit-id:47370399-011b-435a-aa7a-6b12e897302d,key:/events/kube-system/kube-apiserver-instance.18a12cf49510d930,type:*core.Event,resource:events 516ms (01:53:09.138)
Trace[1447580601]:  ---"initial value restored" 181ms (01:53:09.319)
Trace[1447580601]:  ---"Txn call completed" 333ms (01:53:09.654)]
Trace[1447580601]: ---"Object stored in database" 333ms (01:53:09.654)
Trace[1447580601]: [516.905835ms] [516.905835ms] END
I0329 01:53:10.557691       1 trace.go:236] Trace[1235024839]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0801ac75-6383-4227-bc07-9ac60bfbfef3,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:53:09.322) (total time: 1235ms):
Trace[1235024839]: ["GuaranteedUpdate etcd3" audit-id:0801ac75-6383-4227-bc07-9ac60bfbfef3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1234ms (01:53:09.322)
Trace[1235024839]:  ---"Txn call completed" 1233ms (01:53:10.557)]
Trace[1235024839]: [1.235017063s] [1.235017063s] END
I0329 01:53:10.558487       1 trace.go:236] Trace[831486715]: "Update" accept:application/json, */*,audit-id:d77ae0dd-49fa-49cd-85e8-a9f1b8e6466b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:09.322) (total time: 1235ms):
Trace[831486715]: ["GuaranteedUpdate etcd3" audit-id:d77ae0dd-49fa-49cd-85e8-a9f1b8e6466b,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1235ms (01:53:09.322)
Trace[831486715]:  ---"Txn call completed" 1233ms (01:53:10.558)]
Trace[831486715]: [1.235762284s] [1.235762284s] END
I0329 01:53:10.558705       1 trace.go:236] Trace[2141188075]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f634a7e5-1562-41ec-8f34-fc6c8cb2c6e9,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:53:09.322) (total time: 1235ms):
Trace[2141188075]: ["GuaranteedUpdate etcd3" audit-id:f634a7e5-1562-41ec-8f34-fc6c8cb2c6e9,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1235ms (01:53:09.322)
Trace[2141188075]:  ---"Txn call completed" 1234ms (01:53:10.557)]
Trace[2141188075]: [1.235384809s] [1.235384809s] END
I0329 01:53:10.559014       1 trace.go:236] Trace[1613326228]: "Update" accept:application/json, */*,audit-id:b158f1bd-db3f-4829-bfac-de0d450c4f11,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:09.321) (total time: 1237ms):
Trace[1613326228]: ["GuaranteedUpdate etcd3" audit-id:b158f1bd-db3f-4829-bfac-de0d450c4f11,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1236ms (01:53:09.322)
Trace[1613326228]:  ---"Txn call completed" 1235ms (01:53:10.558)]
Trace[1613326228]: [1.237018453s] [1.237018453s] END
I0329 01:53:10.952747       1 trace.go:236] Trace[417101870]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:378d9285-55de-460e-912a-d5bcb8d960e6,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a12cf2fec9a6f9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:53:09.657) (total time: 1295ms):
Trace[417101870]: ["GuaranteedUpdate etcd3" audit-id:378d9285-55de-460e-912a-d5bcb8d960e6,key:/events/kube-system/kube-apiserver-instance.18a12cf2fec9a6f9,type:*core.Event,resource:events 1295ms (01:53:09.657)
Trace[417101870]:  ---"initial value restored" 901ms (01:53:10.558)
Trace[417101870]:  ---"Txn call completed" 392ms (01:53:10.952)]
Trace[417101870]: ---"Object stored in database" 392ms (01:53:10.952)
Trace[417101870]: [1.295194597s] [1.295194597s] END
I0329 01:53:11.596912       1 trace.go:236] Trace[774086169]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (29-Mar-2026 01:53:10.017) (total time: 1579ms):
Trace[774086169]: ---"initial value restored" 540ms (01:53:10.558)
Trace[774086169]: ---"Transaction prepared" 393ms (01:53:10.952)
Trace[774086169]: ---"Txn call completed" 644ms (01:53:11.596)
Trace[774086169]: [1.579055675s] [1.579055675s] END
I0329 01:53:11.597150       1 trace.go:236] Trace[947452868]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3da0066d-3e34-4659-a553-3f625cea76a5,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:53:10.864) (total time: 732ms):
Trace[947452868]: ["GuaranteedUpdate etcd3" audit-id:3da0066d-3e34-4659-a553-3f625cea76a5,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 731ms (01:53:10.865)
Trace[947452868]:  ---"Txn call completed" 730ms (01:53:11.596)]
Trace[947452868]: [732.091725ms] [732.091725ms] END
I0329 01:53:14.017478       1 trace.go:236] Trace[633796486]: "Update" accept:application/json, */*,audit-id:59938e17-9934-48e8-a204-0e3dd0da4793,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:12.701) (total time: 1316ms):
Trace[633796486]: ["GuaranteedUpdate etcd3" audit-id:59938e17-9934-48e8-a204-0e3dd0da4793,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1315ms (01:53:12.701)
Trace[633796486]:  ---"Txn call completed" 1314ms (01:53:14.017)]
Trace[633796486]: [1.316160227s] [1.316160227s] END
I0329 01:53:14.017507       1 trace.go:236] Trace[571634587]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a9fc9022-c03f-4bd1-ae04-f7702b7e8544,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:53:12.702) (total time: 1315ms):
Trace[571634587]: ["GuaranteedUpdate etcd3" audit-id:a9fc9022-c03f-4bd1-ae04-f7702b7e8544,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1314ms (01:53:12.702)
Trace[571634587]:  ---"Txn call completed" 1313ms (01:53:14.017)]
Trace[571634587]: [1.315055062s] [1.315055062s] END
I0329 01:53:14.017651       1 trace.go:236] Trace[1524478073]: "Update" accept:application/json, */*,audit-id:3822eb15-afda-45bf-af78-cd10c477ad69,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:12.701) (total time: 1315ms):
Trace[1524478073]: ["GuaranteedUpdate etcd3" audit-id:3822eb15-afda-45bf-af78-cd10c477ad69,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1315ms (01:53:12.702)
Trace[1524478073]:  ---"Txn call completed" 1314ms (01:53:14.017)]
Trace[1524478073]: [1.31566711s] [1.31566711s] END
I0329 01:53:30.667627       1 trace.go:236] Trace[1223308855]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e4997a0e-faba-463b-a51a-274704cd76cb,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-dtgqx,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:53:30.116) (total time: 551ms):
Trace[1223308855]: ---"About to write a response" 550ms (01:53:30.666)
Trace[1223308855]: [551.366958ms] [551.366958ms] END
I0329 01:53:32.700030       1 trace.go:236] Trace[1136890646]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:405d97e7-a11d-4381-ae4f-57e811fd4a1c,client:199.204.45.156,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-dtgqx/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:53:30.669) (total time: 2029ms):
Trace[1136890646]: ["GuaranteedUpdate etcd3" audit-id:405d97e7-a11d-4381-ae4f-57e811fd4a1c,key:/pods/kube-system/cilium-dtgqx,type:*core.Pod,resource:pods 2029ms (01:53:30.670)
Trace[1136890646]:  ---"Txn call completed" 2018ms (01:53:32.698)]
Trace[1136890646]: ---"Object stored in database" 2019ms (01:53:32.698)
Trace[1136890646]: [2.029289122s] [2.029289122s] END
I0329 01:53:34.724086       1 trace.go:236] Trace[128082903]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (29-Mar-2026 01:53:30.018) (total time: 4705ms):
Trace[128082903]: ---"initial value restored" 647ms (01:53:30.666)
Trace[128082903]: ---"Transaction prepared" 432ms (01:53:31.098)
Trace[128082903]: ---"Txn call completed" 3625ms (01:53:34.723)
Trace[128082903]: [4.705158859s] [4.705158859s] END
I0329 01:53:34.724234       1 trace.go:236] Trace[486903590]: "Get" accept:application/json, */*,audit-id:82777dc5-a472-4d74-b13a-648180f05d36,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:31.034) (total time: 3689ms):
Trace[486903590]: ---"About to write a response" 3689ms (01:53:34.724)
Trace[486903590]: [3.689809349s] [3.689809349s] END
I0329 01:53:34.724887       1 trace.go:236] Trace[359489896]: "Get" accept:application/json, */*,audit-id:c607c898-57d7-4867-8ecb-bc60970b0e60,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:30.721) (total time: 4003ms):
Trace[359489896]: ---"About to write a response" 4003ms (01:53:34.724)
Trace[359489896]: [4.003216613s] [4.003216613s] END
I0329 01:53:34.724937       1 trace.go:236] Trace[1174274844]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0420a141-8953-46f2-82fc-e123f14e95a7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:53:32.092) (total time: 2632ms):
Trace[1174274844]: ["GuaranteedUpdate etcd3" audit-id:0420a141-8953-46f2-82fc-e123f14e95a7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2632ms (01:53:32.092)
Trace[1174274844]:  ---"Txn call completed" 2631ms (01:53:34.724)]
Trace[1174274844]: [2.632772082s] [2.632772082s] END
E0329 01:53:36.285107       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0329 01:53:36.285225       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:53:36.286299       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:53:36.286380       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0329 01:53:36.290094       1 trace.go:236] Trace[229585569]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8ec2d867-45a9-4b4e-9565-9fc97698fa49,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:31.285) (total time: 5002ms):
Trace[229585569]: [5.002301665s] [5.002301665s] END
E0329 01:53:36.290460       1 timeout.go:142] post-timeout activity - time-elapsed: 5.311682ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0329 01:53:36.769752       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0329 01:53:36.769865       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0329 01:53:36.771355       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0329 01:53:36.771401       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0329 01:53:36.772639       1 trace.go:236] Trace[1283677209]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3c599d91-09c6-4c4f-b069-84e38f207311,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:31.769) (total time: 5002ms):
Trace[1283677209]: [5.002932503s] [5.002932503s] END
E0329 01:53:36.772818       1 timeout.go:142] post-timeout activity - time-elapsed: 3.074493ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
I0329 01:53:38.271113       1 trace.go:236] Trace[1797782037]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41dc77af-34eb-4861-b470-97beaa295c0b,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:53:33.102) (total time: 5168ms):
Trace[1797782037]: ["GuaranteedUpdate etcd3" audit-id:41dc77af-34eb-4861-b470-97beaa295c0b,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5167ms (01:53:33.103)
Trace[1797782037]:  ---"Txn call completed" 5166ms (01:53:38.270)]
Trace[1797782037]: [5.168303453s] [5.168303453s] END
I0329 01:53:38.271954       1 trace.go:236] Trace[276263103]: "Update" accept:application/json, */*,audit-id:17f3fac6-6376-432f-ba0a-023585b5579c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:34.726) (total time: 3545ms):
Trace[276263103]: ["GuaranteedUpdate etcd3" audit-id:17f3fac6-6376-432f-ba0a-023585b5579c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3544ms (01:53:34.727)
Trace[276263103]:  ---"Txn call completed" 3544ms (01:53:38.271)]
Trace[276263103]: [3.545062459s] [3.545062459s] END
I0329 01:53:38.272801       1 trace.go:236] Trace[829993307]: "Update" accept:application/json, */*,audit-id:b959f64b-95ee-40bb-89dc-4736a6d44382,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:53:34.727) (total time: 3545ms):
Trace[829993307]: ["GuaranteedUpdate etcd3" audit-id:b959f64b-95ee-40bb-89dc-4736a6d44382,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3545ms (01:53:34.727)
Trace[829993307]:  ---"Txn call completed" 3544ms (01:53:38.272)]
Trace[829993307]: [3.545670886s] [3.545670886s] END
I0329 01:53:39.918089       1 trace.go:236] Trace[731742516]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a89e0644-7d2d-4be1-b66d-edf199a862e5,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:38.304) (total time: 1613ms):
Trace[731742516]: ---"About to write a response" 1613ms (01:53:39.917)
Trace[731742516]: [1.613424749s] [1.613424749s] END
I0329 01:53:39.918166       1 trace.go:236] Trace[146894048]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f1977b5c-f250-4738-bc8e-2ddef0e0ab06,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:38.770) (total time: 1147ms):
Trace[146894048]: ---"About to write a response" 1147ms (01:53:39.918)
Trace[146894048]: [1.147540324s] [1.147540324s] END
I0329 01:53:39.919239       1 trace.go:236] Trace[2098628194]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5c73840e-7d5c-41ce-9d46-cc01d9ee4e49,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-Mar-2026 01:53:34.724) (total time: 5194ms):
Trace[2098628194]: ---"About to write a response" 5194ms (01:53:39.919)
Trace[2098628194]: [5.194317412s] [5.194317412s] END
I0329 01:53:39.923057       1 trace.go:236] Trace[936584252]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:540daba4-97fd-4bf6-82aa-f6e4ebb1d054,client:199.204.45.156,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a12cf2fec9a6f9,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:53:36.332) (total time: 3589ms):
Trace[936584252]: ["GuaranteedUpdate etcd3" audit-id:540daba4-97fd-4bf6-82aa-f6e4ebb1d054,key:/events/kube-system/kube-apiserver-instance.18a12cf2fec9a6f9,type:*core.Event,resource:events 3589ms (01:53:36.333)
Trace[936584252]:  ---"initial value restored" 3585ms (01:53:39.918)]
Trace[936584252]: [3.589978394s] [3.589978394s] END
I0329 01:53:41.950396       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0329 01:53:41.969715       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0329 01:53:42.133884       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0329 01:53:42.417695       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0329 01:53:43.342130       1 trace.go:236] Trace[1750058753]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9df3255d-f7cd-41ce-bea8-7d5baea9e522,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (29-Mar-2026 01:53:42.502) (total time: 839ms):
Trace[1750058753]: ["Create etcd3" audit-id:9df3255d-f7cd-41ce-bea8-7d5baea9e522,key:/apiextensions.k8s.io/customresourcedefinitions/ciliumexternalworkloads.cilium.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 837ms (01:53:42.504)
Trace[1750058753]:  ---"Txn call succeeded" 836ms (01:53:43.340)]
Trace[1750058753]: [839.23721ms] [839.23721ms] END
I0329 01:53:43.377842       1 trace.go:236] Trace[568163839]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1ece6e04-7250-4ab7-b96c-cfd59b8251ea,client:199.204.45.156,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (29-Mar-2026 01:53:42.703) (total time: 674ms):
Trace[568163839]: ["Create etcd3" audit-id:1ece6e04-7250-4ab7-b96c-cfd59b8251ea,key:/apiextensions.k8s.io/customresourcedefinitions/ciliumidentities.cilium.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 672ms (01:53:42.705)
Trace[568163839]:  ---"Txn call succeeded" 671ms (01:53:43.376)]
Trace[568163839]: [674.311132ms] [674.311132ms] END
I0329 01:53:43.378214       1 trace.go:236] Trace[1394773016]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0850d920-319b-42b2-b816-89342bf3c9e3,client:199.204.45.156,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-Mar-2026 01:53:42.530) (total time: 847ms):
Trace[1394773016]: ["GuaranteedUpdate etcd3" audit-id:0850d920-319b-42b2-b816-89342bf3c9e3,key:/minions/instance,type:*core.Node,resource:nodes 847ms (01:53:42.530)
Trace[1394773016]:  ---"Txn call completed" 843ms (01:53:43.377)]
Trace[1394773016]: ---"Object stored in database" 844ms (01:53:43.377)
Trace[1394773016]: [847.58862ms] [847.58862ms] END
I0329 01:53:43.437567       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0329 01:53:43.446462       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0329 01:53:43.466659       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0329 01:53:43.497467       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0329 01:53:44.780781       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0329 01:53:45.247311       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0329 01:53:45.760349       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0329 01:53:52.772299       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0329 01:53:52.772352       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0329 01:53:53.248133       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0329 01:54:00.902042       1 trace.go:236] Trace[636453694]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6c658715-ffcd-4c38-a2ad-3718533195e7,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-Mar-2026 01:53:58.722) (total time: 2179ms):
Trace[636453694]: ["GuaranteedUpdate etcd3" audit-id:6c658715-ffcd-4c38-a2ad-3718533195e7,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 2178ms (01:53:58.723)
Trace[636453694]:  ---"Txn call completed" 2177ms (01:54:00.901)]
Trace[636453694]: [2.179108805s] [2.179108805s] END
I0329 01:54:00.932788       1 trace.go:236] Trace[1445956071]: "Get" accept:application/json, */*,audit-id:5970e8dd-5a6e-41af-bbf6-c68e43a3c43c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:58.858) (total time: 2074ms):
Trace[1445956071]: ---"About to write a response" 2073ms (01:54:00.932)
Trace[1445956071]: [2.074066519s] [2.074066519s] END
I0329 01:54:00.932822       1 trace.go:236] Trace[981065505]: "Get" accept:application/json, */*,audit-id:70c86985-14b8-4103-90d8-f3934f84d776,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:53:58.858) (total time: 2074ms):
Trace[981065505]: ---"About to write a response" 2074ms (01:54:00.932)
Trace[981065505]: [2.074275774s] [2.074275774s] END
I0329 01:54:00.932976       1 trace.go:236] Trace[1974946378]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9a06c911-936a-4cb9-be60-eb42e77de28b,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:53:58.855) (total time: 2077ms):
Trace[1974946378]: ---"About to write a response" 2077ms (01:54:00.932)
Trace[1974946378]: [2.07778221s] [2.07778221s] END
I0329 01:54:00.933109       1 trace.go:236] Trace[8931252]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ba2b69bd-d1ca-47bf-aa70-c176972f4452,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-Mar-2026 01:53:58.744) (total time: 2188ms):
Trace[8931252]: ["GuaranteedUpdate etcd3" audit-id:ba2b69bd-d1ca-47bf-aa70-c176972f4452,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2188ms (01:53:58.744)
Trace[8931252]:  ---"Txn call completed" 2186ms (01:54:00.932)]
Trace[8931252]: [2.188523309s] [2.188523309s] END
I0329 01:54:00.933254       1 trace.go:236] Trace[720404954]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:35116201-8155-4368-b9e2-ded640982ce0,client:199.204.45.156,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs/envoy-gateway-gateway-helm-certgen/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (29-Mar-2026 01:53:59.319) (total time: 1613ms):
Trace[720404954]: ["GuaranteedUpdate etcd3" audit-id:35116201-8155-4368-b9e2-ded640982ce0,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 1613ms (01:53:59.319)
Trace[720404954]:  ---"Txn call completed" 1609ms (01:54:00.932)]
Trace[720404954]: [1.613793487s] [1.613793487s] END
I0329 01:54:00.934469       1 trace.go:236] Trace[244041307]: "Get" accept:application/json, */*,audit-id:91d2ec99-5be1-4740-8f60-4d527cd0b1de,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-Mar-2026 01:54:00.322) (total time: 612ms):
Trace[244041307]: ---"About to write a response" 611ms (01:54:00.934)
Trace[244041307]: [612.113772ms] [612.113772ms] END
I0329 01:54:01.234843       1 trace.go:236] Trace[1589672786]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.156,type:*v1.Endpoints,resource:apiServerIPInfo (29-Mar-2026 01:54:00.020) (total time: 1214ms):
Trace[1589672786]: ---"initial value restored" 912ms (01:54:00.932)
Trace[1589672786]: ---"Transaction prepared" 128ms (01:54:01.060)
Trace[1589672786]: ---"Txn call completed" 174ms (01:54:01.234)
Trace[1589672786]: [1.214455573s] [1.214455573s] END
I0329 01:54:04.566713       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.100.164.123"}
W0329 01:54:04.610924       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.100.164.123:9443: connect: connection refused
E0329 01:54:04.610960       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.100.164.123:9443: connect: connection refused
I0329 01:54:51.706218       1 trace.go:236] Trace[772422732]: "Update" accept:application/json, */*,audit-id:8f3cb8ed-84a6-4342-9a50-f2b7944bbd25,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:54:50.517) (total time: 1188ms):
Trace[772422732]: ["GuaranteedUpdate etcd3" audit-id:8f3cb8ed-84a6-4342-9a50-f2b7944bbd25,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1187ms (01:54:50.517)
Trace[772422732]:  ---"Txn call completed" 1186ms (01:54:51.705)]
Trace[772422732]: [1.188178594s] [1.188178594s] END
I0329 01:54:51.824605       1 trace.go:236] Trace[407920483]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c2f33161-473f-459c-86a3-380f2b9f8172,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:54:51.203) (total time: 620ms):
Trace[407920483]: ---"About to write a response" 620ms (01:54:51.824)
Trace[407920483]: [620.656657ms] [620.656657ms] END
I0329 01:54:51.824874       1 trace.go:236] Trace[486766829]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:61f8e671-4fa6-42b6-b88a-aead3dde2eba,client:10.0.0.188,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Mar-2026 01:54:50.708) (total time: 1116ms):
Trace[486766829]: ["GuaranteedUpdate etcd3" audit-id:61f8e671-4fa6-42b6-b88a-aead3dde2eba,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1116ms (01:54:50.708)
Trace[486766829]:  ---"Txn call completed" 1115ms (01:54:51.824)]
Trace[486766829]: [1.116250304s] [1.116250304s] END
I0329 01:54:51.824932       1 trace.go:236] Trace[1345859599]: "Get" accept:application/json, */*,audit-id:6dced149-3566-4a4f-b581-3b498e66d461,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:54:50.767) (total time: 1057ms):
Trace[1345859599]: ---"About to write a response" 1057ms (01:54:51.824)
Trace[1345859599]: [1.057440872s] [1.057440872s] END
I0329 01:55:57.177817       1 trace.go:236] Trace[541713803]: "Update" accept:application/json, */*,audit-id:4d1033c1-da71-431f-a290-6b6591ce756c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Mar-2026 01:55:56.319) (total time: 857ms):
Trace[541713803]: ["GuaranteedUpdate etcd3" audit-id:4d1033c1-da71-431f-a290-6b6591ce756c,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 857ms (01:55:56.320)
Trace[541713803]:  ---"Txn call completed" 856ms (01:55:57.177)]
Trace[541713803]: [857.934462ms] [857.934462ms] END
I0329 01:55:57.288583       1 trace.go:236] Trace[2061082280]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:12450137-0048-4f9e-a62c-2c8373c90cea,client:10.0.0.188,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-Mar-2026 01:55:56.450) (total time: 837ms):
Trace[2061082280]: ["GuaranteedUpdate etcd3" audit-id:12450137-0048-4f9e-a62c-2c8373c90cea,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 837ms (01:55:56.450)
Trace[2061082280]:  ---"Txn call completed" 836ms (01:55:57.288)]
Trace[2061082280]: [837.766431ms] [837.766431ms] END
I0329 01:55:57.288603       1 trace.go:236] Trace[1608047794]: "Get" accept:application/json, */*,audit-id:6ea9aa40-05d8-48b6-a569-077d27b7a3db,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Mar-2026 01:55:56.527) (total time: 761ms):
Trace[1608047794]: ---"About to write a response" 761ms (01:55:57.288)
Trace[1608047794]: [761.539988ms] [761.539988ms] END
I0329 01:55:57.288975       1 trace.go:236] Trace[1438785081]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:59ecab8c-8b0a-4a74-a72c-be3b2b5cf669,client:199.204.45.156,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-Mar-2026 01:55:56.695) (total time: 593ms):
Trace[1438785081]: ---"About to write a response" 593ms (01:55:57.288)
Trace[1438785081]: [593.256949ms] [593.256949ms] END