I0331 18:27:42.529757       1 options.go:220] external host was not specified, using 162.253.55.110
I0331 18:27:42.530715       1 server.go:148] Version: v1.28.13
I0331 18:27:42.530782       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0331 18:27:43.139330       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0331 18:27:43.150357       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0331 18:27:43.150382       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0331 18:27:43.150608       1 instance.go:298] Using reconciler: lease
I0331 18:27:43.195423       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0331 18:27:43.195459       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0331 18:27:43.448343       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0331 18:27:43.448845       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0331 18:27:43.895951       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0331 18:27:43.915439       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0331 18:27:43.915471       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.915478       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.915917       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0331 18:27:43.915931       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0331 18:27:43.916904       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0331 18:27:43.917878       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0331 18:27:43.917899       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0331 18:27:43.917906       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0331 18:27:43.919626       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0331 18:27:43.919641       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0331 18:27:43.920262       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0331 18:27:43.920274       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.920278       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.920955       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0331 18:27:43.920967       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.920994       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0331 18:27:43.921421       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0331 18:27:43.922652       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0331 18:27:43.922664       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.922668       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.923002       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0331 18:27:43.923012       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.923016       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.923616       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0331 18:27:43.923628       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0331 18:27:43.924914       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0331 18:27:43.924926       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.924929       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.925258       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0331 18:27:43.925270       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.925274       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.926878       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0331 18:27:43.926892       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.926896       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.927829       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0331 18:27:43.928572       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0331 18:27:43.928596       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.928600       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.931287       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0331 18:27:43.931301       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0331 18:27:43.931305       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0331 18:27:43.932126       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0331 18:27:43.932137       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0331 18:27:43.932140       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0331 18:27:43.932563       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0331 18:27:43.932574       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0331 18:27:43.973306       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0331 18:27:43.973351       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0331 18:27:44.363920       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 18:27:44.363929       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 18:27:44.364054       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0331 18:27:44.364230       1 secure_serving.go:213] Serving securely on [::]:6443
I0331 18:27:44.364266       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0331 18:27:44.364429       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0331 18:27:44.364449       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0331 18:27:44.364493       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 18:27:44.364521       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0331 18:27:44.364616       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0331 18:27:44.364639       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0331 18:27:44.364866       1 controller.go:78] Starting OpenAPI AggregationController
I0331 18:27:44.364932       1 available_controller.go:423] Starting AvailableConditionController
I0331 18:27:44.364947       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0331 18:27:44.364960       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 18:27:44.364998       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0331 18:27:44.365080       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0331 18:27:44.365281       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0331 18:27:44.365315       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0331 18:27:44.365372       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 18:27:44.365661       1 controller.go:116] Starting legacy_token_tracking_controller
I0331 18:27:44.365696       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0331 18:27:44.365745       1 controller.go:134] Starting OpenAPI controller
I0331 18:27:44.365770       1 aggregator.go:164] waiting for initial CRD sync...
I0331 18:27:44.365811       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0331 18:27:44.365964       1 controller.go:85] Starting OpenAPI V3 controller
I0331 18:27:44.366019       1 naming_controller.go:291] Starting NamingConditionController
I0331 18:27:44.366066       1 establishing_controller.go:76] Starting EstablishingController
I0331 18:27:44.366127       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0331 18:27:44.366156       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0331 18:27:44.366188       1 crd_finalizer.go:266] Starting CRDFinalizer
I0331 18:27:44.366231       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 18:27:44.366407       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0331 18:27:44.366432       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
E0331 18:27:44.433289       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0331 18:27:44.439495       1 shared_informer.go:318] Caches are synced for node_authorizer
I0331 18:27:44.464508       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0331 18:27:44.464840       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0331 18:27:44.464876       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0331 18:27:44.465022       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0331 18:27:44.464997       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0331 18:27:44.465781       1 shared_informer.go:318] Caches are synced for configmaps
I0331 18:27:44.466571       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0331 18:27:44.466603       1 aggregator.go:166] initial CRD sync complete...
I0331 18:27:44.466611       1 autoregister_controller.go:141] Starting autoregister controller
I0331 18:27:44.466617       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0331 18:27:44.466624       1 cache.go:39] Caches are synced for autoregister controller
I0331 18:27:44.467909       1 controller.go:624] quota admission added evaluator for: namespaces
I0331 18:27:44.637786       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0331 18:27:45.373084       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0331 18:27:45.379616       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0331 18:27:45.379634       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0331 18:27:45.935807       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0331 18:27:45.984930       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0331 18:27:46.077004       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0331 18:27:46.085252       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.110]
I0331 18:27:46.086683       1 controller.go:624] quota admission added evaluator for: endpoints
I0331 18:27:46.096912       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0331 18:27:46.815894       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0331 18:27:48.024409       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0331 18:27:48.063359       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0331 18:27:48.273181       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0331 18:27:51.865004       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0331 18:27:51.910133       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0331 18:28:09.980841       1 trace.go:236] Trace[1913322098]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a806d34d-f51d-46fd-962e-c9ec6f5ae4ce,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:28:09.435) (total time: 545ms):
Trace[1913322098]: ["GuaranteedUpdate etcd3" audit-id:a806d34d-f51d-46fd-962e-c9ec6f5ae4ce,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 544ms (18:28:09.435)
Trace[1913322098]:  ---"Txn call completed" 543ms (18:28:09.980)]
Trace[1913322098]: [545.024055ms] [545.024055ms] END
I0331 18:28:13.938513       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:28:13.960247       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:28:13.960280       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:28:13.987558       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:28:13.999730       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:28:14.034017       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:28:14.050124       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:28:14.069588       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:28:14.142485       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:28:14.143247       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 18:28:14.170766       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:28:14.170851       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 18:28:14.305213       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:28:14.305283       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:28:14.390472       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:28:14.698452       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:28:14.698541       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:28:14.705018       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:14.890537       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:14.943215       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:14.983735       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:15.002730       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:15.629054       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:15.631053       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:15.707286       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:28:20.857911       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0331 18:28:21.903975       1 trace.go:236] Trace[741377876]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:de4f859a-97f8-45a8-8a8a-64cc9ea3199f,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-zkktl/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:28:21.351) (total time: 552ms):
Trace[741377876]: ["GuaranteedUpdate etcd3" audit-id:de4f859a-97f8-45a8-8a8a-64cc9ea3199f,key:/pods/kube-system/cilium-zkktl,type:*core.Pod,resource:pods 552ms (18:28:21.351)
Trace[741377876]:  ---"Txn call completed" 541ms (18:28:21.901)]
Trace[741377876]: ---"Object stored in database" 542ms (18:28:21.902)
Trace[741377876]: [552.374087ms] [552.374087ms] END
I0331 18:28:22.004274       1 trace.go:236] Trace[62446379]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:481e6c1a-2a7b-4e6c-9c2b-48f193cdb46f,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:28:21.395) (total time: 608ms):
Trace[62446379]: ---"About to write a response" 608ms (18:28:22.003)
Trace[62446379]: [608.710669ms] [608.710669ms] END
I0331 18:28:22.004438       1 trace.go:236] Trace[999338921]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:dca1d13d-bea7-4f72-b9fc-efc88912e682,client:162.253.55.110,protocol:HTTP/2.0,resource:backendtlspolicies,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/backendtlspolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:21.441) (total time: 562ms):
Trace[999338921]: ["List(recursive=true) etcd3" audit-id:dca1d13d-bea7-4f72-b9fc-efc88912e682,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 562ms (18:28:21.441)]
Trace[999338921]: [562.609016ms] [562.609016ms] END
I0331 18:28:22.004482       1 trace.go:236] Trace[1494502246]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:21.441) (total time: 563ms):
Trace[1494502246]: [563.093436ms] [563.093436ms] END
I0331 18:28:22.004497       1 trace.go:236] Trace[16867836]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:21.409) (total time: 595ms):
Trace[16867836]: [595.035971ms] [595.035971ms] END
I0331 18:28:22.004601       1 trace.go:236] Trace[1499602295]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:1e521ef6-7a0b-499b-ad19-8e7a6f1e59f0,client:162.253.55.110,protocol:HTTP/2.0,resource:udproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1alpha2/udproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:21.360) (total time: 644ms):
Trace[1499602295]: ["List(recursive=true) etcd3" audit-id:1e521ef6-7a0b-499b-ad19-8e7a6f1e59f0,key:/gateway.networking.k8s.io/udproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 644ms (18:28:21.360)]
Trace[1499602295]: [644.211817ms] [644.211817ms] END
I0331 18:28:22.005137       1 trace.go:236] Trace[1698164921]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:bea7ddf3-3889-489c-aa85-88ca85179241,client:162.253.55.110,protocol:HTTP/2.0,resource:referencegrants,scope:cluster,url:/apis/gateway.networking.k8s.io/v1beta1/referencegrants,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:21.373) (total time: 631ms):
Trace[1698164921]: ["List(recursive=true) etcd3" audit-id:bea7ddf3-3889-489c-aa85-88ca85179241,key:/gateway.networking.k8s.io/referencegrants,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 631ms (18:28:21.373)]
Trace[1698164921]: [631.429689ms] [631.429689ms] END
I0331 18:28:22.005533       1 trace.go:236] Trace[322720534]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:0aec7b36-b142-43d8-b41c-069112fc6cc6,client:162.253.55.110,protocol:HTTP/2.0,resource:xlistenersets,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xlistenersets,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:21.465) (total time: 539ms):
Trace[322720534]: ["List(recursive=true) etcd3" audit-id:0aec7b36-b142-43d8-b41c-069112fc6cc6,key:/gateway.networking.x-k8s.io/xlistenersets,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 539ms (18:28:21.465)]
Trace[322720534]: [539.595519ms] [539.595519ms] END
I0331 18:28:22.005733       1 trace.go:236] Trace[357064124]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xlistenersets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:21.465) (total time: 540ms):
Trace[357064124]: [540.293436ms] [540.293436ms] END
I0331 18:28:22.006000       1 trace.go:236] Trace[1670185311]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/referencegrants,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:21.373) (total time: 632ms):
Trace[1670185311]: [632.739879ms] [632.739879ms] END
I0331 18:28:23.896804       1 trace.go:236] Trace[1462800454]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2dcefb1b-136b-4b23-8ff6-376f271f5e26,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:28:22.295) (total time: 1601ms):
Trace[1462800454]: ["GuaranteedUpdate etcd3" audit-id:2dcefb1b-136b-4b23-8ff6-376f271f5e26,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1601ms (18:28:22.295)
Trace[1462800454]:  ---"Txn call completed" 1600ms (18:28:23.896)]
Trace[1462800454]: [1.601751781s] [1.601751781s] END
I0331 18:28:23.897052       1 trace.go:236] Trace[837928250]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/clienttrafficpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.427) (total time: 1469ms):
Trace[837928250]: [1.469130502s] [1.469130502s] END
I0331 18:28:23.897106       1 trace.go:236] Trace[350696712]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.482) (total time: 1414ms):
Trace[350696712]: [1.414467089s] [1.414467089s] END
I0331 18:28:23.897216       1 trace.go:236] Trace[1134473241]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:abec3e7a-1673-45db-9b3f-24e4bf325d0e,client:162.253.55.110,protocol:HTTP/2.0,resource:grpcroutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/grpcroutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:22.400) (total time: 1496ms):
Trace[1134473241]: ["List(recursive=true) etcd3" audit-id:abec3e7a-1673-45db-9b3f-24e4bf325d0e,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1496ms (18:28:22.400)]
Trace[1134473241]: [1.496331766s] [1.496331766s] END
I0331 18:28:23.897428       1 trace.go:236] Trace[884845850]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:395e8e1c-a8ec-46c1-8db8-62397446d140,client:162.253.55.110,protocol:HTTP/2.0,resource:gatewayclasses,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/gatewayclasses,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:22.502) (total time: 1394ms):
Trace[884845850]: ["List(recursive=true) etcd3" audit-id:395e8e1c-a8ec-46c1-8db8-62397446d140,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1394ms (18:28:22.502)]
Trace[884845850]: [1.39474724s] [1.39474724s] END
I0331 18:28:23.897681       1 trace.go:236] Trace[254387696]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gateways,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.349) (total time: 1548ms):
Trace[254387696]: [1.54850088s] [1.54850088s] END
I0331 18:28:23.897690       1 trace.go:236] Trace[1129336972]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gateways,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.308) (total time: 1589ms):
Trace[1129336972]: [1.589103326s] [1.589103326s] END
I0331 18:28:23.897793       1 trace.go:236] Trace[907940825]: "Get" accept:application/json, */*,audit-id:031e860e-f72a-4f83-8c02-6bb8f91a729e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:28:22.714) (total time: 1183ms):
Trace[907940825]: ---"About to write a response" 1183ms (18:28:23.897)
Trace[907940825]: [1.183233183s] [1.183233183s] END
I0331 18:28:23.897803       1 trace.go:236] Trace[1798333833]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:31a60ad7-5127-4265-8702-eb86a2aa2e7c,client:162.253.55.110,protocol:HTTP/2.0,resource:gateways,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/gateways,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:22.349) (total time: 1548ms):
Trace[1798333833]: ["List(recursive=true) etcd3" audit-id:31a60ad7-5127-4265-8702-eb86a2aa2e7c,key:/gateway.networking.k8s.io/gateways,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1547ms (18:28:22.349)]
Trace[1798333833]: [1.54802981s] [1.54802981s] END
I0331 18:28:23.897800       1 trace.go:236] Trace[1227864516]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.400) (total time: 1497ms):
Trace[1227864516]: [1.497334819s] [1.497334819s] END
I0331 18:28:23.898258       1 trace.go:236] Trace[1697909896]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gatewayclasses,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.501) (total time: 1395ms):
Trace[1697909896]: [1.395955138s] [1.395955138s] END
I0331 18:28:23.898276       1 trace.go:236] Trace[18555224]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xmeshes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:28:22.447) (total time: 1450ms):
Trace[18555224]: [1.450745313s] [1.450745313s] END
I0331 18:28:23.898354       1 trace.go:236] Trace[799804041]: "Update" accept:application/json, */*,audit-id:e811f2bb-1016-4ebc-8ab9-11af1e2d2937,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:28:22.295) (total time: 1602ms):
Trace[799804041]: ["GuaranteedUpdate etcd3" audit-id:e811f2bb-1016-4ebc-8ab9-11af1e2d2937,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1602ms (18:28:22.295)
Trace[799804041]:  ---"Txn call completed" 1600ms (18:28:23.896)]
Trace[799804041]: [1.602331615s] [1.602331615s] END
I0331 18:28:23.898463       1 trace.go:236] Trace[1027482478]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:d12ee323-8e02-4abb-be08-340077cd5212,client:162.253.55.110,protocol:HTTP/2.0,resource:xmeshes,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xmeshes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:22.448) (total time: 1450ms):
Trace[1027482478]: ["List(recursive=true) etcd3" audit-id:d12ee323-8e02-4abb-be08-340077cd5212,key:/gateway.networking.x-k8s.io/xmeshes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1450ms (18:28:22.448)]
Trace[1027482478]: [1.450195361s] [1.450195361s] END
I0331 18:28:23.899167       1 trace.go:236] Trace[1921962631]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:e91683cf-e562-4ebf-8b3f-9ace4e676145,client:162.253.55.110,protocol:HTTP/2.0,resource:clienttrafficpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/clienttrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:28:22.428) (total time: 1470ms):
Trace[1921962631]: ["List(recursive=true) etcd3" audit-id:e91683cf-e562-4ebf-8b3f-9ace4e676145,key:/gateway.envoyproxy.io/clienttrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1470ms (18:28:22.428)]
Trace[1921962631]: [1.470622216s] [1.470622216s] END
I0331 18:28:27.423437       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:28:27.434209       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:28:27.550297       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:27.682649       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:28:27.867162       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:28.235311       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:28:28.299558       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:28.556516       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
W0331 18:28:30.436406       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0331 18:28:30.436463       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0331 18:28:30.495658       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:31.088494       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:31.477497       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:28:34.959461       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0331 18:28:42.489243       1 trace.go:236] Trace[92122437]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2fb16d76-3d6b-4ae3-9f22-628ecd2a92ca,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods/envoy-gateway-gateway-helm-certgen-5r5hg,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:28:41.312) (total time: 1176ms):
Trace[92122437]: ---"About to write a response" 1176ms (18:28:42.489)
Trace[92122437]: [1.176575662s] [1.176575662s] END
I0331 18:28:42.489249       1 trace.go:236] Trace[273088545]: "Get" accept:application/json, */*,audit-id:cc6d7592-d467-4498-ac42-8a4823a9a786,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:28:41.523) (total time: 965ms):
Trace[273088545]: ---"About to write a response" 965ms (18:28:42.489)
Trace[273088545]: [965.779228ms] [965.779228ms] END
I0331 18:28:42.858656       1 trace.go:236] Trace[1136573316]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6e060b0d-b7f8-4b9a-8061-37e58d7193f0,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:28:41.992) (total time: 866ms):
Trace[1136573316]: ---"About to write a response" 866ms (18:28:42.858)
Trace[1136573316]: [866.137348ms] [866.137348ms] END
I0331 18:28:42.879140       1 trace.go:236] Trace[142886213]: "Get" accept:application/json, */*,audit-id:08b1bfae-a539-431c-85e4-2c7ac57b250d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:28:42.000) (total time: 878ms):
Trace[142886213]: ---"About to write a response" 878ms (18:28:42.878)
Trace[142886213]: [878.591567ms] [878.591567ms] END
I0331 18:28:42.881398       1 trace.go:236] Trace[1838727460]: "Get" accept:application/json, */*,audit-id:97652321-84de-41ab-896a-0a78496b25b1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:28:42.201) (total time: 680ms):
Trace[1838727460]: ---"About to write a response" 680ms (18:28:42.881)
Trace[1838727460]: [680.259035ms] [680.259035ms] END
I0331 18:28:46.439601       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.104.2.20"}
W0331 18:28:46.479994       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.2.20:9443: connect: connection refused
E0331 18:28:46.480049       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.104.2.20:9443: connect: connection refused
I0331 18:28:59.155671       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:59.183906       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0331 18:28:59.221485       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:59.481408       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0331 18:28:59.494710       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.110.57.246"}
I0331 18:28:59.632318       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.105.130.171"}
I0331 18:28:59.642451       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:59.719220       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
W0331 18:29:14.092297       1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.105.130.171:443: connect: connection refused
I0331 18:29:19.083502       1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io
I0331 18:29:20.445768       1 trace.go:236] Trace[2126013694]: "Get" accept:application/json, */*,audit-id:013d1ca3-f48c-4514-95f2-a6d16ace6690,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:19.588) (total time: 856ms):
Trace[2126013694]: ---"About to write a response" 856ms (18:29:20.445)
Trace[2126013694]: [856.965424ms] [856.965424ms] END
I0331 18:29:20.445815       1 trace.go:236] Trace[1306735730]: "Get" accept:application/json, */*,audit-id:3bdbc0bc-2b0d-494f-8623-6559c2b1c2be,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:19.830) (total time: 615ms):
Trace[1306735730]: ---"About to write a response" 615ms (18:29:20.445)
Trace[1306735730]: [615.617958ms] [615.617958ms] END
I0331 18:29:20.445874       1 trace.go:236] Trace[908950668]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:613b4ad6-76b4-4a46-a96d-0d919e67e6c5,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:19.576) (total time: 868ms):
Trace[908950668]: ---"About to write a response" 868ms (18:29:20.445)
Trace[908950668]: [868.81683ms] [868.81683ms] END
I0331 18:29:25.580320       1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io
I0331 18:29:40.140273       1 trace.go:236] Trace[1377126011]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d32c9ca2-d80c-4528-809f-f672fcf3f176,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:29:39.615) (total time: 524ms):
Trace[1377126011]: ["GuaranteedUpdate etcd3" audit-id:d32c9ca2-d80c-4528-809f-f672fcf3f176,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 524ms (18:29:39.616)
Trace[1377126011]:  ---"Txn call completed" 523ms (18:29:40.139)]
Trace[1377126011]: [524.194067ms] [524.194067ms] END
I0331 18:29:40.140890       1 trace.go:236] Trace[1477822492]: "Update" accept:application/json, */*,audit-id:8cbf97eb-2206-49d8-8b7a-c9f4ef980719,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:29:39.615) (total time: 524ms):
Trace[1477822492]: ["GuaranteedUpdate etcd3" audit-id:8cbf97eb-2206-49d8-8b7a-c9f4ef980719,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 524ms (18:29:39.616)
Trace[1477822492]:  ---"Txn call completed" 523ms (18:29:40.140)]
Trace[1477822492]: [524.962755ms] [524.962755ms] END
I0331 18:29:51.730732       1 trace.go:236] Trace[1522956320]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d6f5d06c-ed51-44d8-ae44-926084dec3ce,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:29:51.109) (total time: 621ms):
Trace[1522956320]: ["GuaranteedUpdate etcd3" audit-id:d6f5d06c-ed51-44d8-ae44-926084dec3ce,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 621ms (18:29:51.109)
Trace[1522956320]:  ---"Txn call completed" 620ms (18:29:51.730)]
Trace[1522956320]: [621.537562ms] [621.537562ms] END
I0331 18:29:51.730769       1 trace.go:236] Trace[1876147471]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a0ee514-fc1b-43f3-a316-0582923ed466,client:162.253.55.110,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/ingress-nginx/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (31-Mar-2026 18:29:50.375) (total time: 1355ms):
Trace[1876147471]: ["Create etcd3" audit-id:0a0ee514-fc1b-43f3-a316-0582923ed466,key:/events/ingress-nginx/ingress-nginx-admission-create-7cbxh.18a20088ba0944d3,type:*core.Event,resource:events 1354ms (18:29:50.376)
Trace[1876147471]:  ---"Txn call succeeded" 1354ms (18:29:51.730)]
Trace[1876147471]: [1.355439773s] [1.355439773s] END
I0331 18:29:51.957307       1 trace.go:236] Trace[805842859]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:20036e25-3f5b-43e3-9ace-0047fe061cb6,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:50.490) (total time: 1467ms):
Trace[805842859]: ---"About to write a response" 1467ms (18:29:51.957)
Trace[805842859]: [1.467207059s] [1.467207059s] END
I0331 18:29:51.957710       1 trace.go:236] Trace[11645682]: "Get" accept:application/json, */*,audit-id:6dd543e1-9d2b-45b3-8968-f8f11b53b54d,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:50.728) (total time: 1228ms):
Trace[11645682]: ---"About to write a response" 1228ms (18:29:51.957)
Trace[11645682]: [1.228721549s] [1.228721549s] END
I0331 18:29:51.957825       1 trace.go:236] Trace[86448155]: "Get" accept:application/json, */*,audit-id:f8e170bc-aa61-4ced-9b37-6bae63e8b43c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:50.630) (total time: 1327ms):
Trace[86448155]: ---"About to write a response" 1327ms (18:29:51.957)
Trace[86448155]: [1.32744309s] [1.32744309s] END
I0331 18:29:51.957956       1 trace.go:236] Trace[1637210919]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5d1374d6-531a-42d5-8375-148b79a8e0d3,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/ingress-nginx/pods/ingress-nginx-admission-create-7cbxh,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:29:50.599) (total time: 1358ms):
Trace[1637210919]: ---"About to write a response" 1358ms (18:29:51.957)
Trace[1637210919]: [1.358828273s] [1.358828273s] END
I0331 18:29:51.958794       1 trace.go:236] Trace[571842133]: "Get" accept:application/json, */*,audit-id:c61d2102-65df-4b08-b1f3-2dfdd832c6a8,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:51.143) (total time: 814ms):
Trace[571842133]: ---"About to write a response" 814ms (18:29:51.958)
Trace[571842133]: [814.924541ms] [814.924541ms] END
I0331 18:29:56.315112       1 trace.go:236] Trace[802584926]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1f60d20a-46af-4269-9724-9c68a30e9eed,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:55.808) (total time: 506ms):
Trace[802584926]: ["GuaranteedUpdate etcd3" audit-id:1f60d20a-46af-4269-9724-9c68a30e9eed,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 505ms (18:29:55.809)
Trace[802584926]:  ---"Txn call completed" 505ms (18:29:56.314)]
Trace[802584926]: [506.122281ms] [506.122281ms] END
I0331 18:29:57.837994       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.104.206.81"}
I0331 18:29:58.772002       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.109.94.87"}
I0331 18:29:58.772327       1 trace.go:236] Trace[1732493741]: "Create" accept:application/json,audit-id:b774e08e-e61f-43bf-93df-b4e5dd239483,client:162.253.55.110,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:29:57.748) (total time: 1024ms):
Trace[1732493741]: ["Create etcd3" audit-id:b774e08e-e61f-43bf-93df-b4e5dd239483,key:/services/specs/ingress-nginx/ingress-nginx-defaultbackend,type:*core.Service,resource:services 529ms (18:29:58.242)
Trace[1732493741]:  ---"Txn call succeeded" 528ms (18:29:58.771)]
Trace[1732493741]: [1.02420057s] [1.02420057s] END
I0331 18:29:59.111646       1 trace.go:236] Trace[321296066]: "GuaranteedUpdate etcd3" audit-id:,key:/ranges/serviceips,type:*core.RangeAllocation,resource:serviceipallocations (31-Mar-2026 18:29:58.242) (total time: 868ms):
Trace[321296066]: ---"Txn call completed" 866ms (18:29:59.111)
Trace[321296066]: [868.90096ms] [868.90096ms] END
I0331 18:29:59.111967       1 trace.go:236] Trace[1920797506]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54466132-8854-4bd4-b657-5ffffd904b83,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:58.318) (total time: 793ms):
Trace[1920797506]: ["GuaranteedUpdate etcd3" audit-id:54466132-8854-4bd4-b657-5ffffd904b83,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 793ms (18:29:58.318)
Trace[1920797506]:  ---"Txn call completed" 792ms (18:29:59.111)]
Trace[1920797506]: [793.898741ms] [793.898741ms] END
I0331 18:29:59.118005       1 trace.go:236] Trace[1255126129]: "Get" accept:application/json, */*,audit-id:0e017804-68af-495d-bc2d-f3f1c493bc13,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:58.513) (total time: 604ms):
Trace[1255126129]: ---"About to write a response" 604ms (18:29:59.117)
Trace[1255126129]: [604.936715ms] [604.936715ms] END
I0331 18:29:59.118146       1 trace.go:236] Trace[640148815]: "Get" accept:application/json, */*,audit-id:00915765-725c-41c0-94a1-eca6a1297a3c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:58.512) (total time: 605ms):
Trace[640148815]: ---"About to write a response" 605ms (18:29:59.118)
Trace[640148815]: [605.923218ms] [605.923218ms] END
I0331 18:29:59.118371       1 trace.go:236] Trace[807655700]: "Get" accept:application/json, */*,audit-id:57c4c17a-90ec-421f-8fb1-79e0602e8823,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:58.513) (total time: 604ms):
Trace[807655700]: ---"About to write a response" 604ms (18:29:59.118)
Trace[807655700]: [604.891344ms] [604.891344ms] END
I0331 18:29:59.118500       1 trace.go:236] Trace[133502324]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7dedd3f8-f29e-4878-8357-a83c3d231c49,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:58.513) (total time: 605ms):
Trace[133502324]: ---"About to write a response" 605ms (18:29:59.118)
Trace[133502324]: [605.235891ms] [605.235891ms] END
I0331 18:29:59.123306       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.96.180.26"}
I0331 18:29:59.123476       1 trace.go:236] Trace[1888333332]: "Create" accept:application/json,audit-id:ae43463b-09cb-4e1e-bc26-5659228a0cf0,client:162.253.55.110,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:29:57.748) (total time: 1375ms):
Trace[1888333332]: [1.375254155s] [1.375254155s] END
I0331 18:30:00.041489       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.96.200.122"}
I0331 18:30:00.041828       1 trace.go:236] Trace[934587445]: "Create" accept:application/json,audit-id:3ef867cd-6449-4428-bcc6-8b6140354fc4,client:162.253.55.110,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/ingress-nginx/services,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:29:57.748) (total time: 2293ms):
Trace[934587445]: [2.293660379s] [2.293660379s] END
I0331 18:30:03.317071       1 trace.go:236] Trace[1187931695]: "Update" accept:application/json, */*,audit-id:07916201-2a38-4fe4-9aac-d43526b3a69c,client:162.253.55.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/ingress-nginx/secrets/sh.helm.release.v1.ingress-nginx.v1,user-agent:Helm/3.11.2,verb:PUT (31-Mar-2026 18:30:02.680) (total time: 636ms):
Trace[1187931695]: ["GuaranteedUpdate etcd3" audit-id:07916201-2a38-4fe4-9aac-d43526b3a69c,key:/secrets/ingress-nginx/sh.helm.release.v1.ingress-nginx.v1,type:*core.Secret,resource:secrets 632ms (18:30:02.684)
Trace[1187931695]:  ---"Txn call completed" 625ms (18:30:03.311)]
Trace[1187931695]: [636.519462ms] [636.519462ms] END
I0331 18:30:04.459194       1 trace.go:236] Trace[582792739]: "Create" accept:application/json,audit-id:e7c8d9f8-4ebb-44e7-aff0-d7eee6af6468,client:162.253.55.110,protocol:HTTP/2.0,resource:clusterrolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:30:03.320) (total time: 1138ms):
Trace[582792739]: ["Create etcd3" audit-id:e7c8d9f8-4ebb-44e7-aff0-d7eee6af6468,key:/clusterrolebindings/ingress-nginx-admission,type:*rbac.ClusterRoleBinding,resource:clusterrolebindings.rbac.authorization.k8s.io 1137ms (18:30:03.321)
Trace[582792739]:  ---"Txn call succeeded" 1137ms (18:30:04.458)]
Trace[582792739]: [1.138570667s] [1.138570667s] END
I0331 18:30:04.459332       1 trace.go:236] Trace[293991946]: "Create" accept:application/json, */*,audit-id:60c90145-9148-4800-9ce2-25c64f86b3a5,client:162.253.55.110,protocol:HTTP/2.0,resource:ciliumidentities,scope:resource,url:/apis/cilium.io/v2/ciliumidentities,user-agent:cilium-agent/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (31-Mar-2026 18:30:03.262) (total time: 1196ms):
Trace[293991946]: ["Create etcd3" audit-id:60c90145-9148-4800-9ce2-25c64f86b3a5,key:/cilium.io/ciliumidentities/58764,type:*unstructured.Unstructured,resource:ciliumidentities.cilium.io 1195ms (18:30:03.264)
Trace[293991946]:  ---"Txn call succeeded" 1194ms (18:30:04.458)]
Trace[293991946]: [1.196415475s] [1.196415475s] END
I0331 18:30:12.345681       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.365174       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.383517       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.399800       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.418054       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.434144       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.450824       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.471303       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.510005       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.524831       1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager
I0331 18:30:12.547935       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.570850       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:12.590744       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:13.895239       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:30:17.212906       1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io
I0331 18:30:17.219429       1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy
I0331 18:30:17.290513       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.103.218.182"}
I0331 18:30:17.317640       1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io
I0331 18:30:19.641970       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:30:19.684891       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:30:20.359204       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager
I0331 18:30:20.359245       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager
I0331 18:30:20.359279       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:30:26.705726       1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com
I0331 18:30:33.901727       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.98.86.85"}
I0331 18:30:34.165459       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0331 18:30:34.428411       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.98.37.108"}
I0331 18:30:34.443081       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.103.148.16"}
I0331 18:30:38.033675       1 trace.go:236] Trace[297229613]: "Get" accept:application/json, */*,audit-id:0f92d80a-26da-4e84-9aa0-f58e9a2e1a6e,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:30:36.773) (total time: 1259ms):
Trace[297229613]: ---"About to write a response" 1259ms (18:30:38.033)
Trace[297229613]: [1.259960147s] [1.259960147s] END
I0331 18:30:38.033905       1 trace.go:236] Trace[206666574]: "Get" accept:application/json, */*,audit-id:7ae93a73-67f3-4859-bc08-427a4a16ff0a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:30:37.150) (total time: 883ms):
Trace[206666574]: ---"About to write a response" 883ms (18:30:38.033)
Trace[206666574]: [883.183703ms] [883.183703ms] END
I0331 18:30:38.034104       1 trace.go:236] Trace[1466596937]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1864aff1-bd56-4b54-87dc-2c5b552a6dff,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:37.421) (total time: 613ms):
Trace[1466596937]: ["GuaranteedUpdate etcd3" audit-id:1864aff1-bd56-4b54-87dc-2c5b552a6dff,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 612ms (18:30:37.421)
Trace[1466596937]:  ---"Txn call completed" 611ms (18:30:38.033)]
Trace[1466596937]: [613.001933ms] [613.001933ms] END
I0331 18:30:38.034151       1 trace.go:236] Trace[1136021182]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:487cba9d-def2-4fe3-a0c7-8205081fc700,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d3134a51-ecf3-4913-9974-af68a71e2345,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:30:36.805) (total time: 1228ms):
Trace[1136021182]: ---"About to write a response" 1228ms (18:30:38.033)
Trace[1136021182]: [1.228920014s] [1.228920014s] END
I0331 18:30:38.034376       1 trace.go:236] Trace[1463281982]: "Get" accept:application/json, */*,audit-id:3733f479-ada8-484a-bdd8-729549073c76,client:10.0.0.99,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d3134a51-ecf3-4913-9974-af68a71e2345,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:30:37.374) (total time: 659ms):
Trace[1463281982]: ---"About to write a response" 658ms (18:30:38.033)
Trace[1463281982]: [659.349564ms] [659.349564ms] END
I0331 18:30:38.034409       1 trace.go:236] Trace[982183008]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2ed9c7a5-bd89-4e39-af40-0b09d7d2eadb,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:30:37.212) (total time: 821ms):
Trace[982183008]: ---"About to write a response" 821ms (18:30:38.034)
Trace[982183008]: [821.828282ms] [821.828282ms] END
I0331 18:30:38.034455       1 trace.go:236] Trace[1780106984]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:474a6632-5509-4139-8790-9b303d62855e,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:30:37.057) (total time: 976ms):
Trace[1780106984]: ---"About to write a response" 976ms (18:30:38.034)
Trace[1780106984]: [976.591531ms] [976.591531ms] END
I0331 18:30:38.034467       1 trace.go:236] Trace[654366325]: "Get" accept:application/json, */*,audit-id:749cd788-b1e6-48e0-81e6-4970d3258026,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:30:37.257) (total time: 777ms):
Trace[654366325]: ---"About to write a response" 777ms (18:30:38.034)
Trace[654366325]: [777.242622ms] [777.242622ms] END
I0331 18:30:38.034465       1 trace.go:236] Trace[1838235102]: "Get" accept:application/json, */*,audit-id:00b622d5-bc8f-444e-8f8b-b006a2983201,client:10.0.0.76,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:30:37.048) (total time: 985ms):
Trace[1838235102]: ---"About to write a response" 985ms (18:30:38.034)
Trace[1838235102]: [985.5795ms] [985.5795ms] END
I0331 18:30:38.034457       1 trace.go:236] Trace[1850218493]: "Get" accept:application/json, */*,audit-id:fcd73d9e-bef4-4f76-b40c-c2ca5411db40,client:10.0.0.182,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (31-Mar-2026 18:30:37.112) (total time: 922ms):
Trace[1850218493]: ---"About to write a response" 922ms (18:30:38.034)
Trace[1850218493]: [922.209312ms] [922.209312ms] END
I0331 18:30:38.035804       1 trace.go:236] Trace[1733957308]: "Get" accept:application/json,audit-id:d1889e2c-6519-424b-a902-97415e71f1be,client:162.253.55.110,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:30:36.780) (total time: 1254ms):
Trace[1733957308]: ---"About to write a response" 1254ms (18:30:38.035)
Trace[1733957308]: [1.254811558s] [1.254811558s] END
I0331 18:30:38.047423       1 trace.go:236] Trace[817365888]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9dfe0869-840b-4c27-a936-756caf73adfd,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:37.468) (total time: 579ms):
Trace[817365888]: ["GuaranteedUpdate etcd3" audit-id:9dfe0869-840b-4c27-a936-756caf73adfd,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 578ms (18:30:37.468)
Trace[817365888]:  ---"Txn call completed" 577ms (18:30:38.047)]
Trace[817365888]: [579.096223ms] [579.096223ms] END
I0331 18:30:52.685328       1 trace.go:236] Trace[215654715]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ba865aff-8cbc-4c2a-843a-103c787cb18c,client:10.0.0.65,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:52.086) (total time: 598ms):
Trace[215654715]: ["GuaranteedUpdate etcd3" audit-id:ba865aff-8cbc-4c2a-843a-103c787cb18c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 598ms (18:30:52.086)
Trace[215654715]:  ---"Txn call completed" 597ms (18:30:52.685)]
Trace[215654715]: [598.809016ms] [598.809016ms] END
I0331 18:30:52.685598       1 trace.go:236] Trace[727700027]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e29df83e-caf0-4ee8-809f-48055a7816ed,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:52.089) (total time: 596ms):
Trace[727700027]: ["GuaranteedUpdate etcd3" audit-id:e29df83e-caf0-4ee8-809f-48055a7816ed,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 596ms (18:30:52.089)
Trace[727700027]:  ---"Txn call completed" 595ms (18:30:52.685)]
Trace[727700027]: [596.39527ms] [596.39527ms] END
I0331 18:30:57.280239       1 trace.go:236] Trace[1439364191]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ef4c7192-e805-4235-aafe-272e404a655a,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:30:56.737) (total time: 542ms):
Trace[1439364191]: ---"About to write a response" 542ms (18:30:57.280)
Trace[1439364191]: [542.234677ms] [542.234677ms] END
I0331 18:30:57.955888       1 trace.go:236] Trace[1743387931]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:adf3ee60-dcd9-4c53-b593-0aadce08b896,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:57.107) (total time: 848ms):
Trace[1743387931]: ["GuaranteedUpdate etcd3" audit-id:adf3ee60-dcd9-4c53-b593-0aadce08b896,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 847ms (18:30:57.107)
Trace[1743387931]:  ---"Txn call completed" 846ms (18:30:57.955)]
Trace[1743387931]: [848.013693ms] [848.013693ms] END
I0331 18:30:58.074780       1 trace.go:236] Trace[1167166999]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:762ba8a7-f348-41d3-8d4a-da0b25f9b831,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (31-Mar-2026 18:30:57.160) (total time: 914ms):
Trace[1167166999]: ["GuaranteedUpdate etcd3" audit-id:762ba8a7-f348-41d3-8d4a-da0b25f9b831,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 914ms (18:30:57.160)
Trace[1167166999]:  ---"Txn call completed" 913ms (18:30:58.074)]
Trace[1167166999]: [914.304637ms] [914.304637ms] END
I0331 18:30:58.075001       1 trace.go:236] Trace[983824773]: "Get" accept:application/json, */*,audit-id:e7aadd39-85c7-4cfc-85a8-da2a075b4a18,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:30:57.110) (total time: 964ms):
Trace[983824773]: ---"About to write a response" 964ms (18:30:58.074)
Trace[983824773]: [964.722211ms] [964.722211ms] END
I0331 18:30:58.075006       1 trace.go:236] Trace[1076936290]: "Get" accept:application/json, */*,audit-id:c8bbc118-6e70-4d90-81b8-f63572ba6d76,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:30:57.110) (total time: 964ms):
Trace[1076936290]: ---"About to write a response" 964ms (18:30:58.074)
Trace[1076936290]: [964.358043ms] [964.358043ms] END
I0331 18:30:58.075231       1 trace.go:236] Trace[605876084]: "Get" accept:application/json, */*,audit-id:cb99e1db-3b20-4da2-92f1-61df6fd801a8,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:30:57.111) (total time: 964ms):
Trace[605876084]: ---"About to write a response" 964ms (18:30:58.075)
Trace[605876084]: [964.132597ms] [964.132597ms] END
I0331 18:30:58.075473       1 trace.go:236] Trace[1361918333]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:18c390e5-66dd-4f05-9b02-e63b36241ae3,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:30:57.282) (total time: 792ms):
Trace[1361918333]: ["GuaranteedUpdate etcd3" audit-id:18c390e5-66dd-4f05-9b02-e63b36241ae3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 792ms (18:30:57.282)
Trace[1361918333]:  ---"Txn call completed" 790ms (18:30:58.074)]
Trace[1361918333]: [792.685112ms] [792.685112ms] END
I0331 18:30:58.075509       1 trace.go:236] Trace[572487501]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:47d251ce-dcae-406a-96d0-2954fb308d7a,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:30:57.109) (total time: 965ms):
Trace[572487501]: ---"About to write a response" 965ms (18:30:58.075)
Trace[572487501]: [965.858809ms] [965.858809ms] END
I0331 18:31:36.775297       1 trace.go:236] Trace[1700279873]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:27db0f95-547f-49ad-950c-e33cf5fe4dfc,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:31:36.096) (total time: 678ms):
Trace[1700279873]: ["GuaranteedUpdate etcd3" audit-id:27db0f95-547f-49ad-950c-e33cf5fe4dfc,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 678ms (18:31:36.096)
Trace[1700279873]:  ---"Txn call completed" 677ms (18:31:36.774)]
Trace[1700279873]: [678.545904ms] [678.545904ms] END
I0331 18:31:37.962508       1 trace.go:236] Trace[2116694737]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.110,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:31:36.083) (total time: 1878ms):
Trace[2116694737]: ---"Transaction prepared" 1377ms (18:31:37.483)
Trace[2116694737]: ---"Txn call completed" 479ms (18:31:37.962)
Trace[2116694737]: [1.878474128s] [1.878474128s] END
I0331 18:31:37.962664       1 trace.go:236] Trace[1578444880]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:aa5df747-e9c4-4213-b421-35f08bc4bfa5,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:31:36.266) (total time: 1696ms):
Trace[1578444880]: ---"About to write a response" 1696ms (18:31:37.962)
Trace[1578444880]: [1.696559278s] [1.696559278s] END
I0331 18:31:37.962765       1 trace.go:236] Trace[1614826799]: "Get" accept:application/json, */*,audit-id:d2e1581b-5090-48a4-9e81-064dd120e79e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:31:36.290) (total time: 1672ms):
Trace[1614826799]: ---"About to write a response" 1671ms (18:31:37.962)
Trace[1614826799]: [1.672132599s] [1.672132599s] END
I0331 18:31:37.962821       1 trace.go:236] Trace[1767928927]: "Get" accept:application/json, */*,audit-id:b202706a-e395-4a8c-8748-00808a100b21,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:31:36.474) (total time: 1488ms):
Trace[1767928927]: ---"About to write a response" 1487ms (18:31:37.962)
Trace[1767928927]: [1.488018208s] [1.488018208s] END
I0331 18:31:37.963037       1 trace.go:236] Trace[1737292330]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:478c52b9-a162-4332-94d1-e9054b64099b,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:31:36.473) (total time: 1489ms):
Trace[1737292330]: ---"About to write a response" 1489ms (18:31:37.962)
Trace[1737292330]: [1.4898479s] [1.4898479s] END
I0331 18:31:37.963193       1 trace.go:236] Trace[1257202874]: "Get" accept:application/json, */*,audit-id:73e11ed4-ba05-47b1-ab6b-3243235fcfc5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:31:36.468) (total time: 1494ms):
Trace[1257202874]: ---"About to write a response" 1493ms (18:31:37.962)
Trace[1257202874]: [1.494174981s] [1.494174981s] END
I0331 18:31:37.964052       1 trace.go:236] Trace[1216290561]: "Get" accept:application/json,audit-id:76c0d131-2d9c-4fe3-b1a4-5df211d074e2,client:162.253.55.110,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:31:36.847) (total time: 1116ms):
Trace[1216290561]: ---"About to write a response" 1116ms (18:31:37.963)
Trace[1216290561]: [1.116971881s] [1.116971881s] END
I0331 18:32:33.255676       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.110.199.242"}
I0331 18:32:35.837396       1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.98.199.251"}
I0331 18:32:35.850770       1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.103.160.35"}
I0331 18:32:42.601511       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.110.233.197"}
I0331 18:32:42.609167       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.101.78.84"}
I0331 18:32:47.814823       1 trace.go:236] Trace[800159792]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:63a35ccf-b218-4ff5-8277-a4b666742c50,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:32:47.075) (total time: 739ms):
Trace[800159792]: ["GuaranteedUpdate etcd3" audit-id:63a35ccf-b218-4ff5-8277-a4b666742c50,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 738ms (18:32:47.075)
Trace[800159792]:  ---"Txn call completed" 737ms (18:32:47.814)]
Trace[800159792]: [739.11199ms] [739.11199ms] END
I0331 18:33:21.472863       1 trace.go:236] Trace[1455590052]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:253990a5-5ff9-4980-aabc-1e300c8f4062,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (31-Mar-2026 18:33:20.944) (total time: 528ms):
Trace[1455590052]: ["GuaranteedUpdate etcd3" audit-id:253990a5-5ff9-4980-aabc-1e300c8f4062,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 528ms (18:33:20.944)
Trace[1455590052]:  ---"Txn call completed" 527ms (18:33:21.472)]
Trace[1455590052]: [528.1519ms] [528.1519ms] END
I0331 18:33:22.086350       1 trace.go:236] Trace[1571193824]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:74a0219b-d7ec-43c9-81c3-4f4cad22c1db,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:33:21.536) (total time: 549ms):
Trace[1571193824]: ["GuaranteedUpdate etcd3" audit-id:74a0219b-d7ec-43c9-81c3-4f4cad22c1db,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 549ms (18:33:21.537)
Trace[1571193824]:  ---"Txn call completed" 547ms (18:33:22.086)]
Trace[1571193824]: [549.502969ms] [549.502969ms] END
I0331 18:33:22.086443       1 trace.go:236] Trace[1188195276]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:640b3e46-2724-4c50-bef1-23ed5b5ddd99,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:33:21.170) (total time: 915ms):
Trace[1188195276]: ---"About to write a response" 915ms (18:33:22.086)
Trace[1188195276]: [915.814028ms] [915.814028ms] END
I0331 18:33:22.086450       1 trace.go:236] Trace[2128675423]: "Get" accept:application/json, */*,audit-id:1bd3632b-0f51-4a13-afaa-2944f6ca4faa,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:33:21.176) (total time: 910ms):
Trace[2128675423]: ---"About to write a response" 910ms (18:33:22.086)
Trace[2128675423]: [910.263359ms] [910.263359ms] END
I0331 18:33:22.086453       1 trace.go:236] Trace[652384337]: "Get" accept:application/json, */*,audit-id:0669aeda-b36e-4ce2-b5c1-d5027d409e46,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:33:21.171) (total time: 914ms):
Trace[652384337]: ---"About to write a response" 914ms (18:33:22.086)
Trace[652384337]: [914.535948ms] [914.535948ms] END
I0331 18:33:22.093014       1 trace.go:236] Trace[987723581]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f9caec3c-9e44-4d56-8b87-94e95e0d529d,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:33:21.060) (total time: 1032ms):
Trace[987723581]: ---"About to write a response" 1032ms (18:33:22.092)
Trace[987723581]: [1.032400215s] [1.032400215s] END
I0331 18:33:22.093445       1 trace.go:236] Trace[767622187]: "Get" accept:application/json, */*,audit-id:788d2885-616b-4e16-9bfc-4d7538bd5838,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:33:21.171) (total time: 921ms):
Trace[767622187]: ---"About to write a response" 921ms (18:33:22.093)
Trace[767622187]: [921.43132ms] [921.43132ms] END
I0331 18:33:22.098050       1 trace.go:236] Trace[2069105999]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eee680d3-191d-4316-a4f5-259b31a3845a,client:162.253.55.110,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/valkey-node-0.18a200b52e2e2591,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:33:21.303) (total time: 794ms):
Trace[2069105999]: ["GuaranteedUpdate etcd3" audit-id:eee680d3-191d-4316-a4f5-259b31a3845a,key:/events/openstack/valkey-node-0.18a200b52e2e2591,type:*core.Event,resource:events 794ms (18:33:21.303)
Trace[2069105999]:  ---"initial value restored" 788ms (18:33:22.092)]
Trace[2069105999]: [794.121012ms] [794.121012ms] END
I0331 18:35:16.648551       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0331 18:35:21.259364       1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager
I0331 18:35:21.301707       1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager
I0331 18:35:25.347895       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:35:25.367206       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:35:25.389737       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:35:25.402864       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:35:25.417368       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:35:25.429661       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:35:25.449858       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:35:27.181844       1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io
I0331 18:35:38.282666       1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io
I0331 18:35:59.084406       1 trace.go:236] Trace[2036185342]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:977dae38-5b0f-4ac3-9c53-a6d242e3dbcc,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:35:58.578) (total time: 506ms):
Trace[2036185342]: ["GuaranteedUpdate etcd3" audit-id:977dae38-5b0f-4ac3-9c53-a6d242e3dbcc,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 505ms (18:35:58.578)
Trace[2036185342]:  ---"Txn call completed" 504ms (18:35:59.084)]
Trace[2036185342]: [506.216647ms] [506.216647ms] END
I0331 18:35:59.400405       1 trace.go:236] Trace[1917130645]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cb2cdbb8-92d3-486d-88dc-21c032598216,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:35:58.766) (total time: 633ms):
Trace[1917130645]: ["GuaranteedUpdate etcd3" audit-id:cb2cdbb8-92d3-486d-88dc-21c032598216,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 633ms (18:35:58.766)
Trace[1917130645]:  ---"Txn call completed" 631ms (18:35:59.399)]
Trace[1917130645]: [633.968818ms] [633.968818ms] END
I0331 18:35:59.400444       1 trace.go:236] Trace[1222681613]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:4bfa1317-d905-46b0-97cf-c2e5184acf3b,client:162.253.55.110,protocol:HTTP/2.0,resource:passwords,scope:resource,url:/apis/secretgen.k14s.io/v1alpha1/namespaces/monitoring/passwords/kube-prometheus-stack-alertmanager-client-secret,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (31-Mar-2026 18:35:58.800) (total time: 599ms):
Trace[1222681613]: ---"About to write a response" 599ms (18:35:59.399)
Trace[1222681613]: [599.705709ms] [599.705709ms] END
I0331 18:35:59.400533       1 trace.go:236] Trace[44753878]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:50b5bc4f-4c85-470a-9b5a-13ca7c001eee,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:35:58.853) (total time: 546ms):
Trace[44753878]: ["GuaranteedUpdate etcd3" audit-id:50b5bc4f-4c85-470a-9b5a-13ca7c001eee,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 546ms (18:35:58.853)
Trace[44753878]:  ---"Txn call completed" 544ms (18:35:59.399)]
Trace[44753878]: [546.682382ms] [546.682382ms] END
I0331 18:36:19.239488       1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev
I0331 18:36:34.296175       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:36:34.804241       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:34.816300       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:34.841162       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:35.097103       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:36:35.344502       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:35.344669       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:35.511833       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:36:35.535450       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:36:35.625875       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:37:16.941824       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.104.45.147"}
I0331 18:37:16.951235       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.101.65.1"}
I0331 18:37:16.958856       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.101.176.180"}
I0331 18:37:16.974548       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.109.227.252"}
I0331 18:37:16.980397       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.101.93.85"}
I0331 18:37:16.986835       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.111.80.21"}
I0331 18:37:17.031296       1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com
I0331 18:37:17.041040       1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com
I0331 18:37:17.111882       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0331 18:37:17.111884       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0331 18:37:17.133950       1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com
I0331 18:37:17.162928       1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com
W0331 18:37:17.171819       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.171849       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.172141       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.172179       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.172193       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.172223       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173012       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173062       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173096       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173113       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173063       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173130       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173142       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173154       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173176       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173286       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173350       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173397       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173353       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173420       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173477       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.173546       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.173987       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.174010       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.174348       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.174403       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.174377       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.174448       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.175303       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.175380       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
W0331 18:37:17.177187       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
E0331 18:37:17.177228       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.109.227.252:443: connect: connection refused
I0331 18:37:29.030080       1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.107.228.254"}
I0331 18:37:29.040634       1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.110.180.71"}
I0331 18:37:31.913100       1 trace.go:236] Trace[771841161]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b1ba66a-b227-4516-b615-cac6eb6b72a7,client:162.253.55.110,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:37:31.264) (total time: 648ms):
Trace[771841161]: ---"About to write a response" 648ms (18:37:31.912)
Trace[771841161]: [648.439248ms] [648.439248ms] END
I0331 18:37:31.973904       1 trace.go:236] Trace[638317]: "Create" accept:application/json,audit-id:19bd5a52-2aff-43ad-ad51-fe408431dfc0,client:162.253.55.110,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:37:31.229) (total time: 743ms):
Trace[638317]: ["Create etcd3" audit-id:19bd5a52-2aff-43ad-ad51-fe408431dfc0,key:/namespaces/monitoring,type:*core.Namespace,resource:namespaces 743ms (18:37:31.230)
Trace[638317]:  ---"Txn call succeeded" 633ms (18:37:31.864)]
Trace[638317]: ---"Write to database call failed" len:150,err:namespaces "monitoring" already exists 108ms (18:37:31.973)
Trace[638317]: [743.967537ms] [743.967537ms] END
I0331 18:37:31.974169       1 trace.go:236] Trace[1037143606]: "Get" accept:application/json, */*,audit-id:ef42e0bb-5def-4ea7-acb9-ee2510f81a2d,client:10.0.0.99,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-8daef7bb-a237-4d5a-9356-c3069a7df1ca,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:37:31.327) (total time: 646ms):
Trace[1037143606]: ---"About to write a response" 646ms (18:37:31.973)
Trace[1037143606]: [646.799789ms] [646.799789ms] END
I0331 18:37:31.979125       1 trace.go:236] Trace[185594138]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3f3f0e23-a764-480a-a08e-c4f7db5a57c9,client:162.253.55.110,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/monitoring/serviceaccounts/kube-prometheus-stack-prometheus/token,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (31-Mar-2026 18:37:31.365) (total time: 613ms):
Trace[185594138]: ---"Write to database call succeeded" len:177 612ms (18:37:31.978)
Trace[185594138]: [613.216095ms] [613.216095ms] END
I0331 18:37:34.563265       1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.98.176.80"}
I0331 18:37:37.499016       1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.98.128.135"}
I0331 18:37:42.486666       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.103.177.14"}
I0331 18:37:43.428800       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.99.124.25"}
I0331 18:37:50.154163       1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com
I0331 18:37:50.321104       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.105.230.56"}
I0331 18:38:09.106799       1 trace.go:236] Trace[521708620]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7a45eee9-7b72-41c4-a347-aef0e4a1b7c4,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/prometheus-kube-prometheus-stack-prometheus-0/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:38:08.304) (total time: 802ms):
Trace[521708620]: ["GuaranteedUpdate etcd3" audit-id:7a45eee9-7b72-41c4-a347-aef0e4a1b7c4,key:/pods/monitoring/prometheus-kube-prometheus-stack-prometheus-0,type:*core.Pod,resource:pods 802ms (18:38:08.304)
Trace[521708620]:  ---"Txn call completed" 789ms (18:38:09.101)]
Trace[521708620]: ---"Object stored in database" 791ms (18:38:09.103)
Trace[521708620]: [802.590927ms] [802.590927ms] END
I0331 18:38:09.278694       1 trace.go:236] Trace[541015371]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:733cf023-87b9-4f75-96da-76000b1e03fb,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:38:08.595) (total time: 683ms):
Trace[541015371]: ["GuaranteedUpdate etcd3" audit-id:733cf023-87b9-4f75-96da-76000b1e03fb,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 683ms (18:38:08.595)
Trace[541015371]:  ---"Txn call completed" 682ms (18:38:09.278)]
Trace[541015371]: [683.537578ms] [683.537578ms] END
I0331 18:38:09.279190       1 trace.go:236] Trace[625287324]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:976a8311-ebb3-45c1-852a-f94969728bb3,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:38:08.613) (total time: 665ms):
Trace[625287324]: ["GuaranteedUpdate etcd3" audit-id:976a8311-ebb3-45c1-852a-f94969728bb3,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 665ms (18:38:08.613)
Trace[625287324]:  ---"Txn call completed" 664ms (18:38:09.279)]
Trace[625287324]: [665.843294ms] [665.843294ms] END
I0331 18:38:09.279275       1 trace.go:236] Trace[1225956882]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6e1a2847-906e-44f1-91b6-b451683a31a0,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:38:08.558) (total time: 721ms):
Trace[1225956882]: ["GuaranteedUpdate etcd3" audit-id:6e1a2847-906e-44f1-91b6-b451683a31a0,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 720ms (18:38:08.558)
Trace[1225956882]:  ---"Txn call completed" 719ms (18:38:09.279)]
Trace[1225956882]: [721.110635ms] [721.110635ms] END
I0331 18:38:09.279275       1 trace.go:236] Trace[2033679851]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f8516621-0699-4ede-9e80-b3d40446c8fc,client:162.253.55.110,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:38:08.382) (total time: 896ms):
Trace[2033679851]: ---"About to write a response" 896ms (18:38:09.279)
Trace[2033679851]: [896.901929ms] [896.901929ms] END
I0331 18:38:41.123412       1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.96.221.118"}
I0331 18:38:41.140420       1 controller.go:624] quota admission added evaluator for: cronjobs.batch
I0331 18:41:43.743766       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.106.104.232"}
I0331 18:42:17.013945       1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.101.236.38"}
I0331 18:43:20.162564       1 trace.go:236] Trace[1893732106]: "Update" accept:application/json, */*,audit-id:ee055ada-62e1-4573-b669-d0efca386a34,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:43:19.525) (total time: 637ms):
Trace[1893732106]: ["GuaranteedUpdate etcd3" audit-id:ee055ada-62e1-4573-b669-d0efca386a34,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 637ms (18:43:19.525)
Trace[1893732106]:  ---"Txn call completed" 636ms (18:43:20.162)]
Trace[1893732106]: [637.456667ms] [637.456667ms] END
I0331 18:43:20.162721       1 trace.go:236] Trace[1927907356]: "Update" accept:application/json, */*,audit-id:8a4f8152-b8c0-4afb-92ce-c93b6902ca78,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:43:19.525) (total time: 637ms):
Trace[1927907356]: ["GuaranteedUpdate etcd3" audit-id:8a4f8152-b8c0-4afb-92ce-c93b6902ca78,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 637ms (18:43:19.525)
Trace[1927907356]:  ---"Txn call completed" 636ms (18:43:20.162)]
Trace[1927907356]: [637.315613ms] [637.315613ms] END
I0331 18:44:11.249821       1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager
I0331 18:44:11.276165       1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager
I0331 18:44:11.276235       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.282737       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.290164       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.315083       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.330258       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.343702       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.364210       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.375124       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.399400       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.414195       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.429464       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.441369       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.474056       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.518777       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.553486       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:11.697000       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:44:17.057341       1 trace.go:236] Trace[567678741]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c0af5ade-1882-4b55-bf46-8be7144eeca3,client:10.0.0.65,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:15.203) (total time: 1853ms):
Trace[567678741]: ["GuaranteedUpdate etcd3" audit-id:c0af5ade-1882-4b55-bf46-8be7144eeca3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1853ms (18:44:15.203)
Trace[567678741]:  ---"Txn call completed" 1852ms (18:44:17.057)]
Trace[567678741]: [1.853681904s] [1.853681904s] END
I0331 18:44:17.074457       1 trace.go:236] Trace[531655224]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:50e6535d-1a61-4866-8400-9da46974cdd7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:44:15.206) (total time: 1867ms):
Trace[531655224]: ["GuaranteedUpdate etcd3" audit-id:50e6535d-1a61-4866-8400-9da46974cdd7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1867ms (18:44:15.206)
Trace[531655224]:  ---"Txn call completed" 1866ms (18:44:17.074)]
Trace[531655224]: [1.86757123s] [1.86757123s] END
I0331 18:44:17.075424       1 trace.go:236] Trace[267597562]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4cc3b835-c2b5-4099-be7e-c68a1179f5d7,client:162.253.55.110,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:44:16.116) (total time: 959ms):
Trace[267597562]: ---"About to write a response" 958ms (18:44:17.075)
Trace[267597562]: [959.045736ms] [959.045736ms] END
I0331 18:44:17.075883       1 trace.go:236] Trace[1127512777]: "Get" accept:application/json, */*,audit-id:0cab4000-8271-4ff4-baaa-09461c961bf4,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-ks8rz,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:15.757) (total time: 1318ms):
Trace[1127512777]: ---"About to write a response" 1317ms (18:44:17.075)
Trace[1127512777]: [1.318431395s] [1.318431395s] END
I0331 18:44:17.076319       1 trace.go:236] Trace[911885699]: "Get" accept:application/json, */*,audit-id:dd03edf1-02b9-4e01-8d20-0acc10228895,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:16.549) (total time: 526ms):
Trace[911885699]: ---"About to write a response" 526ms (18:44:17.076)
Trace[911885699]: [526.400572ms] [526.400572ms] END
I0331 18:44:17.076343       1 trace.go:236] Trace[902104401]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:49f12c9b-1cfe-4afc-a0e4-2e87a8598817,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:44:15.658) (total time: 1418ms):
Trace[902104401]: ---"About to write a response" 1417ms (18:44:17.076)
Trace[902104401]: [1.418053189s] [1.418053189s] END
I0331 18:44:17.076345       1 trace.go:236] Trace[2068931226]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a0b6bad5-66a8-4508-a3f9-b3e168a3264f,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:44:15.687) (total time: 1388ms):
Trace[2068931226]: ---"About to write a response" 1388ms (18:44:17.076)
Trace[2068931226]: [1.388431365s] [1.388431365s] END
I0331 18:44:17.076399       1 trace.go:236] Trace[620675877]: "Get" accept:application/json, */*,audit-id:5d6351ab-406a-4459-8f6c-db37ef888b6f,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:44:15.883) (total time: 1192ms):
Trace[620675877]: ---"About to write a response" 1192ms (18:44:17.076)
Trace[620675877]: [1.192372832s] [1.192372832s] END
I0331 18:44:17.082809       1 trace.go:236] Trace[699280395]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.110,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:44:16.131) (total time: 951ms):
Trace[699280395]: ---"initial value restored" 944ms (18:44:17.075)
Trace[699280395]: [951.689834ms] [951.689834ms] END
I0331 18:44:28.114745       1 trace.go:236] Trace[523863375]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:83850661-f4e2-4a7f-8300-d3a21803948c,client:10.0.0.65,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:27.089) (total time: 1025ms):
Trace[523863375]: ["GuaranteedUpdate etcd3" audit-id:83850661-f4e2-4a7f-8300-d3a21803948c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1025ms (18:44:27.089)
Trace[523863375]:  ---"Txn call completed" 1024ms (18:44:28.114)]
Trace[523863375]: [1.025510864s] [1.025510864s] END
I0331 18:44:28.351683       1 trace.go:236] Trace[1201911848]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5bd6a28a-833f-4d4a-86b5-3a952658e34c,client:10.0.0.181,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:27.155) (total time: 1196ms):
Trace[1201911848]: ["GuaranteedUpdate etcd3" audit-id:5bd6a28a-833f-4d4a-86b5-3a952658e34c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1196ms (18:44:27.155)
Trace[1201911848]:  ---"Txn call completed" 1195ms (18:44:28.351)]
Trace[1201911848]: [1.196211893s] [1.196211893s] END
I0331 18:44:28.351702       1 trace.go:236] Trace[599376831]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:844c8173-8d84-471d-9fd9-bb9b6b1b5506,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:44:27.155) (total time: 1195ms):
Trace[599376831]: ["GuaranteedUpdate etcd3" audit-id:844c8173-8d84-471d-9fd9-bb9b6b1b5506,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1195ms (18:44:27.155)
Trace[599376831]:  ---"Txn call completed" 1195ms (18:44:28.351)]
Trace[599376831]: [1.195965917s] [1.195965917s] END
I0331 18:44:28.351833       1 trace.go:236] Trace[2037610779]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ef918088-aba8-45c4-bca1-4eb78f424eb0,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:27.167) (total time: 1184ms):
Trace[2037610779]: ["GuaranteedUpdate etcd3" audit-id:ef918088-aba8-45c4-bca1-4eb78f424eb0,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1184ms (18:44:27.167)
Trace[2037610779]:  ---"Txn call completed" 1183ms (18:44:28.351)]
Trace[2037610779]: [1.184304144s] [1.184304144s] END
I0331 18:44:28.352144       1 trace.go:236] Trace[1049800060]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86d7100b-3295-496b-a241-16765f06fee8,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:27.156) (total time: 1195ms):
Trace[1049800060]: ["GuaranteedUpdate etcd3" audit-id:86d7100b-3295-496b-a241-16765f06fee8,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1195ms (18:44:27.156)
Trace[1049800060]:  ---"Txn call completed" 1194ms (18:44:28.351)]
Trace[1049800060]: [1.195343882s] [1.195343882s] END
I0331 18:44:28.353023       1 trace.go:236] Trace[1408310561]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f6a9b14d-72de-422f-9281-101529e66b70,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:44:27.170) (total time: 1182ms):
Trace[1408310561]: ---"About to write a response" 1182ms (18:44:28.352)
Trace[1408310561]: [1.18238589s] [1.18238589s] END
I0331 18:44:28.355674       1 trace.go:236] Trace[836594647]: "Get" accept:application/json, */*,audit-id:7a8c2822-9f4e-4297-a71b-94a4fc25bf2a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:27.173) (total time: 1182ms):
Trace[836594647]: ---"About to write a response" 1182ms (18:44:28.355)
Trace[836594647]: [1.182212835s] [1.182212835s] END
I0331 18:44:28.355804       1 trace.go:236] Trace[583769976]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6dafda94-5524-43eb-8057-bbef089075dc,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:44:27.173) (total time: 1182ms):
Trace[583769976]: ---"About to write a response" 1182ms (18:44:28.355)
Trace[583769976]: [1.182619035s] [1.182619035s] END
I0331 18:44:28.355878       1 trace.go:236] Trace[153508169]: "Get" accept:application/json, */*,audit-id:8f3d49bd-8822-459a-97e2-71e2789d34c1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:27.174) (total time: 1180ms):
Trace[153508169]: ---"About to write a response" 1180ms (18:44:28.355)
Trace[153508169]: [1.180890595s] [1.180890595s] END
I0331 18:44:28.356053       1 trace.go:236] Trace[1818743539]: "Get" accept:application/json, */*,audit-id:61c18b86-1603-4f20-a0f2-a4a1ca13b365,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-ks8rz,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:27.177) (total time: 1178ms):
Trace[1818743539]: ---"About to write a response" 1177ms (18:44:28.355)
Trace[1818743539]: [1.178263603s] [1.178263603s] END
I0331 18:44:28.356189       1 trace.go:236] Trace[89986149]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b07a6064-b32f-4935-afdf-c0382a2b4b85,client:10.0.0.65,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:44:27.270) (total time: 1086ms):
Trace[89986149]: ---"About to write a response" 1085ms (18:44:28.355)
Trace[89986149]: [1.086045182s] [1.086045182s] END
I0331 18:44:28.357744       1 trace.go:236] Trace[335805418]: "Get" accept:application/json, */*,audit-id:c1ca0b27-1f01-40f9-9ae0-236f8ed08b77,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:44:27.174) (total time: 1183ms):
Trace[335805418]: ---"About to write a response" 1182ms (18:44:28.357)
Trace[335805418]: [1.183081015s] [1.183081015s] END
I0331 18:44:28.474049       1 trace.go:236] Trace[1784746104]: "Update" accept:application/json, */*,audit-id:a615674c-e8f4-4a4b-bf8c-44b8d5640b1f,client:10.0.0.178,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:44:27.191) (total time: 1282ms):
Trace[1784746104]: ---"Conversion done" 35ms (18:44:27.228)
Trace[1784746104]: ["GuaranteedUpdate etcd3" audit-id:a615674c-e8f4-4a4b-bf8c-44b8d5640b1f,key:/nfd.k8s-sigs.io/nodefeatures/monitoring/instance,type:*unstructured.Unstructured,resource:nodefeatures.nfd.k8s-sigs.io 1242ms (18:44:27.231)
Trace[1784746104]:  ---"About to Encode" 158ms (18:44:27.403)
Trace[1784746104]:  ---"Txn call completed" 936ms (18:44:28.351)
Trace[1784746104]:  ---"decode succeeded" len:414386 97ms (18:44:28.449)]
Trace[1784746104]: ---"Writing http response done" 24ms (18:44:28.473)
Trace[1784746104]: [1.282443143s] [1.282443143s] END
I0331 18:44:28.547367       1 trace.go:236] Trace[1062037675]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:33e75e4b-7016-4061-bfd1-94d3c7118969,client:162.253.55.110,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/barbican-api-754c8685cf-sb8cx.18a2015042f6f75b,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:44:27.370) (total time: 1177ms):
Trace[1062037675]: ["GuaranteedUpdate etcd3" audit-id:33e75e4b-7016-4061-bfd1-94d3c7118969,key:/events/openstack/barbican-api-754c8685cf-sb8cx.18a2015042f6f75b,type:*core.Event,resource:events 1177ms (18:44:27.370)
Trace[1062037675]:  ---"initial value restored" 985ms (18:44:28.355)
Trace[1062037675]:  ---"Txn call completed" 190ms (18:44:28.547)]
Trace[1062037675]: ---"Object stored in database" 190ms (18:44:28.547)
Trace[1062037675]: [1.177213949s] [1.177213949s] END
I0331 18:44:33.224055       1 trace.go:236] Trace[2022817096]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:30b4e4ec-98df-4fd0-bc25-06a58286aba5,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:32.674) (total time: 549ms):
Trace[2022817096]: ["GuaranteedUpdate etcd3" audit-id:30b4e4ec-98df-4fd0-bc25-06a58286aba5,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 549ms (18:44:32.674)
Trace[2022817096]:  ---"Txn call completed" 548ms (18:44:33.223)]
Trace[2022817096]: [549.535384ms] [549.535384ms] END
I0331 18:44:56.692007       1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io
I0331 18:44:56.704292       1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io
I0331 18:45:01.951902       1 trace.go:236] Trace[1668773832]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:89fad1bd-4081-48dd-804e-b53f9f041123,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:45:01.334) (total time: 616ms):
Trace[1668773832]: ["GuaranteedUpdate etcd3" audit-id:89fad1bd-4081-48dd-804e-b53f9f041123,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 616ms (18:45:01.335)
Trace[1668773832]:  ---"Txn call completed" 615ms (18:45:01.951)]
Trace[1668773832]: [616.924253ms] [616.924253ms] END
I0331 18:45:01.952767       1 trace.go:236] Trace[115467909]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1a1b0455-44f4-4b2e-aef6-73471ae1e9ea,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:45:01.199) (total time: 753ms):
Trace[115467909]: ["GuaranteedUpdate etcd3" audit-id:1a1b0455-44f4-4b2e-aef6-73471ae1e9ea,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 753ms (18:45:01.199)
Trace[115467909]:  ---"Txn call completed" 752ms (18:45:01.952)]
Trace[115467909]: [753.532063ms] [753.532063ms] END
I0331 18:45:06.537377       1 trace.go:236] Trace[1423054554]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7df2734e-2235-48b8-ad1d-6904c214393c,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:45:05.962) (total time: 574ms):
Trace[1423054554]: ["GuaranteedUpdate etcd3" audit-id:7df2734e-2235-48b8-ad1d-6904c214393c,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 574ms (18:45:05.962)
Trace[1423054554]:  ---"Txn call completed" 573ms (18:45:06.537)]
Trace[1423054554]: [574.789345ms] [574.789345ms] END
I0331 18:45:06.538854       1 trace.go:236] Trace[106508511]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:08d24e16-3efc-4abc-a4e2-8663e8475dc1,client:10.0.0.236,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:45:05.964) (total time: 574ms):
Trace[106508511]: ["GuaranteedUpdate etcd3" audit-id:08d24e16-3efc-4abc-a4e2-8663e8475dc1,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 574ms (18:45:05.964)
Trace[106508511]:  ---"Txn call completed" 573ms (18:45:06.538)]
Trace[106508511]: [574.214311ms] [574.214311ms] END
I0331 18:45:06.538866       1 trace.go:236] Trace[739110444]: "Get" accept:application/json, */*,audit-id:d75ccc9e-2ddf-4c7e-8759-8c8a910adfdf,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:45:05.977) (total time: 561ms):
Trace[739110444]: ---"About to write a response" 561ms (18:45:06.538)
Trace[739110444]: [561.7799ms] [561.7799ms] END
I0331 18:45:06.539070       1 trace.go:236] Trace[1241804746]: "Get" accept:application/json, */*,audit-id:27f9a11b-b4ab-4f87-b91c-4fb83b329a8d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:45:05.977) (total time: 561ms):
Trace[1241804746]: ---"About to write a response" 561ms (18:45:06.538)
Trace[1241804746]: [561.323729ms] [561.323729ms] END
I0331 18:45:06.540065       1 trace.go:236] Trace[1713709348]: "Get" accept:application/json, */*,audit-id:495813d5-bb5d-45e2-b4c9-1fe4bfc49240,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:45:05.977) (total time: 562ms):
Trace[1713709348]: ---"About to write a response" 562ms (18:45:06.539)
Trace[1713709348]: [562.308362ms] [562.308362ms] END
I0331 18:45:06.540095       1 trace.go:236] Trace[124099196]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3553e313-afad-4593-a7d7-ea8de5748b6a,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:45:05.977) (total time: 562ms):
Trace[124099196]: ---"About to write a response" 562ms (18:45:06.540)
Trace[124099196]: [562.129088ms] [562.129088ms] END
I0331 18:45:06.540143       1 trace.go:236] Trace[625108211]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:29406de9-1159-41b4-9ae6-52d6a4505621,client:162.253.55.110,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:45:05.983) (total time: 556ms):
Trace[625108211]: ---"About to write a response" 556ms (18:45:06.539)
Trace[625108211]: [556.427715ms] [556.427715ms] END
I0331 18:45:06.545131       1 trace.go:236] Trace[782706790]: "Get" accept:application/json, */*,audit-id:10b815ec-cbaf-436c-abe1-6f27693b5cc0,client:162.253.55.110,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-ks8rz,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:45:05.985) (total time: 559ms):
Trace[782706790]: ---"About to write a response" 559ms (18:45:06.544)
Trace[782706790]: [559.544107ms] [559.544107ms] END
I0331 18:45:06.880472       1 trace.go:236] Trace[1180632994]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.110,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:45:06.134) (total time: 746ms):
Trace[1180632994]: ---"initial value restored" 405ms (18:45:06.539)
Trace[1180632994]: ---"Transaction prepared" 73ms (18:45:06.613)
Trace[1180632994]: ---"Txn call completed" 267ms (18:45:06.880)
Trace[1180632994]: [746.273022ms] [746.273022ms] END
I0331 18:45:30.652738       1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.99.254.169"}
I0331 18:45:33.868012       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.108.149.105"}
I0331 18:46:07.967368       1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.106.247.248"}
I0331 18:50:40.374942       1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.109.238.222"}
E0331 18:50:50.182494       1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc032993ef0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc02f6456d0), ResponseWriter:(*httpsnoop.rw)(0xc02f6456d0), Flusher:(*httpsnoop.rw)(0xc02f6456d0), CloseNotifier:(*httpsnoop.rw)(0xc02f6456d0), Pusher:(*httpsnoop.rw)(0xc02f6456d0)}}, encoder:(*versioning.codec)(0xc02dd47ea0), memAllocator:(*runtime.Allocator)(0xc006ee2420)})