I0331 18:26:44.361796       1 options.go:220] external host was not specified, using 199.204.45.57
I0331 18:26:44.362836       1 server.go:148] Version: v1.28.13
I0331 18:26:44.362908       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0331 18:26:44.972724       1 shared_informer.go:311] Waiting for caches to sync for node_authorizer
I0331 18:26:45.002156       1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
I0331 18:26:45.002192       1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.
I0331 18:26:45.002709       1 instance.go:298] Using reconciler: lease
I0331 18:26:45.044359       1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager
W0331 18:26:45.044387       1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
I0331 18:26:45.290636       1 handler.go:275] Adding GroupVersion  v1 to ResourceManager
I0331 18:26:45.290811       1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping.
I0331 18:26:45.763643       1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping.
I0331 18:26:45.782137       1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager
W0331 18:26:45.782214       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.782234       1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.784414       1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager
W0331 18:26:45.784435       1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
I0331 18:26:45.785719       1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager
I0331 18:26:45.786765       1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager
W0331 18:26:45.786784       1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources.
W0331 18:26:45.786791       1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources.
I0331 18:26:45.788489       1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager
W0331 18:26:45.788510       1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources.
I0331 18:26:45.789478       1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager
W0331 18:26:45.789495       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.789501       1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.790167       1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager
W0331 18:26:45.790185       1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.790362       1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources.
I0331 18:26:45.791031       1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager
I0331 18:26:45.792927       1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager
W0331 18:26:45.792947       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.792952       1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.793583       1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager
W0331 18:26:45.793598       1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.793603       1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.794610       1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager
W0331 18:26:45.794630       1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources.
I0331 18:26:45.796704       1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager
W0331 18:26:45.796723       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.796729       1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.797087       1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager
W0331 18:26:45.797101       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.797104       1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.799475       1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager
W0331 18:26:45.799498       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.799504       1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.800886       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager
I0331 18:26:45.802502       1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager
W0331 18:26:45.802521       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.802525       1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.806431       1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager
W0331 18:26:45.806456       1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources.
W0331 18:26:45.806461       1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources.
I0331 18:26:45.807563       1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager
W0331 18:26:45.807582       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
W0331 18:26:45.807588       1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.
I0331 18:26:45.808173       1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager
W0331 18:26:45.808188       1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources.
I0331 18:26:45.846909       1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager
W0331 18:26:45.846943       1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
I0331 18:26:46.247172       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 18:26:46.247216       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 18:26:46.247319       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key"
I0331 18:26:46.247404       1 secure_serving.go:213] Serving securely on [::]:6443
I0331 18:26:46.247463       1 aggregator.go:164] waiting for initial CRD sync...
I0331 18:26:46.247468       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0331 18:26:46.247554       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0331 18:26:46.247567       1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller
I0331 18:26:46.247608       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
I0331 18:26:46.247639       1 available_controller.go:423] Starting AvailableConditionController
I0331 18:26:46.247709       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0331 18:26:46.247608       1 controller.go:80] Starting OpenAPI V3 AggregationController
I0331 18:26:46.247826       1 apiservice_controller.go:97] Starting APIServiceRegistrationController
I0331 18:26:46.247881       1 controller.go:116] Starting legacy_token_tracking_controller
I0331 18:26:46.247882       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0331 18:26:46.247692       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt"
I0331 18:26:46.247907       1 shared_informer.go:311] Waiting for caches to sync for configmaps
I0331 18:26:46.247930       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 18:26:46.247954       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0331 18:26:46.247998       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister
I0331 18:26:46.248003       1 handler_discovery.go:412] Starting ResourceDiscoveryManager
I0331 18:26:46.248107       1 gc_controller.go:78] Starting apiserver lease garbage collector
I0331 18:26:46.248136       1 apf_controller.go:374] Starting API Priority and Fairness config controller
I0331 18:26:46.248371       1 customresource_discovery_controller.go:289] Starting DiscoveryController
I0331 18:26:46.248583       1 system_namespaces_controller.go:67] Starting system namespaces controller
I0331 18:26:46.248723       1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key"
I0331 18:26:46.248905       1 controller.go:78] Starting OpenAPI AggregationController
I0331 18:26:46.248990       1 controller.go:134] Starting OpenAPI controller
I0331 18:26:46.249039       1 controller.go:85] Starting OpenAPI V3 controller
I0331 18:26:46.249084       1 naming_controller.go:291] Starting NamingConditionController
I0331 18:26:46.249116       1 establishing_controller.go:76] Starting EstablishingController
I0331 18:26:46.249148       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0331 18:26:46.249171       1 crd_finalizer.go:266] Starting CRDFinalizer
I0331 18:26:46.249158       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0331 18:26:46.294058       1 shared_informer.go:318] Caches are synced for node_authorizer
I0331 18:26:46.348014       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0331 18:26:46.348041       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0331 18:26:46.348100       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller
I0331 18:26:46.348254       1 apf_controller.go:379] Running API Priority and Fairness config worker
I0331 18:26:46.348310       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process
I0331 18:26:46.348275       1 shared_informer.go:318] Caches are synced for crd-autoregister
I0331 18:26:46.348349       1 aggregator.go:166] initial CRD sync complete...
I0331 18:26:46.348364       1 shared_informer.go:318] Caches are synced for configmaps
I0331 18:26:46.348364       1 autoregister_controller.go:141] Starting autoregister controller
I0331 18:26:46.348374       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0331 18:26:46.348381       1 cache.go:39] Caches are synced for autoregister controller
I0331 18:26:46.351135       1 controller.go:624] quota admission added evaluator for: namespaces
E0331 18:26:46.456613       1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found
E0331 18:26:46.458214       1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"
I0331 18:26:46.507670       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io
I0331 18:26:47.255436       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000
I0331 18:26:47.260830       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000
I0331 18:26:47.260858       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0331 18:26:47.916174       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0331 18:26:47.976736       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0331 18:26:48.074711       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W0331 18:26:48.083823       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.57]
I0331 18:26:48.085302       1 controller.go:624] quota admission added evaluator for: endpoints
I0331 18:26:48.091298       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0331 18:26:49.656288       1 controller.go:624] quota admission added evaluator for: serviceaccounts
I0331 18:26:49.665506       1 controller.go:624] quota admission added evaluator for: deployments.apps
I0331 18:26:49.690211       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I0331 18:26:49.900412       1 controller.go:624] quota admission added evaluator for: daemonsets.apps
I0331 18:26:55.435788       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps
I0331 18:26:55.490155       1 controller.go:624] quota admission added evaluator for: replicasets.apps
I0331 18:26:57.283878       1 trace.go:236] Trace[1917516821]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bf0ababd-c7a5-4cd5-ac65-79cff2186e39,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-controller-manager-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:26:56.781) (total time: 502ms):
Trace[1917516821]: ["GuaranteedUpdate etcd3" audit-id:bf0ababd-c7a5-4cd5-ac65-79cff2186e39,key:/pods/kube-system/kube-controller-manager-instance,type:*core.Pod,resource:pods 502ms (18:26:56.781)
Trace[1917516821]:  ---"Txn call completed" 497ms (18:26:57.282)]
Trace[1917516821]: ---"Object stored in database" 498ms (18:26:57.283)
Trace[1917516821]: [502.74901ms] [502.74901ms] END
I0331 18:26:58.665517       1 trace.go:236] Trace[1852092801]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.57,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:26:58.067) (total time: 597ms):
Trace[1852092801]: ---"initial value restored" 130ms (18:26:58.198)
Trace[1852092801]: ---"Transaction prepared" 410ms (18:26:58.608)
Trace[1852092801]: ---"Txn call completed" 57ms (18:26:58.665)
Trace[1852092801]: [597.726448ms] [597.726448ms] END
I0331 18:27:03.975032       1 trace.go:236] Trace[1268824420]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:798fc2a1-00b1-46ff-b133-530aaee70e37,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:27:03.349) (total time: 625ms):
Trace[1268824420]: ---"About to write a response" 625ms (18:27:03.974)
Trace[1268824420]: [625.767162ms] [625.767162ms] END
I0331 18:27:17.652896       1 trace.go:236] Trace[196425635]: "Create" accept:application/json,audit-id:877801f0-3e6d-49af-b0fc-55043dd8c8dc,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.927) (total time: 725ms):
Trace[196425635]: ["Create etcd3" audit-id:877801f0-3e6d-49af-b0fc-55043dd8c8dc,key:/apiextensions.k8s.io/customresourcedefinitions/referencegrants.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 723ms (18:27:16.929)
Trace[196425635]:  ---"Txn call succeeded" 721ms (18:27:17.650)]
Trace[196425635]: [725.151772ms] [725.151772ms] END
I0331 18:27:17.653143       1 trace.go:236] Trace[1851719622]: "Create" accept:application/json,audit-id:79b3c63f-473d-49de-a368-4386b2a94e1c,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.920) (total time: 733ms):
Trace[1851719622]: ["Create etcd3" audit-id:79b3c63f-473d-49de-a368-4386b2a94e1c,key:/apiextensions.k8s.io/customresourcedefinitions/xmeshes.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 725ms (18:27:16.927)
Trace[1851719622]:  ---"Txn call succeeded" 723ms (18:27:17.650)]
Trace[1851719622]: [733.046778ms] [733.046778ms] END
I0331 18:27:17.653568       1 trace.go:236] Trace[810090185]: "Create" accept:application/json,audit-id:c4f62f8e-4438-47dc-a69a-a8f9cc18cc97,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.927) (total time: 726ms):
Trace[810090185]: ["Create etcd3" audit-id:c4f62f8e-4438-47dc-a69a-a8f9cc18cc97,key:/apiextensions.k8s.io/customresourcedefinitions/gatewayclasses.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 720ms (18:27:16.932)
Trace[810090185]:  ---"Txn call succeeded" 718ms (18:27:17.650)]
Trace[810090185]: [726.209858ms] [726.209858ms] END
I0331 18:27:17.653594       1 trace.go:236] Trace[1052978218]: "Create" accept:application/json,audit-id:0db95d47-fa49-486c-900a-f587666d361b,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.926) (total time: 726ms):
Trace[1052978218]: ["Create etcd3" audit-id:0db95d47-fa49-486c-900a-f587666d361b,key:/apiextensions.k8s.io/customresourcedefinitions/udproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 712ms (18:27:16.940)
Trace[1052978218]:  ---"Txn call succeeded" 709ms (18:27:17.650)]
Trace[1052978218]: [726.790493ms] [726.790493ms] END
I0331 18:27:17.654548       1 trace.go:236] Trace[1401292208]: "Create" accept:application/json,audit-id:3b1b2efd-9002-44e0-985f-d36ca8e3ac8b,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.934) (total time: 720ms):
Trace[1401292208]: ["Create etcd3" audit-id:3b1b2efd-9002-44e0-985f-d36ca8e3ac8b,key:/apiextensions.k8s.io/customresourcedefinitions/xlistenersets.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 708ms (18:27:16.945)
Trace[1401292208]:  ---"Txn call succeeded" 704ms (18:27:17.650)]
Trace[1401292208]: [720.436195ms] [720.436195ms] END
I0331 18:27:17.654638       1 trace.go:236] Trace[1796866620]: "Create" accept:application/json,audit-id:01db174a-1d2e-40ec-895d-1a8e0ea376d6,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.927) (total time: 727ms):
Trace[1796866620]: ["Create etcd3" audit-id:01db174a-1d2e-40ec-895d-1a8e0ea376d6,key:/apiextensions.k8s.io/customresourcedefinitions/backendtlspolicies.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 711ms (18:27:16.943)
Trace[1796866620]:  ---"Txn call succeeded" 706ms (18:27:17.650)]
Trace[1796866620]: [727.376417ms] [727.376417ms] END
I0331 18:27:17.654857       1 trace.go:236] Trace[1193712248]: "Create" accept:application/json,audit-id:5b65ee8d-0def-4178-aafd-83daf0283e5d,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.923) (total time: 731ms):
Trace[1193712248]: ["Create etcd3" audit-id:5b65ee8d-0def-4178-aafd-83daf0283e5d,key:/apiextensions.k8s.io/customresourcedefinitions/xbackendtrafficpolicies.gateway.networking.x-k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 717ms (18:27:16.936)
Trace[1193712248]:  ---"Txn call succeeded" 715ms (18:27:17.652)]
Trace[1193712248]: [731.272244ms] [731.272244ms] END
I0331 18:27:17.657029       1 trace.go:236] Trace[1158803869]: "Create" accept:application/json,audit-id:00c27392-ca4f-4bd4-8647-f1aa6020fcda,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.929) (total time: 727ms):
Trace[1158803869]: ["Create etcd3" audit-id:00c27392-ca4f-4bd4-8647-f1aa6020fcda,key:/apiextensions.k8s.io/customresourcedefinitions/tcproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 712ms (18:27:16.944)
Trace[1158803869]:  ---"Txn call succeeded" 707ms (18:27:17.652)]
Trace[1158803869]: [727.597772ms] [727.597772ms] END
I0331 18:27:17.658897       1 trace.go:236] Trace[1463368052]: "Create" accept:application/json,audit-id:d460a75e-98d0-44dc-bb44-e61ee6fafd08,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.927) (total time: 731ms):
Trace[1463368052]: ["Create etcd3" audit-id:d460a75e-98d0-44dc-bb44-e61ee6fafd08,key:/apiextensions.k8s.io/customresourcedefinitions/grpcroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 675ms (18:27:16.983)
Trace[1463368052]:  ---"Txn call succeeded" 666ms (18:27:17.651)]
Trace[1463368052]: [731.515429ms] [731.515429ms] END
I0331 18:27:17.659369       1 trace.go:236] Trace[1484742821]: "Create" accept:application/json,audit-id:05db7592-be43-4570-9f1d-43d8a8827788,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.923) (total time: 735ms):
Trace[1484742821]: ["Create etcd3" audit-id:05db7592-be43-4570-9f1d-43d8a8827788,key:/apiextensions.k8s.io/customresourcedefinitions/tlsroutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 698ms (18:27:16.960)
Trace[1484742821]:  ---"Txn call succeeded" 687ms (18:27:17.650)]
Trace[1484742821]: [735.685773ms] [735.685773ms] END
I0331 18:27:17.662689       1 trace.go:236] Trace[54451004]: "Create" accept:application/json,audit-id:3b375de4-c651-4778-be19-9b16487f8578,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.932) (total time: 729ms):
Trace[54451004]: ["Create etcd3" audit-id:3b375de4-c651-4778-be19-9b16487f8578,key:/apiextensions.k8s.io/customresourcedefinitions/gateways.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 681ms (18:27:16.980)
Trace[54451004]:  ---"Txn call succeeded" 669ms (18:27:17.650)]
Trace[54451004]: [729.91755ms] [729.91755ms] END
I0331 18:27:17.702642       1 trace.go:236] Trace[1035445336]: "Create" accept:application/json,audit-id:463659a2-67c5-436c-bc5f-710dd1a183fb,client:199.204.45.57,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:16.929) (total time: 772ms):
Trace[1035445336]: ---"Conversion done" 34ms (18:27:16.969)
Trace[1035445336]: ["Create etcd3" audit-id:463659a2-67c5-436c-bc5f-710dd1a183fb,key:/apiextensions.k8s.io/customresourcedefinitions/httproutes.gateway.networking.k8s.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 604ms (18:27:17.097)
Trace[1035445336]:  ---"Txn call succeeded" 552ms (18:27:17.652)]
Trace[1035445336]: ---"Writing http response done" 35ms (18:27:17.702)
Trace[1035445336]: [772.874713ms] [772.874713ms] END
I0331 18:27:17.717938       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:27:17.733760       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:27:17.753060       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:27:17.804686       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:27:17.804733       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 18:27:17.821278       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:27:17.855269       1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager
I0331 18:27:17.875778       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager
I0331 18:27:17.875827       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager
I0331 18:27:17.932977       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:27:17.933066       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:27:17.965547       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:27:18.106057       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:27:18.106096       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:27:18.122839       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:27:18.130958       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager
I0331 18:27:18.131031       1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager
I0331 18:27:18.159930       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:18.191709       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:18.221051       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:18.259059       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:18.280974       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:19.012907       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:19.013209       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:19.075152       1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager
I0331 18:27:23.450866       1 trace.go:236] Trace[2117963265]: "Update" accept:application/json, */*,audit-id:0a58fee9-67e3-4e7f-b7de-2a09def6791a,client:199.204.45.57,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (31-Mar-2026 18:27:22.840) (total time: 610ms):
Trace[2117963265]: ---"Conversion done" 22ms (18:27:22.866)
Trace[2117963265]: ["GuaranteedUpdate etcd3" audit-id:0a58fee9-67e3-4e7f-b7de-2a09def6791a,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 584ms (18:27:22.866)
Trace[2117963265]:  ---"Txn call completed" 547ms (18:27:23.418)]
Trace[2117963265]: ---"Writing http response done" 31ms (18:27:23.450)
Trace[2117963265]: [610.520575ms] [610.520575ms] END
I0331 18:27:25.361970       1 trace.go:236] Trace[348174882]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f16ed9d1-e2d6-4497-9110-f9cab02e64e8,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-xrh55,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:27:24.861) (total time: 500ms):
Trace[348174882]: ---"About to write a response" 499ms (18:27:25.361)
Trace[348174882]: [500.666598ms] [500.666598ms] END
I0331 18:27:25.467897       1 controller.go:624] quota admission added evaluator for: jobs.batch
I0331 18:27:26.486840       1 trace.go:236] Trace[640096873]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:9becfb75-ac91-4dad-a7b5-c4dacce3dead,client:199.204.45.57,protocol:HTTP/2.0,resource:tcproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1alpha2/tcproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.181) (total time: 1305ms):
Trace[640096873]: ["List(recursive=true) etcd3" audit-id:9becfb75-ac91-4dad-a7b5-c4dacce3dead,key:/gateway.networking.k8s.io/tcproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1305ms (18:27:25.181)]
Trace[640096873]: [1.305495681s] [1.305495681s] END
I0331 18:27:26.487607       1 trace.go:236] Trace[1462753030]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xbackendtrafficpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.985) (total time: 501ms):
Trace[1462753030]: [501.785896ms] [501.785896ms] END
I0331 18:27:26.487750       1 trace.go:236] Trace[935907432]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/envoyproxies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.393) (total time: 1093ms):
Trace[935907432]: [1.093833345s] [1.093833345s] END
I0331 18:27:26.487787       1 trace.go:236] Trace[855897364]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/tlsroutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.455) (total time: 1032ms):
Trace[855897364]: [1.032561588s] [1.032561588s] END
I0331 18:27:26.487798       1 trace.go:236] Trace[152718201]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:266525b0-a2d6-4088-830b-f8b414ddf5d0,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-xrh55/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:27:25.364) (total time: 1123ms):
Trace[152718201]: ["GuaranteedUpdate etcd3" audit-id:266525b0-a2d6-4088-830b-f8b414ddf5d0,key:/pods/kube-system/cilium-xrh55,type:*core.Pod,resource:pods 1123ms (18:27:25.364)
Trace[152718201]:  ---"Txn call completed" 1114ms (18:27:26.487)]
Trace[152718201]: ---"Object stored in database" 1115ms (18:27:26.487)
Trace[152718201]: [1.123276543s] [1.123276543s] END
I0331 18:27:26.487829       1 trace.go:236] Trace[1554148514]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:ab2101c5-c4ab-479a-93f9-40ad05dee0af,client:199.204.45.57,protocol:HTTP/2.0,resource:backendtlspolicies,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/backendtlspolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.804) (total time: 682ms):
Trace[1554148514]: ["List(recursive=true) etcd3" audit-id:ab2101c5-c4ab-479a-93f9-40ad05dee0af,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 682ms (18:27:25.804)]
Trace[1554148514]: [682.929718ms] [682.929718ms] END
I0331 18:27:26.487930       1 trace.go:236] Trace[2059960119]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/httproutefilters,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.419) (total time: 1068ms):
Trace[2059960119]: [1.068670781s] [1.068670781s] END
I0331 18:27:26.488058       1 trace.go:236] Trace[523975457]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/securitypolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.942) (total time: 545ms):
Trace[523975457]: [545.652511ms] [545.652511ms] END
I0331 18:27:26.488086       1 trace.go:236] Trace[1341479198]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:12b21684-ac94-4ad5-907d-fb5328194356,client:199.204.45.57,protocol:HTTP/2.0,resource:securitypolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/securitypolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.943) (total time: 544ms):
Trace[1341479198]: ["List(recursive=true) etcd3" audit-id:12b21684-ac94-4ad5-907d-fb5328194356,key:/gateway.envoyproxy.io/securitypolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 544ms (18:27:25.943)]
Trace[1341479198]: [544.822841ms] [544.822841ms] END
I0331 18:27:26.488139       1 trace.go:236] Trace[1138606243]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xlistenersets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.834) (total time: 654ms):
Trace[1138606243]: [654.002552ms] [654.002552ms] END
I0331 18:27:26.488226       1 trace.go:236] Trace[1951828236]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:ead66269-9440-48f2-bc5a-84acdff89c21,client:199.204.45.57,protocol:HTTP/2.0,resource:envoyproxies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/envoyproxies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.394) (total time: 1093ms):
Trace[1951828236]: ["List(recursive=true) etcd3" audit-id:ead66269-9440-48f2-bc5a-84acdff89c21,key:/gateway.envoyproxy.io/envoyproxies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1093ms (18:27:25.394)]
Trace[1951828236]: [1.093880236s] [1.093880236s] END
I0331 18:27:26.488414       1 trace.go:236] Trace[1107384261]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:be949477-7384-4bb8-b3ed-20c27b5d774d,client:199.204.45.57,protocol:HTTP/2.0,resource:envoypatchpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/envoypatchpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.959) (total time: 529ms):
Trace[1107384261]: ["List(recursive=true) etcd3" audit-id:be949477-7384-4bb8-b3ed-20c27b5d774d,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 528ms (18:27:25.959)]
Trace[1107384261]: [529.01492ms] [529.01492ms] END
I0331 18:27:26.488578       1 trace.go:236] Trace[845383646]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:f7f5406c-535b-4dfe-af9e-d3f42907177c,client:199.204.45.57,protocol:HTTP/2.0,resource:httproutefilters,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/httproutefilters,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.419) (total time: 1069ms):
Trace[845383646]: ["List(recursive=true) etcd3" audit-id:f7f5406c-535b-4dfe-af9e-d3f42907177c,key:/gateway.envoyproxy.io/httproutefilters,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1069ms (18:27:25.419)]
Trace[845383646]: [1.069107993s] [1.069107993s] END
I0331 18:27:26.488915       1 trace.go:236] Trace[1898948650]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:298104f0-4a50-4380-9e2f-0c85f47cde90,client:199.204.45.57,protocol:HTTP/2.0,resource:xlistenersets,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xlistenersets,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.834) (total time: 654ms):
Trace[1898948650]: ["List(recursive=true) etcd3" audit-id:298104f0-4a50-4380-9e2f-0c85f47cde90,key:/gateway.networking.x-k8s.io/xlistenersets,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 654ms (18:27:25.834)]
Trace[1898948650]: [654.159246ms] [654.159246ms] END
I0331 18:27:26.489538       1 trace.go:236] Trace[449219903]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.619) (total time: 870ms):
Trace[449219903]: [870.185531ms] [870.185531ms] END
I0331 18:27:26.489765       1 trace.go:236] Trace[2074940907]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/backendtrafficpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.237) (total time: 1251ms):
Trace[2074940907]: [1.251955547s] [1.251955547s] END
I0331 18:27:26.489906       1 trace.go:236] Trace[1502938565]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:b77e1d51-8e8a-4577-9a3c-b0f9d239c2e0,client:199.204.45.57,protocol:HTTP/2.0,resource:backendtrafficpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/backendtrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.238) (total time: 1251ms):
Trace[1502938565]: ["List(recursive=true) etcd3" audit-id:b77e1d51-8e8a-4577-9a3c-b0f9d239c2e0,key:/gateway.envoyproxy.io/backendtrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1251ms (18:27:25.238)]
Trace[1502938565]: [1.251570627s] [1.251570627s] END
I0331 18:27:26.489976       1 trace.go:236] Trace[903225268]: "Create" accept:application/json,audit-id:19b842a4-88b3-47de-baa3-5be9563b9f57,client:199.204.45.57,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/envoy-gateway-system/jobs,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:27:25.466) (total time: 1023ms):
Trace[903225268]: ["Create etcd3" audit-id:19b842a4-88b3-47de-baa3-5be9563b9f57,key:/jobs/envoy-gateway-system/envoy-gateway-gateway-helm-certgen,type:*batch.Job,resource:jobs.batch 1021ms (18:27:25.467)
Trace[903225268]:  ---"Txn call succeeded" 1021ms (18:27:26.489)]
Trace[903225268]: [1.023754751s] [1.023754751s] END
I0331 18:27:26.490106       1 trace.go:236] Trace[46349122]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.805) (total time: 685ms):
Trace[46349122]: [685.04566ms] [685.04566ms] END
I0331 18:27:26.490178       1 trace.go:236] Trace[520914004]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.959) (total time: 531ms):
Trace[520914004]: [531.102461ms] [531.102461ms] END
I0331 18:27:26.490688       1 trace.go:236] Trace[315107818]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:9564bb86-c019-4d82-9cc3-e1836a1e852a,client:199.204.45.57,protocol:HTTP/2.0,resource:tlsroutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1alpha3/tlsroutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.488) (total time: 1001ms):
Trace[315107818]: ["List(recursive=true) etcd3" audit-id:9564bb86-c019-4d82-9cc3-e1836a1e852a,key:/gateway.networking.k8s.io/tlsroutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1001ms (18:27:25.488)]
Trace[315107818]: [1.001871839s] [1.001871839s] END
I0331 18:27:26.490754       1 trace.go:236] Trace[145305262]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/tlsroutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.488) (total time: 1002ms):
Trace[145305262]: [1.002403822s] [1.002403822s] END
I0331 18:27:26.490782       1 trace.go:236] Trace[1491390812]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/backendtlspolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.773) (total time: 717ms):
Trace[1491390812]: [717.638237ms] [717.638237ms] END
I0331 18:27:26.490705       1 trace.go:236] Trace[569006778]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:4b26726e-1f32-4173-861c-bd1fb7f49390,client:199.204.45.57,protocol:HTTP/2.0,resource:xbackendtrafficpolicies,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xbackendtrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.986) (total time: 504ms):
Trace[569006778]: ["List(recursive=true) etcd3" audit-id:4b26726e-1f32-4173-861c-bd1fb7f49390,key:/gateway.networking.x-k8s.io/xbackendtrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 504ms (18:27:25.986)]
Trace[569006778]: [504.081282ms] [504.081282ms] END
I0331 18:27:26.490704       1 trace.go:236] Trace[1566828152]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 18:27:25.741) (total time: 749ms):
Trace[1566828152]: [749.282869ms] [749.282869ms] END
I0331 18:27:26.490942       1 trace.go:236] Trace[794471219]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:a2818690-202c-45b1-a57b-2623f97a0691,client:199.204.45.57,protocol:HTTP/2.0,resource:httproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/httproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 18:27:25.741) (total time: 749ms):
Trace[794471219]: ["List(recursive=true) etcd3" audit-id:a2818690-202c-45b1-a57b-2623f97a0691,key:/gateway.networking.k8s.io/httproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 749ms (18:27:25.741)]
Trace[794471219]: [749.071534ms] [749.071534ms] END
I0331 18:27:26.491091       1 trace.go:236] Trace[1107716255]: "Get" accept:application/json, */*,audit-id:6f323a7a-6d6d-4f31-80fb-ae55f98c94e3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:27:25.453) (total time: 1036ms):
Trace[1107716255]: ---"About to write a response" 1036ms (18:27:26.490)
Trace[1107716255]: [1.036960567s] [1.036960567s] END
I0331 18:27:27.115108       1 trace.go:236] Trace[950765373]: "List" accept:application/vnd.kubernetes.protobuf, */*,audit-id:278856e0-aced-4123-b766-0d4a9aa1073f,client:::1,protocol:HTTP/2.0,resource:limitranges,scope:namespace,url:/api/v1/namespaces/envoy-gateway-system/limitranges,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:LIST (31-Mar-2026 18:27:26.500) (total time: 614ms):
Trace[950765373]: ["List(recursive=true) etcd3" audit-id:278856e0-aced-4123-b766-0d4a9aa1073f,key:/limitranges/envoy-gateway-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 614ms (18:27:26.500)]
Trace[950765373]: [614.883662ms] [614.883662ms] END
I0331 18:27:27.115166       1 trace.go:236] Trace[1789558413]: "Update" accept:application/json, */*,audit-id:944a63dc-ff67-4770-8eea-0f2293357702,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:27:26.495) (total time: 619ms):
Trace[1789558413]: ["GuaranteedUpdate etcd3" audit-id:944a63dc-ff67-4770-8eea-0f2293357702,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 619ms (18:27:26.495)
Trace[1789558413]:  ---"Txn call completed" 617ms (18:27:27.114)]
Trace[1789558413]: [619.766524ms] [619.766524ms] END
I0331 18:27:27.119050       1 trace.go:236] Trace[45546634]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8bf53f8f-bff2-4d98-94c6-e0aa7b394a85,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:POST (31-Mar-2026 18:27:26.499) (total time: 619ms):
Trace[45546634]: [619.799965ms] [619.799965ms] END
I0331 18:27:28.643875       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:27:28.657893       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:27:28.843926       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:27:29.176483       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:27:29.246816       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:27:29.445829       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:27:29.767506       1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager
I0331 18:27:29.866339       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:27:31.865576       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:27:32.383856       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
I0331 18:27:32.905236       1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager
W0331 18:27:33.729891       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
E0331 18:27:33.729950       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found
I0331 18:27:36.747373       1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io
I0331 18:27:47.078007       1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.75.41"}
W0331 18:27:47.108061       1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.75.41:9443: connect: connection refused
E0331 18:27:47.108130       1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.75.41:9443: connect: connection refused
I0331 18:27:59.992305       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0331 18:28:00.004275       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:00.023878       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:00.044844       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.110.245.117"}
I0331 18:28:00.065834       1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.109.175.23"}
I0331 18:28:00.077694       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:00.122572       1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager
I0331 18:28:00.214857       1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager
I0331 18:28:12.190853       1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io
I0331 18:28:18.118399       1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io
I0331 18:28:23.756006       1 trace.go:236] Trace[697166019]: "Update" accept:application/json, */*,audit-id:e7c814ff-7597-4a3b-aaac-32c1335b8c4f,client:10.0.0.43,protocol:HTTP/2.0,resource:clusterissuers,scope:resource,url:/apis/cert-manager.io/v1/clusterissuers/atmosphere/status,user-agent:cert-manager-clusterissuers/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (31-Mar-2026 18:28:23.093) (total time: 662ms):
Trace[697166019]: ["GuaranteedUpdate etcd3" audit-id:e7c814ff-7597-4a3b-aaac-32c1335b8c4f,key:/cert-manager.io/clusterissuers/atmosphere,type:*unstructured.Unstructured,resource:clusterissuers.cert-manager.io 661ms (18:28:23.094)
Trace[697166019]:  ---"Txn call completed" 656ms (18:28:23.755)]
Trace[697166019]: ---"Write to database call succeeded" len:1059 656ms (18:28:23.755)
Trace[697166019]: [662.399951ms] [662.399951ms] END
I0331 18:28:23.797302       1 trace.go:236] Trace[132369792]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:614870eb-b314-4dd1-a8c7-9a2fc2ff202a,client:199.204.45.57,protocol:HTTP/2.0,resource:certificates,scope:resource,url:/apis/cert-manager.io/v1/namespaces/cert-manager/certificates/self-signed-ca,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (31-Mar-2026 18:28:23.232) (total time: 564ms):
Trace[132369792]: ---"About to write a response" 564ms (18:28:23.797)
Trace[132369792]: [564.358409ms] [564.358409ms] END
I0331 18:28:33.371059       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.104.135.235"}
I0331 18:28:33.382612       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.109.29.187"}
I0331 18:28:33.390749       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.101.155.28"}
I0331 18:28:33.402548       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.100.212.226"}
I0331 18:28:39.888376       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:39.911255       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:39.930617       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:39.948025       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:39.969302       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:39.999330       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.021932       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.048797       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.073446       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.117270       1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager
I0331 18:28:40.203073       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.252697       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:40.288505       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:42.101904       1 trace.go:236] Trace[395121444]: "Patch" accept:application/json,audit-id:2bb11dfe-a71a-403f-a410-d201c68930ca,client:199.204.45.57,protocol:HTTP/1.1,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/rabbitmqclusters.rabbitmq.com,user-agent:OpenAPI-Generator/35.0.0/python,verb:APPLY (31-Mar-2026 18:28:41.578) (total time: 523ms):
Trace[395121444]: ["GuaranteedUpdate etcd3" audit-id:2bb11dfe-a71a-403f-a410-d201c68930ca,key:/apiextensions.k8s.io/customresourcedefinitions/rabbitmqclusters.rabbitmq.com,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 522ms (18:28:41.579)
Trace[395121444]:  ---"Txn call completed" 395ms (18:28:42.079)]
Trace[395121444]: ---"About to check admission control" 42ms (18:28:41.674)
Trace[395121444]: ---"Object stored in database" 415ms (18:28:42.089)
Trace[395121444]: [523.2997ms] [523.2997ms] END
I0331 18:28:42.840484       1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager
I0331 18:28:45.872807       1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io
I0331 18:28:45.935882       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.99.178.10"}
I0331 18:28:45.960977       1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io
I0331 18:28:48.361639       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:28:48.394586       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:28:49.024632       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager
I0331 18:28:49.024665       1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager
I0331 18:28:49.024690       1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager
I0331 18:28:55.430150       1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com
I0331 18:28:59.866988       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.107.140.85"}
I0331 18:29:00.260048       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
I0331 18:29:00.370278       1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy
I0331 18:29:00.640692       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.99.190.223"}
I0331 18:29:00.978454       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.241.240"}
I0331 18:29:04.548598       1 trace.go:236] Trace[439839485]: "Get" accept:application/json, */*,audit-id:a47090a0-b163-40f0-8142-1cf44ee2e16b,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:03.865) (total time: 682ms):
Trace[439839485]: ---"About to write a response" 682ms (18:29:04.548)
Trace[439839485]: [682.725593ms] [682.725593ms] END
I0331 18:29:04.548676       1 trace.go:236] Trace[747107236]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c4cfb22b-088b-451b-852e-dbab10108341,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-2a5c2eda-5811-4d26-9b9b-a1b0e939d4b0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:29:03.349) (total time: 1199ms):
Trace[747107236]: ---"About to write a response" 1198ms (18:29:04.548)
Trace[747107236]: [1.199025519s] [1.199025519s] END
I0331 18:29:04.549341       1 trace.go:236] Trace[1283231803]: "Get" accept:application/json, */*,audit-id:c207c2fe-18aa-40c1-bb0c-c4cc6e737022,client:10.0.0.181,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-2a5c2eda-5811-4d26-9b9b-a1b0e939d4b0,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:03.520) (total time: 1028ms):
Trace[1283231803]: ---"About to write a response" 1028ms (18:29:04.548)
Trace[1283231803]: [1.028541067s] [1.028541067s] END
I0331 18:29:04.549521       1 trace.go:236] Trace[1468528163]: "Get" accept:application/json, */*,audit-id:838df976-4033-4dfb-9bb8-d07fff70b9b9,client:10.0.0.135,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:03.381) (total time: 1167ms):
Trace[1468528163]: ---"About to write a response" 1167ms (18:29:04.548)
Trace[1468528163]: [1.16773578s] [1.16773578s] END
I0331 18:29:04.551564       1 trace.go:236] Trace[27254913]: "Get" accept:application/json,audit-id:8e729963-280d-478b-9965-e9b47515bfc7,client:199.204.45.57,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:29:03.524) (total time: 1027ms):
Trace[27254913]: ---"About to write a response" 1026ms (18:29:04.550)
Trace[27254913]: [1.027182836s] [1.027182836s] END
I0331 18:29:15.288568       1 trace.go:236] Trace[1190958738]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a8b6a44c-e3f1-44fc-948b-49416e876102,client:199.204.45.57,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:29:14.508) (total time: 779ms):
Trace[1190958738]: ---"About to write a response" 779ms (18:29:15.288)
Trace[1190958738]: [779.600379ms] [779.600379ms] END
I0331 18:29:15.290511       1 trace.go:236] Trace[1268176096]: "Get" accept:application/json,audit-id:36ef8200-ea18-4e30-a9a2-ab5c0e7a8db5,client:199.204.45.57,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:29:14.622) (total time: 667ms):
Trace[1268176096]: ---"About to write a response" 667ms (18:29:15.290)
Trace[1268176096]: [667.919279ms] [667.919279ms] END
I0331 18:29:40.298003       1 trace.go:236] Trace[1529679960]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5a69c734-5482-44b4-90e2-22343b5267b1,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:39.753) (total time: 544ms):
Trace[1529679960]: ["GuaranteedUpdate etcd3" audit-id:5a69c734-5482-44b4-90e2-22343b5267b1,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 544ms (18:29:39.753)
Trace[1529679960]:  ---"Txn call completed" 543ms (18:29:40.297)]
Trace[1529679960]: [544.196652ms] [544.196652ms] END
I0331 18:29:53.974708       1 trace.go:236] Trace[24212352]: "Update" accept:application/json, */*,audit-id:7e195178-4d72-4173-a20e-6dd52df6dc44,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:49.979) (total time: 3995ms):
Trace[24212352]: ["GuaranteedUpdate etcd3" audit-id:7e195178-4d72-4173-a20e-6dd52df6dc44,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 3995ms (18:29:49.979)
Trace[24212352]:  ---"Txn call completed" 3994ms (18:29:53.974)]
Trace[24212352]: [3.995592301s] [3.995592301s] END
I0331 18:29:53.974766       1 trace.go:236] Trace[746378749]: "Update" accept:application/json, */*,audit-id:9322069e-dbdf-4660-969c-9a1025dba4e9,client:10.0.0.135,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:49.976) (total time: 3997ms):
Trace[746378749]: ["GuaranteedUpdate etcd3" audit-id:9322069e-dbdf-4660-969c-9a1025dba4e9,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3997ms (18:29:49.977)
Trace[746378749]:  ---"Txn call completed" 3996ms (18:29:53.974)]
Trace[746378749]: [3.997739951s] [3.997739951s] END
I0331 18:29:53.974793       1 trace.go:236] Trace[2016900347]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:abe10660-260a-40f2-a1c3-b10057c94272,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:29:49.976) (total time: 3997ms):
Trace[2016900347]: ["GuaranteedUpdate etcd3" audit-id:abe10660-260a-40f2-a1c3-b10057c94272,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3997ms (18:29:49.976)
Trace[2016900347]:  ---"Txn call completed" 3996ms (18:29:53.974)]
Trace[2016900347]: [3.997859554s] [3.997859554s] END
I0331 18:29:55.468521       1 trace.go:236] Trace[1072680976]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:761d3dba-e298-4b36-b216-f782adf32e1b,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:50.484) (total time: 4983ms):
Trace[1072680976]: ["GuaranteedUpdate etcd3" audit-id:761d3dba-e298-4b36-b216-f782adf32e1b,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4983ms (18:29:50.484)
Trace[1072680976]:  ---"Txn call completed" 4982ms (18:29:55.468)]
Trace[1072680976]: [4.983692756s] [4.983692756s] END
I0331 18:29:55.469653       1 trace.go:236] Trace[576423998]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7484bc97-e363-4000-9493-6c87f00a22b7,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:50.740) (total time: 4729ms):
Trace[576423998]: ["GuaranteedUpdate etcd3" audit-id:7484bc97-e363-4000-9493-6c87f00a22b7,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4729ms (18:29:50.740)
Trace[576423998]:  ---"Txn call completed" 4728ms (18:29:55.469)]
Trace[576423998]: [4.72911739s] [4.72911739s] END
I0331 18:29:55.469686       1 trace.go:236] Trace[1934172717]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0af9695c-a779-41da-8984-b6fc107e442f,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:29:51.410) (total time: 4059ms):
Trace[1934172717]: ["GuaranteedUpdate etcd3" audit-id:0af9695c-a779-41da-8984-b6fc107e442f,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 4059ms (18:29:51.410)
Trace[1934172717]:  ---"Txn call completed" 4058ms (18:29:55.469)]
Trace[1934172717]: [4.059362799s] [4.059362799s] END
I0331 18:29:55.469968       1 trace.go:236] Trace[1430291022]: "Get" accept:application/json, */*,audit-id:72641be2-819f-41ff-8a4b-e661fb5e0f74,client:10.0.0.43,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (31-Mar-2026 18:29:50.206) (total time: 5263ms):
Trace[1430291022]: ---"About to write a response" 5262ms (18:29:55.469)
Trace[1430291022]: [5.26327021s] [5.26327021s] END
E0331 18:29:57.193273       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0331 18:29:57.193421       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:29:57.194677       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:29:57.194765       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:29:57.195950       1 trace.go:236] Trace[12199485]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e781cb65-d368-4dd4-8be5-4ee678654296,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:52.193) (total time: 5002ms):
Trace[12199485]: [5.002645992s] [5.002645992s] END
E0331 18:29:57.196211       1 timeout.go:142] post-timeout activity - time-elapsed: 2.749844ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
I0331 18:29:59.675657       1 trace.go:236] Trace[755234282]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c5c10f62-621a-43b3-965b-255250561dd5,client:199.204.45.57,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:29:53.780) (total time: 5894ms):
Trace[755234282]: ["GuaranteedUpdate etcd3" audit-id:c5c10f62-621a-43b3-965b-255250561dd5,key:/minions/instance,type:*core.Node,resource:nodes 5894ms (18:29:53.781)
Trace[755234282]:  ---"Txn call completed" 5887ms (18:29:59.674)]
Trace[755234282]: ---"Object stored in database" 5889ms (18:29:59.675)
Trace[755234282]: [5.894686841s] [5.894686841s] END
E0331 18:30:00.976868       1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out
I0331 18:30:00.977083       1 trace.go:236] Trace[1077034262]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:705c2237-fd87-4d90-8e4a-5d3241783684,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:29:53.974) (total time: 7002ms):
Trace[1077034262]: ["GuaranteedUpdate etcd3" audit-id:705c2237-fd87-4d90-8e4a-5d3241783684,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (18:29:53.974)
Trace[1077034262]:  ---"Txn call failed" err:etcdserver: request timed out 7001ms (18:30:00.976)]
Trace[1077034262]: [7.002675909s] [7.002675909s] END
E0331 18:30:00.977492       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0331 18:30:00.977682       1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded
E0331 18:30:00.978023       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:00.978785       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:00.978890       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:00.979089       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0331 18:30:00.979879       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
I0331 18:30:00.980012       1 trace.go:236] Trace[537206400]: "Get" accept:application/json, */*,audit-id:defd726a-0def-4ebf-89e0-b059a4f5c688,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:55.977) (total time: 5002ms):
Trace[537206400]: [5.002585569s] [5.002585569s] END
E0331 18:30:00.980189       1 timeout.go:142] post-timeout activity - time-elapsed: 2.5733ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0331 18:30:00.980241       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:00.982227       1 trace.go:236] Trace[1376672575]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eb5f89b0-3364-4244-a0a6-b13da6f6a124,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:55.977) (total time: 5004ms):
Trace[1376672575]: [5.00429967s] [5.00429967s] END
E0331 18:30:00.982371       1 timeout.go:142] post-timeout activity - time-elapsed: 4.613358ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
E0331 18:30:01.093831       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:01.093950       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:01.094978       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:01.095059       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:01.096267       1 trace.go:236] Trace[218536332]: "Get" accept:application/json, */*,audit-id:12271e34-2202-4118-b1ac-3ec7e7b972c1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:51.093) (total time: 10002ms):
Trace[218536332]: [10.00264582s] [10.00264582s] END
E0331 18:30:01.096399       1 timeout.go:142] post-timeout activity - time-elapsed: 2.54634ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: <nil>
E0331 18:30:01.332781       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:01.333532       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:01.334735       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:01.334790       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:01.335892       1 trace.go:236] Trace[689285171]: "Get" accept:application/json, */*,audit-id:beb1d314-773b-4072-839a-e89f7c889bd1,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:51.332) (total time: 10003ms):
Trace[689285171]: [10.003328075s] [10.003328075s] END
E0331 18:30:01.336047       1 timeout.go:142] post-timeout activity - time-elapsed: 2.466778ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: <nil>
E0331 18:30:01.507539       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:01.507691       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:01.508727       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:01.508803       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:01.510017       1 trace.go:236] Trace[152324752]: "Get" accept:application/json, */*,audit-id:c598aba7-93da-4e45-a53a-69519c31b7f5,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:29:51.508) (total time: 10001ms):
Trace[152324752]: [10.001755529s] [10.001755529s] END
E0331 18:30:01.510168       1 timeout.go:142] post-timeout activity - time-elapsed: 2.689863ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: <nil>
E0331 18:30:01.546455       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:01.546564       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:01.547668       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:01.547715       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:01.548800       1 trace.go:236] Trace[175040153]: "Get" accept:application/json, */*,audit-id:9afeac44-16b8-4478-ae57-f1211f5ba183,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:51.547) (total time: 10001ms):
Trace[175040153]: [10.001576214s] [10.001576214s] END
E0331 18:30:01.548942       1 timeout.go:142] post-timeout activity - time-elapsed: 2.418677ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
I0331 18:30:01.730564       1 trace.go:236] Trace[1559933439]: "Update" accept:application/json, */*,audit-id:9d40d302-5836-41dc-909a-f7b27aa078cb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:30:01.094) (total time: 635ms):
Trace[1559933439]: ["GuaranteedUpdate etcd3" audit-id:9d40d302-5836-41dc-909a-f7b27aa078cb,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 635ms (18:30:01.095)
Trace[1559933439]:  ---"Txn call completed" 633ms (18:30:01.730)]
Trace[1559933439]: [635.532869ms] [635.532869ms] END
I0331 18:30:01.730665       1 trace.go:236] Trace[971372788]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d4317dee-b8bb-441b-b052-1c04b7e05a51,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (31-Mar-2026 18:29:56.227) (total time: 5502ms):
Trace[971372788]: ["GuaranteedUpdate etcd3" audit-id:d4317dee-b8bb-441b-b052-1c04b7e05a51,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 5502ms (18:29:56.228)
Trace[971372788]:  ---"Txn call completed" 5501ms (18:30:01.730)]
Trace[971372788]: [5.502706729s] [5.502706729s] END
I0331 18:30:01.730695       1 trace.go:236] Trace[348619076]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:da392725-8437-41d1-b085-c42961e43f74,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:57.472) (total time: 4258ms):
Trace[348619076]: ["GuaranteedUpdate etcd3" audit-id:da392725-8437-41d1-b085-c42961e43f74,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4257ms (18:29:57.472)
Trace[348619076]:  ---"Txn call completed" 4256ms (18:30:01.730)]
Trace[348619076]: [4.258084233s] [4.258084233s] END
I0331 18:30:01.731245       1 trace.go:236] Trace[1198653454]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6e63c6d5-4c76-4016-aca8-bd290d9fab50,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:30:00.979) (total time: 751ms):
Trace[1198653454]: ["GuaranteedUpdate etcd3" audit-id:6e63c6d5-4c76-4016-aca8-bd290d9fab50,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 751ms (18:30:00.979)
Trace[1198653454]:  ---"Txn call completed" 749ms (18:30:01.730)]
Trace[1198653454]: [751.493861ms] [751.493861ms] END
I0331 18:30:01.731256       1 trace.go:236] Trace[833980025]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:39c3d157-b581-493d-acb0-e7435364b0d4,client:10.0.0.32,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:29:51.911) (total time: 9819ms):
Trace[833980025]: ---"About to write a response" 9818ms (18:30:01.730)
Trace[833980025]: [9.819231704s] [9.819231704s] END
I0331 18:30:01.731571       1 trace.go:236] Trace[571218002]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cffc0b71-67c2-478e-92d8-89e14ac17f42,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:29:57.471) (total time: 4259ms):
Trace[571218002]: ["GuaranteedUpdate etcd3" audit-id:cffc0b71-67c2-478e-92d8-89e14ac17f42,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4259ms (18:29:57.471)
Trace[571218002]:  ---"Txn call completed" 4257ms (18:30:01.731)]
Trace[571218002]: [4.259772283s] [4.259772283s] END
I0331 18:30:01.731637       1 trace.go:236] Trace[1030104185]: "Update" accept:application/json, */*,audit-id:3f074202-78ee-4898-b3da-e701769c27f6,client:10.0.0.43,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (31-Mar-2026 18:29:55.472) (total time: 6258ms):
Trace[1030104185]: ["GuaranteedUpdate etcd3" audit-id:3f074202-78ee-4898-b3da-e701769c27f6,key:/leases/cert-manager/cert-manager-controller,type:*coordination.Lease,resource:leases.coordination.k8s.io 6258ms (18:29:55.472)
Trace[1030104185]:  ---"Txn call completed" 6256ms (18:30:01.730)]
Trace[1030104185]: [6.258820848s] [6.258820848s] END
I0331 18:30:01.732427       1 trace.go:236] Trace[1034038930]: "Get" accept:application/json,audit-id:7feede59-877b-4cfa-9536-f657c9606822,client:199.204.45.57,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:29:50.335) (total time: 11397ms):
Trace[1034038930]: ---"About to write a response" 11396ms (18:30:01.732)
Trace[1034038930]: [11.397102753s] [11.397102753s] END
E0331 18:30:01.734860       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:01.734896       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:01.734914       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.73µs, panicked: false, err: context canceled, panic-reason: <nil>
E0331 18:30:01.736856       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0331 18:30:01.736940       1 timeout.go:142] post-timeout activity - time-elapsed: 2.11571ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: <nil>
E0331 18:30:02.193754       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:02.193885       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:02.194901       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:02.195031       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:02.196260       1 trace.go:236] Trace[1569745302]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0823265f-c1df-4884-b67d-6e74d95219e0,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:29:59.195) (total time: 3000ms):
Trace[1569745302]: [3.000739149s] [3.000739149s] END
E0331 18:30:02.196474       1 timeout.go:142] post-timeout activity - time-elapsed: 2.775495ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: <nil>
I0331 18:30:05.662190       1 trace.go:236] Trace[1576791087]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:68b3d08f-6a41-448e-b928-59a7f5ec8d3e,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:03.733) (total time: 1928ms):
Trace[1576791087]: ["GuaranteedUpdate etcd3" audit-id:68b3d08f-6a41-448e-b928-59a7f5ec8d3e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1928ms (18:30:03.734)
Trace[1576791087]:  ---"Txn call completed" 1927ms (18:30:05.661)]
Trace[1576791087]: [1.928158461s] [1.928158461s] END
I0331 18:30:05.938707       1 trace.go:236] Trace[388711535]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:922a495f-b6a9-4343-9710-463aa7c9ea25,client:199.204.45.57,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18a2008567391187,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:29:51.104) (total time: 14833ms):
Trace[388711535]: ["GuaranteedUpdate etcd3" audit-id:922a495f-b6a9-4343-9710-463aa7c9ea25,key:/events/openstack/percona-xtradb-haproxy-0.18a2008567391187,type:*core.Event,resource:events 14833ms (18:29:51.105)
Trace[388711535]:  ---"initial value restored" 10626ms (18:30:01.731)
Trace[388711535]:  ---"Transaction prepared" 3630ms (18:30:05.362)
Trace[388711535]:  ---"Txn call completed" 575ms (18:30:05.938)]
Trace[388711535]: ---"Object stored in database" 4206ms (18:30:05.938)
Trace[388711535]: [14.833705493s] [14.833705493s] END
I0331 18:30:05.938800       1 trace.go:236] Trace[1928076187]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:34e5868d-6b67-4688-bc8a-87d7199df0ac,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:30:03.733) (total time: 2204ms):
Trace[1928076187]: ["GuaranteedUpdate etcd3" audit-id:34e5868d-6b67-4688-bc8a-87d7199df0ac,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2204ms (18:30:03.734)
Trace[1928076187]:  ---"Txn call completed" 2203ms (18:30:05.938)]
Trace[1928076187]: [2.204844555s] [2.204844555s] END
E0331 18:30:05.976852       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:05.976966       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:05.977782       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled
E0331 18:30:05.977968       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
E0331 18:30:05.978084       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout
E0331 18:30:05.979154       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
E0331 18:30:05.979158       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout
I0331 18:30:05.979183       1 trace.go:236] Trace[1240442377]: "Get" accept:application/json, */*,audit-id:3057613e-b537-4638-9265-f2aa5d889a4d,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:30:02.979) (total time: 2999ms):
Trace[1240442377]: [2.999433988s] [2.999433988s] END
E0331 18:30:05.979259       1 timeout.go:142] post-timeout activity - time-elapsed: 2.525819ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: <nil>
E0331 18:30:05.980675       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout
I0331 18:30:05.980700       1 trace.go:236] Trace[645705024]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b120123c-d9d8-4ee8-afdd-32a9d7d32f30,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:30:02.980) (total time: 3000ms):
Trace[645705024]: [3.000542874s] [3.000542874s] END
E0331 18:30:05.980742       1 timeout.go:142] post-timeout activity - time-elapsed: 2.879797ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: <nil>
I0331 18:30:06.081993       1 trace.go:236] Trace[612950532]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7db43284-e91c-42f4-be40-1524c8da5a6d,client:10.0.0.32,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (31-Mar-2026 18:30:01.738) (total time: 4343ms):
Trace[612950532]: [4.3435535s] [4.3435535s] END
I0331 18:30:06.082161       1 trace.go:236] Trace[1302090030]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d471cddd-87b9-4264-b583-7f7f251293a6,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:30:01.732) (total time: 4349ms):
Trace[1302090030]: ---"About to write a response" 4349ms (18:30:06.081)
Trace[1302090030]: [4.349316936s] [4.349316936s] END
I0331 18:30:06.082474       1 trace.go:236] Trace[1562087574]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f7c29fe0-1c2f-43f2-98c4-4a768c6fe356,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:30:02.363) (total time: 3718ms):
Trace[1562087574]: ---"About to write a response" 3718ms (18:30:06.082)
Trace[1562087574]: [3.718987379s] [3.718987379s] END
I0331 18:30:06.084534       1 trace.go:236] Trace[1153625897]: "Get" accept:application/json,audit-id:8bc11aa5-68ea-476b-9075-c805e11696ae,client:199.204.45.57,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 18:30:02.736) (total time: 3348ms):
Trace[1153625897]: ---"About to write a response" 3347ms (18:30:06.083)
Trace[1153625897]: [3.348141463s] [3.348141463s] END
I0331 18:30:06.086994       1 trace.go:236] Trace[22856376]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.57,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:29:58.075) (total time: 8011ms):
Trace[22856376]: ---"initial value restored" 7862ms (18:30:05.938)
Trace[22856376]: ---"Transaction prepared" 144ms (18:30:06.082)
Trace[22856376]: [8.011439799s] [8.011439799s] END
I0331 18:31:06.539019       1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.110.137.192"}
I0331 18:31:12.942563       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.100.228.174"}
I0331 18:31:12.951498       1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.106.205.40"}
I0331 18:31:50.275526       1 trace.go:236] Trace[1550521415]: "Update" accept:application/json, */*,audit-id:cbf4d282-2036-4b85-9985-84e70ee01da7,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:31:49.611) (total time: 663ms):
Trace[1550521415]: ["GuaranteedUpdate etcd3" audit-id:cbf4d282-2036-4b85-9985-84e70ee01da7,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 663ms (18:31:49.611)
Trace[1550521415]:  ---"Txn call completed" 662ms (18:31:50.275)]
Trace[1550521415]: [663.984985ms] [663.984985ms] END
I0331 18:33:56.859977       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
I0331 18:34:00.689422       1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager
I0331 18:34:00.718130       1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager
I0331 18:34:04.568729       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:34:04.576901       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:34:04.592859       1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager
I0331 18:34:04.603908       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:34:04.613403       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:34:04.622739       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:34:04.631876       1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager
I0331 18:34:06.639349       1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io
I0331 18:34:16.473524       1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io
I0331 18:34:53.127655       1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev
I0331 18:35:07.327304       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:35:07.516426       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:07.540234       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:07.546830       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:07.793671       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:35:08.101250       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:08.106337       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:08.163733       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager
I0331 18:35:08.177154       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:08.350988       1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager
I0331 18:35:47.466869       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.108.174.9"}
I0331 18:35:47.480975       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.39.39"}
I0331 18:35:47.488039       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.99.128.139"}
I0331 18:35:47.495337       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.107.18.24"}
I0331 18:35:47.505388       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.105.133.53"}
I0331 18:35:47.512894       1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.104.61.179"}
I0331 18:35:47.569677       1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com
I0331 18:35:47.583172       1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com
I0331 18:35:47.613165       1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com
I0331 18:35:47.622255       1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com
I0331 18:35:47.649836       1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com
W0331 18:35:47.661093       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.661130       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.661522       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.661549       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.661547       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.661579       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.661603       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.661662       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.661977       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.662030       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.662127       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.662167       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.662285       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.662304       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.662492       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.662613       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.663074       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.663103       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.663976       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.663989       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.663995       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.664023       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.664032       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.664003       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.664497       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.664525       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.664835       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.664870       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.665088       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.665122       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
W0331 18:35:47.665249       1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
E0331 18:35:47.665286       1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.61.179:443: connect: connection refused
I0331 18:35:58.655735       1 trace.go:236] Trace[1400714388]: "Get" accept:application/json, */*,audit-id:92341e56-7834-4303-86a7-58950a263a90,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:35:58.075) (total time: 579ms):
Trace[1400714388]: ---"About to write a response" 579ms (18:35:58.655)
Trace[1400714388]: [579.959106ms] [579.959106ms] END
I0331 18:35:58.655800       1 trace.go:236] Trace[137917333]: "Get" accept:application/json, */*,audit-id:d00a74e5-f983-48e5-b828-c0df0d4fe79c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:35:58.079) (total time: 575ms):
Trace[137917333]: ---"About to write a response" 575ms (18:35:58.655)
Trace[137917333]: [575.85215ms] [575.85215ms] END
I0331 18:35:58.656179       1 trace.go:236] Trace[1769793973]: "Get" accept:application/json, */*,audit-id:7124caf9-acac-41f3-9fcc-8bb00b40cec1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:35:58.079) (total time: 576ms):
Trace[1769793973]: ---"About to write a response" 576ms (18:35:58.656)
Trace[1769793973]: [576.550417ms] [576.550417ms] END
I0331 18:35:58.656212       1 trace.go:236] Trace[1817034540]: "Get" accept:application/json, */*,audit-id:4d54deec-439b-4820-af4a-a14f6131d8f2,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:35:58.079) (total time: 576ms):
Trace[1817034540]: ---"About to write a response" 576ms (18:35:58.656)
Trace[1817034540]: [576.635019ms] [576.635019ms] END
I0331 18:35:58.656193       1 trace.go:236] Trace[1097059309]: "Create" accept:application/json,audit-id:6cbfc66c-a4a2-48a5-965d-e7af3124c7e2,client:199.204.45.57,protocol:HTTP/2.0,resource:namespaces,scope:resource,url:/api/v1/namespaces,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 18:35:57.836) (total time: 819ms):
Trace[1097059309]: ["Create etcd3" audit-id:6cbfc66c-a4a2-48a5-965d-e7af3124c7e2,key:/namespaces/monitoring,type:*core.Namespace,resource:namespaces 818ms (18:35:57.837)
Trace[1097059309]:  ---"Txn call succeeded" 817ms (18:35:58.655)]
Trace[1097059309]: [819.688214ms] [819.688214ms] END
I0331 18:35:58.656526       1 trace.go:236] Trace[1605848206]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:401319f9-a3fb-4d5d-9f29-1789c90f312f,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/kube-prometheus-stack-kube-state-metrics-c7bd54d7-5tknp,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:35:57.875) (total time: 781ms):
Trace[1605848206]: ---"About to write a response" 781ms (18:35:58.656)
Trace[1605848206]: [781.336847ms] [781.336847ms] END
I0331 18:35:58.657660       1 trace.go:236] Trace[1562968039]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:498edc12-7add-4ce5-ac78-723467871bcb,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:35:57.873) (total time: 783ms):
Trace[1562968039]: ---"About to write a response" 783ms (18:35:58.657)
Trace[1562968039]: [783.543229ms] [783.543229ms] END
I0331 18:35:58.893676       1 trace.go:236] Trace[687790575]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:46742604-fee0-4a6f-a8cf-93a6889710bd,client:199.204.45.57,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events/kube-prometheus-stack-prometheus-node-exporter-ln46w.18a200de2ca12e04,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:35:58.378) (total time: 515ms):
Trace[687790575]: ["GuaranteedUpdate etcd3" audit-id:46742604-fee0-4a6f-a8cf-93a6889710bd,key:/events/monitoring/kube-prometheus-stack-prometheus-node-exporter-ln46w.18a200de2ca12e04,type:*core.Event,resource:events 515ms (18:35:58.378)
Trace[687790575]:  ---"initial value restored" 276ms (18:35:58.654)
Trace[687790575]:  ---"Txn call completed" 237ms (18:35:58.893)]
Trace[687790575]: ---"Object stored in database" 237ms (18:35:58.893)
Trace[687790575]: [515.392996ms] [515.392996ms] END
I0331 18:35:58.946683       1 trace.go:236] Trace[679131433]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.57,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 18:35:58.093) (total time: 852ms):
Trace[679131433]: ---"initial value restored" 561ms (18:35:58.655)
Trace[679131433]: ---"Transaction prepared" 72ms (18:35:58.727)
Trace[679131433]: ---"Txn call completed" 219ms (18:35:58.946)
Trace[679131433]: [852.678765ms] [852.678765ms] END
I0331 18:35:59.384556       1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.97.50.110"}
I0331 18:35:59.406575       1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.108.245.74"}
I0331 18:36:02.546142       1 trace.go:236] Trace[1144558552]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:20770e2f-f43a-4218-8745-6343e39142a8,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:36:01.797) (total time: 748ms):
Trace[1144558552]: ["GuaranteedUpdate etcd3" audit-id:20770e2f-f43a-4218-8745-6343e39142a8,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 748ms (18:36:01.797)
Trace[1144558552]:  ---"Txn call completed" 747ms (18:36:02.545)]
Trace[1144558552]: [748.868807ms] [748.868807ms] END
I0331 18:36:02.548040       1 trace.go:236] Trace[1465411442]: "Get" accept:application/json, */*,audit-id:25e21841-3a22-4c59-a36e-093d6b339aa8,client:10.0.0.181,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d146960c-b455-442e-b0b5-ddb2ce1bb018,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:36:01.889) (total time: 658ms):
Trace[1465411442]: ---"About to write a response" 657ms (18:36:02.547)
Trace[1465411442]: [658.053212ms] [658.053212ms] END
I0331 18:36:02.550034       1 trace.go:236] Trace[737684320]: "List" accept:application/json, */*,audit-id:9d75bdd6-042c-4968-97f7-23120523efa9,client:199.204.45.57,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/monitoring/secrets,user-agent:Helm/3.11.2,verb:LIST (31-Mar-2026 18:36:01.877) (total time: 672ms):
Trace[737684320]: ["List(recursive=true) etcd3" audit-id:9d75bdd6-042c-4968-97f7-23120523efa9,key:/secrets/monitoring,resourceVersion:,resourceVersionMatch:,limit:0,continue: 672ms (18:36:01.877)]
Trace[737684320]: [672.295196ms] [672.295196ms] END
I0331 18:36:02.553387       1 trace.go:236] Trace[197796925]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a589aa24-32c6-47f3-ba72-16c6c4351e7e,client:199.204.45.57,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/monitoring/serviceaccounts/vector/token,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (31-Mar-2026 18:36:01.887) (total time: 665ms):
Trace[197796925]: ---"Write to database call succeeded" len:144 665ms (18:36:02.553)
Trace[197796925]: [665.737942ms] [665.737942ms] END
I0331 18:36:04.185172       1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.104.124.73"}
I0331 18:36:07.769715       1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.111.208.42"}
I0331 18:36:12.201169       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.102.150.52"}
I0331 18:36:13.044838       1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.103.199.80"}
I0331 18:36:14.297080       1 trace.go:236] Trace[1419013733]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:850f4280-cd46-4007-bd91-6c5133da2673,client:199.204.45.57,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/memcached,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (31-Mar-2026 18:36:13.774) (total time: 522ms):
Trace[1419013733]: ["GuaranteedUpdate etcd3" audit-id:850f4280-cd46-4007-bd91-6c5133da2673,key:/services/endpoints/openstack/memcached,type:*core.Endpoints,resource:endpoints 522ms (18:36:13.774)
Trace[1419013733]:  ---"Txn call completed" 521ms (18:36:14.296)]
Trace[1419013733]: [522.476858ms] [522.476858ms] END
I0331 18:36:14.576936       1 trace.go:236] Trace[711776765]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b8fc8b21-be2d-4ec2-8fb9-209310351967,client:199.204.45.57,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/memcached-metrics,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpoint-controller,verb:PUT (31-Mar-2026 18:36:13.777) (total time: 799ms):
Trace[711776765]: ["GuaranteedUpdate etcd3" audit-id:b8fc8b21-be2d-4ec2-8fb9-209310351967,key:/services/endpoints/openstack/memcached-metrics,type:*core.Endpoints,resource:endpoints 799ms (18:36:13.777)
Trace[711776765]:  ---"Txn call completed" 797ms (18:36:14.576)]
Trace[711776765]: [799.285701ms] [799.285701ms] END
I0331 18:36:14.576976       1 trace.go:236] Trace[1910061888]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2265fd76-46d8-482c-9859-117ef3416870,client:199.204.45.57,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/memcached-zr7ct,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (31-Mar-2026 18:36:13.775) (total time: 801ms):
Trace[1910061888]: ["GuaranteedUpdate etcd3" audit-id:2265fd76-46d8-482c-9859-117ef3416870,key:/endpointslices/openstack/memcached-zr7ct,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 801ms (18:36:13.775)
Trace[1910061888]:  ---"Txn call completed" 800ms (18:36:14.576)]
Trace[1910061888]: [801.705257ms] [801.705257ms] END
I0331 18:36:14.577262       1 trace.go:236] Trace[457510039]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:125583e3-7fdf-4786-b9f3-46bfa265c701,client:199.204.45.57,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/openstack/endpointslices/memcached-metrics-ggg5q,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:endpointslice-controller,verb:PUT (31-Mar-2026 18:36:13.777) (total time: 799ms):
Trace[457510039]: ["GuaranteedUpdate etcd3" audit-id:125583e3-7fdf-4786-b9f3-46bfa265c701,key:/endpointslices/openstack/memcached-metrics-ggg5q,type:*discovery.EndpointSlice,resource:endpointslices.discovery.k8s.io 799ms (18:36:13.777)
Trace[457510039]:  ---"Txn call completed" 799ms (18:36:14.576)]
Trace[457510039]: [799.957267ms] [799.957267ms] END
I0331 18:36:14.577542       1 trace.go:236] Trace[1181103407]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b513c94b-f2c5-429e-bf07-2dd0801a7082,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:36:13.810) (total time: 766ms):
Trace[1181103407]: ["GuaranteedUpdate etcd3" audit-id:b513c94b-f2c5-429e-bf07-2dd0801a7082,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 766ms (18:36:13.810)
Trace[1181103407]:  ---"Txn call completed" 765ms (18:36:14.577)]
Trace[1181103407]: [766.832633ms] [766.832633ms] END
I0331 18:36:14.578539       1 trace.go:236] Trace[2142840440]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:86dab31d-4250-42d3-9e6a-ae72e59350ee,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/kube-prometheus-stack-prometheus-node-exporter-ln46w/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:36:13.778) (total time: 800ms):
Trace[2142840440]: ["GuaranteedUpdate etcd3" audit-id:86dab31d-4250-42d3-9e6a-ae72e59350ee,key:/pods/monitoring/kube-prometheus-stack-prometheus-node-exporter-ln46w,type:*core.Pod,resource:pods 799ms (18:36:13.778)
Trace[2142840440]:  ---"Txn call completed" 792ms (18:36:14.577)]
Trace[2142840440]: ---"Object stored in database" 793ms (18:36:14.577)
Trace[2142840440]: [800.075569ms] [800.075569ms] END
I0331 18:36:14.748232       1 trace.go:236] Trace[1420185758]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:38e2f5b1-a363-4415-b06b-2627e247066c,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 18:36:14.050) (total time: 697ms):
Trace[1420185758]: ["GuaranteedUpdate etcd3" audit-id:38e2f5b1-a363-4415-b06b-2627e247066c,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 697ms (18:36:14.050)
Trace[1420185758]:  ---"Txn call completed" 696ms (18:36:14.747)]
Trace[1420185758]: [697.517915ms] [697.517915ms] END
I0331 18:36:14.772427       1 trace.go:236] Trace[647336217]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0677594f-4130-434d-aeb3-c57ea3078159,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:36:13.851) (total time: 920ms):
Trace[647336217]: ---"About to write a response" 920ms (18:36:14.772)
Trace[647336217]: [920.801308ms] [920.801308ms] END
I0331 18:36:19.645445       1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com
I0331 18:36:19.806411       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.97.199.150"}
I0331 18:36:40.127977       1 trace.go:236] Trace[1729181697]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:86667f28-2342-4790-8832-3f17289b61d8,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:36:39.147) (total time: 980ms):
Trace[1729181697]: ["GuaranteedUpdate etcd3" audit-id:86667f28-2342-4790-8832-3f17289b61d8,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 980ms (18:36:39.147)
Trace[1729181697]:  ---"Txn call completed" 979ms (18:36:40.127)]
Trace[1729181697]: [980.636405ms] [980.636405ms] END
I0331 18:36:40.178723       1 trace.go:236] Trace[1165824574]: "Get" accept:application/json, */*,audit-id:2e6dc412-df75-4ec2-b4fe-bdee23b887a9,client:10.0.0.135,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:36:39.288) (total time: 890ms):
Trace[1165824574]: ---"About to write a response" 890ms (18:36:40.178)
Trace[1165824574]: [890.51562ms] [890.51562ms] END
I0331 18:36:40.181307       1 trace.go:236] Trace[2079672300]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ce7357e2-35c3-41a0-ba6e-6f1b5ef57599,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:36:39.382) (total time: 799ms):
Trace[2079672300]: ---"About to write a response" 799ms (18:36:40.181)
Trace[2079672300]: [799.242729ms] [799.242729ms] END
I0331 18:36:40.181373       1 trace.go:236] Trace[109892954]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3e4a27df-7a0d-4fda-8d52-78d78bf81d57,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rabbitmq-keystone-server-0/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 18:36:39.147) (total time: 1033ms):
Trace[109892954]: ["GuaranteedUpdate etcd3" audit-id:3e4a27df-7a0d-4fda-8d52-78d78bf81d57,key:/pods/openstack/rabbitmq-keystone-server-0,type:*core.Pod,resource:pods 1033ms (18:36:39.147)
Trace[109892954]:  ---"Txn call completed" 1026ms (18:36:40.180)]
Trace[109892954]: ---"Object stored in database" 1027ms (18:36:40.181)
Trace[109892954]: [1.0335756s] [1.0335756s] END
I0331 18:36:40.181823       1 trace.go:236] Trace[1721542128]: "Get" accept:application/json, */*,audit-id:da705316-5aac-42c6-86e5-bf4cdb265839,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:36:39.386) (total time: 795ms):
Trace[1721542128]: ---"About to write a response" 795ms (18:36:40.181)
Trace[1721542128]: [795.479161ms] [795.479161ms] END
I0331 18:36:40.182293       1 trace.go:236] Trace[1433394818]: "Get" accept:application/json, */*,audit-id:d9f26d1e-d2bb-4af2-a08e-ee2dfa3383a9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:36:39.376) (total time: 805ms):
Trace[1433394818]: ---"About to write a response" 805ms (18:36:40.182)
Trace[1433394818]: [805.860653ms] [805.860653ms] END
I0331 18:36:40.184540       1 trace.go:236] Trace[1473883258]: "Get" accept:application/json, */*,audit-id:c1528f1c-4411-41f4-ae8e-8484e6bd82a8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:36:39.383) (total time: 801ms):
Trace[1473883258]: ---"About to write a response" 801ms (18:36:40.184)
Trace[1473883258]: [801.224366ms] [801.224366ms] END
I0331 18:36:40.184735       1 trace.go:236] Trace[1227029500]: "Get" accept:application/json, */*,audit-id:89dc4010-4425-40f7-b522-06b2221d71f1,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:36:39.383) (total time: 801ms):
Trace[1227029500]: ---"About to write a response" 801ms (18:36:40.184)
Trace[1227029500]: [801.447781ms] [801.447781ms] END
I0331 18:36:40.185301       1 trace.go:236] Trace[239063642]: "Get" accept:application/json, */*,audit-id:e5635c01-5050-4902-bfe6-62dcbd47026a,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:36:39.381) (total time: 799ms):
Trace[239063642]: ---"About to write a response" 798ms (18:36:40.180)
Trace[239063642]: [799.116377ms] [799.116377ms] END
I0331 18:36:40.185519       1 trace.go:236] Trace[1462480158]: "Get" accept:application/json, */*,audit-id:63acc1da-0d9f-4886-8e9e-4e782eb229df,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-f8w7d,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:36:39.385) (total time: 799ms):
Trace[1462480158]: ---"About to write a response" 794ms (18:36:40.180)
Trace[1462480158]: [799.978396ms] [799.978396ms] END
I0331 18:36:40.187050       1 trace.go:236] Trace[368554843]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5a6c11d7-31a9-43bb-9ff0-1e217eb81a66,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:36:39.340) (total time: 846ms):
Trace[368554843]: ["GuaranteedUpdate etcd3" audit-id:5a6c11d7-31a9-43bb-9ff0-1e217eb81a66,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 846ms (18:36:39.340)
Trace[368554843]:  ---"Txn call completed" 845ms (18:36:40.186)]
Trace[368554843]: [846.586155ms] [846.586155ms] END
I0331 18:37:08.368940       1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.109.90.151"}
I0331 18:37:08.383039       1 controller.go:624] quota admission added evaluator for: cronjobs.batch
I0331 18:40:04.738841       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.101.161.85"}
E0331 18:40:30.928718       1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.204.45.57:52486->199.204.45.57:10250: write: connection reset by peer
I0331 18:40:37.957590       1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.97.106.16"}
I0331 18:42:34.782311       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.789777       1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager
I0331 18:42:34.821447       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.822606       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.838619       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.851952       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.862691       1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager
I0331 18:42:34.881749       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.892255       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.903146       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.912444       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.923866       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.942375       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.959748       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:34.977573       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:35.009513       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:35.043194       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:35.090634       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:35.153426       1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager
I0331 18:42:51.134050       1 trace.go:236] Trace[673086555]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:86a0cb79-8fc2-49d7-a9f7-b083a0bdeb9f,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 18:42:50.525) (total time: 608ms):
Trace[673086555]: ["GuaranteedUpdate etcd3" audit-id:86a0cb79-8fc2-49d7-a9f7-b083a0bdeb9f,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 608ms (18:42:50.525)
Trace[673086555]:  ---"Txn call completed" 607ms (18:42:51.133)]
Trace[673086555]: [608.736066ms] [608.736066ms] END
I0331 18:42:51.151050       1 trace.go:236] Trace[1352572915]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5b6f6189-8c26-40be-81df-b8bb4513ff27,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:42:50.588) (total time: 562ms):
Trace[1352572915]: ["GuaranteedUpdate etcd3" audit-id:5b6f6189-8c26-40be-81df-b8bb4513ff27,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 562ms (18:42:50.588)
Trace[1352572915]:  ---"Txn call completed" 561ms (18:42:51.150)]
Trace[1352572915]: [562.773775ms] [562.773775ms] END
I0331 18:43:16.288052       1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io
I0331 18:43:16.299591       1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io
I0331 18:43:20.154806       1 trace.go:236] Trace[150587594]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c7cba691-70b6-46fb-9b1d-5d5f7f9a750e,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:43:19.276) (total time: 878ms):
Trace[150587594]: ["GuaranteedUpdate etcd3" audit-id:c7cba691-70b6-46fb-9b1d-5d5f7f9a750e,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 877ms (18:43:19.276)
Trace[150587594]:  ---"Txn call completed" 877ms (18:43:20.154)]
Trace[150587594]: [878.040561ms] [878.040561ms] END
I0331 18:43:20.155484       1 trace.go:236] Trace[122219717]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:81737fd0-bcbf-4599-9189-3ee7b999f783,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:43:19.285) (total time: 870ms):
Trace[122219717]: ---"About to write a response" 870ms (18:43:20.155)
Trace[122219717]: [870.25747ms] [870.25747ms] END
I0331 18:43:20.158243       1 trace.go:236] Trace[2041479215]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b612633-fe53-4356-935e-a591daca44f5,client:10.0.0.32,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:19.605) (total time: 552ms):
Trace[2041479215]: ---"About to write a response" 552ms (18:43:20.157)
Trace[2041479215]: [552.571816ms] [552.571816ms] END
I0331 18:43:22.815778       1 trace.go:236] Trace[437008331]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d0335263-109b-4017-b907-e42e9f2a9040,client:10.0.0.30,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:43:22.158) (total time: 657ms):
Trace[437008331]: ["GuaranteedUpdate etcd3" audit-id:d0335263-109b-4017-b907-e42e9f2a9040,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (18:43:22.158)
Trace[437008331]:  ---"Txn call completed" 656ms (18:43:22.815)]
Trace[437008331]: [657.205765ms] [657.205765ms] END
I0331 18:43:23.298389       1 trace.go:236] Trace[1371006414]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6f837bdf-993b-4369-9d74-1da5fe4b2944,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:43:22.160) (total time: 1137ms):
Trace[1371006414]: ["GuaranteedUpdate etcd3" audit-id:6f837bdf-993b-4369-9d74-1da5fe4b2944,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1137ms (18:43:22.160)
Trace[1371006414]:  ---"Txn call completed" 1136ms (18:43:23.298)]
Trace[1371006414]: [1.137944998s] [1.137944998s] END
I0331 18:43:23.301335       1 trace.go:236] Trace[1628806826]: "Get" accept:application/json, */*,audit-id:21dbe69f-209b-48a4-a80c-d13a6cb71d60,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:22.200) (total time: 1101ms):
Trace[1628806826]: ---"About to write a response" 1101ms (18:43:23.301)
Trace[1628806826]: [1.101256804s] [1.101256804s] END
I0331 18:43:23.301465       1 trace.go:236] Trace[2032833953]: "Get" accept:application/json, */*,audit-id:e605f4f0-a672-4adc-a711-4bcb7d00c880,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:22.200) (total time: 1101ms):
Trace[2032833953]: ---"About to write a response" 1100ms (18:43:23.301)
Trace[2032833953]: [1.101067279s] [1.101067279s] END
I0331 18:43:23.301508       1 trace.go:236] Trace[877876085]: "Get" accept:application/json, */*,audit-id:1b37cf7d-8484-4e32-a98d-49635db3b3e7,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:22.199) (total time: 1101ms):
Trace[877876085]: ---"About to write a response" 1101ms (18:43:23.301)
Trace[877876085]: [1.101801297s] [1.101801297s] END
I0331 18:43:23.301720       1 trace.go:236] Trace[2088549351]: "Get" accept:application/json, */*,audit-id:d297504a-eb1c-4fca-ac72-c47467149bc4,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:22.199) (total time: 1102ms):
Trace[2088549351]: ---"About to write a response" 1102ms (18:43:23.301)
Trace[2088549351]: [1.102064383s] [1.102064383s] END
I0331 18:43:23.301783       1 trace.go:236] Trace[1615184078]: "Get" accept:application/json, */*,audit-id:9d599331-a6cb-43f1-bd46-e71efad627d4,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-f8w7d,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:22.202) (total time: 1099ms):
Trace[1615184078]: ---"About to write a response" 1099ms (18:43:23.301)
Trace[1615184078]: [1.099717108s] [1.099717108s] END
I0331 18:43:23.301726       1 trace.go:236] Trace[943513605]: "Get" accept:application/json, */*,audit-id:10e7b1d3-eade-4a7f-8c8a-26c012903288,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:22.199) (total time: 1102ms):
Trace[943513605]: ---"About to write a response" 1102ms (18:43:23.301)
Trace[943513605]: [1.102169835s] [1.102169835s] END
I0331 18:43:23.301348       1 trace.go:236] Trace[203665282]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e7aa7e9f-7e3e-426a-b2f4-2da7e2d05589,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:43:22.170) (total time: 1130ms):
Trace[203665282]: ---"About to write a response" 1130ms (18:43:23.301)
Trace[203665282]: [1.130776622s] [1.130776622s] END
I0331 18:43:23.303415       1 trace.go:236] Trace[1258524162]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6eee7e2d-7050-4037-8371-070c0983cbe0,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:43:22.199) (total time: 1104ms):
Trace[1258524162]: ---"About to write a response" 1103ms (18:43:23.303)
Trace[1258524162]: [1.104069499s] [1.104069499s] END
I0331 18:43:38.256632       1 trace.go:236] Trace[1721017133]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ceb5aa2b-6d10-4606-ab2b-1bab6f301b2b,client:10.0.0.32,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:43:37.341) (total time: 914ms):
Trace[1721017133]: ["GuaranteedUpdate etcd3" audit-id:ceb5aa2b-6d10-4606-ab2b-1bab6f301b2b,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 914ms (18:43:37.342)
Trace[1721017133]:  ---"Txn call completed" 913ms (18:43:38.256)]
Trace[1721017133]: [914.713827ms] [914.713827ms] END
I0331 18:43:38.256731       1 trace.go:236] Trace[1377211422]: "Get" accept:application/json, */*,audit-id:b17aff14-15b4-4f25-aff2-88b1873c6250,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:37.369) (total time: 887ms):
Trace[1377211422]: ---"About to write a response" 887ms (18:43:38.256)
Trace[1377211422]: [887.217036ms] [887.217036ms] END
I0331 18:43:38.352886       1 trace.go:236] Trace[513222007]: "Get" accept:application/json, */*,audit-id:75d5dee8-722e-41ee-b2b6-7f224f1a439f,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:37.384) (total time: 968ms):
Trace[513222007]: ---"About to write a response" 967ms (18:43:38.352)
Trace[513222007]: [968.291386ms] [968.291386ms] END
I0331 18:43:38.352995       1 trace.go:236] Trace[651844447]: "Get" accept:application/json, */*,audit-id:6519066a-5be7-406a-b5d5-f28a789b384f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:37.383) (total time: 969ms):
Trace[651844447]: ---"About to write a response" 969ms (18:43:38.352)
Trace[651844447]: [969.491744ms] [969.491744ms] END
I0331 18:43:38.353530       1 trace.go:236] Trace[472155383]: "Get" accept:application/json, */*,audit-id:be1ddde7-d327-4077-bd4a-28c6a6b4c14b,client:199.204.45.57,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-f8w7d,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:37.393) (total time: 959ms):
Trace[472155383]: ---"About to write a response" 959ms (18:43:38.352)
Trace[472155383]: [959.954851ms] [959.954851ms] END
I0331 18:43:38.354724       1 trace.go:236] Trace[1914141416]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0f447931-0bba-4a6e-9152-923ba70acf06,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:43:37.374) (total time: 980ms):
Trace[1914141416]: ---"About to write a response" 980ms (18:43:38.354)
Trace[1914141416]: [980.191043ms] [980.191043ms] END
I0331 18:43:38.354781       1 trace.go:236] Trace[929781573]: "Get" accept:application/json, */*,audit-id:82dedaf9-2114-4eba-8aa1-e2dc6c15e600,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 18:43:37.380) (total time: 974ms):
Trace[929781573]: ---"About to write a response" 974ms (18:43:38.354)
Trace[929781573]: [974.187123ms] [974.187123ms] END
I0331 18:43:38.354836       1 trace.go:236] Trace[427519628]: "Get" accept:application/json, */*,audit-id:8c6b3ccd-08ab-43b5-90b9-2671aeb89dec,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:43:37.380) (total time: 973ms):
Trace[427519628]: ---"About to write a response" 973ms (18:43:38.354)
Trace[427519628]: [973.779834ms] [973.779834ms] END
I0331 18:43:38.356233       1 trace.go:236] Trace[686021296]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:438155b8-b55c-4a67-831e-85ecc3170210,client:199.204.45.57,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 18:43:37.379) (total time: 977ms):
Trace[686021296]: ---"About to write a response" 977ms (18:43:38.356)
Trace[686021296]: [977.150682ms] [977.150682ms] END
I0331 18:43:40.732579       1 trace.go:236] Trace[202000763]: "Update" accept:application/json, */*,audit-id:11c8d2db-8ec1-4822-b207-f3ea2277a156,client:10.0.0.244,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services/prometheus-operated,user-agent:PrometheusOperator/0.73.0,verb:PUT (31-Mar-2026 18:43:39.006) (total time: 1725ms):
Trace[202000763]: ["GuaranteedUpdate etcd3" audit-id:11c8d2db-8ec1-4822-b207-f3ea2277a156,key:/services/specs/monitoring/prometheus-operated,type:*core.Service,resource:services 1725ms (18:43:39.006)]
Trace[202000763]: [1.725996313s] [1.725996313s] END
I0331 18:43:40.732717       1 trace.go:236] Trace[1974150200]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1b05104f-dd18-4f21-ab12-74d2de81963d,client:199.204.45.57,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 18:43:39.821) (total time: 911ms):
Trace[1974150200]: ---"About to write a response" 911ms (18:43:40.732)
Trace[1974150200]: [911.155863ms] [911.155863ms] END
I0331 18:43:41.391032       1 trace.go:236] Trace[1362373258]: "Update" accept:application/json, */*,audit-id:fb59892a-1d36-499c-9585-4f78c1c087c0,client:10.0.0.135,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:43:40.884) (total time: 506ms):
Trace[1362373258]: ["GuaranteedUpdate etcd3" audit-id:fb59892a-1d36-499c-9585-4f78c1c087c0,key:/leases/cert-manager/cert-manager-cainjector-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 506ms (18:43:40.884)
Trace[1362373258]:  ---"Txn call completed" 505ms (18:43:41.390)]
Trace[1362373258]: [506.830591ms] [506.830591ms] END
I0331 18:43:41.396019       1 trace.go:236] Trace[1021812325]: "Patch" accept:application/json, */*,audit-id:714b4c72-77fe-4b62-98d1-b482dac31f2f,client:10.0.0.244,protocol:HTTP/2.0,resource:prometheuses,scope:resource,url:/apis/monitoring.coreos.com/v1/namespaces/monitoring/prometheuses/kube-prometheus-stack-prometheus/status,user-agent:PrometheusOperator/0.73.0,verb:APPLY (31-Mar-2026 18:43:40.887) (total time: 508ms):
Trace[1021812325]: ["GuaranteedUpdate etcd3" audit-id:714b4c72-77fe-4b62-98d1-b482dac31f2f,key:/monitoring.coreos.com/prometheuses/monitoring/kube-prometheus-stack-prometheus,type:*unstructured.Unstructured,resource:prometheuses.monitoring.coreos.com 507ms (18:43:40.888)
Trace[1021812325]:  ---"Txn call completed" 498ms (18:43:41.391)]
Trace[1021812325]: ---"Object stored in database" 503ms (18:43:41.394)
Trace[1021812325]: [508.448279ms] [508.448279ms] END
I0331 18:43:49.634167       1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.104.18.56"}
I0331 18:43:51.039302       1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.98.250.38"}
I0331 18:44:24.657646       1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.98.165.53"}
I0331 18:44:50.397436       1 trace.go:236] Trace[624558281]: "Update" accept:application/json, */*,audit-id:348810dc-db83-4d6f-9294-22f2ff982101,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 18:44:49.845) (total time: 551ms):
Trace[624558281]: ["GuaranteedUpdate etcd3" audit-id:348810dc-db83-4d6f-9294-22f2ff982101,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 551ms (18:44:49.845)
Trace[624558281]:  ---"Txn call completed" 550ms (18:44:50.397)]
Trace[624558281]: [551.714082ms] [551.714082ms] END
I0331 18:44:50.397467       1 trace.go:236] Trace[2003167851]: "Update" accept:application/json, */*,audit-id:1a1eedd2-4681-4f92-b4b8-4649fd9cb134,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 18:44:49.845) (total time: 551ms):
Trace[2003167851]: ["GuaranteedUpdate etcd3" audit-id:1a1eedd2-4681-4f92-b4b8-4649fd9cb134,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 551ms (18:44:49.845)
Trace[2003167851]:  ---"Txn call completed" 550ms (18:44:50.397)]
Trace[2003167851]: [551.968608ms] [551.968608ms] END
I0331 18:44:50.397480       1 trace.go:236] Trace[904723894]: "Get" accept:application/json, */*,audit-id:244c01f2-a21c-4869-b767-9ffc50868fde,client:10.0.0.24,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 18:44:49.882) (total time: 515ms):
Trace[904723894]: ---"About to write a response" 515ms (18:44:50.397)
Trace[904723894]: [515.163121ms] [515.163121ms] END
I0331 18:47:03.202596       1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.103.238.216"}