I0409 02:05:17.798198 1 options.go:220] external host was not specified, using 199.204.45.238 I0409 02:05:17.798960 1 server.go:148] Version: v1.28.13 I0409 02:05:17.799003 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0409 02:05:18.292759 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0409 02:05:18.299928 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0409 02:05:18.299947 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0409 02:05:18.300177 1 instance.go:298] Using reconciler: lease I0409 02:05:18.828436 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0409 02:05:18.828467 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0409 02:05:19.101115 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0409 02:05:19.102015 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0409 02:05:19.561537 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0409 02:05:19.582788 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0409 02:05:19.582814 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.582819 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.583148 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0409 02:05:19.583159 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0409 02:05:19.583767 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0409 02:05:19.584329 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0409 02:05:19.584341 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0409 02:05:19.584345 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0409 02:05:19.585308 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0409 02:05:19.585320 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0409 02:05:19.585991 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0409 02:05:19.586002 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.586006 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.586436 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0409 02:05:19.586448 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.586475 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0409 02:05:19.586869 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0409 02:05:19.587996 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0409 02:05:19.588008 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.588012 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.588318 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0409 02:05:19.588328 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.588332 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.588880 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0409 02:05:19.588892 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0409 02:05:19.590204 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0409 02:05:19.590216 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.590220 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.590577 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0409 02:05:19.590590 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.590594 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.592134 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0409 02:05:19.592146 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.592150 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.592953 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0409 02:05:19.593793 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0409 02:05:19.593807 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.593811 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.596775 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0409 02:05:19.596788 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0409 02:05:19.596792 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0409 02:05:19.597421 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0409 02:05:19.597432 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0409 02:05:19.597436 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0409 02:05:19.597808 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0409 02:05:19.597819 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0409 02:05:19.635613 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0409 02:05:19.635645 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0409 02:05:19.994027 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0409 02:05:19.994131 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0409 02:05:19.994247 1 secure_serving.go:213] Serving securely on [::]:6443 I0409 02:05:19.994259 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0409 02:05:19.994353 1 controller.go:80] Starting OpenAPI V3 AggregationController I0409 02:05:19.994413 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0409 02:05:19.994469 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0409 02:05:19.994486 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0409 02:05:19.994534 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0409 02:05:19.994559 1 controller.go:78] Starting OpenAPI AggregationController I0409 02:05:19.994599 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0409 02:05:19.994731 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0409 02:05:19.994782 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0409 02:05:19.994807 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0409 02:05:19.994853 1 controller.go:134] Starting OpenAPI controller I0409 02:05:19.994868 1 controller.go:85] Starting OpenAPI V3 controller I0409 02:05:19.994925 1 system_namespaces_controller.go:67] Starting system namespaces controller I0409 02:05:19.994925 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0409 02:05:19.994948 1 naming_controller.go:291] Starting NamingConditionController I0409 02:05:19.994936 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0409 02:05:19.994998 1 establishing_controller.go:76] Starting EstablishingController I0409 02:05:19.995036 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0409 02:05:19.995071 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0409 02:05:19.995104 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0409 02:05:19.995203 1 controller.go:116] Starting legacy_token_tracking_controller I0409 02:05:19.995236 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0409 02:05:19.994959 1 aggregator.go:164] waiting for initial CRD sync... I0409 02:05:19.995110 1 crd_finalizer.go:266] Starting CRDFinalizer I0409 02:05:19.995364 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0409 02:05:19.995373 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0409 02:05:19.995647 1 gc_controller.go:78] Starting apiserver lease garbage collector I0409 02:05:19.996077 1 gc_controller.go:78] Starting apiserver lease garbage collector I0409 02:05:19.996151 1 available_controller.go:423] Starting AvailableConditionController I0409 02:05:19.996218 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0409 02:05:20.093098 1 shared_informer.go:318] Caches are synced for node_authorizer I0409 02:05:20.095337 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0409 02:05:20.095421 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0409 02:05:20.095562 1 shared_informer.go:318] Caches are synced for configmaps I0409 02:05:20.095593 1 apf_controller.go:379] Running API Priority and Fairness config worker I0409 02:05:20.095605 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0409 02:05:20.095783 1 shared_informer.go:318] Caches are synced for crd-autoregister I0409 02:05:20.095849 1 aggregator.go:166] initial CRD sync complete... I0409 02:05:20.095865 1 autoregister_controller.go:141] Starting autoregister controller I0409 02:05:20.095874 1 cache.go:32] Waiting for caches to sync for autoregister controller I0409 02:05:20.095883 1 cache.go:39] Caches are synced for autoregister controller I0409 02:05:20.096313 1 cache.go:39] Caches are synced for AvailableConditionController controller I0409 02:05:20.097785 1 controller.go:624] quota admission added evaluator for: namespaces I0409 02:05:20.109866 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0409 02:05:21.001920 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0409 02:05:21.008867 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0409 02:05:21.008888 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0409 02:05:21.552756 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0409 02:05:21.601055 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0409 02:05:21.710281 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0409 02:05:21.718379 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.238] I0409 02:05:21.719632 1 controller.go:624] quota admission added evaluator for: endpoints I0409 02:05:21.724628 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0409 02:05:22.325872 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0409 02:05:23.559292 1 controller.go:624] quota admission added evaluator for: deployments.apps I0409 02:05:23.605671 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0409 02:05:23.807033 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0409 02:05:27.073099 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0409 02:05:27.271472 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0409 02:05:47.000245 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0409 02:05:47.019937 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0409 02:05:47.019986 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0409 02:05:47.045459 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0409 02:05:47.061570 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0409 02:05:47.069264 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0409 02:05:47.087217 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0409 02:05:47.108618 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0409 02:05:47.108660 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0409 02:05:47.128238 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0409 02:05:47.174115 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0409 02:05:47.174166 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0409 02:05:47.215369 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0409 02:05:47.215427 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0409 02:05:47.255376 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0409 02:05:47.367059 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:47.533622 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0409 02:05:47.533678 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0409 02:05:47.583192 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:47.610473 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:47.643898 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:47.664815 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:48.316667 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:48.438362 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0409 02:05:54.069481 1 controller.go:624] quota admission added evaluator for: jobs.batch I0409 02:05:54.967999 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0409 02:05:55.051395 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0409 02:05:55.250129 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0409 02:05:55.449635 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0409 02:05:55.653805 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0409 02:05:55.875910 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0409 02:05:56.072299 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0409 02:05:56.272794 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0409 02:05:56.455611 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0409 02:05:58.647381 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0409 02:05:59.058682 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0409 02:05:59.534853 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0409 02:05:59.534918 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0409 02:06:03.138749 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0409 02:06:11.911366 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.99.63.98"} W0409 02:06:11.940334 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.63.98:9443: connect: connection refused E0409 02:06:11.940383 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.63.98:9443: connect: connection refused I0409 02:06:23.962432 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0409 02:06:23.971423 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0409 02:06:23.986062 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0409 02:06:23.994070 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.98.170.0"} I0409 02:06:24.001510 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.109.29"} I0409 02:06:24.020370 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0409 02:06:24.067357 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0409 02:06:24.120393 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0409 02:06:35.185054 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0409 02:06:39.786277 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0409 02:06:54.210616 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.97.48.116"} I0409 02:06:54.219146 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.105.36.202"} I0409 02:06:54.228054 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.102.244.61"} I0409 02:06:54.241756 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.103.97.213"} I0409 02:07:00.726071 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.746510 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.766533 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.784900 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.805801 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.832293 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.856910 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.877929 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.906830 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.920177 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0409 02:07:00.943443 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.962753 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:00.979516 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:02.207608 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0409 02:07:05.699465 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0409 02:07:05.755404 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.101.204.2"} I0409 02:07:05.784125 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0409 02:07:07.945682 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0409 02:07:07.986452 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0409 02:07:08.608436 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0409 02:07:08.608538 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0409 02:07:08.608780 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0409 02:07:15.311757 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0409 02:07:18.033769 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.99.221.159"} I0409 02:07:18.310743 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0409 02:07:18.420308 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0409 02:07:18.572379 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.110.135.158"} I0409 02:07:18.593344 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.109.44.7"} I0409 02:08:46.638988 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.105.42.212"} I0409 02:08:49.110020 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.96.92.122"} I0409 02:08:49.118534 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.104.163.4"} I0409 02:08:55.335694 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.106.69.194"} I0409 02:08:55.347716 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.101.141.74"} I0409 02:11:25.094372 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0409 02:11:28.975334 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0409 02:11:29.010027 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0409 02:11:32.917564 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0409 02:11:32.926760 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0409 02:11:32.944642 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0409 02:11:32.956659 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0409 02:11:32.970883 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0409 02:11:32.992600 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0409 02:11:33.001250 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0409 02:11:34.813690 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0409 02:11:41.240478 1 trace.go:236] Trace[561279914]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5142695d-93f4-4c6b-9285-1675344c0ca2,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:39.293) (total time: 1946ms): Trace[561279914]: ["GuaranteedUpdate etcd3" audit-id:5142695d-93f4-4c6b-9285-1675344c0ca2,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1946ms (02:11:39.293) Trace[561279914]: ---"Txn call completed" 1945ms (02:11:41.240)] Trace[561279914]: [1.946969269s] [1.946969269s] END I0409 02:11:41.241891 1 trace.go:236] Trace[1960473481]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f9bb769a-e1d1-4a71-b01f-f1a410eae644,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:40.547) (total time: 694ms): Trace[1960473481]: ["GuaranteedUpdate etcd3" audit-id:f9bb769a-e1d1-4a71-b01f-f1a410eae644,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 694ms (02:11:40.547) Trace[1960473481]: ---"Txn call completed" 692ms (02:11:41.241)] Trace[1960473481]: [694.249082ms] [694.249082ms] END I0409 02:11:41.242407 1 trace.go:236] Trace[266447648]: "Update" accept:application/json, */*,audit-id:1242ed51-5177-4f0f-aa1d-47bb4b279b7c,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:40.547) (total time: 694ms): Trace[266447648]: ["GuaranteedUpdate etcd3" audit-id:1242ed51-5177-4f0f-aa1d-47bb4b279b7c,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 694ms (02:11:40.548) Trace[266447648]: ---"Txn call completed" 693ms (02:11:41.242)] Trace[266447648]: [694.484757ms] [694.484757ms] END I0409 02:11:41.242548 1 trace.go:236] Trace[810648874]: "Get" accept:application/json, */*,audit-id:29f4d69a-ab9b-40c0-a309-6e779dba232d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:39.721) (total time: 1521ms): Trace[810648874]: ---"About to write a response" 1521ms (02:11:41.242) Trace[810648874]: [1.521476014s] [1.521476014s] END I0409 02:11:41.242695 1 trace.go:236] Trace[752572771]: "Get" accept:application/json, */*,audit-id:46fbb28a-a9ea-4b9b-ac7a-395e1df1d0e9,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:40.702) (total time: 540ms): Trace[752572771]: ---"About to write a response" 540ms (02:11:41.242) Trace[752572771]: [540.452413ms] [540.452413ms] END I0409 02:11:41.243124 1 trace.go:236] Trace[461136565]: "Get" accept:application/json, */*,audit-id:c9a9a4e8-1779-4512-bb48-d08e16d7cf79,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-t847z,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:39.832) (total time: 1410ms): Trace[461136565]: ---"About to write a response" 1409ms (02:11:41.242) Trace[461136565]: [1.410167232s] [1.410167232s] END I0409 02:11:41.243508 1 trace.go:236] Trace[315736470]: "Get" accept:application/json, */*,audit-id:8dbd7911-8f9d-48e9-b9da-3f148e3120a5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:39.723) (total time: 1520ms): Trace[315736470]: ---"About to write a response" 1519ms (02:11:41.243) Trace[315736470]: [1.520313754s] [1.520313754s] END I0409 02:11:41.244889 1 trace.go:236] Trace[706728342]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:592ef84b-d8dc-4d4d-9e13-33c00869799a,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:11:40.703) (total time: 541ms): Trace[706728342]: ---"About to write a response" 541ms (02:11:41.244) Trace[706728342]: [541.83727ms] [541.83727ms] END E0409 02:11:50.253167 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:50.253250 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:50.253317 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 31.691µs, panicked: false, err: context canceled, panic-reason: E0409 02:11:50.254752 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:50.254840 1 trace.go:236] Trace[1520372448]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fff764b4-d586-4592-bbb6-990affa31e4a,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:45.253) (total time: 5001ms): Trace[1520372448]: ["GuaranteedUpdate etcd3" audit-id:fff764b4-d586-4592-bbb6-990affa31e4a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (02:11:45.253) Trace[1520372448]: ---"Txn call failed" err:context canceled 4998ms (02:11:50.253)] Trace[1520372448]: [5.001057982s] [5.001057982s] END E0409 02:11:50.254980 1 timeout.go:142] post-timeout activity - time-elapsed: 1.773127ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0409 02:11:50.265111 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0409 02:11:50.265180 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:50.266379 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:50.266421 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:50.266557 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:50.267924 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0409 02:11:50.267946 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout I0409 02:11:50.267982 1 trace.go:236] Trace[624691189]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b67e38fc-2023-4458-8464-22156aa0997f,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:11:45.265) (total time: 5002ms): Trace[624691189]: [5.002505802s] [5.002505802s] END E0409 02:11:50.268040 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:50.268303 1 timeout.go:142] post-timeout activity - time-elapsed: 3.099041ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0409 02:11:50.269520 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:50.269575 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:50.269577 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:50.270750 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:50.270795 1 trace.go:236] Trace[624671474]: "Get" accept:application/json, */*,audit-id:57da8df4-8816-4b7a-89c8-314db1720bb5,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:45.267) (total time: 5003ms): Trace[624671474]: [5.003057305s] [5.003057305s] END I0409 02:11:50.270827 1 trace.go:236] Trace[913394502]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:85f1ee14-f15b-42e8-b729-514f40b84242,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:11:45.266) (total time: 5004ms): Trace[913394502]: [5.004098054s] [5.004098054s] END E0409 02:11:50.270898 1 timeout.go:142] post-timeout activity - time-elapsed: 2.931337ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0409 02:11:50.270970 1 timeout.go:142] post-timeout activity - time-elapsed: 4.374266ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0409 02:11:52.255218 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0409 02:11:52.255395 1 trace.go:236] Trace[927390320]: "Update" accept:application/json, */*,audit-id:f984d067-82c0-4550-bdb1-589f1c4bb0b5,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:45.252) (total time: 7002ms): Trace[927390320]: ["GuaranteedUpdate etcd3" audit-id:f984d067-82c0-4550-bdb1-589f1c4bb0b5,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:11:45.252) Trace[927390320]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:11:52.255)] Trace[927390320]: [7.00274039s] [7.00274039s] END I0409 02:11:52.314995 1 trace.go:236] Trace[191308626]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:35c89b89-7671-4d55-b82a-bc34d5e5c77e,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:47.315) (total time: 4999ms): Trace[191308626]: ["GuaranteedUpdate etcd3" audit-id:35c89b89-7671-4d55-b82a-bc34d5e5c77e,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (02:11:47.315) Trace[191308626]: ---"Txn call failed" err:context canceled 4998ms (02:11:52.314)] Trace[191308626]: [4.999487491s] [4.999487491s] END E0409 02:11:52.314999 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 40.111µs, panicked: false, err: context canceled, panic-reason: E0409 02:11:52.315245 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com?timeout=5s" audit-ID="35c89b89-7671-4d55-b82a-bc34d5e5c77e" E0409 02:11:52.315289 1 timeout.go:142] post-timeout activity - time-elapsed: 2.88µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0409 02:11:52.662415 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0409 02:11:52.662591 1 trace.go:236] Trace[1707724146]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7930096a-613c-4bff-9dc4-090cdc51d06a,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (09-Apr-2026 02:11:45.659) (total time: 7002ms): Trace[1707724146]: ["GuaranteedUpdate etcd3" audit-id:7930096a-613c-4bff-9dc4-090cdc51d06a,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:11:45.659) Trace[1707724146]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:11:52.662)] Trace[1707724146]: [7.002943645s] [7.002943645s] END E0409 02:11:55.251970 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.252093 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.253521 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.253600 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:55.253528 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.255117 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout I0409 02:11:55.255139 1 trace.go:236] Trace[1922233743]: "Get" accept:application/json, */*,audit-id:068a05cf-a560-4055-8c44-f5ad948930f2,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:52.257) (total time: 2997ms): Trace[1922233743]: [2.997615581s] [2.997615581s] END E0409 02:11:55.255162 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.255267 1 timeout.go:142] post-timeout activity - time-elapsed: 3.273516ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0409 02:11:55.256503 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:55.256552 1 trace.go:236] Trace[1595749532]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:08ee54ac-c2ff-4440-89a3-2e92b6f986a5,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:50.254) (total time: 5002ms): Trace[1595749532]: [5.002044128s] [5.002044128s] END E0409 02:11:55.256680 1 timeout.go:142] post-timeout activity - time-elapsed: 3.142553ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0409 02:11:55.262165 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.262209 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.263221 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.263253 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:55.264796 1 trace.go:236] Trace[140255208]: "Get" accept:application/json, */*,audit-id:7f29975e-48a2-4966-986d-16a518f10b26,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:45.261) (total time: 10003ms): Trace[140255208]: [10.003069291s] [10.003069291s] END E0409 02:11:55.264966 1 timeout.go:142] post-timeout activity - time-elapsed: 2.764793ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0409 02:11:55.265861 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.266113 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.266995 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.267072 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.267210 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:55.267233 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.267903 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0409 02:11:55.268199 1 trace.go:236] Trace[1135476765]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:84a36fe6-4e1f-4ae6-bfe6-43a91fcdbe3d,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:11:52.268) (total time: 3000ms): Trace[1135476765]: [3.000167397s] [3.000167397s] END E0409 02:11:55.268259 1 timeout.go:142] post-timeout activity - time-elapsed: 2.462855ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0409 02:11:55.268314 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.268339 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.268361 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.268587 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:11:55.269424 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.269440 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.269455 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.269526 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:11:55.270083 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:55.270598 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:55.270599 1 trace.go:236] Trace[61677164]: "Get" accept:application/json, */*,audit-id:0eebb452-c1b9-490b-9080-ea150e9fdb42,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:45.267) (total time: 10003ms): Trace[61677164]: [10.003482702s] [10.003482702s] END E0409 02:11:55.270613 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0409 02:11:55.270619 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:11:55.270725 1 timeout.go:142] post-timeout activity - time-elapsed: 2.768553ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: I0409 02:11:55.271210 1 trace.go:236] Trace[274342731]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1e96747d-f57d-41eb-8b4b-aa5449de9f86,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:11:52.267) (total time: 3003ms): Trace[274342731]: [3.003168376s] [3.003168376s] END E0409 02:11:55.271316 1 timeout.go:142] post-timeout activity - time-elapsed: 4.180761ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0409 02:11:55.271843 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:11:55.271962 1 trace.go:236] Trace[1941313670]: "Get" accept:application/json, */*,audit-id:f8725196-61be-4bf7-ab91-681de7975052,client:10.0.0.12,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:45.266) (total time: 10004ms): Trace[1941313670]: [10.004862499s] [10.004862499s] END E0409 02:11:55.272067 1 timeout.go:142] post-timeout activity - time-elapsed: 4.842237ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: I0409 02:11:55.272392 1 trace.go:236] Trace[2109391876]: "Get" accept:application/json, */*,audit-id:f8d4b04f-763a-4608-8d43-6cb72a423df6,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:52.269) (total time: 3002ms): Trace[2109391876]: [3.002911599s] [3.002911599s] END E0409 02:11:55.272479 1 timeout.go:142] post-timeout activity - time-elapsed: 3.872631ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0409 02:11:55.908447 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0409 02:11:55.908769 1 trace.go:236] Trace[2037807195]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c229b72c-a0bd-4076-bb6e-24f3a4d0112b,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (09-Apr-2026 02:11:48.905) (total time: 7002ms): Trace[2037807195]: ["GuaranteedUpdate etcd3" audit-id:c229b72c-a0bd-4076-bb6e-24f3a4d0112b,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (02:11:48.905) Trace[2037807195]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (02:11:55.908)] Trace[2037807195]: [7.002988786s] [7.002988786s] END E0409 02:11:55.909405 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0409 02:11:57.249375 1 trace.go:236] Trace[329637783]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f4f29fa7-f7e7-487e-8f11-cda4de87c44d,client:199.204.45.238,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (09-Apr-2026 02:11:50.789) (total time: 6459ms): Trace[329637783]: ["Create etcd3" audit-id:f4f29fa7-f7e7-487e-8f11-cda4de87c44d,key:/events/kube-system/kube-apiserver-instance.18a48e636df2741f,type:*core.Event,resource:events 6458ms (02:11:50.790) Trace[329637783]: ---"Txn call succeeded" 6458ms (02:11:57.249)] Trace[329637783]: [6.459614306s] [6.459614306s] END I0409 02:11:57.250495 1 trace.go:236] Trace[1702095257]: "Create" accept:application/json, */*,audit-id:a9346c96-56c6-43a0-8086-1aae0c675c9e,client:10.0.0.213,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (09-Apr-2026 02:11:55.255) (total time: 1994ms): Trace[1702095257]: ["Create etcd3" audit-id:a9346c96-56c6-43a0-8086-1aae0c675c9e,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18a48e647814a8cc,type:*core.Event,resource:events 1993ms (02:11:55.256) Trace[1702095257]: ---"Txn call succeeded" 1993ms (02:11:57.250)] Trace[1702095257]: [1.994840817s] [1.994840817s] END I0409 02:11:57.250560 1 trace.go:236] Trace[2019804498]: "Get" accept:application/json,audit-id:3b86abf6-e84e-4462-aaab-29cf2d3ad61d,client:199.204.45.238,protocol:HTTP/1.1,resource:namespaces,scope:resource,url:/api/v1/namespaces/monitoring,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (09-Apr-2026 02:11:45.429) (total time: 11821ms): Trace[2019804498]: ---"About to write a response" 11821ms (02:11:57.250) Trace[2019804498]: [11.821116145s] [11.821116145s] END I0409 02:11:57.251710 1 trace.go:236] Trace[679381002]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:76046bc1-6e82-4f12-8758-d18e48efbc2e,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (09-Apr-2026 02:11:52.664) (total time: 4587ms): Trace[679381002]: ---"About to write a response" 4587ms (02:11:57.251) Trace[679381002]: [4.587154994s] [4.587154994s] END I0409 02:11:57.251924 1 trace.go:236] Trace[798921346]: "Update" accept:application/json, */*,audit-id:643203c3-cf36-40f8-b6df-aca39b070dbe,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (09-Apr-2026 02:11:55.263) (total time: 1988ms): Trace[798921346]: ["GuaranteedUpdate etcd3" audit-id:643203c3-cf36-40f8-b6df-aca39b070dbe,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1988ms (02:11:55.263) Trace[798921346]: ---"Txn call completed" 1987ms (02:11:57.251)] Trace[798921346]: [1.98884185s] [1.98884185s] END I0409 02:11:57.252016 1 trace.go:236] Trace[565186150]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:de18a240-7885-42ef-9f1d-d348a283a5fd,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (09-Apr-2026 02:11:51.721) (total time: 5529ms): Trace[565186150]: ["GuaranteedUpdate etcd3" audit-id:de18a240-7885-42ef-9f1d-d348a283a5fd,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5529ms (02:11:51.722) Trace[565186150]: ---"Txn call completed" 5528ms (02:11:57.251)] Trace[565186150]: [5.529943162s] [5.529943162s] END I0409 02:11:57.252037 1 trace.go:236] Trace[856472311]: "Update" accept:application/json, */*,audit-id:26de5397-38d2-4c6c-ba4b-276212ff5c71,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:11:55.270) (total time: 1981ms): Trace[856472311]: ["GuaranteedUpdate etcd3" audit-id:26de5397-38d2-4c6c-ba4b-276212ff5c71,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1981ms (02:11:55.270) Trace[856472311]: ---"Txn call completed" 1980ms (02:11:57.251)] Trace[856472311]: [1.98197446s] [1.98197446s] END I0409 02:11:57.252061 1 trace.go:236] Trace[419730844]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:534eb408-4b58-4b68-8be8-8a1c7e170823,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:11:52.316) (total time: 4935ms): Trace[419730844]: ---"About to write a response" 4935ms (02:11:57.251) Trace[419730844]: [4.935881452s] [4.935881452s] END I0409 02:11:57.252081 1 trace.go:236] Trace[1743369701]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:29d4a21f-f4af-47f2-9c94-4ee119e437ad,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (09-Apr-2026 02:11:55.266) (total time: 1985ms): Trace[1743369701]: ["GuaranteedUpdate etcd3" audit-id:29d4a21f-f4af-47f2-9c94-4ee119e437ad,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1985ms (02:11:55.266) Trace[1743369701]: ---"Txn call completed" 1982ms (02:11:57.251)] Trace[1743369701]: [1.985311177s] [1.985311177s] END I0409 02:11:57.252168 1 trace.go:236] Trace[463347436]: "Update" accept:application/json, */*,audit-id:0843d46a-6c02-467a-8881-8f7fa63131b9,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (09-Apr-2026 02:11:55.268) (total time: 1983ms): Trace[463347436]: ["GuaranteedUpdate etcd3" audit-id:0843d46a-6c02-467a-8881-8f7fa63131b9,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1983ms (02:11:55.268) Trace[463347436]: ---"Txn call completed" 1982ms (02:11:57.252)] Trace[463347436]: [1.983970882s] [1.983970882s] END I0409 02:11:57.252532 1 trace.go:236] Trace[1729979121]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:73f652bf-41f8-4daf-b384-d4a3414ae3a7,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (09-Apr-2026 02:11:55.910) (total time: 1342ms): Trace[1729979121]: ["GuaranteedUpdate etcd3" audit-id:73f652bf-41f8-4daf-b384-d4a3414ae3a7,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1341ms (02:11:55.910) Trace[1729979121]: ---"Txn call completed" 1340ms (02:11:57.251)] Trace[1729979121]: [1.342137126s] [1.342137126s] END E0409 02:11:57.252989 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0409 02:11:57.253386 1 trace.go:236] Trace[51589859]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b5afdadf-3970-43e0-93ba-70e99d71af09,client:10.0.0.45,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:49.332) (total time: 7921ms): Trace[51589859]: ---"About to write a response" 7920ms (02:11:57.252) Trace[51589859]: [7.921076125s] [7.921076125s] END I0409 02:11:57.253577 1 trace.go:236] Trace[445089572]: "Get" accept:application/json, */*,audit-id:c923ef71-531b-49c7-a722-cadf92758e16,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-t847z,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:11:45.263) (total time: 11989ms): Trace[445089572]: ---"About to write a response" 11988ms (02:11:57.252) Trace[445089572]: [11.989532438s] [11.989532438s] END I0409 02:11:57.308410 1 trace.go:236] Trace[1876751566]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.238,type:*v1.Endpoints,resource:apiServerIPInfo (09-Apr-2026 02:11:51.726) (total time: 5581ms): Trace[1876751566]: ---"initial value restored" 5524ms (02:11:57.251) Trace[1876751566]: ---"Transaction prepared" 45ms (02:11:57.297) Trace[1876751566]: [5.581541618s] [5.581541618s] END I0409 02:11:57.987740 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0409 02:12:36.227078 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0409 02:12:50.505485 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0409 02:12:50.679573 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:50.712684 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:50.712916 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:50.948198 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0409 02:12:51.224674 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:51.237852 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:51.324675 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0409 02:12:51.335786 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:12:51.499517 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0409 02:13:33.535838 1 trace.go:236] Trace[612451132]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:edfe3bf9-d66d-4c19-a23d-92397f1e9104,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/kube-prometheus-stack-admission-create-drr98,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PATCH (09-Apr-2026 02:13:31.195) (total time: 2340ms): Trace[612451132]: ["GuaranteedUpdate etcd3" audit-id:edfe3bf9-d66d-4c19-a23d-92397f1e9104,key:/pods/monitoring/kube-prometheus-stack-admission-create-drr98,type:*core.Pod,resource:pods 2340ms (02:13:31.195) Trace[612451132]: ---"Txn call completed" 2334ms (02:13:33.534)] Trace[612451132]: ---"Object stored in database" 2335ms (02:13:33.535) Trace[612451132]: [2.340547601s] [2.340547601s] END I0409 02:13:33.693884 1 trace.go:236] Trace[1528629257]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:919f80d9-a05d-4593-9dfe-8937a5d66847,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:13:31.626) (total time: 2067ms): Trace[1528629257]: ["GuaranteedUpdate etcd3" audit-id:919f80d9-a05d-4593-9dfe-8937a5d66847,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 2066ms (02:13:31.626) Trace[1528629257]: ---"Txn call completed" 2065ms (02:13:33.693)] Trace[1528629257]: [2.067114933s] [2.067114933s] END I0409 02:13:33.693929 1 trace.go:236] Trace[471094900]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:700fb41f-3457-484a-9a8c-d66d25c799da,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:13:32.294) (total time: 1399ms): Trace[471094900]: ["GuaranteedUpdate etcd3" audit-id:700fb41f-3457-484a-9a8c-d66d25c799da,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1399ms (02:13:32.294) Trace[471094900]: ---"Txn call completed" 1397ms (02:13:33.693)] Trace[471094900]: [1.399607747s] [1.399607747s] END I0409 02:13:33.693993 1 trace.go:236] Trace[551073526]: "Update" accept:application/json, */*,audit-id:85265345-f009-4390-96eb-74f7e59ceaa4,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:13:32.987) (total time: 706ms): Trace[551073526]: ["GuaranteedUpdate etcd3" audit-id:85265345-f009-4390-96eb-74f7e59ceaa4,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 706ms (02:13:32.987) Trace[551073526]: ---"Txn call completed" 705ms (02:13:33.693)] Trace[551073526]: [706.851248ms] [706.851248ms] END I0409 02:13:33.703042 1 trace.go:236] Trace[246991889]: "Get" accept:application/json, */*,audit-id:aea5c0ef-4aa5-4a13-bde8-5f21b5d89e59,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:13:32.148) (total time: 1554ms): Trace[246991889]: ---"About to write a response" 1554ms (02:13:33.702) Trace[246991889]: [1.55476606s] [1.55476606s] END I0409 02:13:33.703057 1 trace.go:236] Trace[1826003485]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3bb80723-20ab-40db-8cb7-a2a6a146d280,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:13:32.999) (total time: 703ms): Trace[1826003485]: ---"About to write a response" 703ms (02:13:33.702) Trace[1826003485]: [703.257162ms] [703.257162ms] END I0409 02:13:33.703083 1 trace.go:236] Trace[2087820027]: "Get" accept:application/json, */*,audit-id:88029f09-d41f-4de9-8567-4033bc8f126c,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:13:32.142) (total time: 1561ms): Trace[2087820027]: ---"About to write a response" 1560ms (02:13:33.702) Trace[2087820027]: [1.561018838s] [1.561018838s] END I0409 02:13:33.703159 1 trace.go:236] Trace[1580592168]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:63d3f413-7409-4f9d-936b-77589c39576b,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:13:32.998) (total time: 704ms): Trace[1580592168]: ---"About to write a response" 704ms (02:13:33.703) Trace[1580592168]: [704.399443ms] [704.399443ms] END I0409 02:13:33.703617 1 trace.go:236] Trace[1104333716]: "Get" accept:application/json, */*,audit-id:adae8c4e-e3c7-428e-b75a-6bb176cb8731,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:13:32.141) (total time: 1561ms): Trace[1104333716]: ---"About to write a response" 1561ms (02:13:33.703) Trace[1104333716]: [1.561723518s] [1.561723518s] END I0409 02:13:33.704418 1 trace.go:236] Trace[1173650014]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:de88a36d-2381-4737-8ade-10e54e5cf128,client:199.204.45.238,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/valkey-data-valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (09-Apr-2026 02:13:32.714) (total time: 989ms): Trace[1173650014]: ---"About to write a response" 988ms (02:13:33.703) Trace[1173650014]: [989.502365ms] [989.502365ms] END I0409 02:13:33.704480 1 trace.go:236] Trace[695875846]: "Get" accept:application/json, */*,audit-id:66a533ea-0643-43dd-bdf9-f1a4374d6e89,client:10.0.0.12,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:13:31.928) (total time: 1776ms): Trace[695875846]: ---"About to write a response" 1775ms (02:13:33.703) Trace[695875846]: [1.776071078s] [1.776071078s] END I0409 02:13:33.705453 1 trace.go:236] Trace[1152390838]: "Get" accept:application/json, */*,audit-id:988c189c-f627-4456-8ba9-87a8e7c3b416,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-t847z,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:13:31.929) (total time: 1775ms): Trace[1152390838]: ---"About to write a response" 1774ms (02:13:33.703) Trace[1152390838]: [1.775217516s] [1.775217516s] END I0409 02:13:33.869390 1 trace.go:236] Trace[1373355084]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.238,type:*v1.Endpoints,resource:apiServerIPInfo (09-Apr-2026 02:13:31.733) (total time: 2135ms): Trace[1373355084]: ---"initial value restored" 1968ms (02:13:33.702) Trace[1373355084]: ---"Txn call completed" 145ms (02:13:33.869) Trace[1373355084]: [2.135398378s] [2.135398378s] END I0409 02:13:35.467768 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.110.32.224"} I0409 02:13:35.468165 1 trace.go:236] Trace[1772250289]: "Create" accept:application/json,audit-id:b8c09a93-8112-439c-a167-b9755bdeb32d,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.960) (total time: 507ms): Trace[1772250289]: [507.614136ms] [507.614136ms] END I0409 02:13:35.664699 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.100.21.203"} I0409 02:13:35.665065 1 trace.go:236] Trace[1039311866]: "Create" accept:application/json,audit-id:d515dc44-a7ad-4875-9b32-eb1a32daa873,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.960) (total time: 704ms): Trace[1039311866]: [704.530807ms] [704.530807ms] END I0409 02:13:35.872389 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.98.131.1"} I0409 02:13:35.872753 1 trace.go:236] Trace[763138695]: "Create" accept:application/json,audit-id:dc3b5164-da40-4193-bf08-68d20e7bd5ff,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.960) (total time: 912ms): Trace[763138695]: [912.238629ms] [912.238629ms] END I0409 02:13:36.071542 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.97.181.145"} I0409 02:13:36.071869 1 trace.go:236] Trace[1766947480]: "Create" accept:application/json,audit-id:d4e71ee1-524f-4692-8c9c-fdb5876b0e39,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.960) (total time: 1111ms): Trace[1766947480]: [1.111277007s] [1.111277007s] END I0409 02:13:36.397616 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.102.221.27"} I0409 02:13:36.398261 1 trace.go:236] Trace[1546823378]: "Create" accept:application/json,audit-id:9aacfc08-5f03-4434-8ec1-334578dfcd59,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.961) (total time: 1436ms): Trace[1546823378]: [1.436605956s] [1.436605956s] END I0409 02:13:36.596112 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.104.247.45"} I0409 02:13:36.596478 1 trace.go:236] Trace[117174645]: "Create" accept:application/json,audit-id:bf46f0d5-e6ec-4d38-bf41-edc3f3341950,client:199.204.45.238,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (09-Apr-2026 02:13:34.960) (total time: 1635ms): Trace[117174645]: [1.635423678s] [1.635423678s] END I0409 02:13:37.263756 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0409 02:13:37.404923 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0409 02:13:37.579503 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0409 02:13:37.720177 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0409 02:13:38.039346 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0409 02:13:38.209733 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.209776 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.210099 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.211254 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.211511 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.211553 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.211328 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.211940 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.212289 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.212310 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.212324 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.212361 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.213371 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.213387 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.213565 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.213595 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.213682 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.213727 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.213754 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.213816 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.214004 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.214040 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.214239 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.214270 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.214407 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.214443 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.214576 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.214595 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.215389 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.215418 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused W0409 02:13:38.215962 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused E0409 02:13:38.215987 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.104.247.45:443: connect: connection refused I0409 02:13:40.121022 1 trace.go:236] Trace[826350680]: "Delete" accept:application/json, */*,audit-id:36dbad61-0952-4a25-b50d-940632b91e55,client:10.0.0.113,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/alertmanager-tls-rdrmp,user-agent:cert-manager-certificates-key-manager/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:DELETE (09-Apr-2026 02:13:39.520) (total time: 600ms): Trace[826350680]: ---"Object deleted from database" 599ms (02:13:40.120) Trace[826350680]: [600.141506ms] [600.141506ms] END I0409 02:13:51.095234 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.106.140.176"} I0409 02:13:51.113875 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.99.161.121"} I0409 02:13:56.191071 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.110.160.231"} I0409 02:13:59.093653 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.111.48.112"} I0409 02:14:03.613774 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.108.100.235"} I0409 02:14:04.531792 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.100.180.117"} E0409 02:14:11.351240 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:14:11.351274 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:14:11.351332 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.771µs, panicked: false, err: context canceled, panic-reason: E0409 02:14:11.352505 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:14:11.352591 1 trace.go:236] Trace[1668439247]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ef247ae-7482-49b4-8c38-7eb6d86f9262,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:14:06.351) (total time: 5001ms): Trace[1668439247]: ["GuaranteedUpdate etcd3" audit-id:4ef247ae-7482-49b4-8c38-7eb6d86f9262,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (02:14:06.351) Trace[1668439247]: ---"Txn call failed" err:context canceled 4998ms (02:14:11.351)] Trace[1668439247]: [5.001098237s] [5.001098237s] END E0409 02:14:11.352741 1 timeout.go:142] post-timeout activity - time-elapsed: 1.51024ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0409 02:14:11.413738 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:14:11.413777 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:14:11.413817 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 20.96µs, panicked: false, err: context canceled, panic-reason: E0409 02:14:11.415919 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:14:11.416010 1 trace.go:236] Trace[772120419]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0eed29ff-fd9d-4e7b-ad40-01014e1e8f28,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:14:06.413) (total time: 5002ms): Trace[772120419]: ["GuaranteedUpdate etcd3" audit-id:0eed29ff-fd9d-4e7b-ad40-01014e1e8f28,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (02:14:06.413) Trace[772120419]: ---"Txn call failed" err:context canceled 4999ms (02:14:11.413)] Trace[772120419]: [5.002270429s] [5.002270429s] END E0409 02:14:11.416146 1 timeout.go:142] post-timeout activity - time-elapsed: 2.355864ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0409 02:14:11.978767 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:14:11.979414 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:14:11.980590 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:14:11.980688 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:14:11.981973 1 trace.go:236] Trace[1036831954]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6286010a-93c2-48e6-9bbc-0d5546c58582,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:14:06.978) (total time: 5003ms): Trace[1036831954]: [5.003549313s] [5.003549313s] END E0409 02:14:11.982154 1 timeout.go:142] post-timeout activity - time-elapsed: 3.553556ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0409 02:14:12.148384 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0409 02:14:12.148510 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:14:12.149726 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:14:12.149818 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:14:12.150866 1 trace.go:236] Trace[955266605]: "Get" accept:application/json, */*,audit-id:c34664d9-ff46-48c2-a1e3-8e56a120a4c1,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:14:07.148) (total time: 5002ms): Trace[955266605]: [5.002199357s] [5.002199357s] END E0409 02:14:12.151085 1 timeout.go:142] post-timeout activity - time-elapsed: 2.645332ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0409 02:14:12.168395 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0409 02:14:12.168487 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0409 02:14:12.170193 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0409 02:14:12.170243 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0409 02:14:12.171325 1 trace.go:236] Trace[1688911188]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f2ea2643-766f-46ed-9293-1979384dc274,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (09-Apr-2026 02:14:07.168) (total time: 5002ms): Trace[1688911188]: [5.002438913s] [5.002438913s] END E0409 02:14:12.171492 1 timeout.go:142] post-timeout activity - time-elapsed: 2.94985ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0409 02:14:12.443746 1 trace.go:236] Trace[340316995]: "Update" accept:application/json, */*,audit-id:37742a78-f427-4c32-a076-075d844a33a3,client:10.0.0.69,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (09-Apr-2026 02:14:06.414) (total time: 6029ms): Trace[340316995]: ["GuaranteedUpdate etcd3" audit-id:37742a78-f427-4c32-a076-075d844a33a3,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 6029ms (02:14:06.414) Trace[340316995]: ---"Txn call completed" 6028ms (02:14:12.443)] Trace[340316995]: [6.029535116s] [6.029535116s] END I0409 02:14:12.447730 1 trace.go:236] Trace[2061083945]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:46e26f4b-b896-4a5a-99b1-1bfd1fd1fb09,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (09-Apr-2026 02:14:10.365) (total time: 2081ms): Trace[2061083945]: ["GuaranteedUpdate etcd3" audit-id:46e26f4b-b896-4a5a-99b1-1bfd1fd1fb09,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 2081ms (02:14:10.366) Trace[2061083945]: ---"Txn call completed" 2080ms (02:14:12.447)] Trace[2061083945]: [2.08183934s] [2.08183934s] END I0409 02:14:12.447739 1 trace.go:236] Trace[1183840841]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d63733d9-15f8-49bc-b85c-5f7a7d022164,client:199.204.45.238,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (09-Apr-2026 02:14:09.366) (total time: 3081ms): Trace[1183840841]: ["GuaranteedUpdate etcd3" audit-id:d63733d9-15f8-49bc-b85c-5f7a7d022164,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 3081ms (02:14:09.366) Trace[1183840841]: ---"Txn call completed" 3080ms (02:14:12.447)] Trace[1183840841]: [3.08146164s] [3.08146164s] END I0409 02:14:12.448045 1 trace.go:236] Trace[1290254699]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a74b10ca-df79-4e80-ae4b-0c796db8df54,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/vector-hls4j,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (09-Apr-2026 02:14:06.381) (total time: 6066ms): Trace[1290254699]: ---"About to write a response" 6066ms (02:14:12.447) Trace[1290254699]: [6.066399991s] [6.066399991s] END I0409 02:14:12.448116 1 trace.go:236] Trace[497631559]: "Get" accept:application/json, */*,audit-id:f463cc09-2310-494d-b0aa-63ef46d70a21,client:10.0.0.12,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:14:07.186) (total time: 5261ms): Trace[497631559]: ---"About to write a response" 5261ms (02:14:12.447) Trace[497631559]: [5.261904303s] [5.261904303s] END I0409 02:14:12.448303 1 trace.go:236] Trace[1372255081]: "Get" accept:application/json, */*,audit-id:898e265b-829e-4a56-aa04-6b2b7f1a9da1,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:14:07.196) (total time: 5251ms): Trace[1372255081]: ---"About to write a response" 5251ms (02:14:12.448) Trace[1372255081]: [5.251866332s] [5.251866332s] END I0409 02:14:12.448357 1 trace.go:236] Trace[1266910592]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a67cdee-44ba-4554-86ed-84830f00769e,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:14:11.414) (total time: 1033ms): Trace[1266910592]: ---"About to write a response" 1033ms (02:14:12.448) Trace[1266910592]: [1.033830203s] [1.033830203s] END I0409 02:14:12.449253 1 trace.go:236] Trace[1802501063]: "Get" accept:application/json, */*,audit-id:863e0dc0-1971-494b-ad86-6be393874ca6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:14:07.196) (total time: 5252ms): Trace[1802501063]: ---"About to write a response" 5251ms (02:14:12.448) Trace[1802501063]: [5.252507039s] [5.252507039s] END I0409 02:14:12.449649 1 trace.go:236] Trace[1341375383]: "Get" accept:application/json, */*,audit-id:a106aad7-a160-44d6-9277-7eab190ca649,client:199.204.45.238,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-t847z,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:14:07.152) (total time: 5296ms): Trace[1341375383]: ---"About to write a response" 5296ms (02:14:12.449) Trace[1341375383]: [5.29694063s] [5.29694063s] END I0409 02:14:12.449833 1 trace.go:236] Trace[1090803844]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8e4740d8-505b-4848-989c-72d12d1fc50e,client:10.0.0.213,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (09-Apr-2026 02:14:11.353) (total time: 1096ms): Trace[1090803844]: ---"About to write a response" 1096ms (02:14:12.449) Trace[1090803844]: [1.096167399s] [1.096167399s] END I0409 02:14:12.449935 1 trace.go:236] Trace[1640912165]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f90a0b98-d20e-4090-9f84-ef31c698f4d4,client:10.0.0.45,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (09-Apr-2026 02:14:10.856) (total time: 1592ms): Trace[1640912165]: ---"About to write a response" 1592ms (02:14:12.449) Trace[1640912165]: [1.592941181s] [1.592941181s] END I0409 02:14:12.451846 1 trace.go:236] Trace[1105570421]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1cee4b3c-c77c-4dfb-8eca-279630880c77,client:199.204.45.238,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18a48e636df2741f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (09-Apr-2026 02:14:08.789) (total time: 3662ms): Trace[1105570421]: ["GuaranteedUpdate etcd3" audit-id:1cee4b3c-c77c-4dfb-8eca-279630880c77,key:/events/kube-system/kube-apiserver-instance.18a48e636df2741f,type:*core.Event,resource:events 3662ms (02:14:08.789) Trace[1105570421]: ---"initial value restored" 3657ms (02:14:12.447)] Trace[1105570421]: [3.662514049s] [3.662514049s] END I0409 02:14:12.456199 1 trace.go:236] Trace[643381086]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.238,type:*v1.Endpoints,resource:apiServerIPInfo (09-Apr-2026 02:14:11.736) (total time: 719ms): Trace[643381086]: ---"initial value restored" 710ms (02:14:12.447) Trace[643381086]: [719.660276ms] [719.660276ms] END I0409 02:14:17.750980 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0409 02:14:17.913362 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.106.28.144"} I0409 02:14:58.297191 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.111.83.57"} I0409 02:14:58.312900 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0409 02:17:53.371331 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.110.135.49"} I0409 02:18:26.540656 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.108.74.193"} I0409 02:20:07.806047 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0409 02:20:07.812471 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.819172 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0409 02:20:07.842229 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.842709 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.870076 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.888744 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.899224 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.907308 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.925694 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.935353 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.961366 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.983097 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:07.998946 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:08.019945 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:08.054814 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:08.101807 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:08.145787 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:08.246519 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0409 02:20:48.252577 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0409 02:20:48.261005 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0409 02:21:21.130420 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.108.58.109"} I0409 02:21:21.817798 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.99.81.199"} I0409 02:21:49.669909 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.98.116.116"} I0409 02:24:29.558726 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.104.225.203"}