I0427 12:02:44.311937 1 options.go:220] external host was not specified, using 199.19.213.78 I0427 12:02:44.314067 1 server.go:148] Version: v1.28.13 I0427 12:02:44.314381 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0427 12:02:44.811251 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0427 12:02:44.819768 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0427 12:02:44.819786 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0427 12:02:44.819976 1 instance.go:298] Using reconciler: lease I0427 12:02:44.948271 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0427 12:02:44.948310 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0427 12:02:45.227339 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0427 12:02:45.227589 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0427 12:02:45.698991 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0427 12:02:45.720014 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0427 12:02:45.720115 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.720145 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.720731 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0427 12:02:45.720785 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0427 12:02:45.721804 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0427 12:02:45.722888 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0427 12:02:45.722979 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0427 12:02:45.723004 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0427 12:02:45.724460 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0427 12:02:45.724502 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0427 12:02:45.725359 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0427 12:02:45.725401 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.725417 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.725988 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0427 12:02:45.726036 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.726102 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0427 12:02:45.726721 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0427 12:02:45.728425 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0427 12:02:45.728470 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.728487 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.728957 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0427 12:02:45.728994 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.729010 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.729784 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0427 12:02:45.729825 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0427 12:02:45.731605 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0427 12:02:45.731649 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.731668 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.732336 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0427 12:02:45.732380 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.732395 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.734236 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0427 12:02:45.734281 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.734298 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.735644 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0427 12:02:45.736957 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0427 12:02:45.737008 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.737030 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.740698 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0427 12:02:45.740746 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0427 12:02:45.740761 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0427 12:02:45.741492 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0427 12:02:45.741535 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0427 12:02:45.741555 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0427 12:02:45.742020 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0427 12:02:45.742062 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0427 12:02:45.779120 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0427 12:02:45.779238 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0427 12:02:46.187740 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0427 12:02:46.187763 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0427 12:02:46.187851 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0427 12:02:46.188013 1 secure_serving.go:213] Serving securely on [::]:6443 I0427 12:02:46.188100 1 available_controller.go:423] Starting AvailableConditionController I0427 12:02:46.188095 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0427 12:02:46.188263 1 aggregator.go:164] waiting for initial CRD sync... I0427 12:02:46.188278 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0427 12:02:46.188121 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0427 12:02:46.188363 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0427 12:02:46.188381 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0427 12:02:46.188474 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0427 12:02:46.188526 1 gc_controller.go:78] Starting apiserver lease garbage collector I0427 12:02:46.188622 1 controller.go:116] Starting legacy_token_tracking_controller I0427 12:02:46.188639 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0427 12:02:46.188706 1 system_namespaces_controller.go:67] Starting system namespaces controller I0427 12:02:46.188748 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0427 12:02:46.188757 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0427 12:02:46.188757 1 controller.go:78] Starting OpenAPI AggregationController I0427 12:02:46.188984 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0427 12:02:46.189006 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0427 12:02:46.189064 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0427 12:02:46.188487 1 controller.go:80] Starting OpenAPI V3 AggregationController I0427 12:02:46.189454 1 gc_controller.go:78] Starting apiserver lease garbage collector I0427 12:02:46.189532 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0427 12:02:46.189606 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0427 12:02:46.189699 1 controller.go:134] Starting OpenAPI controller I0427 12:02:46.189748 1 controller.go:85] Starting OpenAPI V3 controller I0427 12:02:46.189787 1 naming_controller.go:291] Starting NamingConditionController I0427 12:02:46.189816 1 establishing_controller.go:76] Starting EstablishingController I0427 12:02:46.189847 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0427 12:02:46.189894 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0427 12:02:46.189918 1 crd_finalizer.go:266] Starting CRDFinalizer I0427 12:02:46.189659 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0427 12:02:46.211432 1 shared_informer.go:318] Caches are synced for node_authorizer E0427 12:02:46.265477 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0427 12:02:46.288717 1 cache.go:39] Caches are synced for AvailableConditionController controller I0427 12:02:46.288944 1 shared_informer.go:318] Caches are synced for crd-autoregister I0427 12:02:46.288993 1 aggregator.go:166] initial CRD sync complete... I0427 12:02:46.288957 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0427 12:02:46.289012 1 autoregister_controller.go:141] Starting autoregister controller I0427 12:02:46.289185 1 cache.go:32] Waiting for caches to sync for autoregister controller I0427 12:02:46.289210 1 cache.go:39] Caches are synced for autoregister controller I0427 12:02:46.289037 1 shared_informer.go:318] Caches are synced for configmaps I0427 12:02:46.289083 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0427 12:02:46.290004 1 apf_controller.go:379] Running API Priority and Fairness config worker I0427 12:02:46.290029 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0427 12:02:46.291184 1 controller.go:624] quota admission added evaluator for: namespaces I0427 12:02:46.471279 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0427 12:02:47.197188 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0427 12:02:47.205302 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0427 12:02:47.205323 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0427 12:02:47.866803 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0427 12:02:47.917215 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0427 12:02:48.009259 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0427 12:02:48.018581 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.78] I0427 12:02:48.020238 1 controller.go:624] quota admission added evaluator for: endpoints I0427 12:02:48.028362 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0427 12:02:48.484910 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0427 12:02:49.506902 1 controller.go:624] quota admission added evaluator for: deployments.apps I0427 12:02:49.548249 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0427 12:02:49.749507 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0427 12:02:53.579573 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0427 12:02:53.682519 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0427 12:03:13.870420 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 12:03:13.897001 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 12:03:13.900544 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 12:03:13.900604 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 12:03:14.124673 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 12:03:14.153111 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 12:03:14.168901 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 12:03:14.189935 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 12:03:14.215929 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 12:03:14.215972 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0427 12:03:14.253989 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 12:03:14.254050 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0427 12:03:14.287774 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 12:03:14.287853 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 12:03:14.331024 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 12:03:14.428520 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 12:03:14.428599 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 12:03:14.457147 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:14.506136 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:14.530064 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:14.578811 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:14.609602 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:15.308682 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:15.324200 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:15.418226 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 12:03:20.606790 1 controller.go:624] quota admission added evaluator for: jobs.batch I0427 12:03:22.295277 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 12:03:22.305175 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 12:03:22.495794 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 12:03:22.693549 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 12:03:24.076359 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 12:03:24.171981 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 12:03:24.179291 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 12:03:24.197120 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 12:03:25.320257 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 12:03:26.073753 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 12:03:26.293378 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0427 12:03:30.807822 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0427 12:03:30.807882 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0427 12:03:31.301999 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0427 12:03:40.661584 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.103.178.22"} W0427 12:03:40.696319 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.178.22:9443: connect: connection refused E0427 12:03:40.696373 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.103.178.22:9443: connect: connection refused I0427 12:03:53.032975 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0427 12:03:53.040059 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0427 12:03:53.056462 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0427 12:03:53.063515 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.106.94.136"} I0427 12:03:53.072533 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.107.26.82"} I0427 12:03:53.094385 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0427 12:03:53.155855 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0427 12:03:53.197411 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0427 12:04:03.923383 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0427 12:04:08.783816 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0427 12:04:23.143454 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.109.101.213"} I0427 12:04:23.153355 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.98.16.118"} I0427 12:04:23.161249 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.107.218.226"} I0427 12:04:23.170688 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.111.247.162"} I0427 12:04:29.585165 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.602035 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.621853 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.642739 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.660756 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.683390 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.701678 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.718222 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.743440 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.762352 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0427 12:04:29.783171 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.803707 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:29.824221 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:31.192527 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0427 12:04:34.840424 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0427 12:04:34.846682 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0427 12:04:34.896291 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.109.55.32"} I0427 12:04:34.926880 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0427 12:04:37.036814 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0427 12:04:37.072222 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0427 12:04:37.704629 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0427 12:04:37.704702 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0427 12:04:37.704752 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0427 12:04:44.055377 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0427 12:04:47.946400 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.103.132.192"} I0427 12:04:48.320961 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0427 12:04:48.598360 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.99.87.7"} I0427 12:04:48.653130 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.102.130.123"} I0427 12:06:16.410283 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.99.152.8"} I0427 12:06:18.844894 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.103.8.168"} I0427 12:06:18.851505 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.101.197.179"} I0427 12:06:25.393174 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.106.239.116"} I0427 12:06:25.399503 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.102.49.1"} I0427 12:08:55.221727 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0427 12:08:59.158253 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0427 12:08:59.193822 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0427 12:09:03.101834 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0427 12:09:03.113241 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0427 12:09:03.139417 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0427 12:09:03.148157 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0427 12:09:03.161005 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0427 12:09:03.168247 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0427 12:09:03.175988 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0427 12:09:04.950110 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0427 12:09:14.973747 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0427 12:09:53.987225 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0427 12:10:08.177294 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0427 12:10:08.362542 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:08.380107 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:08.404208 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:08.610370 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0427 12:10:08.912991 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:08.917326 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:08.975423 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0427 12:10:09.002059 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:09.166808 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0427 12:10:47.025970 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.102.177.238"} I0427 12:10:47.035203 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.108.81.196"} I0427 12:10:47.041364 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.103.241.185"} I0427 12:10:47.050399 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.110.38.94"} I0427 12:10:47.059377 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.102.247.154"} I0427 12:10:47.069108 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.104.13.65"} I0427 12:10:47.121354 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0427 12:10:47.129094 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0427 12:10:47.155804 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0427 12:10:47.171720 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0427 12:10:47.196080 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0427 12:10:47.204109 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.204144 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.204286 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.204320 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.204565 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.204642 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.205148 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.205192 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.205373 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.205399 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.205664 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.205692 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.205876 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.205933 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.206203 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.206230 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.206360 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.206417 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.206857 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.206898 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.207105 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.207132 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.207274 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.207294 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.207840 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.207862 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.208516 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.208539 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.209256 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.209282 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused W0427 12:10:47.210334 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused E0427 12:10:47.210383 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.241.185:443: connect: connection refused I0427 12:10:57.556637 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.108.34.100"} I0427 12:10:57.570626 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.109.230.182"} I0427 12:11:01.947014 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.111.3.199"} I0427 12:11:04.634534 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.108.109.21"} I0427 12:11:09.264107 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.105.123.202"} I0427 12:11:10.335581 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.100.253.105"} I0427 12:11:16.953032 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0427 12:11:17.114450 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.104.24.91"} I0427 12:11:57.650074 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.103.228.85"} I0427 12:11:57.665007 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0427 12:14:51.997513 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.96.114.49"} I0427 12:15:25.450359 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.111.99.176"} I0427 12:17:18.442234 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0427 12:17:18.450213 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.461543 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0427 12:17:18.479363 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.479763 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.488628 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.498973 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.510520 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.521213 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.533607 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.563375 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.595512 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.623059 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.631567 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.663380 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.710978 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.758491 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.801123 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:18.904555 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0427 12:17:59.353133 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0427 12:17:59.363334 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0427 12:18:32.403110 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.105.81.110"} I0427 12:18:34.139792 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.105.175.219"} I0427 12:19:07.903619 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.100.188.126"} I0427 12:21:48.038106 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.106.36.192"} I0427 12:22:09.997615 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.102.215.29"} I0427 12:22:44.256632 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.102.147.58"} E0427 12:23:28.740068 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc01db3daa0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc00e435040), ResponseWriter:(*httpsnoop.rw)(0xc00e435040), Flusher:(*httpsnoop.rw)(0xc00e435040), CloseNotifier:(*httpsnoop.rw)(0xc00e435040), Pusher:(*httpsnoop.rw)(0xc00e435040)}}, encoder:(*versioning.codec)(0xc030d6dea0), memAllocator:(*runtime.Allocator)(0xc0301c19c8)}) I0427 12:27:34.203984 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.96.245.143"} I0427 12:30:31.805184 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns" clusterIPs={"IPv4":"10.96.0.20"} I0427 12:30:31.817031 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns-metrics" clusterIPs={"IPv4":"10.102.94.203"} I0427 12:30:35.937146 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.98.215.100"} I0427 12:31:13.844477 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.108.50.53"} I0427 12:31:13.856512 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.106.64.3"} I0427 12:31:13.863274 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.96.68.106"} I0427 12:34:17.030157 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-neutron" clusterIPs={"IPv4":"10.96.17.147"} I0427 12:34:51.775348 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-server" clusterIPs={"IPv4":"10.108.117.196"} I0427 12:37:45.681333 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-heat" clusterIPs={"IPv4":"10.106.78.178"} I0427 12:38:19.703911 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-cfn" clusterIPs={"IPv4":"10.107.75.155"} I0427 12:38:19.717092 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-api" clusterIPs={"IPv4":"10.102.129.130"} I0427 12:42:00.986932 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-octavia" clusterIPs={"IPv4":"10.104.108.93"} I0427 12:43:54.179860 1 controller.go:624] quota admission added evaluator for: sshkeys.secretgen.k14s.io I0427 12:44:07.408854 1 alloc.go:330] "allocated clusterIPs" service="openstack/octavia-api" clusterIPs={"IPv4":"10.104.248.61"} I0427 12:46:32.510164 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-magnum" clusterIPs={"IPv4":"10.99.6.212"} I0427 12:47:10.446960 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.480556 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.504684 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.534363 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.567471 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.601943 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.628628 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.673489 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.692434 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.742470 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.785755 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.815279 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.842382 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.862254 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.904593 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.948857 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:10.967450 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.007673 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.028886 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.086198 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.111794 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.132804 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.173986 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.201081 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0427 12:47:11.340255 1 alloc.go:330] "allocated clusterIPs" service="orc-system/orc-controller-manager-metrics-service" clusterIPs={"IPv4":"10.101.182.186"} I0427 12:47:14.905391 1 handler.go:275] Adding GroupVersion clusterctl.cluster.x-k8s.io v1alpha3 to ResourceManager I0427 12:47:16.402096 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.404263 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.441340 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.526576 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.538676 1 handler.go:275] Adding GroupVersion runtime.cluster.x-k8s.io v1alpha1 to ResourceManager I0427 12:47:16.549849 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0427 12:47:16.550027 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.565033 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0427 12:47:16.565118 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.650140 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.665870 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.706482 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.757031 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.803373 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.849685 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:16.956438 1 alloc.go:330] "allocated clusterIPs" service="capi-system/capi-webhook-service" clusterIPs={"IPv4":"10.97.204.9"} I0427 12:47:17.050094 1 controller.go:624] quota admission added evaluator for: providers.clusterctl.cluster.x-k8s.io I0427 12:47:17.368495 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:17.377965 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-bootstrap-system/capi-kubeadm-bootstrap-webhook-service" clusterIPs={"IPv4":"10.103.129.106"} I0427 12:47:17.430974 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:17.709729 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:17.755013 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:17.856106 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-control-plane-system/capi-kubeadm-control-plane-webhook-service" clusterIPs={"IPv4":"10.110.213.103"} I0427 12:47:18.204028 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:18.237775 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:18.251327 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0427 12:47:18.288236 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:18.340509 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0427 12:47:18.374406 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0427 12:47:18.486950 1 alloc.go:330] "allocated clusterIPs" service="capo-system/capo-webhook-service" clusterIPs={"IPv4":"10.111.108.172"} I0427 12:48:37.637171 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-api" clusterIPs={"IPv4":"10.111.59.153"} I0427 12:50:51.480102 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-registry" clusterIPs={"IPv4":"10.106.237.34"} I0427 12:51:08.674381 1 trace.go:236] Trace[1044216499]: "Get" accept:application/json, */*,audit-id:4dc7f2da-5f40-4d52-a43f-45daaf1ff460,client:10.0.0.148,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (27-Apr-2026 12:51:08.097) (total time: 576ms): Trace[1044216499]: ---"About to write a response" 571ms (12:51:08.668) Trace[1044216499]: [576.62648ms] [576.62648ms] END I0427 12:51:09.150871 1 trace.go:236] Trace[1365355671]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.78,type:*v1.Endpoints,resource:apiServerIPInfo (27-Apr-2026 12:51:08.154) (total time: 996ms): Trace[1365355671]: ---"initial value restored" 217ms (12:51:08.371) Trace[1365355671]: ---"Transaction prepared" 296ms (12:51:08.667) Trace[1365355671]: ---"Txn call completed" 482ms (12:51:09.150) Trace[1365355671]: [996.494227ms] [996.494227ms] END I0427 12:51:24.696559 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-manila" clusterIPs={"IPv4":"10.101.58.111"} I0427 12:52:04.242589 1 trace.go:236] Trace[487429076]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5edc7fe7-f61c-4708-a53e-3158c9f27aaa,client:199.19.213.78,protocol:HTTP/2.0,resource:serviceaccounts,scope:resource,url:/api/v1/namespaces/kube-system/serviceaccounts/cilium-operator/token,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (27-Apr-2026 12:52:03.681) (total time: 561ms): Trace[487429076]: ---"Write to database call succeeded" len:164 561ms (12:52:04.242) Trace[487429076]: [561.348404ms] [561.348404ms] END I0427 12:52:29.513087 1 alloc.go:330] "allocated clusterIPs" service="openstack/manila-api" clusterIPs={"IPv4":"10.103.188.4"} I0427 12:53:14.082424 1 trace.go:236] Trace[441769265]: "Get" accept:application/json, */*,audit-id:3e3a8e62-1655-4beb-a0e0-a3c558a3cc28,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (27-Apr-2026 12:53:13.544) (total time: 538ms): Trace[441769265]: ---"About to write a response" 537ms (12:53:14.082) Trace[441769265]: [538.06781ms] [538.06781ms] END I0427 12:54:34.276934 1 trace.go:236] Trace[1379614053]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dd399b78-326e-4ca4-8ca5-87b93ac9a09d,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:54:33.703) (total time: 573ms): Trace[1379614053]: ---"About to write a response" 572ms (12:54:34.276) Trace[1379614053]: [573.056169ms] [573.056169ms] END I0427 12:54:34.276969 1 trace.go:236] Trace[250788781]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:894cc1ec-aba1-4543-b9c2-3af595c2dd47,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:54:33.724) (total time: 552ms): Trace[250788781]: ---"About to write a response" 552ms (12:54:34.276) Trace[250788781]: [552.889636ms] [552.889636ms] END I0427 12:54:34.277010 1 trace.go:236] Trace[160300794]: "Get" accept:application/json, */*,audit-id:eba97fbc-f3b0-4e59-8e04-006ec552031e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:54:33.702) (total time: 574ms): Trace[160300794]: ---"About to write a response" 574ms (12:54:34.276) Trace[160300794]: [574.936047ms] [574.936047ms] END I0427 12:54:34.276940 1 trace.go:236] Trace[1652469113]: "Get" accept:application/json, */*,audit-id:dc707c00-d83d-4aa1-a2dd-1d4e96d365e2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:54:33.702) (total time: 574ms): Trace[1652469113]: ---"About to write a response" 574ms (12:54:34.276) Trace[1652469113]: [574.792984ms] [574.792984ms] END I0427 12:54:34.277328 1 trace.go:236] Trace[608078069]: "Get" accept:application/json, */*,audit-id:ba2d2249-6a7f-4209-8563-f28207b44759,client:10.0.0.205,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/manila-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:54:33.477) (total time: 800ms): Trace[608078069]: [800.12897ms] [800.12897ms] END I0427 12:54:34.277442 1 trace.go:236] Trace[221275840]: "Get" accept:application/json, */*,audit-id:45e79a1e-6a61-4e8f-a58e-40c81eb339f9,client:10.0.0.190,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/manila-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:54:33.495) (total time: 781ms): Trace[221275840]: [781.743262ms] [781.743262ms] END I0427 12:54:34.291272 1 trace.go:236] Trace[1418154771]: "Get" accept:application/json, */*,audit-id:30a969e4-50c7-46ab-be9d-45245004aef5,client:10.0.0.190,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/manila-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:54:33.496) (total time: 794ms): Trace[1418154771]: [794.755173ms] [794.755173ms] END I0427 12:55:03.779166 1 trace.go:236] Trace[979445788]: "Update" accept:application/json, */*,audit-id:147dec00-c920-4f1b-a08e-3002d325d202,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:55:03.251) (total time: 527ms): Trace[979445788]: ["GuaranteedUpdate etcd3" audit-id:147dec00-c920-4f1b-a08e-3002d325d202,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 526ms (12:55:03.252) Trace[979445788]: ---"Txn call completed" 524ms (12:55:03.778)] Trace[979445788]: [527.689115ms] [527.689115ms] END I0427 12:55:26.383576 1 trace.go:236] Trace[1370226994]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fa91a18f-59e2-48ae-84e4-8a95e3e1ba07,client:199.19.213.78,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Apr-2026 12:55:25.602) (total time: 780ms): Trace[1370226994]: ---"About to write a response" 780ms (12:55:26.383) Trace[1370226994]: [780.903969ms] [780.903969ms] END I0427 12:55:26.384351 1 trace.go:236] Trace[171767757]: "Update" accept:application/json, */*,audit-id:bfeea433-673c-4013-b8b5-372ad05bccca,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:55:25.540) (total time: 844ms): Trace[171767757]: ["GuaranteedUpdate etcd3" audit-id:bfeea433-673c-4013-b8b5-372ad05bccca,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 843ms (12:55:25.540) Trace[171767757]: ---"Txn call completed" 842ms (12:55:26.384)] Trace[171767757]: [844.171005ms] [844.171005ms] END I0427 12:55:26.386676 1 trace.go:236] Trace[879709219]: "Get" accept:application/json, */*,audit-id:b8bfeeae-d6f2-47b9-98bc-76128424da73,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:55:25.871) (total time: 515ms): Trace[879709219]: ---"About to write a response" 515ms (12:55:26.386) Trace[879709219]: [515.439839ms] [515.439839ms] END I0427 12:55:26.386868 1 trace.go:236] Trace[2069484189]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d1917e6f-651f-4b31-9e41-77d77e8b59b5,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:55:25.787) (total time: 599ms): Trace[2069484189]: ---"About to write a response" 599ms (12:55:26.386) Trace[2069484189]: [599.409939ms] [599.409939ms] END I0427 12:56:03.717931 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.96.181.192"} I0427 12:56:03.733335 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.97.85.134"} I0427 12:57:40.088598 1 trace.go:236] Trace[342745485]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fe20355d-4660-43e7-a81d-a5aba7addc6a,client:10.0.0.148,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (27-Apr-2026 12:57:39.443) (total time: 645ms): Trace[342745485]: [645.051403ms] [645.051403ms] END I0427 12:57:40.088977 1 trace.go:236] Trace[762260689]: "Update" accept:application/json, */*,audit-id:e126e638-5ed9-4ee0-be63-1b07071ef041,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.554) (total time: 534ms): Trace[762260689]: ["GuaranteedUpdate etcd3" audit-id:e126e638-5ed9-4ee0-be63-1b07071ef041,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 534ms (12:57:39.554) Trace[762260689]: ---"Txn call completed" 532ms (12:57:40.088)] Trace[762260689]: [534.491061ms] [534.491061ms] END I0427 12:57:40.089047 1 trace.go:236] Trace[1386558974]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:589d19e5-2d14-46b1-afb5-2700f6c2413e,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.194) (total time: 894ms): Trace[1386558974]: ["GuaranteedUpdate etcd3" audit-id:589d19e5-2d14-46b1-afb5-2700f6c2413e,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 894ms (12:57:39.194) Trace[1386558974]: ---"Txn call completed" 893ms (12:57:40.088)] Trace[1386558974]: [894.136514ms] [894.136514ms] END I0427 12:57:40.089057 1 trace.go:236] Trace[1265723045]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:97be7c38-6523-4907-9bfa-edaa870c561c,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.550) (total time: 538ms): Trace[1265723045]: ["GuaranteedUpdate etcd3" audit-id:97be7c38-6523-4907-9bfa-edaa870c561c,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 538ms (12:57:39.550) Trace[1265723045]: ---"Txn call completed" 537ms (12:57:40.088)] Trace[1265723045]: [538.828128ms] [538.828128ms] END I0427 12:57:40.089229 1 trace.go:236] Trace[418598275]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3a5be618-9fd5-46ec-8b95-e9366306b5f1,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.473) (total time: 615ms): Trace[418598275]: ["GuaranteedUpdate etcd3" audit-id:3a5be618-9fd5-46ec-8b95-e9366306b5f1,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 615ms (12:57:39.473) Trace[418598275]: ---"Txn call completed" 614ms (12:57:40.088)] Trace[418598275]: [615.106193ms] [615.106193ms] END I0427 12:57:40.089275 1 trace.go:236] Trace[772655303]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ffe61921-d721-46b2-bfa0-4c0026d61acc,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.553) (total time: 535ms): Trace[772655303]: ["GuaranteedUpdate etcd3" audit-id:ffe61921-d721-46b2-bfa0-4c0026d61acc,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 535ms (12:57:39.554) Trace[772655303]: ---"Txn call completed" 533ms (12:57:40.088)] Trace[772655303]: [535.184345ms] [535.184345ms] END I0427 12:57:40.089563 1 trace.go:236] Trace[1094737689]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:115a4208-f291-4046-b514-6e525777621e,client:10.0.0.178,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:39.547) (total time: 541ms): Trace[1094737689]: ["GuaranteedUpdate etcd3" audit-id:115a4208-f291-4046-b514-6e525777621e,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 541ms (12:57:39.547) Trace[1094737689]: ---"Txn call completed" 540ms (12:57:40.089)] Trace[1094737689]: [541.855917ms] [541.855917ms] END I0427 12:57:47.554774 1 trace.go:236] Trace[285025622]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4d62c271-3f90-438a-8b62-e9e37d59c740,client:10.0.0.31,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:46.885) (total time: 668ms): Trace[285025622]: ["GuaranteedUpdate etcd3" audit-id:4d62c271-3f90-438a-8b62-e9e37d59c740,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 668ms (12:57:46.886) Trace[285025622]: ---"Txn call completed" 667ms (12:57:47.554)] Trace[285025622]: [668.739827ms] [668.739827ms] END I0427 12:57:47.565950 1 trace.go:236] Trace[1897027014]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5325b47e-180d-4a07-96ef-2b96afc09f00,client:10.0.0.21,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:47.063) (total time: 502ms): Trace[1897027014]: ["GuaranteedUpdate etcd3" audit-id:5325b47e-180d-4a07-96ef-2b96afc09f00,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 502ms (12:57:47.063) Trace[1897027014]: ---"Txn call completed" 501ms (12:57:47.565)] Trace[1897027014]: [502.725966ms] [502.725966ms] END E0427 12:57:52.566113 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:52.566161 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:52.566208 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 17.6µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:52.567176 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.3µs, panicked: false, err: context canceled, panic-reason: E0427 12:57:52.567247 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:52.567247 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout I0427 12:57:52.569175 1 trace.go:236] Trace[402753273]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7f6cbd19-687d-4ad6-9779-7a1e3367e6f3,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Apr-2026 12:57:47.566) (total time: 5002ms): Trace[402753273]: ["GuaranteedUpdate etcd3" audit-id:7f6cbd19-687d-4ad6-9779-7a1e3367e6f3,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (12:57:47.566) Trace[402753273]: ---"Txn call failed" err:context deadline exceeded 4999ms (12:57:52.565)] Trace[402753273]: [5.002926297s] [5.002926297s] END E0427 12:57:52.569189 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:52.569263 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:52.569317 1 timeout.go:142] post-timeout activity - time-elapsed: 3.171793ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0427 12:57:52.570349 1 trace.go:236] Trace[1034203347]: "Update" accept:application/json, */*,audit-id:48f16a97-5ee4-4f80-8247-c3684e2863b6,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:47.567) (total time: 5002ms): Trace[1034203347]: ["GuaranteedUpdate etcd3" audit-id:48f16a97-5ee4-4f80-8247-c3684e2863b6,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (12:57:47.567) Trace[1034203347]: ---"Txn call failed" err:context canceled 4998ms (12:57:52.567)] Trace[1034203347]: [5.002687142s] [5.002687142s] END E0427 12:57:52.570705 1 timeout.go:142] post-timeout activity - time-elapsed: 3.598001ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0427 12:57:53.120414 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.59µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:53.120448 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.121541 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.121614 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:53.122861 1 trace.go:236] Trace[1064713699]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b568a52b-02e6-4792-afcc-e7a097640ab7,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.120) (total time: 5002ms): Trace[1064713699]: ["GuaranteedUpdate etcd3" audit-id:b568a52b-02e6-4792-afcc-e7a097640ab7,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (12:57:48.120) Trace[1064713699]: ---"Txn call failed" err:context deadline exceeded 4998ms (12:57:53.120)] Trace[1064713699]: [5.002198192s] [5.002198192s] END E0427 12:57:53.123011 1 timeout.go:142] post-timeout activity - time-elapsed: 2.715355ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: I0427 12:57:53.131809 1 trace.go:236] Trace[6081429]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:03baa5d8-9806-4ec7-bef0-03abe6ae24cb,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.132) (total time: 4999ms): Trace[6081429]: ["GuaranteedUpdate etcd3" audit-id:03baa5d8-9806-4ec7-bef0-03abe6ae24cb,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (12:57:48.132) Trace[6081429]: ---"Txn call failed" err:context canceled 4998ms (12:57:53.131)] Trace[6081429]: [4.999506059s] [4.999506059s] END E0427 12:57:53.131875 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.001µs, panicked: false, err: context canceled, panic-reason: E0427 12:57:53.131931 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud?timeout=5s" audit-ID="03baa5d8-9806-4ec7-bef0-03abe6ae24cb" E0427 12:57:53.131945 1 timeout.go:142] post-timeout activity - time-elapsed: 1.19µs, PUT "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0427 12:57:53.132061 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.132101 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.47µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:53.132167 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.132189 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 4.46µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:53.132805 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.132859 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 21.901µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:53.133007 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.133243 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.133295 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.133917 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:53.134096 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:53.134932 1 trace.go:236] Trace[1272273069]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e6e96727-c2b4-4014-bd0a-1e7c58cda802,client:10.0.0.178,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.132) (total time: 5002ms): Trace[1272273069]: ["GuaranteedUpdate etcd3" audit-id:e6e96727-c2b4-4014-bd0a-1e7c58cda802,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (12:57:48.132) Trace[1272273069]: ---"Txn call failed" err:context deadline exceeded 4998ms (12:57:53.131)] Trace[1272273069]: [5.002408557s] [5.002408557s] END I0427 12:57:53.135047 1 trace.go:236] Trace[398421181]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:25f73143-cf7e-4122-87b8-abd5f9a4acd0,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.132) (total time: 5002ms): Trace[398421181]: ["GuaranteedUpdate etcd3" audit-id:25f73143-cf7e-4122-87b8-abd5f9a4acd0,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (12:57:48.132) Trace[398421181]: ---"Txn call failed" err:context deadline exceeded 4998ms (12:57:53.132)] Trace[398421181]: [5.002359686s] [5.002359686s] END E0427 12:57:53.134940 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:53.135087 1 timeout.go:142] post-timeout activity - time-elapsed: 3.034011ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0427 12:57:53.135183 1 timeout.go:142] post-timeout activity - time-elapsed: 3.00493ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: I0427 12:57:53.135445 1 trace.go:236] Trace[1705846145]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ab7853d7-3ad5-4ea6-a921-3c72f8aa71d6,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.133) (total time: 5001ms): Trace[1705846145]: ["GuaranteedUpdate etcd3" audit-id:ab7853d7-3ad5-4ea6-a921-3c72f8aa71d6,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (12:57:48.133) Trace[1705846145]: ---"Txn call failed" err:context deadline exceeded 4998ms (12:57:53.132)] Trace[1705846145]: [5.001919897s] [5.001919897s] END E0427 12:57:53.135747 1 timeout.go:142] post-timeout activity - time-elapsed: 2.99349ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0427 12:57:53.136161 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.136210 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 8.48µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:53.136908 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.137328 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:53.138086 1 trace.go:236] Trace[96635794]: "Update" accept:application/json, */*,audit-id:ba55b13f-ba08-4d9d-ab5b-5944be4686f3,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:48.136) (total time: 5001ms): Trace[96635794]: ["GuaranteedUpdate etcd3" audit-id:ba55b13f-ba08-4d9d-ab5b-5944be4686f3,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (12:57:48.136) Trace[96635794]: ---"Txn call failed" err:context deadline exceeded 4998ms (12:57:53.136)] Trace[96635794]: [5.001754895s] [5.001754895s] END E0427 12:57:53.138267 1 timeout.go:142] post-timeout activity - time-elapsed: 2.141293ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0427 12:57:53.618913 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:53.619042 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:53.620389 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:53.620433 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:53.621597 1 trace.go:236] Trace[1704644616]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:811dda32-a3d7-4fd5-97e3-64b18598abe8,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:57:48.618) (total time: 5002ms): Trace[1704644616]: [5.002997617s] [5.002997617s] END E0427 12:57:53.621758 1 timeout.go:142] post-timeout activity - time-elapsed: 2.984311ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0427 12:57:54.557631 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:54.557677 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:54.557691 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.91µs, panicked: false, err: context canceled, panic-reason: E0427 12:57:54.559112 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:54.559217 1 trace.go:236] Trace[508291482]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:24eb04f9-eb55-42d8-b3b8-c185b4f672c9,client:10.0.0.31,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:49.557) (total time: 5001ms): Trace[508291482]: ["GuaranteedUpdate etcd3" audit-id:24eb04f9-eb55-42d8-b3b8-c185b4f672c9,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (12:57:49.557) Trace[508291482]: ---"Txn call failed" err:context canceled 4998ms (12:57:54.557)] Trace[508291482]: [5.001496008s] [5.001496008s] END E0427 12:57:54.559376 1 timeout.go:142] post-timeout activity - time-elapsed: 1.713493ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0427 12:57:54.568234 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:54.568274 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:54.568302 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.73µs, panicked: false, err: context deadline exceeded, panic-reason: E0427 12:57:54.568974 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0427 12:57:54.569199 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out E0427 12:57:54.569363 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:54.569487 1 trace.go:236] Trace[844122574]: "Update" accept:application/json, */*,audit-id:ddfe57ba-39d6-485d-ad81-84ec161f8f65,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:57:47.566) (total time: 7003ms): Trace[844122574]: ["GuaranteedUpdate etcd3" audit-id:ddfe57ba-39d6-485d-ad81-84ec161f8f65,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (12:57:47.566) Trace[844122574]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (12:57:54.568)] Trace[844122574]: [7.003203246s] [7.003203246s] END I0427 12:57:54.570239 1 trace.go:236] Trace[936180888]: "Update" accept:application/json, */*,audit-id:694dcdde-b86e-4b79-a318-81803de3a7ac,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:57:47.566) (total time: 7003ms): Trace[936180888]: ["GuaranteedUpdate etcd3" audit-id:694dcdde-b86e-4b79-a318-81803de3a7ac,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (12:57:47.567) Trace[936180888]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (12:57:54.569)] Trace[936180888]: [7.003322069s] [7.003322069s] END I0427 12:57:54.570649 1 trace.go:236] Trace[1625087446]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2e40a670-7f50-445d-94c9-3f0014a1e365,client:10.0.0.21,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:49.569) (total time: 5001ms): Trace[1625087446]: ["GuaranteedUpdate etcd3" audit-id:2e40a670-7f50-445d-94c9-3f0014a1e365,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (12:57:49.569) Trace[1625087446]: ---"Txn call failed" err:context deadline exceeded 4997ms (12:57:54.568)] Trace[1625087446]: [5.001044649s] [5.001044649s] END E0427 12:57:54.570817 1 timeout.go:142] post-timeout activity - time-elapsed: 2.605632ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0427 12:57:54.736681 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:57:54.736848 1 trace.go:236] Trace[1974092295]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05a7efab-eab6-473b-9b2e-3b9f72cb30ed,client:10.0.0.253,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:47.733) (total time: 7003ms): Trace[1974092295]: ["GuaranteedUpdate etcd3" audit-id:05a7efab-eab6-473b-9b2e-3b9f72cb30ed,key:/leases/capi-kubeadm-control-plane-system/kubeadm-control-plane-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (12:57:47.733) Trace[1974092295]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (12:57:54.736)] Trace[1974092295]: [7.003643154s] [7.003643154s] END E0427 12:57:54.791101 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:57:54.791327 1 trace.go:236] Trace[326730028]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7d15f38b-813a-475c-a04b-e687ebd6eaa0,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Apr-2026 12:57:47.787) (total time: 7003ms): Trace[326730028]: ["GuaranteedUpdate etcd3" audit-id:7d15f38b-813a-475c-a04b-e687ebd6eaa0,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (12:57:47.788) Trace[326730028]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (12:57:54.791)] Trace[326730028]: [7.003363149s] [7.003363149s] END E0427 12:57:54.791967 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0427 12:57:55.171989 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:57:55.172176 1 trace.go:236] Trace[58738281]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9afaee02-fc16-4bee-acd2-5091f6abf7a2,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (27-Apr-2026 12:57:48.169) (total time: 7002ms): Trace[58738281]: ["GuaranteedUpdate etcd3" audit-id:9afaee02-fc16-4bee-acd2-5091f6abf7a2,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (12:57:48.169) Trace[58738281]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (12:57:55.171)] Trace[58738281]: [7.002440891s] [7.002440891s] END E0427 12:57:57.094662 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:57.094803 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:57.095959 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:57.096002 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:57.098051 1 trace.go:236] Trace[1921085249]: "Get" accept:application/json, */*,audit-id:fb18d9d4-6f25-4451-9694-65f482e8a4cd,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:57:56.580) (total time: 517ms): Trace[1921085249]: [517.675323ms] [517.675323ms] END E0427 12:57:57.098185 1 timeout.go:142] post-timeout activity - time-elapsed: 3.527922ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0427 12:57:57.101214 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:57:57.101310 1 trace.go:236] Trace[19646047]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:87fb6e8e-361d-41f3-b097-b4845e29614a,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Apr-2026 12:57:50.099) (total time: 7002ms): Trace[19646047]: ["GuaranteedUpdate etcd3" audit-id:87fb6e8e-361d-41f3-b097-b4845e29614a,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7001ms (12:57:50.099) Trace[19646047]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (12:57:57.101)] Trace[19646047]: [7.002078864s] [7.002078864s] END E0427 12:57:57.181630 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:57.181972 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:57.182327 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:57.183010 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:57.183005 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:57.183370 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:57.183534 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:57.184407 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:57.184418 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:57.184476 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:57.184895 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:57.185600 1 trace.go:236] Trace[1353626565]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a82c4e01-2127-4be8-9374-35b750bfa07b,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:57:54.569) (total time: 2616ms): Trace[1353626565]: [2.616349601s] [2.616349601s] END I0427 12:57:57.185633 1 trace.go:236] Trace[1693824238]: "Get" accept:application/json, */*,audit-id:99eb63ca-1430-4b47-ae82-160bf89dc72a,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:54.569) (total time: 2616ms): Trace[1693824238]: [2.616161268s] [2.616161268s] END E0427 12:57:57.185672 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:57.185796 1 timeout.go:142] post-timeout activity - time-elapsed: 3.422038ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0427 12:57:57.185990 1 timeout.go:142] post-timeout activity - time-elapsed: 4.498971ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0427 12:57:57.186020 1 trace.go:236] Trace[1142538140]: "Get" accept:application/json, */*,audit-id:654f611d-c14b-4196-83b6-6de070301fd0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:57:56.580) (total time: 605ms): Trace[1142538140]: [605.849878ms] [605.849878ms] END E0427 12:57:57.186099 1 timeout.go:142] post-timeout activity - time-elapsed: 3.048911ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0427 12:57:58.120973 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:58.121116 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.122219 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:58.122293 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:58.123403 1 trace.go:236] Trace[1600951507]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6c06a55c-fe3c-4510-9619-2a2c6b9c5735,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.280) (total time: 4842ms): Trace[1600951507]: [4.84262171s] [4.84262171s] END E0427 12:57:58.123559 1 timeout.go:142] post-timeout activity - time-elapsed: 2.724125ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0427 12:57:58.131535 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:58.131645 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.132079 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:58.132593 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:58.132731 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.132762 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:58.133248 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0427 12:57:58.133303 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.133789 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:58.133848 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:58.133851 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.134398 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:58.134437 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0427 12:57:58.134897 1 trace.go:236] Trace[262529255]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4ba4ab33-8e6d-4aa4-8899-02a62ca36df8,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.133) (total time: 5001ms): Trace[262529255]: [5.001820315s] [5.001820315s] END E0427 12:57:58.134986 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0427 12:57:58.135025 1 trace.go:236] Trace[1221812965]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0435d5f6-9b20-46a3-a9a3-e87e2391fd61,client:10.0.0.178,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.133) (total time: 5001ms): Trace[1221812965]: [5.001353706s] [5.001353706s] END E0427 12:57:58.135076 1 timeout.go:142] post-timeout activity - time-elapsed: 3.486861ms, GET "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0427 12:57:58.135143 1 timeout.go:142] post-timeout activity - time-elapsed: 3.02637ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0427 12:57:58.135720 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:58.135760 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0427 12:57:58.136190 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0427 12:57:58.136229 1 trace.go:236] Trace[2019405153]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:93070815-aaa7-44fd-b45b-581a85571339,client:10.0.0.177,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.134) (total time: 5001ms): Trace[2019405153]: [5.00160744s] [5.00160744s] END E0427 12:57:58.136353 1 timeout.go:142] post-timeout activity - time-elapsed: 3.728684ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: I0427 12:57:58.137374 1 trace.go:236] Trace[1342894319]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0846be05-2040-4912-8a9e-6eacf5ed035d,client:10.0.0.157,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.133) (total time: 5003ms): Trace[1342894319]: [5.003690962s] [5.003690962s] END E0427 12:57:58.137442 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.137483 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:58.137566 1 timeout.go:142] post-timeout activity - time-elapsed: 4.333337ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: E0427 12:57:58.138593 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:58.138674 1 trace.go:236] Trace[905577477]: "Get" accept:application/json, */*,audit-id:badeae77-5c41-4172-9b84-f640e19d936a,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:53.137) (total time: 5001ms): Trace[905577477]: [5.001473457s] [5.001473457s] END E0427 12:57:58.138782 1 timeout.go:142] post-timeout activity - time-elapsed: 2.640863ms, GET "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0427 12:57:58.143241 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0427 12:57:58.143307 1 trace.go:236] Trace[283946462]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:af5b55d9-39ab-4165-a63c-84b7a32c39bf,client:10.0.0.148,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (27-Apr-2026 12:57:50.221) (total time: 7921ms): Trace[283946462]: [7.921463873s] [7.921463873s] END E0427 12:57:58.143562 1 wrap.go:54] timeout or abort while handling: method=GET URI="/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" audit-ID="af5b55d9-39ab-4165-a63c-84b7a32c39bf" E0427 12:57:58.143586 1 timeout.go:142] post-timeout activity - time-elapsed: 2.61µs, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0427 12:57:58.618974 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:58.619103 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:58.620270 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:58.620316 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:58.621431 1 trace.go:236] Trace[436577115]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:68a3bbee-22f5-4c1a-b117-cbf7037cfe59,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (27-Apr-2026 12:57:55.620) (total time: 3000ms): Trace[436577115]: [3.000983334s] [3.000983334s] END E0427 12:57:58.621542 1 timeout.go:142] post-timeout activity - time-elapsed: 2.630482ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0427 12:57:59.557558 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:59.557669 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:59.559301 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:59.559424 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:59.560414 1 trace.go:236] Trace[1970851913]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2818730d-20f3-4e65-89f0-16b59b08befc,client:10.0.0.31,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:54.558) (total time: 5001ms): Trace[1970851913]: [5.001621151s] [5.001621151s] END E0427 12:57:59.560511 1 timeout.go:142] post-timeout activity - time-elapsed: 2.648033ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0427 12:57:59.568514 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:57:59.568832 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:57:59.568965 1 wrap.go:54] timeout or abort while handling: method=POST URI="/api/v1/namespaces/openstack/events" audit-ID="c3e3d972-701c-4a38-834e-726fa014acb9" E0427 12:57:59.568994 1 timeout.go:142] post-timeout activity - time-elapsed: 4.28µs, POST "/api/v1/namespaces/openstack/events" result: E0427 12:57:59.569652 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:57:59.570660 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:57:59.570851 1 trace.go:236] Trace[530483191]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d794a129-687b-453f-8ec7-7dffdb859c1e,client:10.0.0.21,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:54.569) (total time: 5001ms): Trace[530483191]: [5.001037869s] [5.001037869s] END E0427 12:57:59.571228 1 timeout.go:142] post-timeout activity - time-elapsed: 2.579781ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0427 12:57:59.588345 1 wrap.go:54] timeout or abort while handling: method=POST URI="/api/v1/namespaces/openstack/events" audit-ID="51025334-7fe6-4ca1-8e06-9d93e1e6cded" E0427 12:57:59.588589 1 timeout.go:142] post-timeout activity - time-elapsed: 6.16µs, POST "/api/v1/namespaces/openstack/events" result: E0427 12:58:00.571491 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0427 12:58:00.571656 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:58:00.573005 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:58:00.573094 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:58:00.574141 1 trace.go:236] Trace[1026473660]: "List" accept:*/*,audit-id:b2c8ad15-d263-4861-ad72-68beb152dc60,client:10.0.0.119,protocol:HTTP/1.1,resource:openstackclusters,scope:namespace,url:/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters,user-agent:pykube-ng/23.6.0,verb:LIST (27-Apr-2026 12:57:50.563) (total time: 10010ms): Trace[1026473660]: ["List(recursive=true) etcd3" audit-id:b2c8ad15-d263-4861-ad72-68beb152dc60,key:/infrastructure.cluster.x-k8s.io/openstackclusters/magnum-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 10010ms (12:57:50.563)] Trace[1026473660]: [10.010724351s] [10.010724351s] END E0427 12:58:00.574325 1 timeout.go:142] post-timeout activity - time-elapsed: 2.507369ms, GET "/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters" result: E0427 12:58:01.628337 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:58:01.628503 1 trace.go:236] Trace[1228585744]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:06f2ca09-45d9-48ce-a7da-449e451bc133,client:199.19.213.78,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Apr-2026 12:57:52.654) (total time: 8973ms): Trace[1228585744]: [8.973488975s] [8.973488975s] END E0427 12:58:01.628686 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:58:01.629099 1 trace.go:236] Trace[813610235]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.78,type:*v1.Endpoints,resource:apiServerIPInfo (27-Apr-2026 12:57:48.172) (total time: 13456ms): Trace[813610235]: [13.456787838s] [13.456787838s] END E0427 12:58:01.629201 1 controller.go:159] unable to sync kubernetes service: etcdserver: request timed out I0427 12:58:01.629611 1 trace.go:236] Trace[1863215778]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:892fe491-b430-4536-b8f4-ed59bd64eda3,client:199.19.213.78,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/manila-api-84dc8c88f9-qgqjm.18aa37f7b221aae8,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (27-Apr-2026 12:57:49.928) (total time: 11700ms): Trace[1863215778]: ["GuaranteedUpdate etcd3" audit-id:892fe491-b430-4536-b8f4-ed59bd64eda3,key:/events/openstack/manila-api-84dc8c88f9-qgqjm.18aa37f7b221aae8,type:*core.Event,resource:events 11700ms (12:57:49.929)] Trace[1863215778]: [11.700570871s] [11.700570871s] END I0427 12:58:01.751098 1 metrics.go:285] "Failed to get storage metrics" storage_cluster_id="etcd-0" err="context deadline exceeded" E0427 12:58:01.795578 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0427 12:58:01.795816 1 trace.go:236] Trace[427100738]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:62c9de6a-c730-406f-a7ee-4d40792bfa97,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Apr-2026 12:57:54.792) (total time: 7002ms): Trace[427100738]: ["GuaranteedUpdate etcd3" audit-id:62c9de6a-c730-406f-a7ee-4d40792bfa97,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (12:57:54.793) Trace[427100738]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (12:58:01.795)] Trace[427100738]: [7.002873938s] [7.002873938s] END E0427 12:58:01.796683 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0427 12:58:02.183266 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0427 12:58:02.183298 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0427 12:58:02.183384 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 72.101µs, panicked: false, err: context canceled, panic-reason: E0427 12:58:02.184524 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0427 12:58:02.184621 1 trace.go:236] Trace[830799851]: "Update" accept:application/json, */*,audit-id:3d11ec49-4b70-4394-ac69-d739ff60b67a,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:57.183) (total time: 5001ms): Trace[830799851]: ["GuaranteedUpdate etcd3" audit-id:3d11ec49-4b70-4394-ac69-d739ff60b67a,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (12:57:57.183) Trace[830799851]: ---"Txn call failed" err:context canceled 4998ms (12:58:02.183)] Trace[830799851]: [5.001074489s] [5.001074489s] END E0427 12:58:02.184745 1 timeout.go:142] post-timeout activity - time-elapsed: 1.342826ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0427 12:58:02.845848 1 trace.go:236] Trace[728086143]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cfbec277-c598-46c4-b958-22c3ce837f89,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Apr-2026 12:57:57.103) (total time: 5742ms): Trace[728086143]: ["GuaranteedUpdate etcd3" audit-id:cfbec277-c598-46c4-b958-22c3ce837f89,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5741ms (12:57:57.103) Trace[728086143]: ---"Txn call completed" 5740ms (12:58:02.844)] Trace[728086143]: [5.742139241s] [5.742139241s] END I0427 12:58:02.846831 1 trace.go:236] Trace[435763045]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2bc5f9e-6a5e-4808-9c95-01bdfdc14cdf,client:199.19.213.78,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/storage-loki-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Apr-2026 12:58:01.633) (total time: 1213ms): Trace[435763045]: ---"About to write a response" 1212ms (12:58:02.846) Trace[435763045]: [1.213041251s] [1.213041251s] END E0427 12:58:02.846996 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 3.278038044s, panicked: false, err: context canceled, panic-reason: E0427 12:58:02.847115 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 3.258554735s, panicked: false, err: context canceled, panic-reason: I0427 12:58:02.847401 1 trace.go:236] Trace[1702615940]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b26cb434-0c12-4bdd-8c67-b3de414f7836,client:199.19.213.78,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (27-Apr-2026 12:58:00.130) (total time: 2716ms): Trace[1702615940]: ---"About to write a response" 2716ms (12:58:02.846) Trace[1702615940]: [2.716462942s] [2.716462942s] END I0427 12:58:02.847448 1 trace.go:236] Trace[348347965]: "Update" accept:application/json, */*,audit-id:f44df7f7-811d-4ee0-9aaf-c79ad562d31b,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:57:57.183) (total time: 5663ms): Trace[348347965]: ["GuaranteedUpdate etcd3" audit-id:f44df7f7-811d-4ee0-9aaf-c79ad562d31b,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5663ms (12:57:57.184) Trace[348347965]: ---"Txn call completed" 5661ms (12:58:02.846)] Trace[348347965]: [5.663494167s] [5.663494167s] END I0427 12:58:02.847580 1 trace.go:236] Trace[510082366]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:185f8ccc-46b2-4940-9adb-8d2be7d3b549,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (27-Apr-2026 12:57:58.619) (total time: 4227ms): Trace[510082366]: ["GuaranteedUpdate etcd3" audit-id:185f8ccc-46b2-4940-9adb-8d2be7d3b549,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 4227ms (12:57:58.619) Trace[510082366]: ---"Txn call completed" 4226ms (12:58:02.847)] Trace[510082366]: [4.22772054s] [4.22772054s] END I0427 12:58:02.847679 1 trace.go:236] Trace[1967725537]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9cc5b994-f718-4271-a2ad-64e46fbcb3fb,client:10.0.0.253,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:54.738) (total time: 8108ms): Trace[1967725537]: ---"About to write a response" 8108ms (12:58:02.847) Trace[1967725537]: [8.108777978s] [8.108777978s] END I0427 12:58:02.847754 1 trace.go:236] Trace[1287706804]: "Get" accept:application/json, */*,audit-id:d46ff31c-d230-4f48-a748-de7469026872,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (27-Apr-2026 12:57:59.596) (total time: 3250ms): Trace[1287706804]: ---"About to write a response" 3250ms (12:58:02.847) Trace[1287706804]: [3.250930783s] [3.250930783s] END I0427 12:58:02.847591 1 trace.go:236] Trace[952532550]: "Get" accept:application/json, */*,audit-id:e4d0a529-7220-4d72-85f6-0e69ad8948a7,client:10.0.0.185,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (27-Apr-2026 12:57:58.268) (total time: 4578ms): Trace[952532550]: ---"About to write a response" 4578ms (12:58:02.847) Trace[952532550]: [4.578917535s] [4.578917535s] END I0427 12:58:02.848076 1 trace.go:236] Trace[1064176971]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0a2876f6-4daa-4e5c-a99e-235ba3d17cd8,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (27-Apr-2026 12:58:01.797) (total time: 1050ms): Trace[1064176971]: ["GuaranteedUpdate etcd3" audit-id:0a2876f6-4daa-4e5c-a99e-235ba3d17cd8,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1050ms (12:58:01.797) Trace[1064176971]: ---"Txn call completed" 1048ms (12:58:02.847)] Trace[1064176971]: [1.050283036s] [1.050283036s] END I0427 12:58:02.848243 1 trace.go:236] Trace[1166087435]: "Update" accept:application/json, */*,audit-id:e88d816b-ba0e-4e01-97d4-e96bb982851a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (27-Apr-2026 12:57:57.095) (total time: 5752ms): Trace[1166087435]: ["GuaranteedUpdate etcd3" audit-id:e88d816b-ba0e-4e01-97d4-e96bb982851a,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5752ms (12:57:57.095) Trace[1166087435]: ---"Txn call completed" 5751ms (12:58:02.847)] Trace[1166087435]: [5.752696131s] [5.752696131s] END E0427 12:58:02.848654 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0427 12:58:02.848615 1 trace.go:236] Trace[1874696400]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5bc3e256-83f8-4b0e-adce-c13349db8453,client:199.19.213.78,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (27-Apr-2026 12:57:55.174) (total time: 7672ms): Trace[1874696400]: ---"About to write a response" 7672ms (12:58:02.847) Trace[1874696400]: [7.672635623s] [7.672635623s] END I0427 12:58:02.848809 1 trace.go:236] Trace[1871325065]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cfa21580-547f-4387-ab23-da69c894a9a0,client:10.0.0.118,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:58.132) (total time: 4715ms): Trace[1871325065]: ["GuaranteedUpdate etcd3" audit-id:cfa21580-547f-4387-ab23-da69c894a9a0,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 4715ms (12:57:58.132) Trace[1871325065]: ---"Txn call completed" 4711ms (12:58:02.846)] Trace[1871325065]: [4.71573326s] [4.71573326s] END I0427 12:58:02.849655 1 trace.go:236] Trace[2033255212]: "Update" accept:application/json, */*,audit-id:33a73996-36b7-47d8-9b9b-fa9e04f9d500,client:10.0.0.147,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (27-Apr-2026 12:57:58.137) (total time: 4712ms): Trace[2033255212]: ["GuaranteedUpdate etcd3" audit-id:33a73996-36b7-47d8-9b9b-fa9e04f9d500,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 4711ms (12:57:58.137) Trace[2033255212]: ---"Txn call completed" 4708ms (12:58:02.847)] Trace[2033255212]: [4.712006346s] [4.712006346s] END I0427 12:58:02.880050 1 trace.go:236] Trace[1655746114]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a573b4e0-acbb-405b-8ca6-795a53798127,client:199.19.213.78,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (27-Apr-2026 12:58:01.632) (total time: 1247ms): Trace[1655746114]: ["Create etcd3" audit-id:a573b4e0-acbb-405b-8ca6-795a53798127,key:/events/kube-system/kube-apiserver-instance.18aa3816785003a7,type:*core.Event,resource:events 1246ms (12:58:01.633) Trace[1655746114]: ---"TransformToStorage succeeded" 1213ms (12:58:02.847)] Trace[1655746114]: [1.247049562s] [1.247049562s] END I0427 12:58:02.911322 1 trace.go:236] Trace[125836164]: "Create" accept:application/json, */*,audit-id:3d2577b1-9f61-4297-aa9f-2f21623e9c63,client:10.0.0.177,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (27-Apr-2026 12:57:58.136) (total time: 4775ms): Trace[125836164]: ["Create etcd3" audit-id:3d2577b1-9f61-4297-aa9f-2f21623e9c63,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18aa3817df492d0f,type:*core.Event,resource:events 4774ms (12:57:58.137) Trace[125836164]: ---"TransformToStorage succeeded" 4707ms (12:58:02.845)] Trace[125836164]: [4.775028958s] [4.775028958s] END I0427 12:58:02.912506 1 trace.go:236] Trace[1985608853]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.19.213.78,type:*v1.Endpoints,resource:apiServerIPInfo (27-Apr-2026 12:58:01.629) (total time: 1282ms): Trace[1985608853]: ---"initial value restored" 1216ms (12:58:02.846) Trace[1985608853]: [1.282607173s] [1.282607173s] END I0427 13:03:07.601116 1 trace.go:236] Trace[799906612]: "List" accept:application/json,audit-id:dddf8562-8a94-4e7f-a0a3-60e1cef3ace1,client:199.19.213.78,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:cluster,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:LIST (27-Apr-2026 13:03:07.042) (total time: 558ms): Trace[799906612]: ---"Writing http response done" count:140 256ms (13:03:07.601) Trace[799906612]: [558.396009ms] [558.396009ms] END