I0529 21:58:41.001749 1 options.go:220] external host was not specified, using 199.204.45.227 I0529 21:58:41.002700 1 server.go:148] Version: v1.28.13 I0529 21:58:41.002740 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0529 21:58:41.244019 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0529 21:58:41.256700 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0529 21:58:41.256722 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0529 21:58:41.256908 1 instance.go:298] Using reconciler: lease I0529 21:58:41.542276 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0529 21:58:41.542318 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0529 21:58:41.821027 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0529 21:58:41.821237 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0529 21:58:42.280699 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0529 21:58:42.302898 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0529 21:58:42.302932 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.302940 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.303482 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0529 21:58:42.303498 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0529 21:58:42.304502 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0529 21:58:42.305337 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0529 21:58:42.305354 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0529 21:58:42.305359 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0529 21:58:42.307039 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0529 21:58:42.307053 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0529 21:58:42.307874 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0529 21:58:42.307889 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.307893 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.308473 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0529 21:58:42.308486 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.308521 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0529 21:58:42.309078 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0529 21:58:42.310714 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0529 21:58:42.310730 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.310734 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.311204 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0529 21:58:42.311219 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.311223 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.311913 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0529 21:58:42.311926 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0529 21:58:42.313620 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0529 21:58:42.313634 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.313639 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.314040 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0529 21:58:42.314057 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.314061 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.315914 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0529 21:58:42.315928 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.315932 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.316830 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0529 21:58:42.317771 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0529 21:58:42.317786 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.317790 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.320698 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0529 21:58:42.320713 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0529 21:58:42.320717 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0529 21:58:42.321373 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0529 21:58:42.321386 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0529 21:58:42.321390 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0529 21:58:42.321994 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0529 21:58:42.322007 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0529 21:58:42.360596 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0529 21:58:42.360627 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0529 21:58:42.808872 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0529 21:58:42.809000 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0529 21:58:42.809129 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0529 21:58:42.809336 1 secure_serving.go:213] Serving securely on [::]:6443 I0529 21:58:42.809513 1 controller.go:80] Starting OpenAPI V3 AggregationController I0529 21:58:42.809524 1 available_controller.go:423] Starting AvailableConditionController I0529 21:58:42.809544 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0529 21:58:42.809549 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0529 21:58:42.809724 1 system_namespaces_controller.go:67] Starting system namespaces controller I0529 21:58:42.809774 1 aggregator.go:164] waiting for initial CRD sync... I0529 21:58:42.809793 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0529 21:58:42.809814 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0529 21:58:42.809823 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0529 21:58:42.809829 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0529 21:58:42.809843 1 gc_controller.go:78] Starting apiserver lease garbage collector I0529 21:58:42.809876 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0529 21:58:42.809928 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0529 21:58:42.809842 1 gc_controller.go:78] Starting apiserver lease garbage collector I0529 21:58:42.809993 1 controller.go:78] Starting OpenAPI AggregationController I0529 21:58:42.810002 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0529 21:58:42.810023 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0529 21:58:42.810066 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0529 21:58:42.810084 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0529 21:58:42.810201 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0529 21:58:42.810269 1 controller.go:116] Starting legacy_token_tracking_controller I0529 21:58:42.810299 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0529 21:58:42.810384 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0529 21:58:42.810549 1 controller.go:134] Starting OpenAPI controller I0529 21:58:42.810693 1 controller.go:85] Starting OpenAPI V3 controller I0529 21:58:42.810814 1 naming_controller.go:291] Starting NamingConditionController I0529 21:58:42.810999 1 establishing_controller.go:76] Starting EstablishingController I0529 21:58:42.811030 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0529 21:58:42.811147 1 crd_finalizer.go:266] Starting CRDFinalizer I0529 21:58:42.811012 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0529 21:58:42.844712 1 shared_informer.go:318] Caches are synced for node_authorizer E0529 21:58:42.880279 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0529 21:58:42.910335 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0529 21:58:42.910364 1 shared_informer.go:318] Caches are synced for configmaps I0529 21:58:42.910563 1 apf_controller.go:379] Running API Priority and Fairness config worker I0529 21:58:42.910589 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0529 21:58:42.910816 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0529 21:58:42.910861 1 cache.go:39] Caches are synced for AvailableConditionController controller I0529 21:58:42.911813 1 shared_informer.go:318] Caches are synced for crd-autoregister I0529 21:58:42.911915 1 aggregator.go:166] initial CRD sync complete... I0529 21:58:42.911968 1 autoregister_controller.go:141] Starting autoregister controller I0529 21:58:42.911975 1 cache.go:32] Waiting for caches to sync for autoregister controller I0529 21:58:42.911983 1 cache.go:39] Caches are synced for autoregister controller I0529 21:58:42.912770 1 controller.go:624] quota admission added evaluator for: namespaces I0529 21:58:43.084005 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0529 21:58:43.815636 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0529 21:58:43.820700 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0529 21:58:43.820715 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0529 21:58:44.497044 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0529 21:58:44.556516 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0529 21:58:44.624576 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0529 21:58:44.632096 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.227] I0529 21:58:44.633586 1 controller.go:624] quota admission added evaluator for: endpoints I0529 21:58:44.642856 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0529 21:58:45.192065 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0529 21:58:46.238629 1 controller.go:624] quota admission added evaluator for: deployments.apps I0529 21:58:46.250766 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0529 21:58:46.379319 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0529 21:58:49.589997 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0529 21:58:50.387013 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0529 21:59:16.896249 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0529 21:59:16.912638 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0529 21:59:16.912666 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0529 21:59:16.916520 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0529 21:59:16.950567 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0529 21:59:16.974489 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0529 21:59:16.994325 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0529 21:59:17.016685 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0529 21:59:17.016741 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0529 21:59:17.031766 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0529 21:59:17.083203 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0529 21:59:17.083265 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0529 21:59:17.103979 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0529 21:59:17.104093 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0529 21:59:17.155276 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0529 21:59:17.253787 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:17.418198 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0529 21:59:17.418265 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0529 21:59:17.465983 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:17.499135 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:17.538075 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:17.548561 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:18.260835 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:18.267159 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:18.350554 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0529 21:59:24.207811 1 controller.go:624] quota admission added evaluator for: jobs.batch I0529 21:59:29.183650 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:29.192757 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0529 21:59:29.199955 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0529 21:59:29.389208 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0529 21:59:29.603612 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:29.772089 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0529 21:59:29.988193 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager W0529 21:59:30.267207 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0529 21:59:30.267259 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0529 21:59:31.974596 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:32.390971 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:32.989167 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:33.194045 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0529 21:59:36.276791 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0529 21:59:43.630644 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.99.81.4"} W0529 21:59:43.662189 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.81.4:9443: connect: connection refused E0529 21:59:43.662238 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.81.4:9443: connect: connection refused I0529 21:59:56.474539 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0529 21:59:56.488333 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0529 21:59:56.499891 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0529 21:59:56.527383 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.110.12.133"} I0529 21:59:56.536536 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.101.250.165"} I0529 21:59:56.547101 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0529 21:59:56.598424 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0529 21:59:56.637146 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0529 22:00:08.251574 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.110.12.133:443: connect: connection refused I0529 22:00:13.241372 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0529 22:00:17.655407 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0529 22:00:29.922486 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.104.55.232"} I0529 22:00:29.932134 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.99.129.42"} I0529 22:00:29.940751 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.136.225"} I0529 22:00:29.950255 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.107.20.1"} I0529 22:00:37.527613 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.544628 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.565745 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.583352 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.601624 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.622664 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.646827 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.668788 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.693629 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.706981 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0529 22:00:37.727040 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.749570 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:37.776678 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:39.104307 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0529 22:00:43.064402 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0529 22:00:43.120385 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.110.215.198"} I0529 22:00:43.163033 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0529 22:00:45.616807 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0529 22:00:45.659008 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0529 22:00:46.347604 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0529 22:00:46.347713 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0529 22:00:46.347788 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0529 22:00:53.280894 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0529 22:00:56.239205 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.99.127.187"} I0529 22:00:56.513402 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0529 22:00:56.638675 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0529 22:00:56.777942 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.106.139.235"} I0529 22:00:56.791675 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.99.239.9"} I0529 22:02:25.785994 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.96.132.205"} I0529 22:02:28.441158 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.100.60.165"} I0529 22:02:28.451969 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.107.72.69"} I0529 22:02:35.086960 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.108.75.213"} I0529 22:02:35.095968 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.106.251.186"} I0529 22:05:04.993356 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0529 22:05:09.391804 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0529 22:05:09.432859 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0529 22:05:13.754982 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0529 22:05:13.762040 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0529 22:05:13.782904 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0529 22:05:13.799774 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0529 22:05:13.814188 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0529 22:05:13.826172 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0529 22:05:13.835470 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0529 22:05:15.584690 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0529 22:05:26.452389 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0529 22:06:05.516211 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0529 22:06:19.898756 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0529 22:06:20.088280 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.098739 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.110261 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.318384 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0529 22:06:20.592669 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.599377 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.669176 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0529 22:06:20.684762 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:20.837647 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0529 22:06:58.952221 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.106.199.44"} I0529 22:06:58.966845 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.107.44.160"} I0529 22:06:58.974845 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.96.71.190"} I0529 22:06:58.984350 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.96.192.85"} I0529 22:06:58.991249 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.110.91.153"} I0529 22:06:58.999045 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.104.247.251"} I0529 22:06:59.043819 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0529 22:06:59.057848 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0529 22:06:59.093393 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0529 22:06:59.119137 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0529 22:06:59.166710 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0529 22:06:59.175677 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.175705 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.175737 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.175901 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.175943 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.175713 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.176044 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.176101 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.176591 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.176620 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.176943 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.176970 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.177053 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.177100 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.177534 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.177583 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.177790 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.177849 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.177867 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.177882 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.177889 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.177913 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.178249 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.178276 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.178432 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.178457 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.179060 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.179081 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.179060 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.179097 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused W0529 22:06:59.179863 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused E0529 22:06:59.179891 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.44.160:443: connect: connection refused I0529 22:07:09.856881 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.101.153.16"} I0529 22:07:09.866597 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.106.180.73"} I0529 22:07:14.272804 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.108.82.166"} I0529 22:07:17.126961 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-smartctl-exporter" clusterIPs={"IPv4":"10.110.230.99"} I0529 22:07:19.035418 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.108.206.159"} I0529 22:07:23.465598 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.107.90.214"} I0529 22:07:24.347622 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.101.52.32"} I0529 22:07:30.989387 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0529 22:07:31.158405 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.98.39.90"} I0529 22:08:11.522175 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.111.152.196"} I0529 22:08:11.535684 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0529 22:11:07.903977 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.108.198.124"} E0529 22:11:34.180355 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.204.45.227:34220->199.204.45.227:10250: write: broken pipe I0529 22:11:41.029082 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.106.184.106"} E0529 22:13:08.944342 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc02c3e99e0), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc037dee9b0), ResponseWriter:(*httpsnoop.rw)(0xc037dee9b0), Flusher:(*httpsnoop.rw)(0xc037dee9b0), CloseNotifier:(*httpsnoop.rw)(0xc037dee9b0), Pusher:(*httpsnoop.rw)(0xc037dee9b0)}}, encoder:(*versioning.codec)(0xc00bb892c0), memAllocator:(*runtime.Allocator)(0xc013ceb608)}) I0529 22:13:20.742293 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0529 22:13:20.757321 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.763533 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.775515 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.785772 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0529 22:13:20.813960 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.831842 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.841045 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.850390 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.871369 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.878860 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.905706 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.917284 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.936790 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.959436 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:20.996119 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:21.105749 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:21.108017 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:13:21.185788 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0529 22:14:00.563704 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0529 22:14:00.573771 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0529 22:14:32.292370 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.111.174.221"} I0529 22:14:34.502050 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.105.189.124"} I0529 22:15:05.974878 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.100.171.19"} I0529 22:17:44.725860 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.108.242.100"} I0529 22:18:08.868945 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-cinder" clusterIPs={"IPv4":"10.102.221.235"} I0529 22:18:42.973205 1 alloc.go:330] "allocated clusterIPs" service="openstack/cinder-api" clusterIPs={"IPv4":"10.108.141.106"} I0529 22:23:26.842485 1 alloc.go:330] "allocated clusterIPs" service="openstack/placement-api" clusterIPs={"IPv4":"10.98.151.171"} I0529 22:25:47.609305 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns-metrics" clusterIPs={"IPv4":"10.105.13.211"} I0529 22:25:47.617499 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-coredns" clusterIPs={"IPv4":"10.96.0.20"} I0529 22:25:51.650680 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-nova" clusterIPs={"IPv4":"10.96.118.151"} I0529 22:26:29.222776 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-novncproxy" clusterIPs={"IPv4":"10.96.96.182"} I0529 22:26:29.237071 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-metadata" clusterIPs={"IPv4":"10.97.217.208"} I0529 22:26:29.246758 1 alloc.go:330] "allocated clusterIPs" service="openstack/nova-api" clusterIPs={"IPv4":"10.101.193.87"} I0529 22:29:22.447351 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-neutron" clusterIPs={"IPv4":"10.109.113.185"} I0529 22:29:57.691920 1 alloc.go:330] "allocated clusterIPs" service="openstack/neutron-server" clusterIPs={"IPv4":"10.107.205.225"} I0529 22:32:49.931342 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-heat" clusterIPs={"IPv4":"10.109.82.211"} I0529 22:33:23.835334 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-cfn" clusterIPs={"IPv4":"10.111.134.53"} I0529 22:33:23.842590 1 alloc.go:330] "allocated clusterIPs" service="openstack/heat-api" clusterIPs={"IPv4":"10.99.55.22"} I0529 22:36:35.408957 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-octavia" clusterIPs={"IPv4":"10.101.139.161"} I0529 22:38:21.660705 1 controller.go:624] quota admission added evaluator for: sshkeys.secretgen.k14s.io I0529 22:38:34.310287 1 alloc.go:330] "allocated clusterIPs" service="openstack/octavia-api" clusterIPs={"IPv4":"10.98.55.62"} I0529 22:40:45.068893 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-magnum" clusterIPs={"IPv4":"10.106.43.212"} I0529 22:41:23.263730 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.297391 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.320547 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.349571 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.385931 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.419824 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.442711 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.487188 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.505191 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.543312 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.589992 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.611180 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.636873 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.672377 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.722818 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.801977 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.819003 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.879223 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.891941 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.930985 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.958334 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:23.985306 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:24.023134 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:24.043511 1 handler.go:275] Adding GroupVersion openstack.k-orc.cloud v1alpha1 to ResourceManager I0529 22:41:24.161950 1 alloc.go:330] "allocated clusterIPs" service="orc-system/orc-controller-manager-metrics-service" clusterIPs={"IPv4":"10.97.32.151"} I0529 22:41:27.781605 1 handler.go:275] Adding GroupVersion clusterctl.cluster.x-k8s.io v1alpha3 to ResourceManager I0529 22:41:29.214119 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.231838 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.251674 1 handler.go:275] Adding GroupVersion addons.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.331800 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.343364 1 handler.go:275] Adding GroupVersion runtime.cluster.x-k8s.io v1alpha1 to ResourceManager I0529 22:41:29.352181 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0529 22:41:29.352223 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.362578 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1alpha1 to ResourceManager I0529 22:41:29.362649 1 handler.go:275] Adding GroupVersion ipam.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.427780 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.438657 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.479556 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.554390 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.596315 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.635723 1 handler.go:275] Adding GroupVersion cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:29.755793 1 alloc.go:330] "allocated clusterIPs" service="capi-system/capi-webhook-service" clusterIPs={"IPv4":"10.111.159.128"} I0529 22:41:29.846146 1 controller.go:624] quota admission added evaluator for: providers.clusterctl.cluster.x-k8s.io I0529 22:41:30.109151 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:30.150477 1 handler.go:275] Adding GroupVersion bootstrap.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:30.172381 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-bootstrap-system/capi-kubeadm-bootstrap-webhook-service" clusterIPs={"IPv4":"10.110.231.78"} I0529 22:41:30.620160 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:30.649213 1 handler.go:275] Adding GroupVersion controlplane.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:30.693356 1 alloc.go:330] "allocated clusterIPs" service="capi-kubeadm-control-plane-system/capi-kubeadm-control-plane-webhook-service" clusterIPs={"IPv4":"10.111.107.151"} I0529 22:41:31.088242 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:31.145478 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:31.159599 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0529 22:41:31.194744 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:31.237484 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1beta1 to ResourceManager I0529 22:41:31.292555 1 handler.go:275] Adding GroupVersion infrastructure.cluster.x-k8s.io v1alpha1 to ResourceManager I0529 22:41:31.375407 1 alloc.go:330] "allocated clusterIPs" service="capo-system/capo-webhook-service" clusterIPs={"IPv4":"10.97.164.216"} I0529 22:42:45.810904 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-api" clusterIPs={"IPv4":"10.109.51.3"} I0529 22:43:52.586024 1 trace.go:236] Trace[1473645699]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1192926b-1d09-4f00-a24b-7a1be6c29be2,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:43:52.073) (total time: 512ms): Trace[1473645699]: ["GuaranteedUpdate etcd3" audit-id:1192926b-1d09-4f00-a24b-7a1be6c29be2,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 512ms (22:43:52.073) Trace[1473645699]: ---"Txn call completed" 511ms (22:43:52.585)] Trace[1473645699]: [512.468721ms] [512.468721ms] END I0529 22:44:50.355374 1 alloc.go:330] "allocated clusterIPs" service="openstack/magnum-registry" clusterIPs={"IPv4":"10.110.211.39"} I0529 22:45:04.461512 1 trace.go:236] Trace[604925858]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9e7146eb-b8b1-4b0b-8975-a3bd11a05ba0,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:03.907) (total time: 553ms): Trace[604925858]: ["GuaranteedUpdate etcd3" audit-id:9e7146eb-b8b1-4b0b-8975-a3bd11a05ba0,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 553ms (22:45:03.908) Trace[604925858]: ---"Txn call completed" 552ms (22:45:04.461)] Trace[604925858]: [553.506436ms] [553.506436ms] END I0529 22:45:04.461722 1 trace.go:236] Trace[667966990]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8e12a098-f9ce-4430-886f-63b02e77f6f2,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:03.817) (total time: 644ms): Trace[667966990]: ["GuaranteedUpdate etcd3" audit-id:8e12a098-f9ce-4430-886f-63b02e77f6f2,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 644ms (22:45:03.817) Trace[667966990]: ---"Txn call completed" 643ms (22:45:04.461)] Trace[667966990]: [644.62222ms] [644.62222ms] END I0529 22:45:04.462442 1 trace.go:236] Trace[1511866117]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4228053d-1364-4392-b80e-4c0c01fb70cc,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:45:03.914) (total time: 548ms): Trace[1511866117]: ---"About to write a response" 547ms (22:45:04.462) Trace[1511866117]: [548.065154ms] [548.065154ms] END I0529 22:45:04.462742 1 trace.go:236] Trace[230123070]: "Update" accept:application/json, */*,audit-id:5581b9db-79b0-4475-b4f7-0241cc5492e4,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:03.818) (total time: 644ms): Trace[230123070]: ["GuaranteedUpdate etcd3" audit-id:5581b9db-79b0-4475-b4f7-0241cc5492e4,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 644ms (22:45:03.818) Trace[230123070]: ---"Txn call completed" 643ms (22:45:04.462)] Trace[230123070]: [644.61666ms] [644.61666ms] END I0529 22:45:05.006326 1 trace.go:236] Trace[347483764]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8080ea7a-deab-4fdd-bcba-7dcac517abcb,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:45:04.468) (total time: 537ms): Trace[347483764]: ["GuaranteedUpdate etcd3" audit-id:8080ea7a-deab-4fdd-bcba-7dcac517abcb,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 537ms (22:45:04.468) Trace[347483764]: ---"Txn call completed" 536ms (22:45:05.005)] Trace[347483764]: [537.590403ms] [537.590403ms] END I0529 22:45:05.293305 1 trace.go:236] Trace[2108245181]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.227,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 22:45:04.785) (total time: 507ms): Trace[2108245181]: ---"initial value restored" 221ms (22:45:05.006) Trace[2108245181]: ---"Txn call completed" 253ms (22:45:05.293) Trace[2108245181]: [507.743337ms] [507.743337ms] END I0529 22:45:09.852986 1 trace.go:236] Trace[1008642629]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:905c9c72-51ea-4587-af9f-ea804b15f700,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:09.232) (total time: 620ms): Trace[1008642629]: ["GuaranteedUpdate etcd3" audit-id:905c9c72-51ea-4587-af9f-ea804b15f700,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 620ms (22:45:09.232) Trace[1008642629]: ---"Txn call completed" 618ms (22:45:09.852)] Trace[1008642629]: [620.412459ms] [620.412459ms] END I0529 22:45:10.200611 1 trace.go:236] Trace[964834879]: "Update" accept:application/json, */*,audit-id:ed5b8940-4c3f-4790-9098-73584d3b602d,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:09.455) (total time: 744ms): Trace[964834879]: ["GuaranteedUpdate etcd3" audit-id:ed5b8940-4c3f-4790-9098-73584d3b602d,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 744ms (22:45:09.456) Trace[964834879]: ---"Txn call completed" 743ms (22:45:10.200)] Trace[964834879]: [744.769831ms] [744.769831ms] END I0529 22:45:10.200643 1 trace.go:236] Trace[173053634]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b04ae820-4d65-45ed-9f5b-0b127ceaf51f,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:09.454) (total time: 745ms): Trace[173053634]: ["GuaranteedUpdate etcd3" audit-id:b04ae820-4d65-45ed-9f5b-0b127ceaf51f,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 745ms (22:45:09.454) Trace[173053634]: ---"Txn call completed" 744ms (22:45:10.200)] Trace[173053634]: [745.859088ms] [745.859088ms] END I0529 22:45:10.426627 1 trace.go:236] Trace[1451993095]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:03aa3e1a-e231-43a6-9140-02d95e5f3369,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:45:09.752) (total time: 673ms): Trace[1451993095]: ---"About to write a response" 673ms (22:45:10.426) Trace[1451993095]: [673.593794ms] [673.593794ms] END I0529 22:45:10.426653 1 trace.go:236] Trace[811000188]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8d9ab3eb-ccce-4f70-8103-c975a4b65d23,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:45:09.455) (total time: 971ms): Trace[811000188]: ---"About to write a response" 971ms (22:45:10.426) Trace[811000188]: [971.125821ms] [971.125821ms] END I0529 22:45:10.426706 1 trace.go:236] Trace[1750038892]: "Get" accept:application/json, */*,audit-id:0b10f1c8-648e-45f7-968b-d10dd97cc7bf,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:45:09.762) (total time: 664ms): Trace[1750038892]: ---"About to write a response" 664ms (22:45:10.426) Trace[1750038892]: [664.555808ms] [664.555808ms] END I0529 22:45:10.426753 1 trace.go:236] Trace[1907930798]: "Get" accept:application/json, */*,audit-id:e4c12c96-853f-4303-8e86-4c218d6c92e3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:45:09.753) (total time: 673ms): Trace[1907930798]: ---"About to write a response" 673ms (22:45:10.426) Trace[1907930798]: [673.563543ms] [673.563543ms] END I0529 22:45:10.429900 1 trace.go:236] Trace[911423596]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3d994ee8-8fb6-4968-a7cb-8e9e48d0e5d3,client:199.204.45.227,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-d43bd07d-fb1c-4dc7-beab-ae3c6b03ce18,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:45:09.854) (total time: 575ms): Trace[911423596]: ---"About to write a response" 575ms (22:45:10.429) Trace[911423596]: [575.242726ms] [575.242726ms] END I0529 22:45:15.387960 1 trace.go:236] Trace[220238657]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c4871144-b8c1-400a-b163-f78d0936a742,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:45:14.814) (total time: 573ms): Trace[220238657]: ["GuaranteedUpdate etcd3" audit-id:c4871144-b8c1-400a-b163-f78d0936a742,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 573ms (22:45:14.814) Trace[220238657]: ---"Txn call completed" 572ms (22:45:15.387)] Trace[220238657]: [573.892254ms] [573.892254ms] END I0529 22:45:15.388035 1 trace.go:236] Trace[1121425044]: "Update" accept:application/json, */*,audit-id:8fa257a2-14c4-4b58-90b7-41a7a58ddfea,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:45:14.801) (total time: 586ms): Trace[1121425044]: ["GuaranteedUpdate etcd3" audit-id:8fa257a2-14c4-4b58-90b7-41a7a58ddfea,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 586ms (22:45:14.801) Trace[1121425044]: ---"Txn call completed" 585ms (22:45:15.387)] Trace[1121425044]: [586.740042ms] [586.740042ms] END I0529 22:45:15.388033 1 trace.go:236] Trace[327406888]: "Update" accept:application/json, */*,audit-id:352ce049-4221-4460-ba42-526706a1f3d3,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:14.802) (total time: 585ms): Trace[327406888]: ["GuaranteedUpdate etcd3" audit-id:352ce049-4221-4460-ba42-526706a1f3d3,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 585ms (22:45:14.802) Trace[327406888]: ---"Txn call completed" 584ms (22:45:15.387)] Trace[327406888]: [585.707307ms] [585.707307ms] END I0529 22:45:15.388043 1 trace.go:236] Trace[1237477809]: "Update" accept:application/json, */*,audit-id:fa6e7ccb-e1b0-4598-9c10-1a1c192dcb86,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:45:14.800) (total time: 587ms): Trace[1237477809]: ["GuaranteedUpdate etcd3" audit-id:fa6e7ccb-e1b0-4598-9c10-1a1c192dcb86,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 586ms (22:45:14.801) Trace[1237477809]: ---"Txn call completed" 585ms (22:45:15.387)] Trace[1237477809]: [587.016368ms] [587.016368ms] END I0529 22:45:15.388447 1 trace.go:236] Trace[2007229128]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a6fb2738-6666-4142-84aa-0b556d4df350,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:45:14.800) (total time: 587ms): Trace[2007229128]: ["GuaranteedUpdate etcd3" audit-id:a6fb2738-6666-4142-84aa-0b556d4df350,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 587ms (22:45:14.800) Trace[2007229128]: ---"Txn call completed" 585ms (22:45:15.387)] Trace[2007229128]: [587.598602ms] [587.598602ms] END I0529 22:45:15.701238 1 trace.go:236] Trace[1721330446]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.227,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 22:45:14.786) (total time: 914ms): Trace[1721330446]: ---"initial value restored" 363ms (22:45:15.149) Trace[1721330446]: ---"Transaction prepared" 237ms (22:45:15.387) Trace[1721330446]: ---"Txn call completed" 313ms (22:45:15.701) Trace[1721330446]: [914.942503ms] [914.942503ms] END I0529 22:45:16.734441 1 trace.go:236] Trace[829297804]: "Update" accept:application/json, */*,audit-id:d5b2b6fb-106e-4f30-a617-4e54d748d281,client:10.0.0.158,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:45:15.850) (total time: 883ms): Trace[829297804]: ---"Conversion done" 40ms (22:45:15.902) Trace[829297804]: ["GuaranteedUpdate etcd3" audit-id:d5b2b6fb-106e-4f30-a617-4e54d748d281,key:/nfd.k8s-sigs.io/nodefeatures/monitoring/instance,type:*unstructured.Unstructured,resource:nodefeatures.nfd.k8s-sigs.io 829ms (22:45:15.905) Trace[829297804]: ---"About to Encode" 222ms (22:45:16.139) Trace[829297804]: ---"Txn call completed" 489ms (22:45:16.642) Trace[829297804]: ---"decode succeeded" len:418449 65ms (22:45:16.707)] Trace[829297804]: ---"Writing http response done" 26ms (22:45:16.734) Trace[829297804]: [883.364157ms] [883.364157ms] END I0529 22:45:27.077535 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-manila" clusterIPs={"IPv4":"10.111.247.244"} I0529 22:45:29.194616 1 trace.go:236] Trace[1986656978]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:235b8d19-5382-46f7-bd67-d017454bb1b3,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:28.690) (total time: 504ms): Trace[1986656978]: ["GuaranteedUpdate etcd3" audit-id:235b8d19-5382-46f7-bd67-d017454bb1b3,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 504ms (22:45:28.690) Trace[1986656978]: ---"Txn call completed" 502ms (22:45:29.194)] Trace[1986656978]: [504.224892ms] [504.224892ms] END I0529 22:45:29.830754 1 trace.go:236] Trace[834526266]: "Get" accept:application/json, */*,audit-id:9a0477ea-2896-48cf-b6a2-089e8aaee4a2,client:10.0.0.252,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-e3d5bf65-8d43-4abb-a4fe-9874fe27eab4,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:45:29.282) (total time: 548ms): Trace[834526266]: ---"About to write a response" 547ms (22:45:29.830) Trace[834526266]: [548.217858ms] [548.217858ms] END I0529 22:45:30.574722 1 trace.go:236] Trace[2083959016]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cbf2caee-def0-4fae-a095-31e15f3e1920,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:45:30.019) (total time: 555ms): Trace[2083959016]: ["GuaranteedUpdate etcd3" audit-id:cbf2caee-def0-4fae-a095-31e15f3e1920,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 554ms (22:45:30.019) Trace[2083959016]: ---"Txn call completed" 553ms (22:45:30.574)] Trace[2083959016]: [555.235646ms] [555.235646ms] END I0529 22:46:40.601601 1 alloc.go:330] "allocated clusterIPs" service="openstack/manila-api" clusterIPs={"IPv4":"10.100.46.253"} I0529 22:49:01.935343 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.104.129.119"} I0529 22:49:01.941984 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.107.90.119"} I0529 22:49:42.938971 1 trace.go:236] Trace[1897141566]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5529de51-9ea9-469e-a25f-d437f62e1058,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.774) (total time: 1163ms): Trace[1897141566]: ["GuaranteedUpdate etcd3" audit-id:5529de51-9ea9-469e-a25f-d437f62e1058,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1163ms (22:49:41.775) Trace[1897141566]: ---"Txn call completed" 1162ms (22:49:42.938)] Trace[1897141566]: [1.163919799s] [1.163919799s] END I0529 22:49:43.008676 1 trace.go:236] Trace[1133991843]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e19ae844-fea1-42dd-9e8a-04ceaef1e496,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.777) (total time: 1230ms): Trace[1133991843]: ["GuaranteedUpdate etcd3" audit-id:e19ae844-fea1-42dd-9e8a-04ceaef1e496,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 1230ms (22:49:41.777) Trace[1133991843]: ---"Txn call completed" 1224ms (22:49:43.008)] Trace[1133991843]: [1.230954186s] [1.230954186s] END I0529 22:49:43.010024 1 trace.go:236] Trace[1513746861]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:85bc1f63-d33e-41af-99c5-493e664fffb6,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.784) (total time: 1224ms): Trace[1513746861]: ["GuaranteedUpdate etcd3" audit-id:85bc1f63-d33e-41af-99c5-493e664fffb6,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 1224ms (22:49:41.785) Trace[1513746861]: ---"Txn call completed" 1224ms (22:49:43.009)] Trace[1513746861]: [1.224984173s] [1.224984173s] END I0529 22:49:43.010295 1 trace.go:236] Trace[1496030206]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ac845c09-cf45-4653-83f8-ace5cbfb513c,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.785) (total time: 1224ms): Trace[1496030206]: ["GuaranteedUpdate etcd3" audit-id:ac845c09-cf45-4653-83f8-ace5cbfb513c,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 1224ms (22:49:41.785) Trace[1496030206]: ---"Txn call completed" 1203ms (22:49:43.010)] Trace[1496030206]: [1.22483005s] [1.22483005s] END I0529 22:49:43.010361 1 trace.go:236] Trace[1757180483]: "Update" accept:application/json, */*,audit-id:2dc67c82-1c22-4acd-99a1-191f2d86a453,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.779) (total time: 1230ms): Trace[1757180483]: ["GuaranteedUpdate etcd3" audit-id:2dc67c82-1c22-4acd-99a1-191f2d86a453,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1230ms (22:49:41.779) Trace[1757180483]: ---"Txn call completed" 1228ms (22:49:43.009)] Trace[1757180483]: [1.230545427s] [1.230545427s] END I0529 22:49:43.010437 1 trace.go:236] Trace[1821940232]: "Update" accept:application/json, */*,audit-id:4d0410f2-9400-4e5b-bdfe-a003a28d5402,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.794) (total time: 1216ms): Trace[1821940232]: ["GuaranteedUpdate etcd3" audit-id:4d0410f2-9400-4e5b-bdfe-a003a28d5402,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1215ms (22:49:41.794) Trace[1821940232]: ---"Txn call completed" 1214ms (22:49:43.010)] Trace[1821940232]: [1.216010676s] [1.216010676s] END I0529 22:49:43.010574 1 trace.go:236] Trace[2084880883]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0bd73ea0-24c9-40af-be19-c4934a1107ba,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.771) (total time: 1238ms): Trace[2084880883]: ["GuaranteedUpdate etcd3" audit-id:0bd73ea0-24c9-40af-be19-c4934a1107ba,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1234ms (22:49:41.776) Trace[2084880883]: ---"Txn call completed" 1230ms (22:49:43.010)] Trace[2084880883]: [1.238689814s] [1.238689814s] END I0529 22:49:43.010980 1 trace.go:236] Trace[61180702]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d9be7310-0e16-4085-a9a4-d6f8f7420be5,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-May-2026 22:49:41.775) (total time: 1235ms): Trace[61180702]: ["GuaranteedUpdate etcd3" audit-id:d9be7310-0e16-4085-a9a4-d6f8f7420be5,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1235ms (22:49:41.775) Trace[61180702]: ---"Txn call completed" 1223ms (22:49:43.010)] Trace[61180702]: [1.235096457s] [1.235096457s] END I0529 22:49:43.012592 1 trace.go:236] Trace[520685254]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:47d2b73f-34d7-41e4-bb16-f6fd531740cb,client:199.204.45.227,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-nova-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:49:42.195) (total time: 816ms): Trace[520685254]: ---"About to write a response" 816ms (22:49:43.012) Trace[520685254]: [816.84205ms] [816.84205ms] END I0529 22:49:43.012952 1 trace.go:236] Trace[1699284336]: "Get" accept:application/json,audit-id:81c2a54e-6f62-422e-968c-c3e1c3c55a7e,client:199.204.45.227,protocol:HTTP/1.1,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/openstack-database-exporter-dsn,user-agent:OpenAPI-Generator/36.0.1/python,verb:GET (29-May-2026 22:49:41.788) (total time: 1224ms): Trace[1699284336]: [1.224871751s] [1.224871751s] END I0529 22:49:43.013236 1 trace.go:236] Trace[1618672229]: "Get" accept:application/json, */*,audit-id:8a12734c-01df-4c0a-ad60-05080f079042,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:49:41.811) (total time: 1201ms): Trace[1618672229]: ---"About to write a response" 1201ms (22:49:43.013) Trace[1618672229]: [1.201733673s] [1.201733673s] END I0529 22:49:43.013592 1 trace.go:236] Trace[1073472664]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ca545efd-f228-422c-8f14-86d4b4cfdc3c,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:49:41.774) (total time: 1238ms): Trace[1073472664]: ---"About to write a response" 1238ms (22:49:43.013) Trace[1073472664]: [1.238997421s] [1.238997421s] END I0529 22:49:43.013805 1 trace.go:236] Trace[741450876]: "Get" accept:application/json, */*,audit-id:2a90226b-46d4-4e66-b3b9-fc27aeaf8d83,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:49:41.800) (total time: 1213ms): Trace[741450876]: ---"About to write a response" 1213ms (22:49:43.013) Trace[741450876]: [1.213298911s] [1.213298911s] END I0529 22:49:43.013881 1 trace.go:236] Trace[1787842059]: "Get" accept:application/json, */*,audit-id:c5ab648f-fbf0-46cc-b799-d86b18c26a6e,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:49:41.784) (total time: 1229ms): Trace[1787842059]: ---"About to write a response" 1229ms (22:49:43.013) Trace[1787842059]: [1.229784569s] [1.229784569s] END I0529 22:49:43.014088 1 trace.go:236] Trace[933561197]: "Update" accept:application/json, */*,audit-id:a6eee8a5-4882-45d0-828c-e7c9ee772b2e,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:41.804) (total time: 1209ms): Trace[933561197]: ["GuaranteedUpdate etcd3" audit-id:a6eee8a5-4882-45d0-828c-e7c9ee772b2e,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 1209ms (22:49:41.804) Trace[933561197]: ---"Txn call completed" 1208ms (22:49:43.013)] Trace[933561197]: [1.209986632s] [1.209986632s] END I0529 22:49:43.014466 1 trace.go:236] Trace[2123669011]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c9584b06-12e9-4f6f-8221-1882744fe857,client:199.204.45.227,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/openstack-exporter-5d5977ccd9-vjzzx,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:49:41.825) (total time: 1188ms): Trace[2123669011]: ---"About to write a response" 1188ms (22:49:43.014) Trace[2123669011]: [1.188966175s] [1.188966175s] END I0529 22:49:43.015678 1 trace.go:236] Trace[1669022856]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7d0a7428-38c6-4a9e-9bac-13fd401f4a29,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:49:41.776) (total time: 1239ms): Trace[1669022856]: ---"About to write a response" 1237ms (22:49:43.013) Trace[1669022856]: [1.239464061s] [1.239464061s] END I0529 22:49:43.017192 1 trace.go:236] Trace[800107573]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3aa4350e-b01e-4485-9249-4061118b6577,client:199.204.45.227,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/manila-api-869654657b-hb4pg.18b42ae63757d313,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-May-2026 22:49:42.183) (total time: 833ms): Trace[800107573]: ["GuaranteedUpdate etcd3" audit-id:3aa4350e-b01e-4485-9249-4061118b6577,key:/events/openstack/manila-api-869654657b-hb4pg.18b42ae63757d313,type:*core.Event,resource:events 833ms (22:49:42.183) Trace[800107573]: ---"initial value restored" 826ms (22:49:43.009)] Trace[800107573]: [833.137952ms] [833.137952ms] END I0529 22:49:49.661625 1 trace.go:236] Trace[854261272]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:329c30cb-5751-4326-8758-a7d66dec4330,client:10.0.0.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:48.375) (total time: 1286ms): Trace[854261272]: ["GuaranteedUpdate etcd3" audit-id:329c30cb-5751-4326-8758-a7d66dec4330,key:/leases/capi-kubeadm-control-plane-system/kubeadm-control-plane-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 1286ms (22:49:48.375) Trace[854261272]: ---"Txn call completed" 1285ms (22:49:49.661)] Trace[854261272]: [1.286387041s] [1.286387041s] END I0529 22:49:49.665750 1 trace.go:236] Trace[2098224969]: "List" accept:*/*,audit-id:fbd6483d-68cc-404f-a566-c91289c9e13d,client:10.0.0.155,protocol:HTTP/1.1,resource:openstackclusters,scope:namespace,url:/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters,user-agent:pykube-ng/23.6.0,verb:LIST (29-May-2026 22:49:48.786) (total time: 878ms): Trace[2098224969]: ["List(recursive=true) etcd3" audit-id:fbd6483d-68cc-404f-a566-c91289c9e13d,key:/infrastructure.cluster.x-k8s.io/openstackclusters/magnum-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 878ms (22:49:48.786)] Trace[2098224969]: [878.948909ms] [878.948909ms] END I0529 22:49:49.665893 1 trace.go:236] Trace[609557445]: "Get" accept:application/json, */*,audit-id:6130eb42-8fb3-48e1-aa69-e6d596cb4859,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:49:49.035) (total time: 630ms): Trace[609557445]: ---"About to write a response" 630ms (22:49:49.665) Trace[609557445]: [630.345248ms] [630.345248ms] END I0529 22:49:49.666057 1 trace.go:236] Trace[1349926301]: "Get" accept:application/json, */*,audit-id:ea76185a-8766-48e9-b936-d4fc19d03264,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:49:49.055) (total time: 610ms): Trace[1349926301]: ---"About to write a response" 610ms (22:49:49.665) Trace[1349926301]: [610.720637ms] [610.720637ms] END I0529 22:49:49.666089 1 trace.go:236] Trace[598031924]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aadf5c4c-ea95-4e56-b07c-2b55888654bf,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.032) (total time: 633ms): Trace[598031924]: ["GuaranteedUpdate etcd3" audit-id:aadf5c4c-ea95-4e56-b07c-2b55888654bf,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 633ms (22:49:49.032) Trace[598031924]: ---"Txn call completed" 632ms (22:49:49.665)] Trace[598031924]: [633.730719ms] [633.730719ms] END I0529 22:49:49.666213 1 trace.go:236] Trace[1521521339]: "Get" accept:application/json, */*,audit-id:42a4d1f3-9f83-45a3-80ec-8540127e644d,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:49:49.043) (total time: 622ms): Trace[1521521339]: ---"About to write a response" 622ms (22:49:49.665) Trace[1521521339]: [622.344626ms] [622.344626ms] END I0529 22:49:49.666250 1 trace.go:236] Trace[1221614973]: "Get" accept:application/json, */*,audit-id:f9473b85-a50d-4ca2-81d1-ce5f685b2744,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:49:49.055) (total time: 611ms): Trace[1221614973]: ---"About to write a response" 610ms (22:49:49.666) Trace[1221614973]: [611.077817ms] [611.077817ms] END I0529 22:49:49.666294 1 trace.go:236] Trace[889965088]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:823ea89c-88d3-41a3-9294-28ebc679e43e,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:49:49.049) (total time: 616ms): Trace[889965088]: ---"About to write a response" 616ms (22:49:49.666) Trace[889965088]: [616.862805ms] [616.862805ms] END I0529 22:49:49.666098 1 trace.go:236] Trace[185959170]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d81f0a4b-ec17-4945-b28e-2562e83185d6,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.028) (total time: 637ms): Trace[185959170]: ["GuaranteedUpdate etcd3" audit-id:d81f0a4b-ec17-4945-b28e-2562e83185d6,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 637ms (22:49:49.028) Trace[185959170]: ---"Txn call completed" 636ms (22:49:49.665)] Trace[185959170]: [637.389406ms] [637.389406ms] END I0529 22:49:49.666468 1 trace.go:236] Trace[744031454]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:45937450-7b52-4f15-9c58-04269e6c102b,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.026) (total time: 640ms): Trace[744031454]: ["GuaranteedUpdate etcd3" audit-id:45937450-7b52-4f15-9c58-04269e6c102b,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 640ms (22:49:49.026) Trace[744031454]: ---"Txn call completed" 639ms (22:49:49.666)] Trace[744031454]: [640.398869ms] [640.398869ms] END I0529 22:49:49.665909 1 trace.go:236] Trace[1466990848]: "Update" accept:application/json, */*,audit-id:56732cca-ab95-42f9-9a89-41fc8a5a4681,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.033) (total time: 632ms): Trace[1466990848]: ["GuaranteedUpdate etcd3" audit-id:56732cca-ab95-42f9-9a89-41fc8a5a4681,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 632ms (22:49:49.033) Trace[1466990848]: ---"Txn call completed" 631ms (22:49:49.665)] Trace[1466990848]: [632.653473ms] [632.653473ms] END I0529 22:49:49.666654 1 trace.go:236] Trace[50875548]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:afe68edb-b06a-4720-a37c-25f0c1e9308b,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:48.954) (total time: 712ms): Trace[50875548]: ["GuaranteedUpdate etcd3" audit-id:afe68edb-b06a-4720-a37c-25f0c1e9308b,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 711ms (22:49:48.954) Trace[50875548]: ---"Txn call completed" 711ms (22:49:49.666)] Trace[50875548]: [712.091129ms] [712.091129ms] END I0529 22:49:49.667883 1 trace.go:236] Trace[1571291715]: "Update" accept:application/json, */*,audit-id:b0f451f4-c0b9-4d21-b47a-b7eeb91d9864,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.032) (total time: 634ms): Trace[1571291715]: ["GuaranteedUpdate etcd3" audit-id:b0f451f4-c0b9-4d21-b47a-b7eeb91d9864,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 634ms (22:49:49.033) Trace[1571291715]: ---"Txn call completed" 633ms (22:49:49.667)] Trace[1571291715]: [634.965059ms] [634.965059ms] END I0529 22:49:49.675011 1 trace.go:236] Trace[2098210584]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9f84a27-1de3-4ec0-be84-9e94cec523c2,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:49:49.032) (total time: 642ms): Trace[2098210584]: ["GuaranteedUpdate etcd3" audit-id:e9f84a27-1de3-4ec0-be84-9e94cec523c2,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 642ms (22:49:49.032) Trace[2098210584]: ---"Txn call completed" 641ms (22:49:49.674)] Trace[2098210584]: [642.491149ms] [642.491149ms] END I0529 22:49:49.675142 1 trace.go:236] Trace[1893367615]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9a985a94-b81f-432d-a33a-9e4b2f6f9cb8,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:49:49.050) (total time: 624ms): Trace[1893367615]: ---"About to write a response" 624ms (22:49:49.675) Trace[1893367615]: [624.456797ms] [624.456797ms] END E0529 22:50:10.731697 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.731739 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.731764 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 19.87µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:10.733062 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.733098 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.733170 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 48.472µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:10.733182 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:10.734316 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:10.734387 1 trace.go:236] Trace[1621155201]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e1f3f6b0-59d2-42db-94e2-27e8c21d9cf3,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.733) (total time: 5001ms): Trace[1621155201]: ["GuaranteedUpdate etcd3" audit-id:e1f3f6b0-59d2-42db-94e2-27e8c21d9cf3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:05.733) Trace[1621155201]: ---"Txn call failed" err:context canceled 4997ms (22:50:10.731)] Trace[1621155201]: [5.001290596s] [5.001290596s] END I0529 22:50:10.734387 1 trace.go:236] Trace[828206338]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:1aa868b0-7c15-4f02-9b63-a125d2083c56,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.734) (total time: 5000ms): Trace[828206338]: ["GuaranteedUpdate etcd3" audit-id:1aa868b0-7c15-4f02-9b63-a125d2083c56,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (22:50:05.734) Trace[828206338]: ---"Txn call failed" err:context canceled 4998ms (22:50:10.733)] Trace[828206338]: [5.000014796s] [5.000014796s] END E0529 22:50:10.734521 1 timeout.go:142] post-timeout activity - time-elapsed: 2.92073ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0529 22:50:10.734624 1 timeout.go:142] post-timeout activity - time-elapsed: 1.480625ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0529 22:50:10.735765 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.735791 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.735811 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 6.73µs, panicked: false, err: context deadline exceeded, panic-reason: I0529 22:50:10.735861 1 trace.go:236] Trace[1840581857]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7feb511a-ab55-416a-8613-31c4cab9c101,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.738) (total time: 4997ms): Trace[1840581857]: ---"Write to database call failed" len:447,err:Timeout: request did not complete within requested timeout - context canceled 4997ms (22:50:10.735) Trace[1840581857]: [4.997775862s] [4.997775862s] END E0529 22:50:10.736004 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud?timeout=5s" audit-ID="7feb511a-ab55-416a-8613-31c4cab9c101" E0529 22:50:10.736051 1 timeout.go:142] post-timeout activity - time-elapsed: 4.24µs, PUT "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0529 22:50:10.736298 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 338.268µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:10.737052 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 7.16µs, panicked: false, err: context deadline exceeded, panic-reason: E0529 22:50:10.737123 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.737271 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.737319 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.97µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:10.737613 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:10.738288 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.738659 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0529 22:50:10.738743 1 trace.go:236] Trace[1604837419]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:afd904a2-b81b-4a13-9c30-4c326f6ae709,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.735) (total time: 5003ms): Trace[1604837419]: ["GuaranteedUpdate etcd3" audit-id:afd904a2-b81b-4a13-9c30-4c326f6ae709,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 5003ms (22:50:05.735) Trace[1604837419]: ---"Txn call failed" err:context deadline exceeded 4999ms (22:50:10.735)] Trace[1604837419]: [5.003413567s] [5.003413567s] END E0529 22:50:10.738844 1 timeout.go:142] post-timeout activity - time-elapsed: 2.972502ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0529 22:50:10.738896 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:10.739880 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:10.739965 1 trace.go:236] Trace[1697781881]: "Update" accept:application/json, */*,audit-id:251854b3-3f05-47d2-a8da-eb24fa2157e2,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.737) (total time: 5002ms): Trace[1697781881]: ["GuaranteedUpdate etcd3" audit-id:251854b3-3f05-47d2-a8da-eb24fa2157e2,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:05.737) Trace[1697781881]: ---"Txn call failed" err:context canceled 4998ms (22:50:10.737)] Trace[1697781881]: [5.002165176s] [5.002165176s] END I0529 22:50:10.739979 1 trace.go:236] Trace[442010645]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:50f4bcde-6ded-489a-aaab-56e8dd05f174,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.737) (total time: 5002ms): Trace[442010645]: ["GuaranteedUpdate etcd3" audit-id:50f4bcde-6ded-489a-aaab-56e8dd05f174,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (22:50:05.737) Trace[442010645]: ---"Txn call failed" err:context deadline exceeded 4999ms (22:50:10.737)] Trace[442010645]: [5.002749852s] [5.002749852s] END E0529 22:50:10.740025 1 timeout.go:142] post-timeout activity - time-elapsed: 2.842368ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0529 22:50:10.740183 1 timeout.go:142] post-timeout activity - time-elapsed: 3.032822ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: E0529 22:50:10.741153 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0529 22:50:10.741306 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.742399 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.742445 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:10.742810 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0529 22:50:10.743968 1 trace.go:236] Trace[1164538700]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ea45fec9-89a3-401e-b147-5ae146caba59,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:05.740) (total time: 5002ms): Trace[1164538700]: [5.002975926s] [5.002975926s] END E0529 22:50:10.744056 1 timeout.go:142] post-timeout activity - time-elapsed: 2.830618ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0529 22:50:10.744308 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.745148 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.746261 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:10.746288 1 trace.go:236] Trace[234309723]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e869be74-ae06-494d-9434-3afb78b1b814,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:05.743) (total time: 5002ms): Trace[234309723]: [5.00233225s] [5.00233225s] END E0529 22:50:10.746336 1 timeout.go:142] post-timeout activity - time-elapsed: 3.490944ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0529 22:50:10.748636 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0529 22:50:10.748717 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:10.749871 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:10.749919 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:10.750972 1 trace.go:236] Trace[583027039]: "Get" accept:application/json, */*,audit-id:9537ea76-9e62-4464-a425-48cacefa9b18,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:05.748) (total time: 5002ms): Trace[583027039]: [5.002391924s] [5.002391924s] END E0529 22:50:10.751094 1 timeout.go:142] post-timeout activity - time-elapsed: 2.340006ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0529 22:50:12.339042 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:12.339214 1 trace.go:236] Trace[710508361]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:50a7af61-ae69-4f5e-a67d-67b1f06fe500,client:199.204.45.227,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/heat-engine-cleaner-29668250/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (29-May-2026 22:50:05.333) (total time: 7005ms): Trace[710508361]: ["GuaranteedUpdate etcd3" audit-id:50a7af61-ae69-4f5e-a67d-67b1f06fe500,key:/jobs/openstack/heat-engine-cleaner-29668250,type:*batch.Job,resource:jobs.batch 7005ms (22:50:05.333) Trace[710508361]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:12.338)] Trace[710508361]: [7.005802351s] [7.005802351s] END E0529 22:50:12.531078 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:12.531248 1 trace.go:236] Trace[1243705742]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:18759e40-5c10-4147-b0d2-b3aa3fb1ad16,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-May-2026 22:50:05.528) (total time: 7002ms): Trace[1243705742]: ["GuaranteedUpdate etcd3" audit-id:18759e40-5c10-4147-b0d2-b3aa3fb1ad16,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (22:50:05.528) Trace[1243705742]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (22:50:12.531)] Trace[1243705742]: [7.002577644s] [7.002577644s] END E0529 22:50:12.740247 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:12.740362 1 trace.go:236] Trace[32925719]: "Update" accept:application/json, */*,audit-id:e571fd5c-b21d-4de4-9a87-45eaff65acc3,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:05.738) (total time: 7001ms): Trace[32925719]: ["GuaranteedUpdate etcd3" audit-id:e571fd5c-b21d-4de4-9a87-45eaff65acc3,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7001ms (22:50:05.739) Trace[32925719]: ---"Txn call failed" err:etcdserver: request timed out 7000ms (22:50:12.740)] Trace[32925719]: [7.001440596s] [7.001440596s] END E0529 22:50:13.773004 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:13.773331 1 trace.go:236] Trace[1272735064]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e765e9d9-07ff-439e-87dc-14dd5a2d5940,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:06.769) (total time: 7003ms): Trace[1272735064]: ["GuaranteedUpdate etcd3" audit-id:e765e9d9-07ff-439e-87dc-14dd5a2d5940,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:06.769) Trace[1272735064]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:13.772)] Trace[1272735064]: [7.003859504s] [7.003859504s] END E0529 22:50:13.774025 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0529 22:50:14.349171 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:14.349430 1 trace.go:236] Trace[1547527404]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fff18365-8f52-40e5-b660-ba18f6d64abc,client:199.204.45.227,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-May-2026 22:50:07.345) (total time: 7003ms): Trace[1547527404]: ["Create etcd3" audit-id:fff18365-8f52-40e5-b660-ba18f6d64abc,key:/events/openstack/horizon-598d7486df-bkkqn.18b42afa5338d583,type:*core.Event,resource:events 7002ms (22:50:07.346) Trace[1547527404]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:14.349)] Trace[1547527404]: [7.003450675s] [7.003450675s] END E0529 22:50:15.461872 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:15.462039 1 trace.go:236] Trace[612694095]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:24d1d12a-9ed1-48ab-8661-03cc9f4e25f1,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:08.458) (total time: 7003ms): Trace[612694095]: ["GuaranteedUpdate etcd3" audit-id:24d1d12a-9ed1-48ab-8661-03cc9f4e25f1,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:08.458) Trace[612694095]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:15.461)] Trace[612694095]: [7.003403384s] [7.003403384s] END E0529 22:50:15.732104 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded I0529 22:50:15.732299 1 trace.go:236] Trace[673267147]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a4cb2a2e-33b1-4ec9-8dfe-5bf270330802,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.732) (total time: 4999ms): Trace[673267147]: [4.999943884s] [4.999943884s] END E0529 22:50:15.732499 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com?timeout=5s" audit-ID="a4cb2a2e-33b1-4ec9-8dfe-5bf270330802" E0529 22:50:15.732535 1 timeout.go:142] post-timeout activity - time-elapsed: 4.91µs, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0529 22:50:15.732788 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.733633 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.734182 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.734765 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.735688 1 trace.go:236] Trace[1749605254]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dc2668e8-1fd5-41f8-87e1-1e42a4db2b6d,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.734) (total time: 5001ms): Trace[1749605254]: [5.001359978s] [5.001359978s] END E0529 22:50:15.735806 1 timeout.go:142] post-timeout activity - time-elapsed: 2.998143ms, GET "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0529 22:50:15.735909 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.735950 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.737188 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.737584 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.737423 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.737524 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.737838 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0529 22:50:15.739494 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.739525 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.739545 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.739507 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.739576 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.740783 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.740832 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.740890 1 trace.go:236] Trace[942435319]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e6bf1f27-2808-4553-90ad-b2895d6fc25b,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.737) (total time: 5003ms): Trace[942435319]: [5.00354563s] [5.00354563s] END E0529 22:50:15.741041 1 timeout.go:142] post-timeout activity - time-elapsed: 5.114403ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0529 22:50:15.741072 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0529 22:50:15.741142 1 trace.go:236] Trace[855473972]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:314e5f5e-1692-4e3b-9e4f-d2d6d34bb5e3,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.736) (total time: 5004ms): Trace[855473972]: [5.004690808s] [5.004690808s] END E0529 22:50:15.741274 1 timeout.go:142] post-timeout activity - time-elapsed: 5.514742ms, GET "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0529 22:50:15.741500 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.742457 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.743329 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.743601 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.744446 1 trace.go:236] Trace[1140501508]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4de57855-5779-4c19-b574-1e931d71bf04,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:12.743) (total time: 3001ms): Trace[1140501508]: [3.001090097s] [3.001090097s] END E0529 22:50:15.744596 1 timeout.go:142] post-timeout activity - time-elapsed: 3.060243ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0529 22:50:15.744906 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.746173 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.746193 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.746415 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.746540 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.746547 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 52.781µs, panicked: false, err: context canceled, panic-reason: I0529 22:50:15.746610 1 trace.go:236] Trace[1077545729]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f3c292d7-109a-49c2-9265-080bac5b1c7f,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.737) (total time: 5008ms): Trace[1077545729]: [5.008611923s] [5.008611923s] END E0529 22:50:15.746743 1 timeout.go:142] post-timeout activity - time-elapsed: 8.800751ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: I0529 22:50:15.747961 1 trace.go:236] Trace[838155634]: "Get" accept:application/json, */*,audit-id:e0f611ba-3fba-4663-81e9-0da4999e1b64,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:10.738) (total time: 5009ms): Trace[838155634]: [5.009601486s] [5.009601486s] END E0529 22:50:15.747973 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.748002 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.748019 1 timeout.go:142] post-timeout activity - time-elapsed: 10.468411ms, GET "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0529 22:50:15.748093 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.749150 1 trace.go:236] Trace[909831724]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:72c58ffd-1181-49b0-b5fc-d81ff4eb1e5c,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:12.744) (total time: 3005ms): Trace[909831724]: [3.005098162s] [3.005098162s] END I0529 22:50:15.749224 1 trace.go:236] Trace[1856118743]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a211a16a-4e04-42f3-9cba-7c85bc1f941e,client:199.204.45.227,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/heat-engine-cleaner-29668250/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (29-May-2026 22:50:13.343) (total time: 2406ms): Trace[1856118743]: ["GuaranteedUpdate etcd3" audit-id:a211a16a-4e04-42f3-9cba-7c85bc1f941e,key:/jobs/openstack/heat-engine-cleaner-29668250,type:*batch.Job,resource:jobs.batch 2405ms (22:50:13.343) Trace[1856118743]: ---"Txn call failed" err:context canceled 2398ms (22:50:15.746)] Trace[1856118743]: [2.406042924s] [2.406042924s] END E0529 22:50:15.749340 1 timeout.go:142] post-timeout activity - time-elapsed: 2.781397ms, PUT "/apis/batch/v1/namespaces/openstack/jobs/heat-engine-cleaner-29668250/status" result: E0529 22:50:15.749356 1 timeout.go:142] post-timeout activity - time-elapsed: 3.027892ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0529 22:50:15.749713 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.750740 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.750777 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.751909 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.751965 1 trace.go:236] Trace[108760060]: "Get" accept:application/json, */*,audit-id:61f01ccc-c0e0-4ed5-a09e-66d7ee9862a7,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:12.751) (total time: 3000ms): Trace[108760060]: [3.000683455s] [3.000683455s] END E0529 22:50:15.752048 1 timeout.go:142] post-timeout activity - time-elapsed: 2.246733ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0529 22:50:15.753140 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.753211 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.754518 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.754610 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.756296 1 trace.go:236] Trace[192711845]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b044c4d0-f85e-4aa0-ab12-dd45a56207f9,client:10.0.0.29,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:08.515) (total time: 7240ms): Trace[192711845]: [7.240332966s] [7.240332966s] END E0529 22:50:15.756347 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.756407 1 timeout.go:142] post-timeout activity - time-elapsed: 3.295648ms, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0529 22:50:15.756422 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.756514 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:15.757775 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.757811 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.757918 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.759518 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.759603 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:15.759562 1 trace.go:236] Trace[905416052]: "Get" accept:application/json, */*,audit-id:a31e092d-93d4-4a7e-975e-df53d0d0bf06,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:05.753) (total time: 10005ms): Trace[905416052]: [10.005565845s] [10.005565845s] END E0529 22:50:15.759723 1 timeout.go:142] post-timeout activity - time-elapsed: 3.358111ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: I0529 22:50:15.761357 1 trace.go:236] Trace[1408287390]: "Get" accept:application/json, */*,audit-id:20a4dbc4-c71f-4fc5-ad81-993f0936e256,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:05.754) (total time: 10007ms): Trace[1408287390]: [10.007288617s] [10.007288617s] END E0529 22:50:15.761484 1 timeout.go:142] post-timeout activity - time-elapsed: 4.926499ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0529 22:50:15.773301 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:15.773330 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:15.773406 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 63.491µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:15.774597 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:15.774726 1 timeout.go:142] post-timeout activity - time-elapsed: 1.531246ms, POST "/api/v1/namespaces/kube-system/events" result: E0529 22:50:16.713199 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:16.713370 1 trace.go:236] Trace[337152193]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a072f16a-c022-4429-8ea2-960eb31234f7,client:10.0.0.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:09.709) (total time: 7003ms): Trace[337152193]: ["GuaranteedUpdate etcd3" audit-id:a072f16a-c022-4429-8ea2-960eb31234f7,key:/leases/capi-kubeadm-control-plane-system/kubeadm-control-plane-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:09.709) Trace[337152193]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:16.713)] Trace[337152193]: [7.003640439s] [7.003640439s] END E0529 22:50:19.312997 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:19.313114 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:19.313949 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:19.314938 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:19.314963 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:19.314997 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:19.316118 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:19.316171 1 trace.go:236] Trace[1746101932]: "Get" accept:application/json, */*,audit-id:872ed540-c6d1-4480-9e81-d5efeff9ce5c,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:12.741) (total time: 6574ms): Trace[1746101932]: [6.574178769s] [6.574178769s] END E0529 22:50:19.316187 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:19.316283 1 timeout.go:142] post-timeout activity - time-elapsed: 3.147206ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: I0529 22:50:19.317633 1 trace.go:236] Trace[464820960]: "Get" accept:application/json, */*,audit-id:ccc35ed2-2448-4f03-92c2-63496c1d3ff8,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:05.752) (total time: 13564ms): Trace[464820960]: [13.564777226s] [13.564777226s] END E0529 22:50:19.317720 1 timeout.go:142] post-timeout activity - time-elapsed: 3.896203ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0529 22:50:19.737031 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0529 22:50:19.737157 1 trace.go:236] Trace[984607324]: "List" accept:*/*,audit-id:88de606a-d908-4952-9ca7-3bdfd94a415a,client:10.0.0.155,protocol:HTTP/1.1,resource:openstackclusters,scope:namespace,url:/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters,user-agent:pykube-ng/23.6.0,verb:LIST (29-May-2026 22:50:09.736) (total time: 10001ms): Trace[984607324]: ["List(recursive=true) etcd3" audit-id:88de606a-d908-4952-9ca7-3bdfd94a415a,key:/infrastructure.cluster.x-k8s.io/openstackclusters/magnum-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 10001ms (22:50:09.736)] Trace[984607324]: [10.001059837s] [10.001059837s] END E0529 22:50:19.737251 1 wrap.go:54] timeout or abort while handling: method=GET URI="/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters" audit-ID="88de606a-d908-4952-9ca7-3bdfd94a415a" E0529 22:50:19.737306 1 timeout.go:142] post-timeout activity - time-elapsed: 7.001µs, GET "/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters" result: E0529 22:50:20.532472 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:50:20.532735 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:20.533968 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:20.534041 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:20.535284 1 trace.go:236] Trace[1625446754]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3e2e19aa-6d52-4dc3-8f0e-dcb367547a2f,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (29-May-2026 22:50:12.532) (total time: 8002ms): Trace[1625446754]: [8.002432004s] [8.002432004s] END E0529 22:50:20.535449 1 timeout.go:142] post-timeout activity - time-elapsed: 2.89227ms, GET "/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader" result: E0529 22:50:20.736736 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:20.736793 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:20.737226 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 374.479µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:20.737693 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:20.737938 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:20.738400 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:20.738580 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 845.28µs, panicked: false, err: context deadline exceeded, panic-reason: I0529 22:50:20.738840 1 trace.go:236] Trace[1908092125]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ec62d8a4-efca-4659-9405-421de7699f23,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:15.737) (total time: 5001ms): Trace[1908092125]: ["GuaranteedUpdate etcd3" audit-id:ec62d8a4-efca-4659-9405-421de7699f23,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:15.737) Trace[1908092125]: ---"Txn call failed" err:context canceled 4998ms (22:50:20.737)] Trace[1908092125]: [5.001578633s] [5.001578633s] END E0529 22:50:20.739041 1 timeout.go:142] post-timeout activity - time-elapsed: 2.210283ms, PUT "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0529 22:50:20.739096 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:50:20.743096 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:20.743150 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:20.743290 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 115.583µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:20.744520 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:20.744576 1 trace.go:236] Trace[1504504968]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3837eb4e-33ba-494d-86e3-5b94b6ff9371,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:50:15.742) (total time: 5002ms): Trace[1504504968]: ["GuaranteedUpdate etcd3" audit-id:3837eb4e-33ba-494d-86e3-5b94b6ff9371,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:15.742) Trace[1504504968]: ---"Txn call failed" err:context canceled 4999ms (22:50:20.743)] Trace[1504504968]: [5.002187747s] [5.002187747s] END I0529 22:50:20.744684 1 trace.go:236] Trace[1607757536]: "Update" accept:application/json, */*,audit-id:e69bcff1-7aa8-4fa0-91e2-9aad038e4a73,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:15.738) (total time: 5006ms): Trace[1607757536]: ["GuaranteedUpdate etcd3" audit-id:e69bcff1-7aa8-4fa0-91e2-9aad038e4a73,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 5006ms (22:50:15.738) Trace[1607757536]: ---"Txn call failed" err:context deadline exceeded 4999ms (22:50:20.738)] Trace[1607757536]: [5.006348297s] [5.006348297s] END E0529 22:50:20.744691 1 timeout.go:142] post-timeout activity - time-elapsed: 1.418664ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0529 22:50:20.744894 1 timeout.go:142] post-timeout activity - time-elapsed: 7.255584ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0529 22:50:20.749764 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 53.131µs, panicked: false, err: context canceled, panic-reason: E0529 22:50:20.749826 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:50:20.750912 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:50:20.751193 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:50:20.752064 1 trace.go:236] Trace[1326910095]: "Update" accept:application/json, */*,audit-id:d5344e01-461f-4e5b-9bbb-894af1a1f72a,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:15.749) (total time: 5002ms): Trace[1326910095]: ["GuaranteedUpdate etcd3" audit-id:d5344e01-461f-4e5b-9bbb-894af1a1f72a,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:15.750) Trace[1326910095]: ---"Txn call failed" err:context canceled 4999ms (22:50:20.749)] Trace[1326910095]: [5.002060935s] [5.002060935s] END E0529 22:50:20.752249 1 timeout.go:142] post-timeout activity - time-elapsed: 2.209523ms, PUT "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0529 22:50:20.777915 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:20.778102 1 trace.go:236] Trace[885857722]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:483c60ca-0e97-4b30-914b-aede45ffdbd5,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:13.774) (total time: 7003ms): Trace[885857722]: ["GuaranteedUpdate etcd3" audit-id:483c60ca-0e97-4b30-914b-aede45ffdbd5,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (22:50:13.775) Trace[885857722]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (22:50:20.777)] Trace[885857722]: [7.003084695s] [7.003084695s] END E0529 22:50:20.778795 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0529 22:50:21.353479 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:21.353756 1 trace.go:236] Trace[2116780346]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:dae3deee-53f8-4c34-ba4a-8f2ed6096a4e,client:199.204.45.227,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-May-2026 22:50:14.351) (total time: 7002ms): Trace[2116780346]: ["Create etcd3" audit-id:dae3deee-53f8-4c34-ba4a-8f2ed6096a4e,key:/events/kube-system/kube-apiserver-instance.18b42afaeebf6c1f,type:*core.Event,resource:events 7001ms (22:50:14.352) Trace[2116780346]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (22:50:21.353)] Trace[2116780346]: [7.002193064s] [7.002193064s] END E0529 22:50:22.472249 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:22.472487 1 trace.go:236] Trace[2016961837]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:30bd0112-2702-4bef-b46e-42908b0b3f8c,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:15.466) (total time: 7005ms): Trace[2016961837]: ["GuaranteedUpdate etcd3" audit-id:30bd0112-2702-4bef-b46e-42908b0b3f8c,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7004ms (22:50:15.467) Trace[2016961837]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:22.472)] Trace[2016961837]: [7.005523164s] [7.005523164s] END E0529 22:50:22.737576 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:22.737771 1 trace.go:236] Trace[820458874]: "Create" accept:application/json, */*,audit-id:095d3b7e-d2a8-488f-9aeb-1e5c3bb9290c,client:10.0.0.231,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/events,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (29-May-2026 22:50:15.734) (total time: 7003ms): Trace[820458874]: ["Create etcd3" audit-id:095d3b7e-d2a8-488f-9aeb-1e5c3bb9290c,key:/events/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io.18b42afc473351d1,type:*core.Event,resource:events 7002ms (22:50:15.735) Trace[820458874]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:50:22.737)] Trace[820458874]: [7.003562818s] [7.003562818s] END E0529 22:50:22.766282 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:22.766475 1 trace.go:236] Trace[1381313712]: "Update" accept:application/json, */*,audit-id:25195314-4187-486b-a7a1-f388256c0491,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:50:15.758) (total time: 7008ms): Trace[1381313712]: ["GuaranteedUpdate etcd3" audit-id:25195314-4187-486b-a7a1-f388256c0491,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7007ms (22:50:15.758) Trace[1381313712]: ---"Txn call failed" err:etcdserver: request timed out 7006ms (22:50:22.766)] Trace[1381313712]: [7.008050984s] [7.008050984s] END E0529 22:50:22.767118 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:22.768547 1 trace.go:236] Trace[279351429]: "Update" accept:application/json, */*,audit-id:67182403-31cd-46f8-bbc8-fe8f6ba1bb8e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:50:15.756) (total time: 7012ms): Trace[279351429]: ["GuaranteedUpdate etcd3" audit-id:67182403-31cd-46f8-bbc8-fe8f6ba1bb8e,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 7011ms (22:50:15.756) Trace[279351429]: ---"Txn call failed" err:etcdserver: request timed out 7006ms (22:50:22.767)] Trace[279351429]: [7.012162793s] [7.012162793s] END E0529 22:50:27.782861 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:50:27.783109 1 trace.go:236] Trace[649813043]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:758da560-5ab6-4f09-b21d-da5ccc9e66c0,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:20.779) (total time: 7003ms): Trace[649813043]: ["GuaranteedUpdate etcd3" audit-id:758da560-5ab6-4f09-b21d-da5ccc9e66c0,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:20.779) Trace[649813043]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (22:50:27.782)] Trace[649813043]: [7.003362123s] [7.003362123s] END E0529 22:50:27.783896 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" I0529 22:50:27.854646 1 trace.go:236] Trace[2003991286]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:db2d8552-5b8b-4093-9f6c-3b85f9fae630,client:199.204.45.227,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (29-May-2026 22:50:21.355) (total time: 6499ms): Trace[2003991286]: ["Create etcd3" audit-id:db2d8552-5b8b-4093-9f6c-3b85f9fae630,key:/events/kube-system/kube-apiserver-instance.18b42afb0b8a9fe0,type:*core.Event,resource:events 6498ms (22:50:21.356) Trace[2003991286]: ---"Txn call succeeded" 6498ms (22:50:27.854)] Trace[2003991286]: [6.49914114s] [6.49914114s] END E0529 22:50:27.855225 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0529 22:50:27.855362 1 trace.go:236] Trace[2090127588]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:523d015c-44a5-4e40-b8f6-06b2d2ef1e8e,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:22.474) (total time: 5380ms): Trace[2090127588]: ["GuaranteedUpdate etcd3" audit-id:523d015c-44a5-4e40-b8f6-06b2d2ef1e8e,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 5380ms (22:50:22.474) Trace[2090127588]: ---"Txn call completed" 5378ms (22:50:27.854)] Trace[2090127588]: [5.380769468s] [5.380769468s] END I0529 22:50:27.893209 1 trace.go:236] Trace[1243913726]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:762c8139-0ce4-4a25-85a3-fa960242bcea,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-May-2026 22:50:20.533) (total time: 7359ms): Trace[1243913726]: ["GuaranteedUpdate etcd3" audit-id:762c8139-0ce4-4a25-85a3-fa960242bcea,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7358ms (22:50:20.534)] Trace[1243913726]: [7.359161496s] [7.359161496s] END I0529 22:50:27.894074 1 trace.go:236] Trace[1902695254]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c8f8fed6-d42d-4688-9e70-ab8acd3f19a0,client:199.204.45.227,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:50:19.403) (total time: 8490ms): Trace[1902695254]: ---"About to write a response" 8490ms (22:50:27.893) Trace[1902695254]: [8.490935739s] [8.490935739s] END I0529 22:50:27.894136 1 trace.go:236] Trace[1723753362]: "Get" accept:application/json, */*,audit-id:fe99fa8f-0f84-416d-9ba1-c753d9884425,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (29-May-2026 22:50:18.133) (total time: 9760ms): Trace[1723753362]: ---"About to write a response" 9760ms (22:50:27.893) Trace[1723753362]: [9.760295552s] [9.760295552s] END I0529 22:50:27.894319 1 trace.go:236] Trace[388851975]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f809f1d8-1c3d-466d-b546-896645f2d038,client:10.0.0.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:16.715) (total time: 11178ms): Trace[388851975]: ---"About to write a response" 11178ms (22:50:27.894) Trace[388851975]: [11.178521397s] [11.178521397s] END I0529 22:50:27.896684 1 trace.go:236] Trace[1613334118]: "Get" accept:application/json, */*,audit-id:bd7ec291-0ed7-48b5-b0d9-9fae062564fd,client:10.0.0.188,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:17.895) (total time: 10001ms): Trace[1613334118]: ---"About to write a response" 10001ms (22:50:27.896) Trace[1613334118]: [10.001442137s] [10.001442137s] END I0529 22:50:27.899857 1 trace.go:236] Trace[2102722955]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:51a2c04d-82d5-453f-a732-b080e5f4599a,client:199.204.45.227,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:50:17.976) (total time: 9923ms): Trace[2102722955]: ---"About to write a response" 9919ms (22:50:27.896) Trace[2102722955]: [9.92320785s] [9.92320785s] END I0529 22:50:27.944077 1 trace.go:236] Trace[1422428328]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.227,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 22:50:14.803) (total time: 13140ms): Trace[1422428328]: ---"initial value restored" 13091ms (22:50:27.894) Trace[1422428328]: [13.140750285s] [13.140750285s] END I0529 22:50:27.990200 1 trace.go:236] Trace[267647970]: "Get" accept:application/json, */*,audit-id:ea667951-ab6f-460d-b4a5-83f3d4ea3e4b,client:10.0.0.158,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:15.373) (total time: 12616ms): Trace[267647970]: ---"About to write a response" 12590ms (22:50:27.963) Trace[267647970]: [12.616949194s] [12.616949194s] END E0529 22:51:00.579550 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:00.579616 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:00.579555 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 11.64µs, panicked: false, err: context canceled, panic-reason: E0529 22:51:00.580727 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:00.580815 1 trace.go:236] Trace[1829535154]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:94af7def-caa4-47a8-aeff-a6ec8425945f,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:55.579) (total time: 5001ms): Trace[1829535154]: ["GuaranteedUpdate etcd3" audit-id:94af7def-caa4-47a8-aeff-a6ec8425945f,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:55.579) Trace[1829535154]: ---"Txn call failed" err:context canceled 4998ms (22:51:00.579)] Trace[1829535154]: [5.001325858s] [5.001325858s] END E0529 22:51:00.580946 1 timeout.go:142] post-timeout activity - time-elapsed: 1.456316ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0529 22:51:00.655121 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0529 22:51:00.655619 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:00.656684 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:00.656763 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:00.658038 1 trace.go:236] Trace[1933044262]: "Get" accept:application/json, */*,audit-id:2da844ef-01b4-4520-927c-ed33bcfa25ed,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:55.654) (total time: 5003ms): Trace[1933044262]: [5.003441088s] [5.003441088s] END E0529 22:51:00.658181 1 timeout.go:142] post-timeout activity - time-elapsed: 2.837078ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0529 22:51:00.789330 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:00.789442 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:00.791457 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:00.791581 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:00.792606 1 trace.go:236] Trace[240369467]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6dc189a9-3d9e-433e-b716-c2a4e086baa4,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:55.789) (total time: 5002ms): Trace[240369467]: [5.002822353s] [5.002822353s] END E0529 22:51:00.792768 1 timeout.go:142] post-timeout activity - time-elapsed: 3.429302ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0529 22:51:00.842856 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:00.842888 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:00.842918 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.37µs, panicked: false, err: context deadline exceeded, panic-reason: E0529 22:51:00.844728 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:00.844823 1 trace.go:236] Trace[14792521]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2a7695f3-d59a-4a5d-9b39-134e7c1797c9,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:55.842) (total time: 5002ms): Trace[14792521]: ["GuaranteedUpdate etcd3" audit-id:2a7695f3-d59a-4a5d-9b39-134e7c1797c9,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (22:50:55.842) Trace[14792521]: ---"Txn call failed" err:context deadline exceeded 4999ms (22:51:00.842)] Trace[14792521]: [5.00221243s] [5.00221243s] END E0529 22:51:00.844964 1 timeout.go:142] post-timeout activity - time-elapsed: 2.062229ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0529 22:51:01.485226 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:01.485324 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:01.486499 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:01.486700 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:01.487689 1 trace.go:236] Trace[319111551]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ba455344-3135-4549-b141-4f3a16c963fa,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:50:56.485) (total time: 5002ms): Trace[319111551]: [5.002351362s] [5.002351362s] END E0529 22:51:01.487862 1 timeout.go:142] post-timeout activity - time-elapsed: 2.575271ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: I0529 22:51:01.538840 1 trace.go:236] Trace[987431157]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:81b12371-4afd-41cd-9472-71d2b4986014,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:56.539) (total time: 4999ms): Trace[987431157]: ---"Write to database call failed" len:512,err:Timeout: request did not complete within requested timeout - context canceled 4999ms (22:51:01.538) Trace[987431157]: [4.999702079s] [4.999702079s] END E0529 22:51:01.539120 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi?timeout=5s" audit-ID="81b12371-4afd-41cd-9472-71d2b4986014" E0529 22:51:01.539271 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 246.616µs, panicked: false, err: context canceled, panic-reason: E0529 22:51:01.539407 1 timeout.go:142] post-timeout activity - time-elapsed: 15.441µs, PUT "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: E0529 22:51:01.773500 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:01.773550 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:01.773588 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.38µs, panicked: false, err: context deadline exceeded, panic-reason: E0529 22:51:01.774846 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:01.775180 1 trace.go:236] Trace[24562467]: "Update" accept:application/json, */*,audit-id:c5980db6-a3a3-4a1a-b0d2-097c8ade1388,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:56.773) (total time: 5001ms): Trace[24562467]: ["GuaranteedUpdate etcd3" audit-id:c5980db6-a3a3-4a1a-b0d2-097c8ade1388,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (22:50:56.774) Trace[24562467]: ---"Txn call failed" err:context deadline exceeded 4998ms (22:51:01.773)] Trace[24562467]: [5.001145133s] [5.001145133s] END E0529 22:51:01.775398 1 timeout.go:142] post-timeout activity - time-elapsed: 1.863875ms, PUT "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0529 22:51:01.835984 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:01.836024 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:01.836059 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 10.41µs, panicked: false, err: context deadline exceeded, panic-reason: E0529 22:51:01.837116 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:01.837228 1 trace.go:236] Trace[1417147714]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0551ec42-a059-4ea0-bbff-8419e3179db1,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:56.836) (total time: 5000ms): Trace[1417147714]: ["GuaranteedUpdate etcd3" audit-id:0551ec42-a059-4ea0-bbff-8419e3179db1,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 5000ms (22:50:56.836) Trace[1417147714]: ---"Txn call failed" err:context deadline exceeded 4998ms (22:51:01.835)] Trace[1417147714]: [5.000916928s] [5.000916928s] END E0529 22:51:01.837469 1 timeout.go:142] post-timeout activity - time-elapsed: 1.535327ms, PUT "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0529 22:51:02.427595 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:02.427764 1 trace.go:236] Trace[1601627663]: "Update" accept:application/json, */*,audit-id:31e3c368-bc47-4948-9b39-377ad596d627,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:55.424) (total time: 7003ms): Trace[1601627663]: ["GuaranteedUpdate etcd3" audit-id:31e3c368-bc47-4948-9b39-377ad596d627,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:55.424) Trace[1601627663]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:51:02.427)] Trace[1601627663]: [7.003597208s] [7.003597208s] END E0529 22:51:02.444761 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:02.444990 1 trace.go:236] Trace[1309964721]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:22934827-bf46-49dc-90b1-9f17fbdd1f72,client:199.204.45.227,protocol:HTTP/2.0,resource:rabbitmqclusters,scope:resource,url:/apis/rabbitmq.com/v1beta1/namespaces/openstack/rabbitmqclusters/rabbitmq-barbican,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.443) (total time: 7001ms): Trace[1309964721]: [7.001768694s] [7.001768694s] END E0529 22:51:04.971956 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:04.972208 1 trace.go:236] Trace[939730954]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3b33e709-ce37-4dd0-8b72-07367eb24b60,client:10.0.0.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:50:57.969) (total time: 7002ms): Trace[939730954]: ["GuaranteedUpdate etcd3" audit-id:3b33e709-ce37-4dd0-8b72-07367eb24b60,key:/leases/capi-kubeadm-control-plane-system/kubeadm-control-plane-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 7002ms (22:50:57.969) Trace[939730954]: ---"Txn call failed" err:etcdserver: request timed out 7001ms (22:51:04.971)] Trace[939730954]: [7.002595803s] [7.002595803s] END E0529 22:51:04.990362 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:04.990579 1 trace.go:236] Trace[1493932372]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:339c0904-3f0a-4515-95ca-a736651a7354,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (29-May-2026 22:50:57.984) (total time: 7005ms): Trace[1493932372]: ["GuaranteedUpdate etcd3" audit-id:339c0904-3f0a-4515-95ca-a736651a7354,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 7005ms (22:50:57.985) Trace[1493932372]: ---"Txn call failed" err:etcdserver: request timed out 7004ms (22:51:04.990)] Trace[1493932372]: [7.005542926s] [7.005542926s] END E0529 22:51:05.423912 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.423989 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.425644 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.425697 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.426966 1 trace.go:236] Trace[1583679643]: "Get" accept:application/json, */*,audit-id:89f54c2e-ade1-43b2-bc27-9d20c831c0cb,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:02.431) (total time: 2995ms): Trace[1583679643]: [2.995530983s] [2.995530983s] END E0529 22:51:05.427119 1 timeout.go:142] post-timeout activity - time-elapsed: 3.264508ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0529 22:51:05.524572 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:05.524716 1 trace.go:236] Trace[1833932798]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5225a98c-1390-44d9-80b0-99b80cfaba02,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:58.521) (total time: 7003ms): Trace[1833932798]: ["GuaranteedUpdate etcd3" audit-id:5225a98c-1390-44d9-80b0-99b80cfaba02,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:58.521) Trace[1833932798]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:51:05.524)] Trace[1833932798]: [7.003527257s] [7.003527257s] END E0529 22:51:05.525214 1 controller.go:193] "Failed to update lease" err="etcdserver: request timed out" E0529 22:51:05.540851 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.540963 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.541912 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.542088 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.543364 1 trace.go:236] Trace[1970586204]: "Get" accept:application/json, */*,audit-id:a3755b6d-973b-4fdc-bf54-144e0412c7ea,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:55.541) (total time: 10001ms): Trace[1970586204]: [10.001989669s] [10.001989669s] END E0529 22:51:05.543536 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.543694 1 timeout.go:142] post-timeout activity - time-elapsed: 2.889749ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock" result: E0529 22:51:05.543730 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.545519 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.545590 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.546755 1 trace.go:236] Trace[1386336503]: "Get" accept:application/json, */*,audit-id:9a05ce99-e145-4f0f-80c2-fb5f73aa1bab,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:55.543) (total time: 10003ms): Trace[1386336503]: [10.00332673s] [10.00332673s] END E0529 22:51:05.546986 1 timeout.go:142] post-timeout activity - time-elapsed: 3.533364ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock" result: E0529 22:51:05.578626 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.578698 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.579940 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.579981 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.581174 1 trace.go:236] Trace[1366107496]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:aa1b4673-a1e5-4847-a4c9-be0c474d4a47,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:00.580) (total time: 5000ms): Trace[1366107496]: [5.000483187s] [5.000483187s] END E0529 22:51:05.581353 1 timeout.go:142] post-timeout activity - time-elapsed: 2.794127ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi" result: E0529 22:51:05.655681 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.655790 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.656856 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.656931 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.658000 1 trace.go:236] Trace[100233096]: "Get" accept:application/json, */*,audit-id:c58cc166-6013-4ef9-9aae-622302aea389,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:02.656) (total time: 3001ms): Trace[100233096]: [3.001705589s] [3.001705589s] END E0529 22:51:05.658150 1 timeout.go:142] post-timeout activity - time-elapsed: 2.448089ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: E0529 22:51:05.790320 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.790451 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.792478 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.792559 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.793682 1 trace.go:236] Trace[738747828]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:35d5073b-5df7-45da-a7c1-677662849558,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:51:02.790) (total time: 3002ms): Trace[738747828]: [3.002794886s] [3.002794886s] END E0529 22:51:05.793907 1 timeout.go:142] post-timeout activity - time-elapsed: 3.533896ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0529 22:51:05.829112 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829140 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0529 22:51:05.829283 1 trace.go:236] Trace[2075397726]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:6c3d2db0-16d1-4798-9f3f-83ba2c4bbb0e,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/rabbitmq-magnum-nodes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.493) (total time: 10335ms): Trace[2075397726]: [10.335336353s] [10.335336353s] END E0529 22:51:05.829331 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829340 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829353 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829367 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829488 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829511 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829579 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829587 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829622 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829632 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829665 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829666 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829673 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829687 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829717 1 wrap.go:54] timeout or abort while handling: method=GET URI="/api/v1/namespaces/openstack/services/rabbitmq-magnum-nodes" audit-ID="6c3d2db0-16d1-4798-9f3f-83ba2c4bbb0e" E0529 22:51:05.829749 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829754 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829773 1 timeout.go:142] post-timeout activity - time-elapsed: 7.74µs, GET "/api/v1/namespaces/openstack/services/rabbitmq-magnum-nodes" result: E0529 22:51:05.829770 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.829974 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.830241 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830367 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830450 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830495 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830588 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830617 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830752 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830781 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830796 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830858 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830895 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830938 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830939 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830981 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.830991 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.831100 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.831130 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.831169 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.831279 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.831306 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.831283 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.831640 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.831915 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.831951 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832002 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832067 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832197 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832225 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832227 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832237 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832252 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832258 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832279 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832282 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832282 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832309 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832392 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.832282 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832420 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.832572 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.832435 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.832953 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833141 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833194 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833278 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833301 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833317 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833336 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833359 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833370 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.833386 1 trace.go:236] Trace[1375613766]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:11ffa329-ac0a-4534-855e-5ddb7f3cfde1,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/barbican-api,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.869) (total time: 9964ms): Trace[1375613766]: [9.964261534s] [9.964261534s] END E0529 22:51:05.833393 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833390 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833429 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833431 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833454 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833491 1 timeout.go:142] post-timeout activity - time-elapsed: 3.636037ms, GET "/api/v1/namespaces/openstack/services/barbican-api" result: E0529 22:51:05.833461 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0529 22:51:05.833600 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.833807 1 trace.go:236] Trace[719681928]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:22347233-b489-4be5-9eef-407130d4825c,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/kube-system/services/kube-prometheus-stack-coredns,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.792) (total time: 10041ms): Trace[719681928]: [10.041126678s] [10.041126678s] END E0529 22:51:05.833863 1 timeout.go:142] post-timeout activity - time-elapsed: 4.57699ms, GET "/api/v1/namespaces/kube-system/services/kube-prometheus-stack-coredns" result: I0529 22:51:05.833923 1 trace.go:236] Trace[1289098334]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:da945074-26e4-435b-965f-9db6568b9286,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/magnum-api,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.618) (total time: 10215ms): Trace[1289098334]: [10.215694625s] [10.215694625s] END I0529 22:51:05.834008 1 trace.go:236] Trace[2041991338]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:32b30152-8a38-40bf-a071-63941d59ff0d,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/openstack-exporter,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.643) (total time: 10190ms): Trace[2041991338]: [10.190322366s] [10.190322366s] END E0529 22:51:05.834027 1 timeout.go:142] post-timeout activity - time-elapsed: 4.355695ms, GET "/api/v1/namespaces/openstack/services/magnum-api" result: I0529 22:51:05.834196 1 trace.go:236] Trace[1689510304]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:8ea97aca-e90d-4b71-9f01-70b9ed4efaf7,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services/loki-gateway,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.844) (total time: 9990ms): Trace[1689510304]: [9.990046373s] [9.990046373s] END I0529 22:51:05.834351 1 trace.go:236] Trace[152872257]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:b36c44a1-481b-478d-9cc8-07c3bc433e9a,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services/loki,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.569) (total time: 10265ms): Trace[152872257]: [10.265173011s] [10.265173011s] END I0529 22:51:05.834221 1 trace.go:236] Trace[2008154860]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:58fd8aee-e87f-4778-beab-b25a50c53033,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.743) (total time: 10090ms): Trace[2008154860]: [10.090610555s] [10.090610555s] END I0529 22:51:05.834449 1 trace.go:236] Trace[765229198]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:0163997e-36f7-48c4-9b7a-63e99b437376,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-metrics,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:51:02.447) (total time: 3386ms): Trace[765229198]: [3.386725505s] [3.386725505s] END I0529 22:51:05.834472 1 trace.go:236] Trace[187972548]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:1043391b-aaad-4ea6-84a9-d7a733435056,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services/kube-prometheus-stack-alertmanager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.820) (total time: 10013ms): Trace[187972548]: [10.013504935s] [10.013504935s] END I0529 22:51:05.834504 1 trace.go:236] Trace[450788963]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:991607f4-b2c2-4926-92cc-fc962facd80a,client:199.204.45.227,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/openstack/endpoints/ceph-mon,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.893) (total time: 9941ms): Trace[450788963]: [9.941429007s] [9.941429007s] END I0529 22:51:05.834507 1 trace.go:236] Trace[572119172]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:239e2848-db52-478d-a0fb-1881d105b3ea,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/horizon,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.918) (total time: 9915ms): Trace[572119172]: [9.915674679s] [9.915674679s] END E0529 22:51:05.834411 1 timeout.go:142] post-timeout activity - time-elapsed: 5.100173ms, GET "/api/v1/namespaces/openstack/services/openstack-exporter" result: I0529 22:51:05.834591 1 trace.go:236] Trace[1871566409]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:2b356389-d699-448d-9234-67efe4591b3c,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/rook-ceph-rgw-ceph,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.669) (total time: 10165ms): Trace[1871566409]: [10.165400518s] [10.165400518s] END I0529 22:51:05.834599 1 trace.go:236] Trace[1264459823]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:b1ac9e07-7a2a-44f4-9826-b1f0f22af405,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services/kube-prometheus-stack-grafana,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.543) (total time: 10290ms): Trace[1264459823]: [10.290877497s] [10.290877497s] END E0529 22:51:05.834596 1 timeout.go:142] post-timeout activity - time-elapsed: 4.956348ms, GET "/api/v1/namespaces/monitoring/services/kube-prometheus-stack-alertmanager" result: E0529 22:51:05.834634 1 timeout.go:142] post-timeout activity - time-elapsed: 4.945108ms, GET "/api/v1/namespaces/openstack/services/rook-ceph-rgw-ceph" result: E0529 22:51:05.834646 1 timeout.go:142] post-timeout activity - time-elapsed: 4.99808ms, GET "/api/v1/namespaces/monitoring/services/kube-prometheus-stack-grafana" result: I0529 22:51:05.834653 1 trace.go:236] Trace[1111634041]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:f941253f-37b7-4abf-bb08-88623dbea41d,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/kube-system/services/kube-prometheus-stack-kube-etcd,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.593) (total time: 10241ms): Trace[1111634041]: [10.24134669s] [10.24134669s] END I0529 22:51:05.834659 1 trace.go:236] Trace[2069652185]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:9f9c8fd3-c39c-448d-af82-4e1cd8da9c5d,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/manila-api,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.468) (total time: 10365ms): Trace[2069652185]: [10.365860976s] [10.365860976s] END I0529 22:51:05.834240 1 trace.go:236] Trace[1137695628]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:73da4b8a-bb57-47d3-98f0-d627cdf495b3,client:199.204.45.227,protocol:HTTP/2.0,resource:rabbitmqclusters,scope:resource,url:/apis/rabbitmq.com/v1beta1/namespaces/openstack/rabbitmqclusters/rabbitmq-heat,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.693) (total time: 10140ms): Trace[1137695628]: [10.140574703s] [10.140574703s] END E0529 22:51:05.834727 1 timeout.go:142] post-timeout activity - time-elapsed: 4.876518ms, GET "/api/v1/namespaces/kube-system/services/kube-prometheus-stack-kube-etcd" result: E0529 22:51:05.834552 1 timeout.go:142] post-timeout activity - time-elapsed: 4.931988ms, GET "/api/v1/namespaces/monitoring/services/loki" result: E0529 22:51:05.834555 1 timeout.go:142] post-timeout activity - time-elapsed: 5.340248ms, GET "/api/v1/namespaces/openstack/endpoints/ceph-mon" result: E0529 22:51:05.834562 1 timeout.go:142] post-timeout activity - time-elapsed: 4.925869ms, GET "/api/v1/namespaces/openstack/services/horizon" result: E0529 22:51:05.834563 1 timeout.go:142] post-timeout activity - time-elapsed: 5.149484ms, GET "/api/v1/namespaces/auth-system/services/keycloak-metrics" result: E0529 22:51:05.834572 1 timeout.go:142] post-timeout activity - time-elapsed: 5.169904ms, GET "/api/v1/namespaces/auth-system/services/keycloak" result: I0529 22:51:05.834583 1 trace.go:236] Trace[488633865]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:5ba79644-2cde-4bb4-9b5c-421fd1136051,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/openstack/services/valkey,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.718) (total time: 10115ms): Trace[488633865]: [10.115630875s] [10.115630875s] END E0529 22:51:05.834692 1 timeout.go:142] post-timeout activity - time-elapsed: 5.524153ms, GET "/api/v1/namespaces/openstack/services/manila-api" result: I0529 22:51:05.834688 1 trace.go:236] Trace[581309162]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:dee7e7e6-9831-433a-b3c3-d39b21334939,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/kube-system/services/kube-dns,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.768) (total time: 10066ms): Trace[581309162]: [10.066628629s] [10.066628629s] END I0529 22:51:05.834722 1 trace.go:236] Trace[629323424]: "Get" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:08314558-1d32-42b6-9814-f7bb4ab9ecc1,client:199.204.45.227,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/cert-manager/services/cert-manager-webhook,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:GET (29-May-2026 22:50:55.520) (total time: 10313ms): Trace[629323424]: [10.313938371s] [10.313938371s] END E0529 22:51:05.834719 1 timeout.go:142] post-timeout activity - time-elapsed: 5.321798ms, GET "/api/v1/namespaces/monitoring/services/loki-gateway" result: E0529 22:51:05.834950 1 timeout.go:142] post-timeout activity - time-elapsed: 5.438861ms, GET "/api/v1/namespaces/openstack/services/valkey" result: E0529 22:51:05.835064 1 timeout.go:142] post-timeout activity - time-elapsed: 5.311787ms, GET "/apis/rabbitmq.com/v1beta1/namespaces/openstack/rabbitmqclusters/rabbitmq-heat" result: E0529 22:51:05.835148 1 timeout.go:142] post-timeout activity - time-elapsed: 5.591224ms, GET "/api/v1/namespaces/kube-system/services/kube-dns" result: E0529 22:51:05.835202 1 timeout.go:142] post-timeout activity - time-elapsed: 5.475511ms, GET "/api/v1/namespaces/cert-manager/services/cert-manager-webhook" result: E0529 22:51:05.842576 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:05.842676 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:05.843867 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:05.843915 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:05.845131 1 trace.go:236] Trace[1549214074]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9f7ad102-6462-4fba-bcfe-512a91a6b31a,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:00.844) (total time: 5000ms): Trace[1549214074]: [5.000614281s] [5.000614281s] END E0529 22:51:05.845263 1 timeout.go:142] post-timeout activity - time-elapsed: 2.545941ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0529 22:51:05.869174 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled I0529 22:51:05.869289 1 trace.go:236] Trace[1302399184]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:eb81a1cc-7e63-4322-a04e-b5c5f76217d8,client:10.0.0.29,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 22:50:56.827) (total time: 9041ms): Trace[1302399184]: [9.041335781s] [9.041335781s] END E0529 22:51:05.869420 1 wrap.go:54] timeout or abort while handling: method=GET URI="/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" audit-ID="eb81a1cc-7e63-4322-a04e-b5c5f76217d8" E0529 22:51:05.869536 1 timeout.go:142] post-timeout activity - time-elapsed: 8.99µs, GET "/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0" result: E0529 22:51:06.081923 1 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out I0529 22:51:06.082106 1 trace.go:236] Trace[182227747]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e824d254-e8dc-4a0a-8d35-92f310693db4,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:50:59.078) (total time: 7003ms): Trace[182227747]: ["GuaranteedUpdate etcd3" audit-id:e824d254-e8dc-4a0a-8d35-92f310693db4,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 7003ms (22:50:59.078) Trace[182227747]: ---"Txn call failed" err:etcdserver: request timed out 7002ms (22:51:06.081)] Trace[182227747]: [7.003868365s] [7.003868365s] END E0529 22:51:06.485026 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:06.485159 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:06.486334 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:06.486382 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:06.487533 1 trace.go:236] Trace[1049504951]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:280ffcf9-1481-4fa7-87a0-0ec5c8bf79b1,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:51:03.486) (total time: 3000ms): Trace[1049504951]: [3.000492851s] [3.000492851s] END E0529 22:51:06.487783 1 timeout.go:142] post-timeout activity - time-elapsed: 2.765937ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0529 22:51:06.538232 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:06.538320 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:06.539773 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:06.539904 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:06.540972 1 trace.go:236] Trace[364635163]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:da430a25-30a2-424f-a314-b43ff82dad67,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:01.540) (total time: 5000ms): Trace[364635163]: [5.000311004s] [5.000311004s] END E0529 22:51:06.541153 1 timeout.go:142] post-timeout activity - time-elapsed: 2.966052ms, GET "/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi" result: E0529 22:51:06.773720 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:06.773890 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:06.774844 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:06.775335 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:06.775975 1 trace.go:236] Trace[1433156941]: "Get" accept:application/json, */*,audit-id:5a55ae5a-4e99-4893-b2da-2907e25ff234,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:01.775) (total time: 5000ms): Trace[1433156941]: [5.000705372s] [5.000705372s] END E0529 22:51:06.776322 1 timeout.go:142] post-timeout activity - time-elapsed: 2.452958ms, GET "/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo" result: E0529 22:51:06.836783 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:06.836926 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:06.838138 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:06.838275 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:06.839287 1 trace.go:236] Trace[68233607]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8d9ced4e-ee67-4b8a-8881-4737595f7392,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:01.836) (total time: 5002ms): Trace[68233607]: [5.002413764s] [5.002413764s] END E0529 22:51:06.839555 1 timeout.go:142] post-timeout activity - time-elapsed: 2.975422ms, GET "/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud" result: E0529 22:51:07.298918 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0529 22:51:07.299158 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0529 22:51:07.300058 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0529 22:51:07.301316 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0529 22:51:07.301403 1 trace.go:236] Trace[730595755]: "Get" accept:application/json, */*,audit-id:943c07e4-f083-4e57-a916-559dbdf78077,client:10.0.0.127,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:55.781) (total time: 11520ms): Trace[730595755]: [11.520217643s] [11.520217643s] END E0529 22:51:07.301978 1 timeout.go:142] post-timeout activity - time-elapsed: 3.193167ms, GET "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: I0529 22:51:07.414024 1 trace.go:236] Trace[1280909681]: "Update" accept:application/json, */*,audit-id:3adc02c6-f1ef-4362-a630-d7f90736253f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:51:05.544) (total time: 1869ms): Trace[1280909681]: ["GuaranteedUpdate etcd3" audit-id:3adc02c6-f1ef-4362-a630-d7f90736253f,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1869ms (22:51:05.544) Trace[1280909681]: ---"Txn call completed" 1868ms (22:51:07.413)] Trace[1280909681]: [1.869835125s] [1.869835125s] END I0529 22:51:07.414468 1 trace.go:236] Trace[581663163]: "Update" accept:application/json, */*,audit-id:ea8ae7a7-989d-4f88-b66e-592b86dcef7f,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:51:05.656) (total time: 1758ms): Trace[581663163]: ["GuaranteedUpdate etcd3" audit-id:ea8ae7a7-989d-4f88-b66e-592b86dcef7f,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1757ms (22:51:05.656) Trace[581663163]: ---"Txn call completed" 1756ms (22:51:07.414)] Trace[581663163]: [1.758170987s] [1.758170987s] END I0529 22:51:07.414523 1 trace.go:236] Trace[434775176]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:7289dcc8-184a-41e3-9e37-2957286b10a3,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:51:05.526) (total time: 1888ms): Trace[434775176]: ["GuaranteedUpdate etcd3" audit-id:7289dcc8-184a-41e3-9e37-2957286b10a3,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1888ms (22:51:05.526) Trace[434775176]: ---"Txn call completed" 1886ms (22:51:07.413)] Trace[434775176]: [1.888395639s] [1.888395639s] END I0529 22:51:07.415033 1 trace.go:236] Trace[852200070]: "Get" accept:application/json, */*,audit-id:f8e17ff4-dc16-460b-815a-af5c158741a0,client:10.0.0.188,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:50:57.967) (total time: 9447ms): Trace[852200070]: ---"About to write a response" 9447ms (22:51:07.414) Trace[852200070]: [9.447385278s] [9.447385278s] END I0529 22:51:07.415126 1 trace.go:236] Trace[36593486]: "Update" accept:application/json, */*,audit-id:153252c5-0772-434b-9efe-937fd6fe0bce,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-May-2026 22:51:05.541) (total time: 1873ms): Trace[36593486]: ["GuaranteedUpdate etcd3" audit-id:153252c5-0772-434b-9efe-937fd6fe0bce,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1872ms (22:51:05.542) Trace[36593486]: ---"Txn call completed" 1871ms (22:51:07.414)] Trace[36593486]: [1.873215065s] [1.873215065s] END I0529 22:51:07.415232 1 trace.go:236] Trace[1246225905]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bbf2caf8-ac4c-4352-a41d-7dc15e09b627,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (29-May-2026 22:51:06.084) (total time: 1330ms): Trace[1246225905]: ["GuaranteedUpdate etcd3" audit-id:bbf2caf8-ac4c-4352-a41d-7dc15e09b627,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1330ms (22:51:06.084) Trace[1246225905]: ---"Txn call completed" 1329ms (22:51:07.414)] Trace[1246225905]: [1.330746545s] [1.330746545s] END E0529 22:51:07.415255 1 controller.go:193] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"apiserver-f3tcohoifagyom4bbi4wgeu7te\": the object has been modified; please apply your changes to the latest version and try again" I0529 22:51:07.415523 1 trace.go:236] Trace[1519667385]: "Update" accept:application/json, */*,audit-id:933c59f8-9e35-4861-a912-d7920775227a,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:51:06.775) (total time: 639ms): Trace[1519667385]: ["GuaranteedUpdate etcd3" audit-id:933c59f8-9e35-4861-a912-d7920775227a,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 639ms (22:51:06.776) Trace[1519667385]: ---"Txn call completed" 637ms (22:51:07.415)] Trace[1519667385]: [639.681621ms] [639.681621ms] END I0529 22:51:07.415684 1 trace.go:236] Trace[159000508]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b2a9bd26-274b-4f78-9690-13cc5b67608f,client:199.204.45.227,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/datadir-percona-xtradb-pxc-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:50:57.306) (total time: 10109ms): Trace[159000508]: ---"About to write a response" 10109ms (22:51:07.415) Trace[159000508]: [10.109257152s] [10.109257152s] END I0529 22:51:07.416885 1 trace.go:236] Trace[226988173]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:440340be-2495-4744-b10a-fa981c66d305,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:51:06.838) (total time: 577ms): Trace[226988173]: ["GuaranteedUpdate etcd3" audit-id:440340be-2495-4744-b10a-fa981c66d305,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 577ms (22:51:06.839) Trace[226988173]: ---"Txn call completed" 575ms (22:51:07.415)] Trace[226988173]: [577.988762ms] [577.988762ms] END I0529 22:51:07.417940 1 trace.go:236] Trace[776479019]: "Get" accept:application/json, */*,audit-id:c4c80a0a-478c-4ea2-afd1-28443bab1c4b,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (29-May-2026 22:50:57.960) (total time: 9457ms): Trace[776479019]: ---"About to write a response" 9457ms (22:51:07.417) Trace[776479019]: [9.457601724s] [9.457601724s] END I0529 22:51:07.418096 1 trace.go:236] Trace[1515587042]: "List" accept:*/*,audit-id:47d6b8a1-35e9-4bec-bd09-14328b967805,client:10.0.0.155,protocol:HTTP/1.1,resource:openstackclusters,scope:namespace,url:/apis/infrastructure.cluster.x-k8s.io/v1beta1/namespaces/magnum-system/openstackclusters,user-agent:pykube-ng/23.6.0,verb:LIST (29-May-2026 22:50:59.854) (total time: 7563ms): Trace[1515587042]: ["List(recursive=true) etcd3" audit-id:47d6b8a1-35e9-4bec-bd09-14328b967805,key:/infrastructure.cluster.x-k8s.io/openstackclusters/magnum-system,resourceVersion:,resourceVersionMatch:,limit:0,continue: 7563ms (22:50:59.854)] Trace[1515587042]: [7.563658601s] [7.563658601s] END I0529 22:51:07.420085 1 trace.go:236] Trace[1191261002]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:42fac155-f2d5-4f95-b484-3793749efc0e,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (29-May-2026 22:51:06.486) (total time: 933ms): Trace[1191261002]: ["GuaranteedUpdate etcd3" audit-id:42fac155-f2d5-4f95-b484-3793749efc0e,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 933ms (22:51:06.486) Trace[1191261002]: ---"Txn call completed" 927ms (22:51:07.414)] Trace[1191261002]: [933.794556ms] [933.794556ms] END I0529 22:51:07.420708 1 trace.go:236] Trace[971678255]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:32980f23-9670-4608-952d-9d926e3350a6,client:10.0.0.122,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-control-plane-system/leases/kubeadm-control-plane-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 22:51:04.975) (total time: 2445ms): Trace[971678255]: ---"About to write a response" 2445ms (22:51:07.420) Trace[971678255]: [2.445595133s] [2.445595133s] END I0529 22:51:07.421020 1 trace.go:236] Trace[997383135]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2261927e-b8f5-4947-a58d-94f1eff3bf72,client:199.204.45.227,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-apiserver-instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (29-May-2026 22:51:05.976) (total time: 1444ms): Trace[997383135]: ---"About to write a response" 1444ms (22:51:07.420) Trace[997383135]: [1.444608846s] [1.444608846s] END I0529 22:51:07.421328 1 trace.go:236] Trace[961760780]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:381b2b89-f92f-47d1-a3c4-8ef0fe88c713,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:GET (29-May-2026 22:51:04.992) (total time: 2428ms): Trace[961760780]: ---"About to write a response" 2428ms (22:51:07.421) Trace[961760780]: [2.428578436s] [2.428578436s] END I0529 22:51:07.452811 1 trace.go:236] Trace[2004408718]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.227,type:*v1.Endpoints,resource:apiServerIPInfo (29-May-2026 22:50:57.970) (total time: 9482ms): Trace[2004408718]: ---"initial value restored" 9447ms (22:51:07.418) Trace[2004408718]: [9.482184973s] [9.482184973s] END I0529 22:51:07.458945 1 trace.go:236] Trace[316006421]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:37f160bb-e5ef-41e9-aff3-e06578b81175,client:199.204.45.227,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18b42afaeebf6c1f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (29-May-2026 22:50:59.955) (total time: 7503ms): Trace[316006421]: ["GuaranteedUpdate etcd3" audit-id:37f160bb-e5ef-41e9-aff3-e06578b81175,key:/events/kube-system/kube-apiserver-instance.18b42afaeebf6c1f,type:*core.Event,resource:events 7503ms (22:50:59.955) Trace[316006421]: ---"initial value restored" 7462ms (22:51:07.417)] Trace[316006421]: ---"Object stored in database" 40ms (22:51:07.458) Trace[316006421]: [7.503439987s] [7.503439987s] END E0529 22:51:07.497640 1 watch.go:287] unable to encode watch object *v1.WatchEvent: write tcp 199.204.45.227:6443->199.204.45.227:59370: write: connection reset by peer (&streaming.encoderWithAllocator{writer:(*framer.lengthDelimitedFrameWriter)(0xc05df40c48), encoder:(*versioning.codec)(0xc05db64dc0), memAllocator:(*runtime.Allocator)(0xc03178e5e8)}) I0529 22:56:51.822754 1 trace.go:236] Trace[285487465]: "List" accept:application/json,audit-id:bd22f672-f567-4d2c-8acc-dd88489fb546,client:199.204.45.227,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:cluster,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:LIST (29-May-2026 22:56:51.180) (total time: 641ms): Trace[285487465]: ---"Writing http response done" count:140 245ms (22:56:51.822) Trace[285487465]: [641.816052ms] [641.816052ms] END I0529 22:59:33.093163 1 trace.go:236] Trace[61139406]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:4edeaaea-a271-46f3-84ac-2927b61331b6,client:10.0.0.138,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-kubeadm-bootstrap-system/leases/kubeadm-bootstrap-manager-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 22:59:32.482) (total time: 610ms): Trace[61139406]: ["GuaranteedUpdate etcd3" audit-id:4edeaaea-a271-46f3-84ac-2927b61331b6,key:/leases/capi-kubeadm-bootstrap-system/kubeadm-bootstrap-manager-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 610ms (22:59:32.482) Trace[61139406]: ---"Txn call completed" 609ms (22:59:33.092)] Trace[61139406]: [610.84494ms] [610.84494ms] END I0529 22:59:33.109663 1 trace.go:236] Trace[105765297]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a7793fef-2f51-4766-b11d-e2e52a8266d7,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 22:59:32.504) (total time: 604ms): Trace[105765297]: ---"About to write a response" 604ms (22:59:33.109) Trace[105765297]: [604.972019ms] [604.972019ms] END I0529 23:00:40.888270 1 trace.go:236] Trace[409195527]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1b40f21f-71eb-42fa-a290-4145002ec54d,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 23:00:39.610) (total time: 1278ms): Trace[409195527]: ---"About to write a response" 1277ms (23:00:40.888) Trace[409195527]: [1.278041121s] [1.278041121s] END I0529 23:00:40.888538 1 trace.go:236] Trace[1845842584]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2832fad4-fdca-4999-9fa4-3a42e2106fb3,client:10.0.0.29,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:39.807) (total time: 1080ms): Trace[1845842584]: ["GuaranteedUpdate etcd3" audit-id:2832fad4-fdca-4999-9fa4-3a42e2106fb3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1080ms (23:00:39.808) Trace[1845842584]: ---"Txn call completed" 1078ms (23:00:40.888)] Trace[1845842584]: [1.080550255s] [1.080550255s] END I0529 23:00:41.343098 1 trace.go:236] Trace[177197632]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ced5520f-be63-4892-9b38-c62a74da06c0,client:10.0.0.231,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:40.502) (total time: 840ms): Trace[177197632]: ["GuaranteedUpdate etcd3" audit-id:ced5520f-be63-4892-9b38-c62a74da06c0,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 840ms (23:00:40.502) Trace[177197632]: ---"Txn call completed" 839ms (23:00:41.342)] Trace[177197632]: [840.993888ms] [840.993888ms] END I0529 23:00:41.343150 1 trace.go:236] Trace[1066031783]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8a122b47-2e40-47c7-872d-1dbb54933632,client:10.0.0.35,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/orc-system/leases/f35396c5.k-orc.cloud,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:40.762) (total time: 580ms): Trace[1066031783]: ["GuaranteedUpdate etcd3" audit-id:8a122b47-2e40-47c7-872d-1dbb54933632,key:/leases/orc-system/f35396c5.k-orc.cloud,type:*coordination.Lease,resource:leases.coordination.k8s.io 580ms (23:00:40.762) Trace[1066031783]: ---"Txn call completed" 579ms (23:00:41.342)] Trace[1066031783]: [580.653755ms] [580.653755ms] END I0529 23:00:41.343165 1 trace.go:236] Trace[882729101]: "Update" accept:application/json, */*,audit-id:065fbd0d-a09b-48a0-a852-15b2809b7dd3,client:10.0.0.152,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capo-system/leases/controller-leader-election-capo,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:39.821) (total time: 1521ms): Trace[882729101]: ["GuaranteedUpdate etcd3" audit-id:065fbd0d-a09b-48a0-a852-15b2809b7dd3,key:/leases/capo-system/controller-leader-election-capo,type:*coordination.Lease,resource:leases.coordination.k8s.io 1520ms (23:00:39.822) Trace[882729101]: ---"Txn call completed" 1519ms (23:00:41.342)] Trace[882729101]: [1.521199712s] [1.521199712s] END I0529 23:00:41.343098 1 trace.go:236] Trace[272424921]: "Update" accept:application/json, */*,audit-id:a81a3d5e-cf42-4828-bd34-5097a5dc2262,client:10.0.0.16,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:39.809) (total time: 1533ms): Trace[272424921]: ["GuaranteedUpdate etcd3" audit-id:a81a3d5e-cf42-4828-bd34-5097a5dc2262,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1533ms (23:00:39.809) Trace[272424921]: ---"Txn call completed" 1532ms (23:00:41.342)] Trace[272424921]: [1.533542738s] [1.533542738s] END I0529 23:00:41.343114 1 trace.go:236] Trace[133056191]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:554b91a6-d3d5-4600-bbce-99b8b1dbc27b,client:10.0.0.109,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/capi-system/leases/controller-leader-election-capi,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (29-May-2026 23:00:40.588) (total time: 754ms): Trace[133056191]: ["GuaranteedUpdate etcd3" audit-id:554b91a6-d3d5-4600-bbce-99b8b1dbc27b,key:/leases/capi-system/controller-leader-election-capi,type:*coordination.Lease,resource:leases.coordination.k8s.io 754ms (23:00:40.588) Trace[133056191]: ---"Txn call completed" 753ms (23:00:41.342)] Trace[133056191]: [754.668508ms] [754.668508ms] END I0529 23:00:41.347316 1 trace.go:236] Trace[263308072]: "Get" accept:application/json, */*,audit-id:51e3572d-2268-4339-966e-9ed75308c538,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 23:00:39.900) (total time: 1446ms): Trace[263308072]: ---"About to write a response" 1446ms (23:00:41.347) Trace[263308072]: [1.446830558s] [1.446830558s] END I0529 23:00:41.347504 1 trace.go:236] Trace[62364067]: "Get" accept:application/json, */*,audit-id:9963b8dd-38e8-4766-9f2d-496dc3ca9ffa,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 23:00:39.900) (total time: 1446ms): Trace[62364067]: ---"About to write a response" 1446ms (23:00:41.347) Trace[62364067]: [1.446608022s] [1.446608022s] END I0529 23:00:41.347686 1 trace.go:236] Trace[129866457]: "Get" accept:application/json, */*,audit-id:cb025cfa-8bc8-491a-ac4d-c411623a0401,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (29-May-2026 23:00:39.953) (total time: 1394ms): Trace[129866457]: ---"About to write a response" 1394ms (23:00:41.347) Trace[129866457]: [1.394452562s] [1.394452562s] END I0529 23:00:41.348183 1 trace.go:236] Trace[1156738019]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b53d4929-5525-43a5-b286-41d6b07f8583,client:199.204.45.227,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (29-May-2026 23:00:40.552) (total time: 795ms): Trace[1156738019]: ---"About to write a response" 795ms (23:00:41.347) Trace[1156738019]: [795.559479ms] [795.559479ms] END I0529 23:00:41.348640 1 trace.go:236] Trace[1732487542]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a6fbf735-5f77-41a4-b63d-ae33b3f02eae,client:10.0.0.29,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-May-2026 23:00:40.631) (total time: 717ms): Trace[1732487542]: ---"About to write a response" 716ms (23:00:41.348) Trace[1732487542]: [717.345453ms] [717.345453ms] END I0529 23:00:41.350841 1 trace.go:236] Trace[1567409510]: "List" accept:application/json, */*,audit-id:b7a2c4a8-e3f9-4604-976b-b6e3080b7529,client:10.0.0.201,protocol:HTTP/2.0,resource:deployments,scope:namespace,url:/apis/apps/v1/namespaces/openstack/deployments,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (29-May-2026 23:00:40.548) (total time: 801ms): Trace[1567409510]: ["List(recursive=true) etcd3" audit-id:b7a2c4a8-e3f9-4604-976b-b6e3080b7529,key:/deployments/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 801ms (23:00:40.549)] Trace[1567409510]: [801.872531ms] [801.872531ms] END