I0422 00:27:45.150830 1 options.go:220] external host was not specified, using 199.204.45.240 I0422 00:27:45.151674 1 server.go:148] Version: v1.28.13 I0422 00:27:45.151722 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0422 00:27:45.916227 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0422 00:27:45.929390 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0422 00:27:45.929414 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0422 00:27:45.929691 1 instance.go:298] Using reconciler: lease I0422 00:27:45.971217 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0422 00:27:45.971250 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0422 00:27:46.235140 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0422 00:27:46.235448 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0422 00:27:46.732643 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0422 00:27:46.753418 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0422 00:27:46.753451 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.753462 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.753922 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0422 00:27:46.753938 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0422 00:27:46.754845 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0422 00:27:46.755559 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0422 00:27:46.755571 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0422 00:27:46.755576 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0422 00:27:46.756941 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0422 00:27:46.756955 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0422 00:27:46.757907 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0422 00:27:46.757920 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.757925 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.758601 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0422 00:27:46.758612 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.758682 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0422 00:27:46.759270 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0422 00:27:46.761071 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0422 00:27:46.761091 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.761096 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.761519 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0422 00:27:46.761533 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.761537 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.762281 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0422 00:27:46.762293 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0422 00:27:46.763890 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0422 00:27:46.763905 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.763910 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.764329 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0422 00:27:46.764343 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.764346 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.766365 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0422 00:27:46.766380 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.766384 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.767518 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0422 00:27:46.768574 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0422 00:27:46.768587 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.768591 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.771932 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0422 00:27:46.771948 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0422 00:27:46.771953 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0422 00:27:46.772822 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0422 00:27:46.772835 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0422 00:27:46.772838 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0422 00:27:46.773278 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0422 00:27:46.773290 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0422 00:27:46.827035 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0422 00:27:46.827069 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0422 00:27:47.221429 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0422 00:27:47.221480 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0422 00:27:47.221771 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0422 00:27:47.222197 1 secure_serving.go:213] Serving securely on [::]:6443 I0422 00:27:47.222264 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0422 00:27:47.222294 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0422 00:27:47.222343 1 available_controller.go:423] Starting AvailableConditionController I0422 00:27:47.222392 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0422 00:27:47.222456 1 controller.go:80] Starting OpenAPI V3 AggregationController I0422 00:27:47.222563 1 aggregator.go:164] waiting for initial CRD sync... I0422 00:27:47.222634 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0422 00:27:47.222680 1 system_namespaces_controller.go:67] Starting system namespaces controller I0422 00:27:47.222743 1 controller.go:134] Starting OpenAPI controller I0422 00:27:47.222780 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0422 00:27:47.222842 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0422 00:27:47.222879 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0422 00:27:47.222983 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0422 00:27:47.223009 1 controller.go:78] Starting OpenAPI AggregationController I0422 00:27:47.223037 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0422 00:27:47.223060 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0422 00:27:47.223070 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0422 00:27:47.223013 1 establishing_controller.go:76] Starting EstablishingController I0422 00:27:47.223099 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0422 00:27:47.223111 1 controller.go:85] Starting OpenAPI V3 controller I0422 00:27:47.223193 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0422 00:27:47.223218 1 naming_controller.go:291] Starting NamingConditionController I0422 00:27:47.223064 1 crd_finalizer.go:266] Starting CRDFinalizer I0422 00:27:47.223236 1 gc_controller.go:78] Starting apiserver lease garbage collector I0422 00:27:47.223421 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0422 00:27:47.222983 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0422 00:27:47.223811 1 gc_controller.go:78] Starting apiserver lease garbage collector I0422 00:27:47.223817 1 controller.go:116] Starting legacy_token_tracking_controller I0422 00:27:47.223869 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0422 00:27:47.223088 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller E0422 00:27:47.300984 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0422 00:27:47.316880 1 shared_informer.go:318] Caches are synced for node_authorizer I0422 00:27:47.322330 1 apf_controller.go:379] Running API Priority and Fairness config worker I0422 00:27:47.322523 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0422 00:27:47.322554 1 cache.go:39] Caches are synced for AvailableConditionController controller I0422 00:27:47.323136 1 shared_informer.go:318] Caches are synced for crd-autoregister I0422 00:27:47.323192 1 aggregator.go:166] initial CRD sync complete... I0422 00:27:47.323207 1 autoregister_controller.go:141] Starting autoregister controller I0422 00:27:47.323219 1 cache.go:32] Waiting for caches to sync for autoregister controller I0422 00:27:47.323241 1 cache.go:39] Caches are synced for autoregister controller I0422 00:27:47.323389 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0422 00:27:47.323933 1 shared_informer.go:318] Caches are synced for configmaps I0422 00:27:47.324122 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0422 00:27:47.325087 1 controller.go:624] quota admission added evaluator for: namespaces I0422 00:27:47.342609 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0422 00:27:48.230918 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0422 00:27:48.236368 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0422 00:27:48.236393 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0422 00:27:49.233634 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0422 00:27:49.289710 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0422 00:27:49.440369 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0422 00:27:49.452610 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.240] I0422 00:27:49.454322 1 controller.go:624] quota admission added evaluator for: endpoints I0422 00:27:49.462030 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0422 00:27:50.882359 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0422 00:27:50.892852 1 controller.go:624] quota admission added evaluator for: deployments.apps I0422 00:27:50.910664 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0422 00:27:51.092993 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0422 00:27:55.607169 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0422 00:27:56.308960 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0422 00:28:01.605372 1 trace.go:236] Trace[536583796]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2dc4475e-62da-4792-b293-262149e3b9ca,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/kube-vip-instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:28:00.980) (total time: 625ms): Trace[536583796]: ["GuaranteedUpdate etcd3" audit-id:2dc4475e-62da-4792-b293-262149e3b9ca,key:/pods/kube-system/kube-vip-instance,type:*core.Pod,resource:pods 624ms (00:28:00.980) Trace[536583796]: ---"Txn call completed" 619ms (00:28:01.604)] Trace[536583796]: ---"Object stored in database" 619ms (00:28:01.604) Trace[536583796]: [625.119214ms] [625.119214ms] END I0422 00:28:01.905020 1 trace.go:236] Trace[1338787656]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5e7d053a-7532-4ff6-aee8-6381b04e9a0a,client:199.204.45.240,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:28:01.278) (total time: 626ms): Trace[1338787656]: ["GuaranteedUpdate etcd3" audit-id:5e7d053a-7532-4ff6-aee8-6381b04e9a0a,key:/minions/instance,type:*core.Node,resource:nodes 626ms (00:28:01.278) Trace[1338787656]: ---"Txn call completed" 622ms (00:28:01.904)] Trace[1338787656]: ---"Object stored in database" 623ms (00:28:01.904) Trace[1338787656]: [626.677134ms] [626.677134ms] END I0422 00:28:01.909825 1 trace.go:236] Trace[864435183]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:04c98719-ee5f-4e7c-a94f-3a6b655f106e,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Apr-2026 00:28:01.328) (total time: 581ms): Trace[864435183]: ["GuaranteedUpdate etcd3" audit-id:04c98719-ee5f-4e7c-a94f-3a6b655f106e,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 581ms (00:28:01.328) Trace[864435183]: ---"Txn call completed" 579ms (00:28:01.909)] Trace[864435183]: [581.165667ms] [581.165667ms] END I0422 00:28:15.794090 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0422 00:28:15.803325 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0422 00:28:15.886163 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0422 00:28:15.891942 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0422 00:28:15.909441 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0422 00:28:15.940404 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0422 00:28:15.940469 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0422 00:28:15.960436 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0422 00:28:15.979178 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0422 00:28:15.979261 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0422 00:28:16.003744 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0422 00:28:16.003798 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0422 00:28:16.057342 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0422 00:28:16.057381 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0422 00:28:16.092867 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0422 00:28:16.199309 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:16.280313 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:16.409857 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0422 00:28:16.409965 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0422 00:28:16.457441 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:16.497232 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:16.509711 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:17.363457 1 trace.go:236] Trace[1314552758]: "Create" accept:application/json,audit-id:02693769-8273-482c-a414-0e1c24449058,client:199.204.45.240,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (22-Apr-2026 00:28:16.818) (total time: 545ms): Trace[1314552758]: ---"Writing http response done" 21ms (00:28:17.363) Trace[1314552758]: [545.259939ms] [545.259939ms] END I0422 00:28:17.413302 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:17.417249 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:17.544644 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0422 00:28:23.033761 1 controller.go:624] quota admission added evaluator for: jobs.batch I0422 00:28:25.145888 1 trace.go:236] Trace[1214990973]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:04498ea1-a596-42bf-9c45-94d6974c0962,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-lcspg/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:28:24.643) (total time: 502ms): Trace[1214990973]: ["GuaranteedUpdate etcd3" audit-id:04498ea1-a596-42bf-9c45-94d6974c0962,key:/pods/kube-system/cilium-lcspg,type:*core.Pod,resource:pods 502ms (00:28:24.643) Trace[1214990973]: ---"Txn call completed" 492ms (00:28:25.144)] Trace[1214990973]: ---"Object stored in database" 493ms (00:28:25.145) Trace[1214990973]: [502.681268ms] [502.681268ms] END I0422 00:28:27.748059 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0422 00:28:27.944090 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0422 00:28:28.144080 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0422 00:28:28.355359 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0422 00:28:28.599335 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0422 00:28:28.742719 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0422 00:28:28.953497 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0422 00:28:29.146132 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0422 00:28:29.372853 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0422 00:28:31.575251 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0422 00:28:31.974831 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0422 00:28:32.255721 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0422 00:28:32.255766 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0422 00:28:35.702144 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0422 00:28:44.569370 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.97.219.9"} W0422 00:28:44.603248 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.97.219.9:9443: connect: connection refused E0422 00:28:44.603284 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.97.219.9:9443: connect: connection refused I0422 00:28:58.458357 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0422 00:28:58.472597 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0422 00:28:58.489937 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0422 00:28:58.511586 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0422 00:28:58.516663 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.107.3.199"} I0422 00:28:58.525229 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.98.149.157"} I0422 00:28:58.591079 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0422 00:28:58.636556 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0422 00:29:09.599309 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0422 00:29:14.573587 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0422 00:29:26.875796 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.96.50.3"} I0422 00:29:26.885118 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.110.1.146"} I0422 00:29:26.894994 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.107.61.179"} I0422 00:29:26.902729 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.109.13.59"} I0422 00:29:33.437863 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.456270 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.480166 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.505292 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.546255 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.573064 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.598328 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.618000 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.644830 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.659195 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0422 00:29:33.676137 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.696350 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:33.724786 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:35.210293 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0422 00:29:39.037028 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0422 00:29:39.095964 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.104.253.42"} I0422 00:29:39.127719 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0422 00:29:41.736850 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0422 00:29:41.773943 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0422 00:29:42.559061 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0422 00:29:42.559138 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0422 00:29:42.559202 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0422 00:29:49.654848 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0422 00:29:53.567398 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.103.199.9"} I0422 00:29:53.951138 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0422 00:29:54.078437 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0422 00:29:54.216827 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.103.178.200"} I0422 00:29:54.230524 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.97.98.57"} I0422 00:31:22.116717 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.101.234.181"} I0422 00:31:24.762793 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.110.212.43"} I0422 00:31:24.775431 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.102.42.189"} I0422 00:31:31.660648 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.98.65.36"} I0422 00:31:31.668676 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.105.22.12"} I0422 00:34:11.587919 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0422 00:34:15.905433 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0422 00:34:15.939900 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0422 00:34:19.965058 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0422 00:34:19.977420 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0422 00:34:19.989797 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0422 00:34:19.999923 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0422 00:34:20.012962 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0422 00:34:20.024319 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0422 00:34:20.036796 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0422 00:34:22.456581 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0422 00:34:33.183521 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0422 00:35:13.445127 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0422 00:35:28.118569 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0422 00:35:28.361704 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:28.390375 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:28.404676 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:28.630691 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0422 00:35:29.023918 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:29.024001 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:29.140609 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0422 00:35:29.145282 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:35:29.308206 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0422 00:36:10.984039 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.101.189.113"} I0422 00:36:10.996063 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.28.107"} I0422 00:36:11.004657 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.98.178.74"} I0422 00:36:11.020017 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.107.174.47"} I0422 00:36:11.024183 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.97.23.226"} I0422 00:36:11.033708 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.106.235.123"} I0422 00:36:11.077306 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0422 00:36:11.095104 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0422 00:36:11.140145 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0422 00:36:11.152808 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0422 00:36:11.176698 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0422 00:36:11.186023 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.186065 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.186649 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.186678 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.187917 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.187966 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.187975 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188026 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.188613 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.187921 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188680 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.188692 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188744 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188698 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.188661 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188785 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.188709 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.188818 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.189031 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.189055 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.189088 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.189119 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.189276 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.189318 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.189747 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.189803 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.198848 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.199132 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.199161 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused W0422 00:36:11.199132 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.199258 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused E0422 00:36:11.198902 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.107.174.47:443: connect: connection refused I0422 00:36:21.871097 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.100.250.234"} I0422 00:36:21.882943 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.104.14.231"} I0422 00:36:26.745580 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.103.173.58"} I0422 00:36:30.063226 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.109.222.249"} I0422 00:36:34.564326 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.105.40.64"} I0422 00:36:35.790299 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.111.55.17"} I0422 00:36:43.439626 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0422 00:36:43.612253 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.101.167.18"} I0422 00:36:45.384320 1 trace.go:236] Trace[1332395074]: "Delete" accept:application/json, */*,audit-id:6db3d7c1-06b8-4a2b-8d9f-ee5ce813d0dc,client:10.0.0.168,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/alertmanager-kube-prometheus-stack-alertmanager-tls-assets-1,user-agent:PrometheusOperator/0.74.0,verb:DELETE (22-Apr-2026 00:36:44.664) (total time: 719ms): Trace[1332395074]: [719.993949ms] [719.993949ms] END I0422 00:36:45.586258 1 trace.go:236] Trace[618699085]: "Get" accept:application/json, */*,audit-id:3b029227-aca6-49d8-a0ea-87df3f189cc9,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:36:44.908) (total time: 677ms): Trace[618699085]: ---"About to write a response" 677ms (00:36:45.585) Trace[618699085]: [677.322457ms] [677.322457ms] END I0422 00:36:45.586564 1 trace.go:236] Trace[1489230618]: "Get" accept:application/json, */*,audit-id:7ff219cb-33fb-4b98-a1c6-f7b7f54a18da,client:10.0.0.195,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-85e8b814-f6c9-401e-80f2-7df1b6e072bf,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:36:44.775) (total time: 811ms): Trace[1489230618]: ---"About to write a response" 810ms (00:36:45.586) Trace[1489230618]: [811.33911ms] [811.33911ms] END I0422 00:36:45.601714 1 trace.go:236] Trace[1188564110]: "List" accept:application/json, */*,audit-id:9aaa037d-4220-48bc-8fd8-ad640a6d29b3,client:10.0.0.168,protocol:HTTP/2.0,resource:configmaps,scope:namespace,url:/api/v1/namespaces/monitoring/configmaps,user-agent:PrometheusOperator/0.74.0,verb:LIST (22-Apr-2026 00:36:44.900) (total time: 701ms): Trace[1188564110]: ["List(recursive=true) etcd3" audit-id:9aaa037d-4220-48bc-8fd8-ad640a6d29b3,key:/configmaps/monitoring,resourceVersion:,resourceVersionMatch:,limit:0,continue: 701ms (00:36:44.900)] Trace[1188564110]: [701.630111ms] [701.630111ms] END I0422 00:36:45.614558 1 trace.go:236] Trace[1525392999]: "Create" accept:application/json, */*,audit-id:cd94aec1-bab7-4887-a965-aaf2d45f845e,client:10.0.0.151,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:cert-manager-certificaterequests-issuer-venafi/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (22-Apr-2026 00:36:45.016) (total time: 598ms): Trace[1525392999]: ["Create etcd3" audit-id:cd94aec1-bab7-4887-a965-aaf2d45f845e,key:/events/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5.18a886be544c1db2,type:*core.Event,resource:events 597ms (00:36:45.017) Trace[1525392999]: ---"Txn call succeeded" 597ms (00:36:45.614)] Trace[1525392999]: [598.144123ms] [598.144123ms] END I0422 00:36:45.614649 1 trace.go:236] Trace[316467740]: "Create" accept:application/json, */*,audit-id:c088fd73-037b-43ac-ad6e-a3640884fea3,client:10.0.0.151,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:cert-manager-certificates-request-manager/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (22-Apr-2026 00:36:45.015) (total time: 598ms): Trace[316467740]: ["Create etcd3" audit-id:c088fd73-037b-43ac-ad6e-a3640884fea3,key:/events/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls.18a886be54496d97,type:*core.Event,resource:events 597ms (00:36:45.017) Trace[316467740]: ---"Txn call succeeded" 596ms (00:36:45.614)] Trace[316467740]: [598.971324ms] [598.971324ms] END I0422 00:36:45.614933 1 trace.go:236] Trace[775357394]: "Create" accept:application/json, */*,audit-id:90ad0105-0768-4985-baa5-615c15cdfebd,client:10.0.0.151,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:cert-manager-certificaterequests-issuer-acme/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (22-Apr-2026 00:36:45.015) (total time: 598ms): Trace[775357394]: ["Create etcd3" audit-id:90ad0105-0768-4985-baa5-615c15cdfebd,key:/events/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5.18a886be5449f592,type:*core.Event,resource:events 598ms (00:36:45.016) Trace[775357394]: ---"Txn call succeeded" 598ms (00:36:45.614)] Trace[775357394]: [598.964665ms] [598.964665ms] END I0422 00:36:45.614988 1 trace.go:236] Trace[877034055]: "Create" accept:application/json, */*,audit-id:7a7c759a-4179-4f19-b213-aeaa1ac46265,client:10.0.0.151,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:cert-manager-certificaterequests-issuer-selfsigned/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (22-Apr-2026 00:36:45.016) (total time: 598ms): Trace[877034055]: ["Create etcd3" audit-id:7a7c759a-4179-4f19-b213-aeaa1ac46265,key:/events/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5.18a886be544ece58,type:*core.Event,resource:events 597ms (00:36:45.017) Trace[877034055]: ---"Txn call succeeded" 597ms (00:36:45.614)] Trace[877034055]: [598.292707ms] [598.292707ms] END I0422 00:36:45.615635 1 trace.go:236] Trace[1042752]: "Create" accept:application/json, */*,audit-id:c77d2050-0646-4dba-8017-f2162383e721,client:10.0.0.151,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:cert-manager-certificaterequests-issuer-ca/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:POST (22-Apr-2026 00:36:45.015) (total time: 599ms): Trace[1042752]: ["Create etcd3" audit-id:c77d2050-0646-4dba-8017-f2162383e721,key:/events/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5.18a886be54496207,type:*core.Event,resource:events 598ms (00:36:45.017) Trace[1042752]: ---"Txn call succeeded" 597ms (00:36:45.615)] Trace[1042752]: [599.774425ms] [599.774425ms] END I0422 00:36:45.616000 1 trace.go:236] Trace[67930691]: "Update" accept:application/json, */*,audit-id:2cd999d5-b41f-4828-990d-9e8fd0438670,client:10.0.0.151,protocol:HTTP/2.0,resource:certificaterequests,scope:resource,url:/apis/cert-manager.io/v1/namespaces/monitoring/certificaterequests/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5/status,user-agent:cert-manager-certificaterequests-approver/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:PUT (22-Apr-2026 00:36:45.015) (total time: 600ms): Trace[67930691]: ["GuaranteedUpdate etcd3" audit-id:2cd999d5-b41f-4828-990d-9e8fd0438670,key:/cert-manager.io/certificaterequests/monitoring/prometheus-kube-prometheus-stack-prometheus-0-tls-rzqp5,type:*unstructured.Unstructured,resource:certificaterequests.cert-manager.io 599ms (00:36:45.016) Trace[67930691]: ---"Txn call completed" 588ms (00:36:45.614)] Trace[67930691]: ---"Write to database call succeeded" len:3768 589ms (00:36:45.615) Trace[67930691]: [600.879134ms] [600.879134ms] END I0422 00:36:45.906635 1 trace.go:236] Trace[257614839]: "Get" accept:application/json, */*,audit-id:d94cba23-35fd-41e7-8315-4c7ff789ec65,client:10.0.0.168,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/alertmanager-kube-prometheus-stack-alertmanager-web-config,user-agent:PrometheusOperator/0.74.0,verb:GET (22-Apr-2026 00:36:45.386) (total time: 520ms): Trace[257614839]: ---"About to write a response" 520ms (00:36:45.906) Trace[257614839]: [520.202031ms] [520.202031ms] END I0422 00:37:35.541387 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.105.38.188"} I0422 00:37:35.565789 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0422 00:40:35.842796 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.102.25.103"} I0422 00:41:09.349719 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.97.189.17"} I0422 00:41:31.303531 1 trace.go:236] Trace[1400921950]: "Update" accept:application/json, */*,audit-id:9b89e9cb-e20d-411a-b3e2-dcaf59dfb7b8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Apr-2026 00:41:29.776) (total time: 1527ms): Trace[1400921950]: ["GuaranteedUpdate etcd3" audit-id:9b89e9cb-e20d-411a-b3e2-dcaf59dfb7b8,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1527ms (00:41:29.776) Trace[1400921950]: ---"Txn call completed" 1526ms (00:41:31.303)] Trace[1400921950]: [1.527406664s] [1.527406664s] END I0422 00:41:31.303559 1 trace.go:236] Trace[1450204980]: "Update" accept:application/json, */*,audit-id:85651333-358e-407e-ada9-5637d7d62ff9,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:41:30.250) (total time: 1052ms): Trace[1450204980]: ["GuaranteedUpdate etcd3" audit-id:85651333-358e-407e-ada9-5637d7d62ff9,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1052ms (00:41:30.251) Trace[1450204980]: ---"Txn call completed" 1051ms (00:41:31.303)] Trace[1450204980]: [1.052499436s] [1.052499436s] END I0422 00:41:31.303532 1 trace.go:236] Trace[437756964]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2aecbb2c-15d1-49e4-9134-8f3a753ec76a,client:::1,protocol:HTTP/2.0,resource:endpointslices,scope:resource,url:/apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:41:29.777) (total time: 1525ms): Trace[437756964]: ---"About to write a response" 1525ms (00:41:31.303) Trace[437756964]: [1.52574513s] [1.52574513s] END I0422 00:41:31.336834 1 trace.go:236] Trace[1890633686]: "Get" accept:application/json, */*,audit-id:63a8486a-16e7-4eb5-a14e-1c440adb922f,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:41:29.975) (total time: 1361ms): Trace[1890633686]: ---"About to write a response" 1360ms (00:41:31.336) Trace[1890633686]: [1.361029702s] [1.361029702s] END I0422 00:41:31.337053 1 trace.go:236] Trace[1702750167]: "Get" accept:application/json, */*,audit-id:3871e50e-0050-4bc4-9a0a-52e0f672f192,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.110) (total time: 1226ms): Trace[1702750167]: ---"About to write a response" 1226ms (00:41:31.336) Trace[1702750167]: [1.226691431s] [1.226691431s] END I0422 00:41:31.337068 1 trace.go:236] Trace[1559646403]: "Get" accept:application/json, */*,audit-id:6b0cb18d-dd53-439c-a5c9-23e55c5b0a2a,client:10.0.0.152,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-ks-user,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.370) (total time: 966ms): Trace[1559646403]: [966.786645ms] [966.786645ms] END I0422 00:41:31.337252 1 trace.go:236] Trace[2116816057]: "Get" accept:application/json, */*,audit-id:4f213f64-ef37-46e4-b3a1-377c516d5a9b,client:10.0.0.152,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-ks-endpoints,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.370) (total time: 966ms): Trace[2116816057]: [966.995871ms] [966.995871ms] END I0422 00:41:31.337373 1 trace.go:236] Trace[411529418]: "Get" accept:application/json, */*,audit-id:63277c45-c54f-4c75-9772-adf1e544eb98,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-jzkc8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.287) (total time: 1049ms): Trace[411529418]: ---"About to write a response" 1049ms (00:41:31.336) Trace[411529418]: [1.049760716s] [1.049760716s] END I0422 00:41:31.337413 1 trace.go:236] Trace[964345781]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bdd7e0ee-a002-4d01-aa50-876414465fbc,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:41:30.759) (total time: 578ms): Trace[964345781]: ["GuaranteedUpdate etcd3" audit-id:bdd7e0ee-a002-4d01-aa50-876414465fbc,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 578ms (00:41:30.759) Trace[964345781]: ---"Txn call completed" 577ms (00:41:31.337)] Trace[964345781]: [578.256426ms] [578.256426ms] END I0422 00:41:31.337520 1 trace.go:236] Trace[2135557944]: "Get" accept:application/json, */*,audit-id:5dc0774b-56b8-4e61-9fce-64e4a6b28ffa,client:10.0.0.152,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-rabbit-init,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.370) (total time: 966ms): Trace[2135557944]: [966.739393ms] [966.739393ms] END I0422 00:41:31.337535 1 trace.go:236] Trace[961160593]: "Get" accept:application/json, */*,audit-id:1c9e5fc2-8088-4952-9193-92e8252ae60a,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:41:30.484) (total time: 853ms): Trace[961160593]: ---"About to write a response" 853ms (00:41:31.337) Trace[961160593]: [853.322665ms] [853.322665ms] END I0422 00:41:31.337421 1 trace.go:236] Trace[568362874]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1368c9e6-4963-4157-9385-6fd224ecf454,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:41:30.116) (total time: 1220ms): Trace[568362874]: ---"About to write a response" 1220ms (00:41:31.337) Trace[568362874]: [1.220705336s] [1.220705336s] END I0422 00:41:31.337712 1 trace.go:236] Trace[750754446]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d08094bf-7ff8-46f1-91a8-adcd3c37798c,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:41:30.101) (total time: 1236ms): Trace[750754446]: ---"About to write a response" 1236ms (00:41:31.337) Trace[750754446]: [1.236265359s] [1.236265359s] END I0422 00:41:31.337767 1 trace.go:236] Trace[1704657783]: "Get" accept:application/json, */*,audit-id:e97ca759-1179-4b38-b27a-c7106248f57e,client:10.0.0.152,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:41:30.373) (total time: 964ms): Trace[1704657783]: ---"About to write a response" 963ms (00:41:31.336) Trace[1704657783]: [964.098466ms] [964.098466ms] END I0422 00:42:41.954557 1 trace.go:236] Trace[1443113518]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5ac39488-6cc1-4605-a2a7-71adcf374c23,client:199.204.45.240,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/barbican-ks-user/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (22-Apr-2026 00:42:41.307) (total time: 645ms): Trace[1443113518]: ["GuaranteedUpdate etcd3" audit-id:5ac39488-6cc1-4605-a2a7-71adcf374c23,key:/jobs/openstack/barbican-ks-user,type:*batch.Job,resource:jobs.batch 645ms (00:42:41.307) Trace[1443113518]: ---"Txn call completed" 639ms (00:42:41.952)] Trace[1443113518]: [645.93625ms] [645.93625ms] END I0422 00:42:45.320433 1 trace.go:236] Trace[797791404]: "List" accept:application/json, */*,audit-id:9a7c187f-9724-4dcf-a169-041efd84a627,client:199.204.45.240,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/openstack/secrets,user-agent:Helm/3.11.2,verb:LIST (22-Apr-2026 00:42:42.122) (total time: 3198ms): Trace[797791404]: ["List(recursive=true) etcd3" audit-id:9a7c187f-9724-4dcf-a169-041efd84a627,key:/secrets/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 3197ms (00:42:42.122)] Trace[797791404]: ---"Writing http response done" count:6 30ms (00:42:45.320) Trace[797791404]: [3.198028344s] [3.198028344s] END I0422 00:42:45.332390 1 trace.go:236] Trace[1157175394]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:15ad7257-7531-4600-8c00-6463898cfdf0,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:42:44.357) (total time: 974ms): Trace[1157175394]: ["GuaranteedUpdate etcd3" audit-id:15ad7257-7531-4600-8c00-6463898cfdf0,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 974ms (00:42:44.357) Trace[1157175394]: ---"Txn call completed" 973ms (00:42:45.331)] Trace[1157175394]: [974.828014ms] [974.828014ms] END I0422 00:42:45.339230 1 trace.go:236] Trace[258746339]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c8f18b55-ae24-4762-abca-4aa60e081661,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:42:44.359) (total time: 980ms): Trace[258746339]: ["GuaranteedUpdate etcd3" audit-id:c8f18b55-ae24-4762-abca-4aa60e081661,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 980ms (00:42:44.359) Trace[258746339]: ---"Txn call completed" 979ms (00:42:45.338)] Trace[258746339]: [980.177243ms] [980.177243ms] END I0422 00:42:45.339567 1 trace.go:236] Trace[626730475]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:faca6453-c152-4753-859f-e7ee37b62c5b,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:42:44.351) (total time: 988ms): Trace[626730475]: ["GuaranteedUpdate etcd3" audit-id:faca6453-c152-4753-859f-e7ee37b62c5b,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 988ms (00:42:44.351) Trace[626730475]: ---"About to Encode" 938ms (00:42:45.290)] Trace[626730475]: [988.198691ms] [988.198691ms] END I0422 00:42:45.339723 1 trace.go:236] Trace[647490471]: "Update" accept:application/json, */*,audit-id:ff9c1268-7427-4030-83a8-d6358666ba0a,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:42:44.460) (total time: 879ms): Trace[647490471]: ["GuaranteedUpdate etcd3" audit-id:ff9c1268-7427-4030-83a8-d6358666ba0a,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 879ms (00:42:44.460) Trace[647490471]: ---"Txn call completed" 878ms (00:42:45.339)] Trace[647490471]: [879.571121ms] [879.571121ms] END I0422 00:42:45.340087 1 trace.go:236] Trace[1976357768]: "Get" accept:application/json, */*,audit-id:ee324ad8-1ad6-4002-9339-e9086614a24c,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-jzkc8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:42:44.457) (total time: 882ms): Trace[1976357768]: ---"About to write a response" 881ms (00:42:45.339) Trace[1976357768]: [882.301872ms] [882.301872ms] END I0422 00:42:58.669468 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.690815 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0422 00:42:58.702857 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.709352 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.718130 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.726202 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.736786 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.746674 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.762079 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.780735 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.795034 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.829797 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.875094 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.880987 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.921924 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.957282 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:58.985720 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:42:59.086873 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0422 00:43:03.969965 1 trace.go:236] Trace[141002509]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f515814f-6218-4ae0-acea-883bcaa5a48f,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:43:03.448) (total time: 521ms): Trace[141002509]: ["GuaranteedUpdate etcd3" audit-id:f515814f-6218-4ae0-acea-883bcaa5a48f,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 520ms (00:43:03.448) Trace[141002509]: ---"Txn call completed" 519ms (00:43:03.969)] Trace[141002509]: [521.102624ms] [521.102624ms] END I0422 00:43:04.045766 1 trace.go:236] Trace[1571562542]: "Update" accept:application/json, */*,audit-id:d82fae2b-149e-43bb-8055-852bc05f56b1,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:43:03.450) (total time: 595ms): Trace[1571562542]: ["GuaranteedUpdate etcd3" audit-id:d82fae2b-149e-43bb-8055-852bc05f56b1,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 595ms (00:43:03.450) Trace[1571562542]: ---"Txn call completed" 594ms (00:43:04.045)] Trace[1571562542]: [595.193745ms] [595.193745ms] END I0422 00:43:04.045889 1 trace.go:236] Trace[1491327491]: "Get" accept:application/json, */*,audit-id:6859d256-dcf9-4c6f-8576-c87ade07a882,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:43:03.476) (total time: 569ms): Trace[1491327491]: ---"About to write a response" 569ms (00:43:04.045) Trace[1491327491]: [569.672293ms] [569.672293ms] END I0422 00:43:04.045918 1 trace.go:236] Trace[902435612]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:af3ca34b-cb00-4318-939b-58581ad722d5,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:43:03.450) (total time: 594ms): Trace[902435612]: ["GuaranteedUpdate etcd3" audit-id:af3ca34b-cb00-4318-939b-58581ad722d5,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 594ms (00:43:03.450) Trace[902435612]: ---"Txn call completed" 593ms (00:43:04.045)] Trace[902435612]: [594.991039ms] [594.991039ms] END I0422 00:43:04.046618 1 trace.go:236] Trace[945935010]: "Get" accept:application/json, */*,audit-id:c4e11575-6937-4e5a-98f7-ceb797827e96,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:43:03.540) (total time: 505ms): Trace[945935010]: ---"About to write a response" 505ms (00:43:04.046) Trace[945935010]: [505.815389ms] [505.815389ms] END I0422 00:43:04.046668 1 trace.go:236] Trace[2068199850]: "Get" accept:application/json, */*,audit-id:a91d951b-7a78-4bf2-bd7c-516e2ffec062,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:43:03.543) (total time: 503ms): Trace[2068199850]: ---"About to write a response" 503ms (00:43:04.046) Trace[2068199850]: [503.459758ms] [503.459758ms] END I0422 00:43:04.046682 1 trace.go:236] Trace[1422780351]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:123de4a3-d77f-48db-8609-c8691ffbe8f0,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:43:03.542) (total time: 504ms): Trace[1422780351]: ---"About to write a response" 504ms (00:43:04.046) Trace[1422780351]: [504.345001ms] [504.345001ms] END I0422 00:43:04.046752 1 trace.go:236] Trace[668601554]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:957d0b25-1059-4cc5-899c-603b2d3a687c,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:43:03.541) (total time: 505ms): Trace[668601554]: ---"About to write a response" 505ms (00:43:04.046) Trace[668601554]: [505.377897ms] [505.377897ms] END I0422 00:43:40.538503 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0422 00:43:40.548571 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0422 00:44:14.143225 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.99.117.56"} I0422 00:44:14.959856 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.99.74.42"} I0422 00:44:48.948549 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.96.157.208"} I0422 00:46:32.850671 1 trace.go:236] Trace[1058581125]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9e6d1682-d4e5-4498-8230-c48d26121f34,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:46:32.214) (total time: 635ms): Trace[1058581125]: ["GuaranteedUpdate etcd3" audit-id:9e6d1682-d4e5-4498-8230-c48d26121f34,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 635ms (00:46:32.214) Trace[1058581125]: ---"Txn call completed" 634ms (00:46:32.850)] Trace[1058581125]: [635.752379ms] [635.752379ms] END I0422 00:46:32.851709 1 trace.go:236] Trace[1995304624]: "Update" accept:application/json, */*,audit-id:d5861f60-65b7-458d-853b-de0481870164,client:199.204.45.240,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/sh.helm.release.v1.glance.v1,user-agent:Helm/3.11.2,verb:PUT (22-Apr-2026 00:46:32.243) (total time: 607ms): Trace[1995304624]: ["GuaranteedUpdate etcd3" audit-id:d5861f60-65b7-458d-853b-de0481870164,key:/secrets/openstack/sh.helm.release.v1.glance.v1,type:*core.Secret,resource:secrets 604ms (00:46:32.246) Trace[1995304624]: ---"Txn call completed" 601ms (00:46:32.850)] Trace[1995304624]: [607.879165ms] [607.879165ms] END I0422 00:46:32.857450 1 trace.go:236] Trace[939946539]: "Create" accept:application/json, */*,audit-id:f35a73c3-dfa6-4058-9342-ff1635097fcd,client:10.0.0.97,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,verb:POST (22-Apr-2026 00:46:32.111) (total time: 746ms): Trace[939946539]: ---"Write to database call failed" len:20051,err:deployments.apps "rook-ceph-rgw-ceph-a" already exists 235ms (00:46:32.857) Trace[939946539]: [746.207078ms] [746.207078ms] END I0422 00:46:34.176422 1 trace.go:236] Trace[256719785]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:29d22e48-e249-4b38-b230-8cf6a204fe35,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:POST (22-Apr-2026 00:46:33.171) (total time: 1005ms): Trace[256719785]: ["Create etcd3" audit-id:29d22e48-e249-4b38-b230-8cf6a204fe35,key:/pods/openstack/glance-metadefs-load-ddhvb,type:*core.Pod,resource:pods 931ms (00:46:33.244) Trace[256719785]: ---"Txn call succeeded" 931ms (00:46:34.175)] Trace[256719785]: [1.005320606s] [1.005320606s] END I0422 00:46:34.178302 1 trace.go:236] Trace[837680212]: "List" accept:application/json, */*,audit-id:5dfe4ab0-1948-4bab-b404-b6ff9a076e97,client:10.0.0.97,protocol:HTTP/2.0,resource:deployments,scope:namespace,url:/apis/apps/v1/namespaces/openstack/deployments,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (22-Apr-2026 00:46:33.245) (total time: 932ms): Trace[837680212]: ["List(recursive=true) etcd3" audit-id:5dfe4ab0-1948-4bab-b404-b6ff9a076e97,key:/deployments/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 932ms (00:46:33.246)] Trace[837680212]: [932.276759ms] [932.276759ms] END I0422 00:46:34.760221 1 trace.go:236] Trace[1036160303]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:be2c9df3-7dab-4c19-887b-40ab06f38a04,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/glance-metadefs-load-ddhvb/binding,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (22-Apr-2026 00:46:34.178) (total time: 581ms): Trace[1036160303]: ["GuaranteedUpdate etcd3" audit-id:be2c9df3-7dab-4c19-887b-40ab06f38a04,key:/pods/openstack/glance-metadefs-load-ddhvb,type:*core.Pod,resource:pods 580ms (00:46:34.179) Trace[1036160303]: ---"Txn call completed" 580ms (00:46:34.759)] Trace[1036160303]: [581.461129ms] [581.461129ms] END I0422 00:46:34.760308 1 trace.go:236] Trace[555712735]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6e2a13cf-b3d5-40f9-8ffd-7b396b8c1856,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:46:33.845) (total time: 914ms): Trace[555712735]: ["GuaranteedUpdate etcd3" audit-id:6e2a13cf-b3d5-40f9-8ffd-7b396b8c1856,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 914ms (00:46:33.846) Trace[555712735]: ---"Txn call completed" 913ms (00:46:34.760)] Trace[555712735]: [914.289752ms] [914.289752ms] END I0422 00:46:34.760835 1 trace.go:236] Trace[2045405491]: "Update" accept:application/json, */*,audit-id:9b780a13-a65c-4e73-ab1a-4476b0ae8ee2,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:46:34.215) (total time: 545ms): Trace[2045405491]: ["GuaranteedUpdate etcd3" audit-id:9b780a13-a65c-4e73-ab1a-4476b0ae8ee2,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 545ms (00:46:34.215) Trace[2045405491]: ---"Txn call completed" 544ms (00:46:34.760)] Trace[2045405491]: [545.242139ms] [545.242139ms] END I0422 00:46:34.760832 1 trace.go:236] Trace[1269221497]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:afd84fc9-6a65-4d01-8701-70bb5063245b,client:199.204.45.240,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/glance-metadefs-load/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (22-Apr-2026 00:46:34.178) (total time: 582ms): Trace[1269221497]: ["GuaranteedUpdate etcd3" audit-id:afd84fc9-6a65-4d01-8701-70bb5063245b,key:/jobs/openstack/glance-metadefs-load,type:*batch.Job,resource:jobs.batch 581ms (00:46:34.178) Trace[1269221497]: ---"Txn call completed" 576ms (00:46:34.760)] Trace[1269221497]: [582.123107ms] [582.123107ms] END I0422 00:46:34.761051 1 trace.go:236] Trace[1712782617]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ef2325f5-1b49-41e0-91c8-5e6ae636178e,client:199.204.45.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:POST (22-Apr-2026 00:46:34.178) (total time: 581ms): Trace[1712782617]: ["Create etcd3" audit-id:ef2325f5-1b49-41e0-91c8-5e6ae636178e,key:/events/openstack/glance-metadefs-load.18a88747812c3141,type:*core.Event,resource:events 581ms (00:46:34.179) Trace[1712782617]: ---"Txn call succeeded" 580ms (00:46:34.760)] Trace[1712782617]: [581.940122ms] [581.940122ms] END I0422 00:46:34.761199 1 trace.go:236] Trace[1384710728]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f578dd78-4ba7-43d5-8c8a-038948ce7612,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:46:34.215) (total time: 545ms): Trace[1384710728]: ["GuaranteedUpdate etcd3" audit-id:f578dd78-4ba7-43d5-8c8a-038948ce7612,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 545ms (00:46:34.215) Trace[1384710728]: ---"Txn call completed" 543ms (00:46:34.760)] Trace[1384710728]: [545.401413ms] [545.401413ms] END I0422 00:46:35.074241 1 trace.go:236] Trace[898406901]: "Get" accept:application/json, */*,audit-id:4f4bbde2-f483-462b-841b-d1d86a76bf1c,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (22-Apr-2026 00:46:33.255) (total time: 1818ms): Trace[898406901]: ---"About to write a response" 1818ms (00:46:35.074) Trace[898406901]: [1.818516074s] [1.818516074s] END I0422 00:46:57.586683 1 trace.go:236] Trace[933788987]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:22c8e9fb-eb33-4c86-b20f-889ccba23ac9,client:199.204.45.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/glance-api-7c84669bd8-srgzn.18a8872f0e2f03f1,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:46:56.917) (total time: 668ms): Trace[933788987]: ["GuaranteedUpdate etcd3" audit-id:22c8e9fb-eb33-4c86-b20f-889ccba23ac9,key:/events/openstack/glance-api-7c84669bd8-srgzn.18a8872f0e2f03f1,type:*core.Event,resource:events 668ms (00:46:56.917) Trace[933788987]: ---"initial value restored" 212ms (00:46:57.130) Trace[933788987]: ---"Txn call completed" 454ms (00:46:57.586)] Trace[933788987]: ---"Object stored in database" 455ms (00:46:57.586) Trace[933788987]: [668.759716ms] [668.759716ms] END I0422 00:49:23.549692 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.103.1.254"} I0422 00:49:45.987819 1 trace.go:236] Trace[1854098175]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:deb8e760-4194-4d4c-88ca-9b3a68aec1c4,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:49:44.619) (total time: 1368ms): Trace[1854098175]: ["GuaranteedUpdate etcd3" audit-id:deb8e760-4194-4d4c-88ca-9b3a68aec1c4,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1368ms (00:49:44.619) Trace[1854098175]: ---"Txn call completed" 1366ms (00:49:45.987)] Trace[1854098175]: [1.368326398s] [1.368326398s] END I0422 00:49:45.988080 1 trace.go:236] Trace[407201307]: "Update" accept:application/json, */*,audit-id:59f0e0ca-12f7-4f04-9c53-9c181b84305d,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:44.618) (total time: 1369ms): Trace[407201307]: ["GuaranteedUpdate etcd3" audit-id:59f0e0ca-12f7-4f04-9c53-9c181b84305d,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1369ms (00:49:44.618) Trace[407201307]: ---"Txn call completed" 1367ms (00:49:45.987)] Trace[407201307]: [1.369717494s] [1.369717494s] END I0422 00:49:45.988303 1 trace.go:236] Trace[1982505388]: "Update" accept:application/json, */*,audit-id:62ec262e-ca84-44b2-a3c5-364fac58e664,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:44.620) (total time: 1367ms): Trace[1982505388]: ["GuaranteedUpdate etcd3" audit-id:62ec262e-ca84-44b2-a3c5-364fac58e664,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1367ms (00:49:44.620) Trace[1982505388]: ---"Txn call completed" 1366ms (00:49:45.987)] Trace[1982505388]: [1.367775194s] [1.367775194s] END I0422 00:49:48.901884 1 metrics.go:285] "Failed to get storage metrics" storage_cluster_id="etcd-0" err="context deadline exceeded" I0422 00:49:49.893380 1 trace.go:236] Trace[1810422012]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0c2e8cea-b64b-4bc4-9778-a954b1c8d6f6,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:44.893) (total time: 4999ms): Trace[1810422012]: ["GuaranteedUpdate etcd3" audit-id:0c2e8cea-b64b-4bc4-9778-a954b1c8d6f6,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (00:49:44.894) Trace[1810422012]: ---"Txn call failed" err:context canceled 4998ms (00:49:49.893)] Trace[1810422012]: [4.999381475s] [4.999381475s] END E0422 00:49:49.893426 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com?timeout=5s" audit-ID="0c2e8cea-b64b-4bc4-9778-a954b1c8d6f6" E0422 00:49:49.893462 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 21.95µs, panicked: false, err: context canceled, panic-reason: E0422 00:49:49.893573 1 timeout.go:142] post-timeout activity - time-elapsed: 70.791µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0422 00:49:50.087996 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0422 00:49:50.088064 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0422 00:49:50.088110 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 15.591µs, panicked: false, err: context deadline exceeded, panic-reason: E0422 00:49:50.089449 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0422 00:49:50.089573 1 trace.go:236] Trace[952678322]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:16d16e7f-d3b2-4b3f-99e7-f9252b25816b,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:45.088) (total time: 5001ms): Trace[952678322]: ["GuaranteedUpdate etcd3" audit-id:16d16e7f-d3b2-4b3f-99e7-f9252b25816b,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (00:49:45.088) Trace[952678322]: ---"Txn call failed" err:context deadline exceeded 4998ms (00:49:50.087)] Trace[952678322]: [5.001377276s] [5.001377276s] END E0422 00:49:50.089779 1 timeout.go:142] post-timeout activity - time-elapsed: 1.807058ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0422 00:49:50.900311 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0422 00:49:50.900480 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0422 00:49:50.901841 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0422 00:49:50.901915 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0422 00:49:50.902994 1 trace.go:236] Trace[1378435361]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b274d95a-6322-4b8b-8410-e2443ebff349,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:49:45.900) (total time: 5002ms): Trace[1378435361]: [5.002070364s] [5.002070364s] END E0422 00:49:50.903161 1 timeout.go:142] post-timeout activity - time-elapsed: 2.658439ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: I0422 00:49:51.848862 1 trace.go:236] Trace[1322401556]: "Update" accept:application/json, */*,audit-id:5df70ab7-dbe5-4f48-a536-3e6a10fe6809,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:45.127) (total time: 6721ms): Trace[1322401556]: ["GuaranteedUpdate etcd3" audit-id:5df70ab7-dbe5-4f48-a536-3e6a10fe6809,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 6721ms (00:49:45.127) Trace[1322401556]: ---"Txn call completed" 6720ms (00:49:51.848)] Trace[1322401556]: [6.721630645s] [6.721630645s] END I0422 00:49:52.224247 1 trace.go:236] Trace[926596876]: "Get" accept:application/json, */*,audit-id:ab2c054a-ccb2-4fd6-a13c-0e45699f0687,client:10.0.0.28,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/staffeln-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:45.127) (total time: 7096ms): Trace[926596876]: ---"About to write a response" 7095ms (00:49:52.223) Trace[926596876]: [7.096255365s] [7.096255365s] END I0422 00:49:52.224823 1 trace.go:236] Trace[1456557502]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:97f1e2bb-4734-4897-942f-3d63da6cec08,client:199.204.45.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (22-Apr-2026 00:49:48.950) (total time: 3274ms): Trace[1456557502]: ["Create etcd3" audit-id:97f1e2bb-4734-4897-942f-3d63da6cec08,key:/events/kube-system/kube-apiserver-instance.18a88774da7ac647,type:*core.Event,resource:events 3273ms (00:49:48.951) Trace[1456557502]: ---"Txn call succeeded" 3273ms (00:49:52.224)] Trace[1456557502]: [3.274385562s] [3.274385562s] END I0422 00:49:52.225921 1 trace.go:236] Trace[821443515]: "Get" accept:application/json, */*,audit-id:8284af60-2d09-4f94-a3c7-c9992e615953,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-jzkc8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:46.629) (total time: 5596ms): Trace[821443515]: ---"About to write a response" 5595ms (00:49:52.225) Trace[821443515]: [5.596444056s] [5.596444056s] END I0422 00:49:52.226700 1 trace.go:236] Trace[1235683141]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:079fe78b-8443-42e5-8b6d-bb6de8de679d,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Apr-2026 00:49:51.161) (total time: 1065ms): Trace[1235683141]: ["GuaranteedUpdate etcd3" audit-id:079fe78b-8443-42e5-8b6d-bb6de8de679d,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1065ms (00:49:51.161) Trace[1235683141]: ---"Txn call completed" 1064ms (00:49:52.226)] Trace[1235683141]: [1.065535287s] [1.065535287s] END I0422 00:49:52.226718 1 trace.go:236] Trace[1605849323]: "Get" accept:application/json, */*,audit-id:22c69ef5-52b1-40c8-b703-4319915424c3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:46.325) (total time: 5901ms): Trace[1605849323]: ---"About to write a response" 5901ms (00:49:52.226) Trace[1605849323]: [5.901541405s] [5.901541405s] END I0422 00:49:52.226832 1 trace.go:236] Trace[479207836]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:63a4ee31-f978-429a-b174-badab184125c,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:50.090) (total time: 2136ms): Trace[479207836]: ---"About to write a response" 2136ms (00:49:52.226) Trace[479207836]: [2.136771962s] [2.136771962s] END I0422 00:49:52.226884 1 trace.go:236] Trace[564845978]: "Get" accept:application/json, */*,audit-id:be9dd455-f6b4-4663-9563-0c8f1c61b9b6,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:47.990) (total time: 4236ms): Trace[564845978]: ---"About to write a response" 4236ms (00:49:52.226) Trace[564845978]: [4.236162157s] [4.236162157s] END I0422 00:49:52.226939 1 trace.go:236] Trace[440472652]: "Get" accept:application/json, */*,audit-id:3e4436fd-7829-41e6-b846-d36eefd8e42e,client:10.0.0.151,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (22-Apr-2026 00:49:50.709) (total time: 1517ms): Trace[440472652]: ---"About to write a response" 1517ms (00:49:52.226) Trace[440472652]: [1.517774063s] [1.517774063s] END I0422 00:49:52.227060 1 trace.go:236] Trace[1815932096]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a52e2669-be35-4a22-a585-0f48c56d18c9,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:49.894) (total time: 2332ms): Trace[1815932096]: ---"About to write a response" 2332ms (00:49:52.227) Trace[1815932096]: [2.332855252s] [2.332855252s] END I0422 00:49:52.227116 1 trace.go:236] Trace[1744988543]: "Get" accept:application/json, */*,audit-id:d0fb3447-e0ea-4f82-8b82-0fa4a2d41fe6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:46.791) (total time: 5435ms): Trace[1744988543]: ---"About to write a response" 5435ms (00:49:52.227) Trace[1744988543]: [5.435129994s] [5.435129994s] END I0422 00:49:52.226947 1 trace.go:236] Trace[870651296]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ad08d9c5-62a9-40be-bdfa-a7422a4b14b8,client:10.0.0.163,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:47.629) (total time: 4597ms): Trace[870651296]: ---"About to write a response" 4597ms (00:49:52.226) Trace[870651296]: [4.597591623s] [4.597591623s] END I0422 00:49:52.227177 1 trace.go:236] Trace[325629161]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:19d582a6-3d36-4cbf-99fc-a649e33c43a4,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Apr-2026 00:49:49.347) (total time: 2879ms): Trace[325629161]: ["GuaranteedUpdate etcd3" audit-id:19d582a6-3d36-4cbf-99fc-a649e33c43a4,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 2879ms (00:49:49.347) Trace[325629161]: ---"Txn call completed" 2878ms (00:49:52.227)] Trace[325629161]: [2.879470639s] [2.879470639s] END I0422 00:49:52.227198 1 trace.go:236] Trace[539115500]: "Get" accept:application/json, */*,audit-id:333dd0e8-cd0e-49f5-9b76-65418e244146,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:47.990) (total time: 4236ms): Trace[539115500]: ---"About to write a response" 4236ms (00:49:52.227) Trace[539115500]: [4.236200727s] [4.236200727s] END I0422 00:49:52.227214 1 trace.go:236] Trace[1558470069]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7c583d39-da2c-40ec-a39e-b22c741cce35,client:199.204.45.240,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/valkey-data-valkey-node-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:49:47.014) (total time: 5212ms): Trace[1558470069]: ---"About to write a response" 5212ms (00:49:52.227) Trace[1558470069]: [5.212726092s] [5.212726092s] END I0422 00:49:52.227405 1 trace.go:236] Trace[809567543]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a69a8391-d0a9-46f1-ab85-16567be88d76,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:49:47.989) (total time: 4237ms): Trace[809567543]: ---"About to write a response" 4237ms (00:49:52.227) Trace[809567543]: [4.237386617s] [4.237386617s] END I0422 00:49:52.226722 1 trace.go:236] Trace[7263754]: "Get" accept:application/json, */*,audit-id:8d4f6406-ecb4-49a8-a432-fecb7c1c3f75,client:10.0.0.243,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:48.451) (total time: 3775ms): Trace[7263754]: ---"About to write a response" 3774ms (00:49:52.226) Trace[7263754]: [3.775031s] [3.775031s] END I0422 00:49:52.405068 1 trace.go:236] Trace[1586324729]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.240,type:*v1.Endpoints,resource:apiServerIPInfo (22-Apr-2026 00:49:49.497) (total time: 2907ms): Trace[1586324729]: ---"initial value restored" 2728ms (00:49:52.226) Trace[1586324729]: ---"Transaction prepared" 77ms (00:49:52.303) Trace[1586324729]: ---"Txn call completed" 101ms (00:49:52.405) Trace[1586324729]: [2.907206906s] [2.907206906s] END I0422 00:49:54.532476 1 trace.go:236] Trace[1214449216]: "Update" accept:application/json, */*,audit-id:bde07d73-d7ce-4236-b5bd-8d64f3aea9eb,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:53.852) (total time: 680ms): Trace[1214449216]: ["GuaranteedUpdate etcd3" audit-id:bde07d73-d7ce-4236-b5bd-8d64f3aea9eb,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 679ms (00:49:53.852) Trace[1214449216]: ---"Txn call completed" 678ms (00:49:54.532)] Trace[1214449216]: [680.15891ms] [680.15891ms] END I0422 00:49:54.986142 1 trace.go:236] Trace[1540461036]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:79b7b132-3c3f-4b76-9c17-4a172643c325,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:54.407) (total time: 578ms): Trace[1540461036]: ["GuaranteedUpdate etcd3" audit-id:79b7b132-3c3f-4b76-9c17-4a172643c325,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 578ms (00:49:54.407) Trace[1540461036]: ---"Txn call completed" 578ms (00:49:54.985)] Trace[1540461036]: [578.990594ms] [578.990594ms] END I0422 00:49:54.986329 1 trace.go:236] Trace[2012058839]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6398ab41-7ffb-4058-96b0-b2690e6c1403,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:54.409) (total time: 577ms): Trace[2012058839]: ["GuaranteedUpdate etcd3" audit-id:6398ab41-7ffb-4058-96b0-b2690e6c1403,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 577ms (00:49:54.409) Trace[2012058839]: ---"Txn call completed" 575ms (00:49:54.985)] Trace[2012058839]: [577.251458ms] [577.251458ms] END I0422 00:49:54.986687 1 trace.go:236] Trace[1544345326]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bacdd18b-4abc-4a17-8b0f-d8f66d8547dd,client:199.204.45.240,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/staffeln-db-sync/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (22-Apr-2026 00:49:54.011) (total time: 975ms): Trace[1544345326]: ["GuaranteedUpdate etcd3" audit-id:bacdd18b-4abc-4a17-8b0f-d8f66d8547dd,key:/jobs/openstack/staffeln-db-sync,type:*batch.Job,resource:jobs.batch 975ms (00:49:54.011) Trace[1544345326]: ---"Txn call completed" 970ms (00:49:54.985)] Trace[1544345326]: [975.439567ms] [975.439567ms] END I0422 00:49:56.209887 1 trace.go:236] Trace[114082158]: "Get" accept:application/json, */*,audit-id:6a5da90f-02e6-4863-9295-cec2e7c5eb3a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:54.406) (total time: 1803ms): Trace[114082158]: ---"About to write a response" 1802ms (00:49:56.209) Trace[114082158]: [1.803106303s] [1.803106303s] END I0422 00:49:56.210376 1 trace.go:236] Trace[1357215249]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:475f151d-5d7a-4bf7-a05f-5ecc521c5341,client:199.204.45.240,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-glance-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:49:54.070) (total time: 2139ms): Trace[1357215249]: ---"About to write a response" 2139ms (00:49:56.210) Trace[1357215249]: [2.139988155s] [2.139988155s] END I0422 00:49:56.210685 1 trace.go:236] Trace[1486537725]: "Get" accept:application/json, */*,audit-id:659b0a83-2d88-48a2-8c14-a6c4d9ca4000,client:10.0.0.28,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/staffeln-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:54.229) (total time: 1980ms): Trace[1486537725]: ---"About to write a response" 1979ms (00:49:56.209) Trace[1486537725]: [1.980663614s] [1.980663614s] END I0422 00:49:56.211035 1 trace.go:236] Trace[271950194]: "Get" accept:application/json, */*,audit-id:d775b0f9-4572-478e-a572-a8ec8c2de2a2,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-jzkc8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:54.413) (total time: 1797ms): Trace[271950194]: ---"About to write a response" 1796ms (00:49:56.210) Trace[271950194]: [1.797193039s] [1.797193039s] END I0422 00:49:56.211210 1 trace.go:236] Trace[1467157008]: "Get" accept:application/json, */*,audit-id:36ce1e25-19c3-4d80-90fe-c9ccae9c28c4,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:54.405) (total time: 1805ms): Trace[1467157008]: ---"About to write a response" 1805ms (00:49:56.211) Trace[1467157008]: [1.805533355s] [1.805533355s] END I0422 00:49:56.211312 1 trace.go:236] Trace[614718851]: "Get" accept:application/json, */*,audit-id:2c3b3f8e-fbe0-411e-83a9-94b5b520b0f2,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:54.406) (total time: 1804ms): Trace[614718851]: ---"About to write a response" 1804ms (00:49:56.211) Trace[614718851]: [1.804387485s] [1.804387485s] END I0422 00:49:56.211213 1 trace.go:236] Trace[541947160]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:41c425e0-dec3-4a34-b38d-a271c1aae3ab,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:49:54.405) (total time: 1805ms): Trace[541947160]: ---"About to write a response" 1805ms (00:49:56.211) Trace[541947160]: [1.805409412s] [1.805409412s] END I0422 00:49:56.211352 1 trace.go:236] Trace[1209141437]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:75d5af1d-a1c1-411a-a26b-15961bd1b447,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:49:55.241) (total time: 969ms): Trace[1209141437]: ---"About to write a response" 969ms (00:49:56.211) Trace[1209141437]: [969.682128ms] [969.682128ms] END I0422 00:49:56.211360 1 trace.go:236] Trace[1589870786]: "Get" accept:application/json, */*,audit-id:bdb02429-eadb-4f1e-8952-b74092011ebb,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:54.405) (total time: 1805ms): Trace[1589870786]: ---"About to write a response" 1805ms (00:49:56.211) Trace[1589870786]: [1.805854023s] [1.805854023s] END I0422 00:49:56.527691 1 trace.go:236] Trace[1735137822]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c5fbaaab-d163-43ae-878e-62646f7a743d,client:199.204.45.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/staffeln-db-sync-44qbn.18a887730ea4c023,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:49:55.822) (total time: 704ms): Trace[1735137822]: ["GuaranteedUpdate etcd3" audit-id:c5fbaaab-d163-43ae-878e-62646f7a743d,key:/events/openstack/staffeln-db-sync-44qbn.18a887730ea4c023,type:*core.Event,resource:events 704ms (00:49:55.823) Trace[1735137822]: ---"initial value restored" 386ms (00:49:56.209) Trace[1735137822]: ---"Txn call completed" 316ms (00:49:56.527)] Trace[1735137822]: ---"Object stored in database" 317ms (00:49:56.527) Trace[1735137822]: [704.705146ms] [704.705146ms] END I0422 00:49:57.021713 1 trace.go:236] Trace[1819861527]: "Update" accept:application/json, */*,audit-id:87a00e3a-f819-4912-b17a-6d8c868003b3,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Apr-2026 00:49:56.213) (total time: 808ms): Trace[1819861527]: ["GuaranteedUpdate etcd3" audit-id:87a00e3a-f819-4912-b17a-6d8c868003b3,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 808ms (00:49:56.213) Trace[1819861527]: ---"Txn call completed" 807ms (00:49:57.021)] Trace[1819861527]: [808.387196ms] [808.387196ms] END I0422 00:49:57.021793 1 trace.go:236] Trace[1165268471]: "Update" accept:application/json, */*,audit-id:9d1977c7-dc38-43d8-a2f1-319bb1544a57,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Apr-2026 00:49:56.212) (total time: 809ms): Trace[1165268471]: ["GuaranteedUpdate etcd3" audit-id:9d1977c7-dc38-43d8-a2f1-319bb1544a57,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 809ms (00:49:56.212) Trace[1165268471]: ---"Txn call completed" 808ms (00:49:57.021)] Trace[1165268471]: [809.626479ms] [809.626479ms] END I0422 00:49:57.021810 1 trace.go:236] Trace[1121412777]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c2813674-f8ac-4b5d-93cf-557c745eb930,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:49:56.213) (total time: 808ms): Trace[1121412777]: ["GuaranteedUpdate etcd3" audit-id:c2813674-f8ac-4b5d-93cf-557c745eb930,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 807ms (00:49:56.213) Trace[1121412777]: ---"Txn call completed" 806ms (00:49:57.021)] Trace[1121412777]: [808.10144ms] [808.10144ms] END I0422 00:49:57.021905 1 trace.go:236] Trace[1700679063]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e6ce8e33-9870-44e2-a215-5ce794ec162e,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:49:56.214) (total time: 807ms): Trace[1700679063]: ["GuaranteedUpdate etcd3" audit-id:e6ce8e33-9870-44e2-a215-5ce794ec162e,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 807ms (00:49:56.214) Trace[1700679063]: ---"Txn call completed" 806ms (00:49:57.021)] Trace[1700679063]: [807.251257ms] [807.251257ms] END I0422 00:49:57.021910 1 trace.go:236] Trace[1358424788]: "Update" accept:application/json, */*,audit-id:5cd63b00-017b-469c-afe7-12555b88a09d,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:56.214) (total time: 807ms): Trace[1358424788]: ["GuaranteedUpdate etcd3" audit-id:5cd63b00-017b-469c-afe7-12555b88a09d,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 807ms (00:49:56.214) Trace[1358424788]: ---"Txn call completed" 806ms (00:49:57.021)] Trace[1358424788]: [807.530595ms] [807.530595ms] END I0422 00:49:57.027100 1 trace.go:236] Trace[514507166]: "List" accept:application/json, */*,audit-id:5fb931d1-45e3-4071-883d-fc350fa27fea,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/openstack/pods,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (22-Apr-2026 00:49:56.214) (total time: 812ms): Trace[514507166]: ["List(recursive=true) etcd3" audit-id:5fb931d1-45e3-4071-883d-fc350fa27fea,key:/pods/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 812ms (00:49:56.214)] Trace[514507166]: [812.939004ms] [812.939004ms] END I0422 00:49:57.027969 1 trace.go:236] Trace[1062829130]: "Update" accept:application/json, */*,audit-id:465dcd70-bad3-4049-98aa-9f2e2dbdce97,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:56.214) (total time: 813ms): Trace[1062829130]: ["GuaranteedUpdate etcd3" audit-id:465dcd70-bad3-4049-98aa-9f2e2dbdce97,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 813ms (00:49:56.214) Trace[1062829130]: ---"Txn call completed" 807ms (00:49:57.022)] Trace[1062829130]: [813.797816ms] [813.797816ms] END I0422 00:49:57.887691 1 trace.go:236] Trace[1124993133]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a6649587-aa5e-42c2-a70a-1f596b9c4f7e,client:199.204.45.240,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/staffeln-db-sync-44qbn.18a8877327b5b3a7,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:49:56.530) (total time: 1356ms): Trace[1124993133]: ["GuaranteedUpdate etcd3" audit-id:a6649587-aa5e-42c2-a70a-1f596b9c4f7e,key:/events/openstack/staffeln-db-sync-44qbn.18a8877327b5b3a7,type:*core.Event,resource:events 1356ms (00:49:56.531) Trace[1124993133]: ---"initial value restored" 496ms (00:49:57.027) Trace[1124993133]: ---"Txn call completed" 858ms (00:49:57.887)] Trace[1124993133]: ---"Object stored in database" 859ms (00:49:57.887) Trace[1124993133]: [1.356634785s] [1.356634785s] END I0422 00:49:57.970446 1 trace.go:236] Trace[1058758366]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2b3ff4c7-418c-4da3-a800-0979b773ceb6,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/staffeln-db-sync-44qbn/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:49:57.030) (total time: 939ms): Trace[1058758366]: ["GuaranteedUpdate etcd3" audit-id:2b3ff4c7-418c-4da3-a800-0979b773ceb6,key:/pods/openstack/staffeln-db-sync-44qbn,type:*core.Pod,resource:pods 939ms (00:49:57.030) Trace[1058758366]: ---"Txn call completed" 934ms (00:49:57.969)] Trace[1058758366]: ---"Object stored in database" 935ms (00:49:57.969) Trace[1058758366]: [939.716634ms] [939.716634ms] END I0422 00:50:03.245469 1 trace.go:236] Trace[2055455443]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:68bbdc91-c59f-4539-93ba-0d01c27a9036,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:59.029) (total time: 4215ms): Trace[2055455443]: ["GuaranteedUpdate etcd3" audit-id:68bbdc91-c59f-4539-93ba-0d01c27a9036,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 4215ms (00:49:59.030) Trace[2055455443]: ---"Txn call completed" 4214ms (00:50:03.245)] Trace[2055455443]: [4.215441199s] [4.215441199s] END I0422 00:50:03.247677 1 trace.go:236] Trace[957586792]: "Update" accept:application/json, */*,audit-id:e9fb87ae-57e4-46ea-b767-60908763722f,client:10.0.0.105,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:59.030) (total time: 4217ms): Trace[957586792]: ["GuaranteedUpdate etcd3" audit-id:e9fb87ae-57e4-46ea-b767-60908763722f,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4217ms (00:49:59.030) Trace[957586792]: ---"Txn call completed" 4216ms (00:50:03.247)] Trace[957586792]: [4.217471172s] [4.217471172s] END I0422 00:50:03.247706 1 trace.go:236] Trace[752613036]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b5de980e-57a7-45b7-a8e6-11aeb5b87e3a,client:10.0.0.99,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:49:59.030) (total time: 4217ms): Trace[752613036]: ["GuaranteedUpdate etcd3" audit-id:b5de980e-57a7-45b7-a8e6-11aeb5b87e3a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 4217ms (00:49:59.030) Trace[752613036]: ---"Txn call completed" 4216ms (00:50:03.247)] Trace[752613036]: [4.217127802s] [4.217127802s] END E0422 00:50:04.024922 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0422 00:50:04.025102 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0422 00:50:04.027074 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0422 00:50:04.027167 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0422 00:50:04.028412 1 trace.go:236] Trace[1531584249]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d973ad09-98cf-41d9-935f-1400a2e0a3c2,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (22-Apr-2026 00:49:59.025) (total time: 5003ms): Trace[1531584249]: [5.00304324s] [5.00304324s] END E0422 00:50:04.028632 1 timeout.go:142] post-timeout activity - time-elapsed: 3.921472ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0422 00:50:04.031750 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0422 00:50:04.031877 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0422 00:50:04.032932 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0422 00:50:04.032996 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0422 00:50:04.034164 1 trace.go:236] Trace[776877935]: "Get" accept:application/json, */*,audit-id:0c736ca1-5f78-4d38-a87e-a1ee184d5895,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:59.031) (total time: 5002ms): Trace[776877935]: [5.002391982s] [5.002391982s] END E0422 00:50:04.034300 1 timeout.go:142] post-timeout activity - time-elapsed: 2.611768ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0422 00:50:04.182676 1 trace.go:236] Trace[1742990795]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:93afd05f-f9df-4fe9-a757-8be73f0f250b,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Apr-2026 00:50:02.429) (total time: 1752ms): Trace[1742990795]: ["GuaranteedUpdate etcd3" audit-id:93afd05f-f9df-4fe9-a757-8be73f0f250b,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 1752ms (00:50:02.430) Trace[1742990795]: ---"Txn call completed" 1751ms (00:50:04.182)] Trace[1742990795]: [1.752756231s] [1.752756231s] END I0422 00:50:04.183534 1 trace.go:236] Trace[102651244]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:038fc2d4-8096-4fa1-8a73-1bf1227b0856,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (22-Apr-2026 00:49:59.298) (total time: 4885ms): Trace[102651244]: ["GuaranteedUpdate etcd3" audit-id:038fc2d4-8096-4fa1-8a73-1bf1227b0856,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 4885ms (00:49:59.298) Trace[102651244]: ---"Txn call completed" 4884ms (00:50:04.183)] Trace[102651244]: [4.885281053s] [4.885281053s] END I0422 00:50:04.184121 1 trace.go:236] Trace[512803323]: "Get" accept:application/json, */*,audit-id:665b0515-1c42-4ff3-915c-11e6292c4e32,client:10.0.0.173,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (22-Apr-2026 00:49:59.025) (total time: 5158ms): Trace[512803323]: ---"About to write a response" 5158ms (00:50:04.183) Trace[512803323]: [5.158181512s] [5.158181512s] END I0422 00:50:04.184201 1 trace.go:236] Trace[1620642395]: "Get" accept:application/json, */*,audit-id:d06a1c41-71b6-4489-93dd-60ece4dbe514,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:59.025) (total time: 5159ms): Trace[1620642395]: ---"About to write a response" 5158ms (00:50:04.183) Trace[1620642395]: [5.159107525s] [5.159107525s] END I0422 00:50:04.184436 1 trace.go:236] Trace[1793336638]: "Get" accept:application/json, */*,audit-id:9bc6db9b-b926-4093-b58f-b2253db6566e,client:199.204.45.240,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-jzkc8,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:59.029) (total time: 5154ms): Trace[1793336638]: ---"About to write a response" 5154ms (00:50:04.183) Trace[1793336638]: [5.154907328s] [5.154907328s] END I0422 00:50:04.184743 1 trace.go:236] Trace[1463272547]: "Get" accept:application/json, */*,audit-id:b422340b-700f-4c4a-87fd-be0556e7e522,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:49:59.025) (total time: 5159ms): Trace[1463272547]: ---"About to write a response" 5159ms (00:50:04.184) Trace[1463272547]: [5.159193537s] [5.159193537s] END I0422 00:50:04.184805 1 trace.go:236] Trace[1314237524]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ac6f5829-df44-4869-a85b-bbf60349dcde,client:199.204.45.240,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (22-Apr-2026 00:49:59.696) (total time: 4487ms): Trace[1314237524]: ["GuaranteedUpdate etcd3" audit-id:ac6f5829-df44-4869-a85b-bbf60349dcde,key:/minions/instance,type:*core.Node,resource:nodes 4487ms (00:49:59.697) Trace[1314237524]: ---"Txn call completed" 4479ms (00:50:04.182)] Trace[1314237524]: ---"Object stored in database" 4482ms (00:50:04.184) Trace[1314237524]: [4.487821424s] [4.487821424s] END I0422 00:50:04.185088 1 trace.go:236] Trace[760221976]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:82b34d21-fc98-4f55-a2ad-e2e255ab0fc0,client:199.204.45.240,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/storage-loki-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:49:59.070) (total time: 5113ms): Trace[760221976]: ---"About to write a response" 5113ms (00:50:04.183) Trace[760221976]: [5.113362773s] [5.113362773s] END I0422 00:50:04.185294 1 trace.go:236] Trace[260053874]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a0b234d7-14db-44d8-8fe5-82a81d2bc66b,client:199.204.45.240,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (22-Apr-2026 00:49:59.732) (total time: 4452ms): Trace[260053874]: ["GuaranteedUpdate etcd3" audit-id:a0b234d7-14db-44d8-8fe5-82a81d2bc66b,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 4452ms (00:49:59.732) Trace[260053874]: ---"Txn call completed" 4450ms (00:50:04.184)] Trace[260053874]: [4.452534061s] [4.452534061s] END I0422 00:50:04.463619 1 trace.go:236] Trace[1327424766]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:22fe5291-e8d0-4d49-b374-ee6c73d968ea,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (22-Apr-2026 00:50:03.929) (total time: 533ms): Trace[1327424766]: ["GuaranteedUpdate etcd3" audit-id:22fe5291-e8d0-4d49-b374-ee6c73d968ea,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 533ms (00:50:03.930) Trace[1327424766]: ---"Txn call completed" 532ms (00:50:04.463)] Trace[1327424766]: [533.659771ms] [533.659771ms] END I0422 00:50:04.465147 1 trace.go:236] Trace[1609295002]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54d75f86-e469-4909-bfd3-10bb35979fc4,client:10.0.0.163,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:50:03.556) (total time: 908ms): Trace[1609295002]: ---"About to write a response" 908ms (00:50:04.464) Trace[1609295002]: [908.638409ms] [908.638409ms] END I0422 00:50:04.465708 1 trace.go:236] Trace[1328374596]: "Get" accept:application/json, */*,audit-id:05373655-0eb1-406e-b97d-fdedf3e8e855,client:10.0.0.28,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/staffeln-db-sync,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (22-Apr-2026 00:50:00.464) (total time: 4000ms): Trace[1328374596]: ---"About to write a response" 3999ms (00:50:04.464) Trace[1328374596]: [4.000719226s] [4.000719226s] END I0422 00:50:04.735596 1 trace.go:236] Trace[1123306677]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.240,type:*v1.Endpoints,resource:apiServerIPInfo (22-Apr-2026 00:49:59.498) (total time: 5237ms): Trace[1123306677]: ---"initial value restored" 4964ms (00:50:04.462) Trace[1123306677]: ---"Transaction prepared" 66ms (00:50:04.529) Trace[1123306677]: ---"Txn call completed" 205ms (00:50:04.735) Trace[1123306677]: [5.237023331s] [5.237023331s] END I0422 00:56:10.415112 1 trace.go:236] Trace[68739449]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.240,type:*v1.Endpoints,resource:apiServerIPInfo (22-Apr-2026 00:56:09.521) (total time: 893ms): Trace[68739449]: ---"Transaction prepared" 97ms (00:56:09.619) Trace[68739449]: ---"Txn call completed" 795ms (00:56:10.415) Trace[68739449]: [893.853935ms] [893.853935ms] END I0422 00:56:10.469019 1 trace.go:236] Trace[777907775]: "Update" accept:application/json, */*,audit-id:da5b8057-93c3-40f3-9c22-62a27fb6ba26,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (22-Apr-2026 00:56:09.622) (total time: 846ms): Trace[777907775]: ["GuaranteedUpdate etcd3" audit-id:da5b8057-93c3-40f3-9c22-62a27fb6ba26,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 846ms (00:56:09.622) Trace[777907775]: ---"Txn call completed" 844ms (00:56:10.468)] Trace[777907775]: [846.497737ms] [846.497737ms] END I0422 00:56:10.603297 1 trace.go:236] Trace[1248082160]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0fd124c9-fc48-4a03-805e-1b6824abce77,client:10.0.0.163,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (22-Apr-2026 00:56:09.796) (total time: 806ms): Trace[1248082160]: ["GuaranteedUpdate etcd3" audit-id:0fd124c9-fc48-4a03-805e-1b6824abce77,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 806ms (00:56:09.796) Trace[1248082160]: ---"Txn call completed" 805ms (00:56:10.603)] Trace[1248082160]: [806.523783ms] [806.523783ms] END I0422 00:56:10.605572 1 trace.go:236] Trace[490609347]: "Get" accept:application/json,audit-id:f6a45e9d-5397-4b0a-93c8-69200a1fda88,client:199.204.45.240,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openstack/rolebindings/rabbitmq-barbican-server,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:56:09.851) (total time: 753ms): Trace[490609347]: ---"About to write a response" 753ms (00:56:10.605) Trace[490609347]: [753.513038ms] [753.513038ms] END I0422 00:56:10.608750 1 trace.go:236] Trace[1169433561]: "Get" accept:application/json,audit-id:46e1428e-7888-45a4-b4c3-cffdbe5d96a9,client:199.204.45.240,protocol:HTTP/2.0,resource:rolebindings,scope:resource,url:/apis/rbac.authorization.k8s.io/v1/namespaces/openstack/rolebindings/pxc-operator,user-agent:kubectl/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (22-Apr-2026 00:56:09.839) (total time: 769ms): Trace[1169433561]: ---"About to write a response" 769ms (00:56:10.608) Trace[1169433561]: [769.624034ms] [769.624034ms] END