I0516 09:15:27.953899 1 options.go:220] external host was not specified, using 199.204.45.223 I0516 09:15:27.954809 1 server.go:148] Version: v1.28.13 I0516 09:15:27.954825 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0516 09:15:28.633044 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0516 09:15:28.638715 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0516 09:15:28.638731 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0516 09:15:28.638900 1 instance.go:298] Using reconciler: lease I0516 09:15:28.682881 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0516 09:15:28.682903 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0516 09:15:28.922008 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0516 09:15:28.922140 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0516 09:15:29.361078 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0516 09:15:29.382875 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0516 09:15:29.382913 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.382921 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.383523 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0516 09:15:29.383539 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0516 09:15:29.384558 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0516 09:15:29.385350 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0516 09:15:29.385364 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0516 09:15:29.385368 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0516 09:15:29.387067 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0516 09:15:29.387085 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0516 09:15:29.388175 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0516 09:15:29.388191 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.388195 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.389034 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0516 09:15:29.389055 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.389138 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0516 09:15:29.389764 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0516 09:15:29.391431 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0516 09:15:29.391444 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.391449 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.391910 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0516 09:15:29.391921 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.391925 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.392770 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0516 09:15:29.392785 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0516 09:15:29.395052 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0516 09:15:29.395068 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.395074 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.395623 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0516 09:15:29.395645 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.395650 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.398161 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0516 09:15:29.398180 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.398185 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.399595 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0516 09:15:29.400941 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0516 09:15:29.400975 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.400980 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.404042 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0516 09:15:29.404057 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0516 09:15:29.404061 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0516 09:15:29.404829 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0516 09:15:29.404843 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0516 09:15:29.404847 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0516 09:15:29.405358 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0516 09:15:29.405370 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0516 09:15:29.437721 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0516 09:15:29.437746 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0516 09:15:29.844528 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0516 09:15:29.844551 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0516 09:15:29.844741 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0516 09:15:29.844991 1 secure_serving.go:213] Serving securely on [::]:6443 I0516 09:15:29.845104 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0516 09:15:29.845203 1 controller.go:80] Starting OpenAPI V3 AggregationController I0516 09:15:29.845256 1 system_namespaces_controller.go:67] Starting system namespaces controller I0516 09:15:29.845318 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0516 09:15:29.845387 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0516 09:15:29.845534 1 gc_controller.go:78] Starting apiserver lease garbage collector I0516 09:15:29.845593 1 available_controller.go:423] Starting AvailableConditionController I0516 09:15:29.845632 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0516 09:15:29.845682 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0516 09:15:29.845699 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0516 09:15:29.845766 1 gc_controller.go:78] Starting apiserver lease garbage collector I0516 09:15:29.846000 1 aggregator.go:164] waiting for initial CRD sync... I0516 09:15:29.846022 1 controller.go:78] Starting OpenAPI AggregationController I0516 09:15:29.846045 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0516 09:15:29.846269 1 controller.go:116] Starting legacy_token_tracking_controller I0516 09:15:29.846281 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0516 09:15:29.846382 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0516 09:15:29.848027 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0516 09:15:29.848047 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0516 09:15:29.849362 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0516 09:15:29.850006 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0516 09:15:29.850022 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0516 09:15:29.850209 1 controller.go:134] Starting OpenAPI controller I0516 09:15:29.850233 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0516 09:15:29.850288 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0516 09:15:29.850307 1 crd_finalizer.go:266] Starting CRDFinalizer I0516 09:15:29.850239 1 controller.go:85] Starting OpenAPI V3 controller I0516 09:15:29.850255 1 naming_controller.go:291] Starting NamingConditionController I0516 09:15:29.850269 1 establishing_controller.go:76] Starting EstablishingController I0516 09:15:29.850279 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0516 09:15:29.933803 1 shared_informer.go:318] Caches are synced for node_authorizer I0516 09:15:29.946273 1 cache.go:39] Caches are synced for AvailableConditionController controller I0516 09:15:29.946309 1 apf_controller.go:379] Running API Priority and Fairness config worker I0516 09:15:29.946316 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0516 09:15:29.946627 1 shared_informer.go:318] Caches are synced for configmaps I0516 09:15:29.946648 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0516 09:15:29.948077 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0516 09:15:29.948541 1 controller.go:624] quota admission added evaluator for: namespaces I0516 09:15:29.950081 1 shared_informer.go:318] Caches are synced for crd-autoregister I0516 09:15:29.950122 1 aggregator.go:166] initial CRD sync complete... I0516 09:15:29.950132 1 autoregister_controller.go:141] Starting autoregister controller I0516 09:15:29.950142 1 cache.go:32] Waiting for caches to sync for autoregister controller I0516 09:15:29.950151 1 cache.go:39] Caches are synced for autoregister controller I0516 09:15:29.968000 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0516 09:15:30.852417 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0516 09:15:30.857453 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0516 09:15:30.857475 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0516 09:15:31.405249 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0516 09:15:31.447172 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0516 09:15:31.559446 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0516 09:15:31.567494 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.223] I0516 09:15:31.569514 1 controller.go:624] quota admission added evaluator for: endpoints I0516 09:15:31.575627 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0516 09:15:32.703628 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0516 09:15:33.112766 1 controller.go:624] quota admission added evaluator for: deployments.apps I0516 09:15:33.223196 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0516 09:15:33.388909 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0516 09:15:37.596792 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0516 09:15:37.897726 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0516 09:15:57.473988 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0516 09:15:57.494670 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0516 09:15:57.494708 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0516 09:15:57.497366 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0516 09:15:57.508247 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0516 09:15:57.522864 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0516 09:15:57.535426 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0516 09:15:57.563340 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0516 09:15:57.563447 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0516 09:15:57.580461 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0516 09:15:57.580527 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0516 09:15:57.628462 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0516 09:15:57.628501 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0516 09:15:57.643795 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0516 09:15:57.681304 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0516 09:15:57.800072 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:57.902994 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.010006 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0516 09:15:58.010067 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0516 09:15:58.042621 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.073084 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.082646 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.721279 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.738802 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:15:58.806082 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0516 09:16:03.940657 1 controller.go:624] quota admission added evaluator for: jobs.batch I0516 09:16:08.352779 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0516 09:16:08.362649 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0516 09:16:08.373599 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0516 09:16:08.386048 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0516 09:16:08.460384 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0516 09:16:08.650673 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0516 09:16:08.851639 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0516 09:16:09.056119 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0516 09:16:11.101800 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0516 09:16:11.674431 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0516 09:16:12.070655 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0516 09:16:12.116806 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0516 09:16:12.116876 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0516 09:16:15.664704 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0516 09:16:23.446627 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.102.59.134"} W0516 09:16:25.424776 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.102.59.134:9443: connect: connection refused E0516 09:16:25.424831 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.102.59.134:9443: connect: connection refused I0516 09:16:37.719101 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0516 09:16:37.732574 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0516 09:16:37.765336 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0516 09:16:37.778565 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.103.137.148"} I0516 09:16:37.804876 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.108.68.45"} I0516 09:16:37.820345 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0516 09:16:37.892789 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0516 09:16:37.936868 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0516 09:16:48.741138 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io E0516 09:16:51.550789 1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc011b0f080), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc007a75b30), ResponseWriter:(*httpsnoop.rw)(0xc007a75b30), Flusher:(*httpsnoop.rw)(0xc007a75b30), CloseNotifier:(*httpsnoop.rw)(0xc007a75b30), Pusher:(*httpsnoop.rw)(0xc007a75b30)}}, encoder:(*versioning.codec)(0xc014e308c0), memAllocator:(*runtime.Allocator)(0xc0082ed290)}) I0516 09:16:53.562125 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0516 09:17:07.731565 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.99.248.188"} I0516 09:17:07.749092 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.97.214.174"} I0516 09:17:07.753701 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.111.200.147"} I0516 09:17:07.763611 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.110.244.78"} I0516 09:17:14.194472 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.211676 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.243452 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.271842 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.280681 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.311928 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.320658 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.342426 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.361645 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.379611 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0516 09:17:14.400855 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.421765 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:14.467846 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:15.633474 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0516 09:17:19.488671 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0516 09:17:19.494905 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0516 09:17:19.567315 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.107.112.192"} I0516 09:17:19.606576 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0516 09:17:21.813097 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0516 09:17:21.846036 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0516 09:17:22.421153 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0516 09:17:22.421194 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0516 09:17:22.421222 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0516 09:17:29.233407 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0516 09:17:32.685384 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.105.63.153"} I0516 09:17:32.955769 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0516 09:17:33.103277 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.107.159.163"} I0516 09:17:33.114542 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.100.39.31"} I0516 09:19:14.770586 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.109.213.146"} I0516 09:19:16.878006 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.102.168.166"} I0516 09:19:17.761772 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.109.91.185"} I0516 09:19:25.432233 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.105.12.73"} I0516 09:19:25.443155 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.109.179.14"} I0516 09:20:57.000272 1 trace.go:236] Trace[1489339401]: "Get" accept:application/json, */*,audit-id:d89469e2-f299-44d0-ab54-989d2c2d3c73,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:20:52.755) (total time: 4245ms): Trace[1489339401]: ---"About to write a response" 4244ms (09:20:56.999) Trace[1489339401]: [4.245005369s] [4.245005369s] END I0516 09:20:57.030280 1 trace.go:236] Trace[194685889]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:37ec1c3f-8223-4bf8-85b5-8e5eb569a2fe,client:10.0.0.192,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:20:53.246) (total time: 3784ms): Trace[194685889]: ["GuaranteedUpdate etcd3" audit-id:37ec1c3f-8223-4bf8-85b5-8e5eb569a2fe,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 3783ms (09:20:53.246) Trace[194685889]: ---"Txn call completed" 3782ms (09:20:57.029)] Trace[194685889]: [3.784061397s] [3.784061397s] END I0516 09:20:57.045311 1 trace.go:236] Trace[91765229]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:03f9e0d3-de7a-4c6d-9d0e-b3b1a14f2e71,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:20:53.648) (total time: 3396ms): Trace[91765229]: ["GuaranteedUpdate etcd3" audit-id:03f9e0d3-de7a-4c6d-9d0e-b3b1a14f2e71,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3396ms (09:20:53.648) Trace[91765229]: ---"Txn call completed" 3394ms (09:20:57.044)] Trace[91765229]: [3.396673893s] [3.396673893s] END I0516 09:20:57.045942 1 trace.go:236] Trace[140504970]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:672d122a-c4bb-4c0d-87d7-7cd944180ebb,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:20:54.208) (total time: 2837ms): Trace[140504970]: ["GuaranteedUpdate etcd3" audit-id:672d122a-c4bb-4c0d-87d7-7cd944180ebb,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2837ms (09:20:54.208) Trace[140504970]: ---"Txn call completed" 2836ms (09:20:57.045)] Trace[140504970]: [2.837811816s] [2.837811816s] END I0516 09:20:57.046068 1 trace.go:236] Trace[2125427855]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:27d18a9a-542b-43b4-88f7-5adb55db1fe3,client:10.0.0.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:20:53.596) (total time: 3449ms): Trace[2125427855]: ["GuaranteedUpdate etcd3" audit-id:27d18a9a-542b-43b4-88f7-5adb55db1fe3,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 3449ms (09:20:53.596) Trace[2125427855]: ---"Txn call completed" 3448ms (09:20:57.045)] Trace[2125427855]: [3.449208917s] [3.449208917s] END I0516 09:20:57.188703 1 trace.go:236] Trace[1376476885]: "Get" accept:application/json, */*,audit-id:abb2997c-c75d-4d36-a0af-f5f8d87910d2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:20:53.484) (total time: 3704ms): Trace[1376476885]: ---"About to write a response" 3703ms (09:20:57.188) Trace[1376476885]: [3.704064007s] [3.704064007s] END I0516 09:20:57.189038 1 trace.go:236] Trace[971309136]: "Get" accept:application/json, */*,audit-id:cfcd6637-e802-4058-ae4a-7c5ed1c654cf,client:10.0.0.148,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:20:55.923) (total time: 1265ms): Trace[971309136]: ---"About to write a response" 1265ms (09:20:57.188) Trace[971309136]: [1.265822329s] [1.265822329s] END I0516 09:20:57.189421 1 trace.go:236] Trace[1999053690]: "Get" accept:application/json, */*,audit-id:035611c8-1100-4e3a-b492-85f16ae27581,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:20:53.334) (total time: 3854ms): Trace[1999053690]: ---"About to write a response" 3854ms (09:20:57.189) Trace[1999053690]: [3.854462268s] [3.854462268s] END I0516 09:20:57.190069 1 trace.go:236] Trace[306522336]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0fec8d10-bc55-417d-b69e-98ed257f8e91,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:20:54.280) (total time: 2909ms): Trace[306522336]: ---"About to write a response" 2909ms (09:20:57.189) Trace[306522336]: [2.909563151s] [2.909563151s] END I0516 09:20:57.190116 1 trace.go:236] Trace[1946887427]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:77fcc3fc-c29c-49a5-90db-771206bd2a5e,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:20:54.642) (total time: 2547ms): Trace[1946887427]: ---"About to write a response" 2547ms (09:20:57.190) Trace[1946887427]: [2.547325769s] [2.547325769s] END I0516 09:20:57.190498 1 trace.go:236] Trace[1811552663]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fdc92e4a-6022-4cfb-8f69-1037b7463ade,client:10.0.0.192,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:20:56.047) (total time: 1143ms): Trace[1811552663]: ---"About to write a response" 1142ms (09:20:57.189) Trace[1811552663]: [1.143211944s] [1.143211944s] END I0516 09:20:57.192451 1 trace.go:236] Trace[259318595]: "Get" accept:application/json, */*,audit-id:6dcee8ab-3695-4d02-a543-79d1f0ca2096,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (16-May-2026 09:20:53.495) (total time: 3697ms): Trace[259318595]: ---"About to write a response" 3697ms (09:20:57.192) Trace[259318595]: [3.697415622s] [3.697415622s] END I0516 09:20:57.259816 1 trace.go:236] Trace[372693007]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7666fd32-093a-4da7-9073-2825dca9b48e,client:199.204.45.223,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/auth-system/events/keycloak-0.18b0013531db013a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (16-May-2026 09:20:55.794) (total time: 1465ms): Trace[372693007]: ["GuaranteedUpdate etcd3" audit-id:7666fd32-093a-4da7-9073-2825dca9b48e,key:/events/auth-system/keycloak-0.18b0013531db013a,type:*core.Event,resource:events 1465ms (09:20:55.794) Trace[372693007]: ---"initial value restored" 1397ms (09:20:57.192) Trace[372693007]: ---"Txn call completed" 65ms (09:20:57.259)] Trace[372693007]: ---"Object stored in database" 65ms (09:20:57.259) Trace[372693007]: [1.465180057s] [1.465180057s] END E0516 09:21:34.137869 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.137960 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0516 09:21:34.138110 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 102.991µs, panicked: false, err: context canceled, panic-reason: E0516 09:21:34.139011 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0516 09:21:34.140297 1 trace.go:236] Trace[305003044]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:41fc3779-0207-40b6-923b-640d64202dec,client:10.0.0.192,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:21:29.137) (total time: 5002ms): Trace[305003044]: ["GuaranteedUpdate etcd3" audit-id:41fc3779-0207-40b6-923b-640d64202dec,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 5002ms (09:21:29.137) Trace[305003044]: ---"Txn call failed" err:context canceled 4999ms (09:21:34.137)] Trace[305003044]: [5.002496946s] [5.002496946s] END E0516 09:21:34.140425 1 timeout.go:142] post-timeout activity - time-elapsed: 2.18855ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com" result: E0516 09:21:34.142796 1 wrap.go:54] timeout or abort while handling: method=PUT URI="/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election?timeout=5s" audit-ID="f3a2ac43-300f-4466-890a-494cab3b7f77" I0516 09:21:34.142800 1 trace.go:236] Trace[1659031235]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f3a2ac43-300f-4466-890a-494cab3b7f77,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:21:29.143) (total time: 4999ms): Trace[1659031235]: ["GuaranteedUpdate etcd3" audit-id:f3a2ac43-300f-4466-890a-494cab3b7f77,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 4999ms (09:21:29.143) Trace[1659031235]: ---"Txn call failed" err:context canceled 4998ms (09:21:34.142)] Trace[1659031235]: [4.999268856s] [4.999268856s] END E0516 09:21:34.142832 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 16.75µs, panicked: false, err: context canceled, panic-reason: E0516 09:21:34.142865 1 timeout.go:142] post-timeout activity - time-elapsed: 36.001µs, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election" result: E0516 09:21:34.144064 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.144100 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0516 09:21:34.144128 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 5.54µs, panicked: false, err: context deadline exceeded, panic-reason: E0516 09:21:34.145294 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0516 09:21:34.145382 1 trace.go:236] Trace[1850485293]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9fef0f5d-6956-4404-b6ef-b821c61e3a83,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:21:29.143) (total time: 5001ms): Trace[1850485293]: ["GuaranteedUpdate etcd3" audit-id:9fef0f5d-6956-4404-b6ef-b821c61e3a83,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:21:29.143) Trace[1850485293]: ---"Txn call failed" err:context deadline exceeded 4999ms (09:21:34.143)] Trace[1850485293]: [5.001635559s] [5.001635559s] END E0516 09:21:34.145526 1 timeout.go:142] post-timeout activity - time-elapsed: 1.548364ms, PUT "/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election" result: E0516 09:21:34.146240 1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 41.5µs, panicked: false, err: context canceled, panic-reason: E0516 09:21:34.146345 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.147536 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0516 09:21:34.147586 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0516 09:21:34.148663 1 trace.go:236] Trace[312425892]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0d814646-304a-4ef2-98f9-ff55ee304e9a,client:10.0.0.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:21:29.146) (total time: 5001ms): Trace[312425892]: ["GuaranteedUpdate etcd3" audit-id:0d814646-304a-4ef2-98f9-ff55ee304e9a,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 5001ms (09:21:29.146) Trace[312425892]: ---"Txn call failed" err:context canceled 4998ms (09:21:34.146)] Trace[312425892]: [5.00174747s] [5.00174747s] END E0516 09:21:34.148766 1 timeout.go:142] post-timeout activity - time-elapsed: 2.389542ms, PUT "/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io" result: E0516 09:21:34.563283 1 status.go:71] apiserver received an error that is not an metav1.Status: context.deadlineExceededError{}: context deadline exceeded E0516 09:21:34.563695 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.564348 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0516 09:21:34.564834 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0516 09:21:34.566071 1 trace.go:236] Trace[861991676]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b3d9f952-fc8e-4349-8744-4c60c60a90ba,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:21:29.563) (total time: 5002ms): Trace[861991676]: [5.002483119s] [5.002483119s] END E0516 09:21:34.566371 1 timeout.go:142] post-timeout activity - time-elapsed: 2.019248ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager" result: E0516 09:21:34.569355 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0516 09:21:34.569418 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.570518 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout E0516 09:21:34.570549 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout E0516 09:21:34.571130 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}: context canceled E0516 09:21:34.572280 1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout E0516 09:21:34.572298 1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout I0516 09:21:34.572313 1 trace.go:236] Trace[1355520333]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:113177b0-d2b7-4f8e-bd99-0d23ebab314c,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:21:29.569) (total time: 5002ms): Trace[1355520333]: [5.002678941s] [5.002678941s] END E0516 09:21:34.572510 1 timeout.go:142] post-timeout activity - time-elapsed: 3.148849ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler" result: E0516 09:21:34.573578 1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout I0516 09:21:34.573779 1 trace.go:236] Trace[694389074]: "Get" accept:application/json, */*,audit-id:02de2f36-40dd-4930-a6da-52653d8253b9,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:29.571) (total time: 5001ms): Trace[694389074]: [5.001952794s] [5.001952794s] END E0516 09:21:34.573960 1 timeout.go:142] post-timeout activity - time-elapsed: 2.957158ms, GET "/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock" result: I0516 09:21:37.501806 1 trace.go:236] Trace[423936767]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:396781f2-0c70-4293-ba53-b253f18631b8,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (16-May-2026 09:21:31.045) (total time: 6456ms): Trace[423936767]: ["GuaranteedUpdate etcd3" audit-id:396781f2-0c70-4293-ba53-b253f18631b8,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 6456ms (09:21:31.045) Trace[423936767]: ---"Txn call completed" 6455ms (09:21:37.501)] Trace[423936767]: [6.456753049s] [6.456753049s] END I0516 09:21:37.501934 1 trace.go:236] Trace[1466301221]: "Get" accept:application/json, */*,audit-id:2de7137e-dacb-4d30-b35e-967a6ecd2c3e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:21:29.336) (total time: 8165ms): Trace[1466301221]: ---"About to write a response" 8165ms (09:21:37.501) Trace[1466301221]: [8.165460331s] [8.165460331s] END I0516 09:21:37.513904 1 trace.go:236] Trace[1345568400]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9c1d0de8-b29f-4925-8887-76aca3b75bd7,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (16-May-2026 09:21:36.585) (total time: 928ms): Trace[1345568400]: ["GuaranteedUpdate etcd3" audit-id:9c1d0de8-b29f-4925-8887-76aca3b75bd7,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 927ms (09:21:36.585) Trace[1345568400]: ---"Txn call completed" 927ms (09:21:37.513)] Trace[1345568400]: [928.08722ms] [928.08722ms] END I0516 09:21:37.598037 1 trace.go:236] Trace[756947508]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7a06d90a-5791-4f33-93f5-db0a5db68f5d,client:10.0.0.192,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:34.138) (total time: 3459ms): Trace[756947508]: ---"About to write a response" 3459ms (09:21:37.597) Trace[756947508]: [3.459241434s] [3.459241434s] END I0516 09:21:37.598142 1 trace.go:236] Trace[1154381873]: "Get" accept:application/json, */*,audit-id:77eeb27a-d62c-42c0-bb87-a6b2280b74f5,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:36.572) (total time: 1025ms): Trace[1154381873]: ---"About to write a response" 1025ms (09:21:37.597) Trace[1154381873]: [1.02523511s] [1.02523511s] END I0516 09:21:37.598497 1 trace.go:236] Trace[366244007]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e62e6159-60c7-4537-8df4-c00afa55ec3c,client:10.0.0.192,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:21:33.195) (total time: 4403ms): Trace[366244007]: ---"About to write a response" 4402ms (09:21:37.598) Trace[366244007]: [4.403271214s] [4.403271214s] END I0516 09:21:37.598726 1 trace.go:236] Trace[131139667]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8520452c-c874-4ffe-90e0-58cf4e42b2e9,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:21:36.564) (total time: 1033ms): Trace[131139667]: ---"About to write a response" 1033ms (09:21:37.598) Trace[131139667]: [1.03385346s] [1.03385346s] END I0516 09:21:37.598909 1 trace.go:236] Trace[581499209]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5f693773-3b33-4528-9956-b40594af0e81,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:34.145) (total time: 3453ms): Trace[581499209]: ---"About to write a response" 3453ms (09:21:37.598) Trace[581499209]: [3.453783573s] [3.453783573s] END I0516 09:21:37.599011 1 trace.go:236] Trace[1400261203]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:8335c76a-6bbb-4221-a518-094b93f6238e,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:21:36.570) (total time: 1027ms): Trace[1400261203]: ---"About to write a response" 1027ms (09:21:37.598) Trace[1400261203]: [1.027992405s] [1.027992405s] END I0516 09:21:37.599236 1 trace.go:236] Trace[988997113]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:8ee8a39e-30bf-4629-8b6d-56393a661d54,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:34.144) (total time: 3455ms): Trace[988997113]: ---"About to write a response" 3455ms (09:21:37.599) Trace[988997113]: [3.455185666s] [3.455185666s] END I0516 09:21:37.599367 1 trace.go:236] Trace[1368379581]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cb033f0a-48bd-4583-a584-62f4473fa062,client:10.0.0.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (16-May-2026 09:21:34.146) (total time: 3452ms): Trace[1368379581]: ---"About to write a response" 3452ms (09:21:37.599) Trace[1368379581]: [3.452589852s] [3.452589852s] END I0516 09:21:37.599541 1 trace.go:236] Trace[753261540]: "Get" accept:application/json, */*,audit-id:3335fddf-24a5-4870-ab01-d1671e3bc086,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:21:29.563) (total time: 8035ms): Trace[753261540]: ---"About to write a response" 8035ms (09:21:37.599) Trace[753261540]: [8.035547219s] [8.035547219s] END I0516 09:21:37.602950 1 trace.go:236] Trace[49517115]: "Get" accept:application/json, */*,audit-id:061f4e8e-7535-454d-88df-ea1f88994a0a,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/auth-system/services/keycloak-headless,user-agent:Helm/3.11.2,verb:GET (16-May-2026 09:21:29.495) (total time: 8107ms): Trace[49517115]: ---"About to write a response" 8107ms (09:21:37.602) Trace[49517115]: [8.107684626s] [8.107684626s] END I0516 09:21:37.670054 1 trace.go:236] Trace[1491940620]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2008e3cb-2075-4bb9-a552-b76f018abf43,client:199.204.45.223,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events/kube-apiserver-instance.18b00146fbc07b01,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (16-May-2026 09:21:31.553) (total time: 6116ms): Trace[1491940620]: ["GuaranteedUpdate etcd3" audit-id:2008e3cb-2075-4bb9-a552-b76f018abf43,key:/events/kube-system/kube-apiserver-instance.18b00146fbc07b01,type:*core.Event,resource:events 6116ms (09:21:31.553) Trace[1491940620]: ---"initial value restored" 6044ms (09:21:37.597) Trace[1491940620]: ---"Txn call completed" 66ms (09:21:37.669)] Trace[1491940620]: ---"Object stored in database" 66ms (09:21:37.669) Trace[1491940620]: [6.116726014s] [6.116726014s] END I0516 09:21:37.802078 1 trace.go:236] Trace[1269965375]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.223,type:*v1.Endpoints,resource:apiServerIPInfo (16-May-2026 09:21:31.572) (total time: 6229ms): Trace[1269965375]: ---"initial value restored" 6025ms (09:21:37.597) Trace[1269965375]: ---"Txn call completed" 188ms (09:21:37.801) Trace[1269965375]: [6.229958244s] [6.229958244s] END I0516 09:21:59.271095 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0516 09:22:01.141724 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0516 09:22:01.148891 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0516 09:22:01.168194 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0516 09:22:01.181061 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0516 09:22:01.189858 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0516 09:22:01.205364 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0516 09:22:01.218051 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0516 09:22:13.415897 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0516 09:22:52.527834 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0516 09:23:06.807923 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0516 09:23:07.030930 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.049650 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.060761 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.403808 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0516 09:23:07.642430 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.642746 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.709373 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0516 09:23:07.723812 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:07.858255 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0516 09:23:50.869734 1 trace.go:236] Trace[441088124]: "Delete" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:26e9e52b-7373-4fa6-a9f9-da8fe88d4352,client:199.204.45.223,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/kube-prometheus-stack-admission-create-jx8nh,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:DELETE (16-May-2026 09:23:50.344) (total time: 524ms): Trace[441088124]: ---"Object deleted from database" 153ms (09:23:50.869) Trace[441088124]: [524.683827ms] [524.683827ms] END I0516 09:23:51.492749 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.97.199.91"} I0516 09:23:51.722377 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.105.235.129"} I0516 09:23:51.722835 1 trace.go:236] Trace[2046474849]: "Create" accept:application/json,audit-id:cf5b73c9-d3a1-4645-937a-6237bc39fdc9,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (16-May-2026 09:23:51.084) (total time: 638ms): Trace[2046474849]: [638.40366ms] [638.40366ms] END I0516 09:23:51.960327 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.140.154"} I0516 09:23:51.960676 1 trace.go:236] Trace[1571596064]: "Create" accept:application/json,audit-id:c78a5f2d-c3b2-4103-b54f-66a262244406,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (16-May-2026 09:23:51.084) (total time: 876ms): Trace[1571596064]: [876.052336ms] [876.052336ms] END I0516 09:23:52.189395 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.103.50.45"} I0516 09:23:52.189617 1 trace.go:236] Trace[1777279238]: "Create" accept:application/json,audit-id:301c21f7-0344-4eb3-b924-b5fbf83c4bfb,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (16-May-2026 09:23:51.085) (total time: 1104ms): Trace[1777279238]: [1.104369299s] [1.104369299s] END I0516 09:23:52.377106 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.97.95.70"} I0516 09:23:52.377342 1 trace.go:236] Trace[645992641]: "Create" accept:application/json,audit-id:f3c20e85-8883-45df-847b-802c842bddf7,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (16-May-2026 09:23:51.085) (total time: 1291ms): Trace[645992641]: [1.291834476s] [1.291834476s] END I0516 09:23:52.747945 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.110.237.239"} I0516 09:23:52.748206 1 trace.go:236] Trace[425057097]: "Create" accept:application/json,audit-id:af67365a-9f06-4c46-835f-3356c8f16a5d,client:199.204.45.223,protocol:HTTP/2.0,resource:services,scope:resource,url:/api/v1/namespaces/monitoring/services,user-agent:Helm/3.11.2,verb:POST (16-May-2026 09:23:51.085) (total time: 1662ms): Trace[425057097]: [1.662719005s] [1.662719005s] END I0516 09:23:52.984426 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0516 09:23:53.221131 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0516 09:23:53.431925 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0516 09:23:53.691213 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0516 09:23:54.498420 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0516 09:23:54.874934 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.874961 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876011 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876039 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876174 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876201 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876313 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876333 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876456 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876472 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876478 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876493 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.876601 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.876653 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.877214 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.877269 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.877284 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.877329 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.877852 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.877875 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.878032 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.878121 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.878361 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.878415 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.878706 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.878730 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.878932 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.878956 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.878986 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.879009 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused W0516 09:23:54.880897 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused E0516 09:23:54.880921 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.103.50.45:443: connect: connection refused I0516 09:23:55.710864 1 trace.go:236] Trace[17674313]: "Patch" accept:application/json, */*,audit-id:fd4f4a04-9f3a-45c9-8133-3d2bd23934da,client:199.204.45.223,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/ingress-nginx/events/ingress-nginx-controller-z6d5s.18b00112f3959b50,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PATCH (16-May-2026 09:23:54.949) (total time: 761ms): Trace[17674313]: ["GuaranteedUpdate etcd3" audit-id:fd4f4a04-9f3a-45c9-8133-3d2bd23934da,key:/events/ingress-nginx/ingress-nginx-controller-z6d5s.18b00112f3959b50,type:*core.Event,resource:events 761ms (09:23:54.949) Trace[17674313]: ---"initial value restored" 345ms (09:23:55.294) Trace[17674313]: ---"Txn call completed" 414ms (09:23:55.710)] Trace[17674313]: ---"Object stored in database" 415ms (09:23:55.710) Trace[17674313]: [761.173894ms] [761.173894ms] END I0516 09:23:56.318319 1 trace.go:236] Trace[785273373]: "Patch" accept:application/json, */*,audit-id:6a558427-18d8-497f-8070-e2ce7aced9d7,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/grafana-tls,user-agent:cert-manager-certificates-issuing/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:APPLY (16-May-2026 09:23:55.672) (total time: 645ms): Trace[785273373]: ["GuaranteedUpdate etcd3" audit-id:6a558427-18d8-497f-8070-e2ce7aced9d7,key:/secrets/monitoring/grafana-tls,type:*core.Secret,resource:secrets 645ms (09:23:55.672) Trace[785273373]: ---"initial value restored" 421ms (09:23:56.094) Trace[785273373]: ---"Txn call completed" 221ms (09:23:56.317)] Trace[785273373]: ---"Object stored in database" 222ms (09:23:56.317) Trace[785273373]: [645.802206ms] [645.802206ms] END I0516 09:23:56.318713 1 trace.go:236] Trace[214845688]: "Patch" accept:application/json, */*,audit-id:f1d67a5f-08e3-4385-a8e8-729021877a81,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/alertmanager-tls,user-agent:cert-manager-certificates-issuing/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:APPLY (16-May-2026 09:23:55.667) (total time: 650ms): Trace[214845688]: ["GuaranteedUpdate etcd3" audit-id:f1d67a5f-08e3-4385-a8e8-729021877a81,key:/secrets/monitoring/alertmanager-tls,type:*core.Secret,resource:secrets 650ms (09:23:55.667) Trace[214845688]: ---"initial value restored" 427ms (09:23:56.094) Trace[214845688]: ---"Txn call completed" 220ms (09:23:56.318)] Trace[214845688]: ---"Object stored in database" 221ms (09:23:56.318) Trace[214845688]: [650.892342ms] [650.892342ms] END I0516 09:23:56.319982 1 trace.go:236] Trace[2057851174]: "Patch" accept:application/json, */*,audit-id:0b4e2102-d392-4cdd-9c73-e74b3783c044,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/prometheus-tls,user-agent:cert-manager-certificates-issuing/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:APPLY (16-May-2026 09:23:55.672) (total time: 647ms): Trace[2057851174]: ["GuaranteedUpdate etcd3" audit-id:0b4e2102-d392-4cdd-9c73-e74b3783c044,key:/secrets/monitoring/prometheus-tls,type:*core.Secret,resource:secrets 647ms (09:23:55.672) Trace[2057851174]: ---"initial value restored" 420ms (09:23:56.093) Trace[2057851174]: ---"Txn call completed" 223ms (09:23:56.319)] Trace[2057851174]: ---"Object stored in database" 224ms (09:23:56.319) Trace[2057851174]: [647.474553ms] [647.474553ms] END I0516 09:23:57.328598 1 trace.go:236] Trace[2021977426]: "Delete" accept:application/json, */*,audit-id:46486aee-c827-4800-90dc-7581fc7b0d21,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/grafana-tls-hjrzh,user-agent:cert-manager-certificates-key-manager/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:DELETE (16-May-2026 09:23:56.697) (total time: 630ms): Trace[2021977426]: ---"Object deleted from database" 630ms (09:23:57.328) Trace[2021977426]: [630.609457ms] [630.609457ms] END I0516 09:23:57.386537 1 trace.go:236] Trace[1109840754]: "Delete" accept:application/json, */*,audit-id:ae0315ca-5a5e-47dc-99cb-808769058213,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/alertmanager-tls-j8sgp,user-agent:cert-manager-certificates-key-manager/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:DELETE (16-May-2026 09:23:56.698) (total time: 688ms): Trace[1109840754]: ---"Object deleted from database" 688ms (09:23:57.386) Trace[1109840754]: [688.454476ms] [688.454476ms] END I0516 09:23:57.386577 1 trace.go:236] Trace[695410794]: "Delete" accept:application/json, */*,audit-id:bd304186-8161-456a-be86-59440bfcc1ca,client:10.0.0.110,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/monitoring/secrets/prometheus-tls-57wtf,user-agent:cert-manager-certificates-key-manager/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:DELETE (16-May-2026 09:23:56.699) (total time: 687ms): Trace[695410794]: ---"Object deleted from database" 686ms (09:23:57.386) Trace[695410794]: [687.324806ms] [687.324806ms] END I0516 09:23:58.490056 1 trace.go:236] Trace[659309179]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:28330936-70f2-45aa-afef-2f95ddb0539f,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (16-May-2026 09:23:57.927) (total time: 562ms): Trace[659309179]: ["GuaranteedUpdate etcd3" audit-id:28330936-70f2-45aa-afef-2f95ddb0539f,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 562ms (09:23:57.927) Trace[659309179]: ---"Txn call completed" 562ms (09:23:58.489)] Trace[659309179]: [562.966317ms] [562.966317ms] END I0516 09:23:58.490742 1 trace.go:236] Trace[1189260654]: "Update" accept:application/json, */*,audit-id:60ed74f3-dbd5-4b1c-89b0-4c37eb6915aa,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:23:57.919) (total time: 570ms): Trace[1189260654]: ["GuaranteedUpdate etcd3" audit-id:60ed74f3-dbd5-4b1c-89b0-4c37eb6915aa,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 570ms (09:23:57.919) Trace[1189260654]: ---"Txn call completed" 569ms (09:23:58.490)] Trace[1189260654]: [570.97758ms] [570.97758ms] END I0516 09:24:08.682516 1 trace.go:236] Trace[487067199]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7d5afe4c-741b-413d-aa9d-cd248545f324,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (16-May-2026 09:24:07.848) (total time: 833ms): Trace[487067199]: ["GuaranteedUpdate etcd3" audit-id:7d5afe4c-741b-413d-aa9d-cd248545f324,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 833ms (09:24:07.849) Trace[487067199]: ---"Txn call completed" 832ms (09:24:08.682)] Trace[487067199]: [833.462433ms] [833.462433ms] END I0516 09:24:08.683328 1 trace.go:236] Trace[1122546496]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:33dd6097-1aec-41ba-86a5-0be0028624f9,client:10.0.0.192,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:07.758) (total time: 925ms): Trace[1122546496]: ["GuaranteedUpdate etcd3" audit-id:33dd6097-1aec-41ba-86a5-0be0028624f9,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 925ms (09:24:07.758) Trace[1122546496]: ---"Txn call completed" 924ms (09:24:08.683)] Trace[1122546496]: [925.081531ms] [925.081531ms] END I0516 09:24:08.683435 1 trace.go:236] Trace[621494295]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ae4ac234-07e0-40ee-bf03-f7315ef76a86,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:07.751) (total time: 931ms): Trace[621494295]: ["GuaranteedUpdate etcd3" audit-id:ae4ac234-07e0-40ee-bf03-f7315ef76a86,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 931ms (09:24:07.751) Trace[621494295]: ---"Txn call completed" 930ms (09:24:08.683)] Trace[621494295]: [931.946614ms] [931.946614ms] END I0516 09:24:08.683999 1 trace.go:236] Trace[1709244222]: "Get" accept:application/json, */*,audit-id:67789a1d-cc15-46c2-9ee3-ce71df81bf8b,client:10.0.0.68,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-77ba30d2-15ee-4c87-94ff-a9abfc0ec012,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:07.863) (total time: 820ms): Trace[1709244222]: ---"About to write a response" 819ms (09:24:08.683) Trace[1709244222]: [820.042059ms] [820.042059ms] END I0516 09:24:09.271874 1 trace.go:236] Trace[1085102005]: "Get" accept:application/json, */*,audit-id:35bd061a-1bb4-4f90-b5dc-34fcbf068e35,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:08.257) (total time: 1013ms): Trace[1085102005]: ---"About to write a response" 1013ms (09:24:09.271) Trace[1085102005]: [1.013903774s] [1.013903774s] END I0516 09:24:09.272172 1 trace.go:236] Trace[1682339809]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d78196fc-51ca-46ec-a652-fd928fa34901,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (16-May-2026 09:24:07.986) (total time: 1286ms): Trace[1682339809]: ---"About to write a response" 1286ms (09:24:09.272) Trace[1682339809]: [1.286082646s] [1.286082646s] END I0516 09:24:09.272592 1 trace.go:236] Trace[1015034438]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ab74a9eb-4743-48ec-bd62-d7d727fadc65,client:10.0.0.192,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:07.933) (total time: 1338ms): Trace[1015034438]: ---"About to write a response" 1338ms (09:24:09.272) Trace[1015034438]: [1.338873069s] [1.338873069s] END I0516 09:24:09.272657 1 trace.go:236] Trace[1044919548]: "Get" accept:application/json, */*,audit-id:8ba5a877-6fbd-4c57-a420-b70ac63b6001,client:10.0.0.68,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-9e2a1511-0a30-4730-b62a-e5a5af729131,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:08.350) (total time: 921ms): Trace[1044919548]: ---"About to write a response" 920ms (09:24:09.271) Trace[1044919548]: [921.70972ms] [921.70972ms] END I0516 09:24:09.272920 1 trace.go:236] Trace[1393464900]: "Get" accept:application/json, */*,audit-id:574585a4-df3a-4df3-84ed-0e8299ae5789,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:08.218) (total time: 1054ms): Trace[1393464900]: ---"About to write a response" 1054ms (09:24:09.272) Trace[1393464900]: [1.054577506s] [1.054577506s] END I0516 09:24:09.273246 1 trace.go:236] Trace[1863175446]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:3290a67b-2692-420f-8046-727f60307994,client:199.204.45.223,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (16-May-2026 09:24:08.269) (total time: 1004ms): Trace[1863175446]: ["Create etcd3" audit-id:3290a67b-2692-420f-8046-727f60307994,key:/events/monitoring/kube-prometheus-stack-grafana-5fd7476558-jvlz4.18b0017378a12860,type:*core.Event,resource:events 1003ms (09:24:08.269) Trace[1863175446]: ---"Txn call succeeded" 1002ms (09:24:09.272)] Trace[1863175446]: [1.004040144s] [1.004040144s] END I0516 09:24:09.919349 1 trace.go:236] Trace[1237066400]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b1aace25-274f-4100-a309-b318dd922700,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (16-May-2026 09:24:09.274) (total time: 644ms): Trace[1237066400]: ["GuaranteedUpdate etcd3" audit-id:b1aace25-274f-4100-a309-b318dd922700,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 644ms (09:24:09.274) Trace[1237066400]: ---"Txn call completed" 643ms (09:24:09.919)] Trace[1237066400]: [644.642432ms] [644.642432ms] END I0516 09:24:11.076623 1 trace.go:236] Trace[730163231]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c10c5b8a-a746-4524-b1f6-ef1f2c4f603b,client:199.204.45.223,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (16-May-2026 09:24:09.274) (total time: 1801ms): Trace[730163231]: ["Create etcd3" audit-id:c10c5b8a-a746-4524-b1f6-ef1f2c4f603b,key:/events/monitoring/kube-prometheus-stack-grafana-5fd7476558-jvlz4.18b0017378c23fa0,type:*core.Event,resource:events 1801ms (09:24:09.274) Trace[730163231]: ---"Txn call succeeded" 1801ms (09:24:11.076)] Trace[730163231]: [1.801993888s] [1.801993888s] END I0516 09:24:11.076699 1 trace.go:236] Trace[1040764050]: "Update" accept:application/json, */*,audit-id:334f4248-4eec-4cad-893e-532759b2e110,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (16-May-2026 09:24:09.276) (total time: 1800ms): Trace[1040764050]: ["GuaranteedUpdate etcd3" audit-id:334f4248-4eec-4cad-893e-532759b2e110,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1800ms (09:24:09.276) Trace[1040764050]: ---"Txn call completed" 1799ms (09:24:11.076)] Trace[1040764050]: [1.800166482s] [1.800166482s] END I0516 09:24:11.076817 1 trace.go:236] Trace[206460470]: "Update" accept:application/json, */*,audit-id:6497ac1c-46cd-4fc5-bd7d-aa46571d7aa2,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:09.276) (total time: 1800ms): Trace[206460470]: ["GuaranteedUpdate etcd3" audit-id:6497ac1c-46cd-4fc5-bd7d-aa46571d7aa2,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1799ms (09:24:09.277) Trace[206460470]: ---"Txn call completed" 1799ms (09:24:11.076)] Trace[206460470]: [1.800045791s] [1.800045791s] END I0516 09:24:11.076856 1 trace.go:236] Trace[1688015361]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:bcf21845-ec6a-4dd0-80c7-9eb819680acc,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:09.277) (total time: 1799ms): Trace[1688015361]: ["GuaranteedUpdate etcd3" audit-id:bcf21845-ec6a-4dd0-80c7-9eb819680acc,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 1799ms (09:24:09.277) Trace[1688015361]: ---"Txn call completed" 1798ms (09:24:11.076)] Trace[1688015361]: [1.799136803s] [1.799136803s] END I0516 09:24:11.077022 1 trace.go:236] Trace[485217394]: "Update" accept:application/json, */*,audit-id:30b0f4c0-291c-483f-8340-bd1f11c086bd,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (16-May-2026 09:24:09.275) (total time: 1801ms): Trace[485217394]: ["GuaranteedUpdate etcd3" audit-id:30b0f4c0-291c-483f-8340-bd1f11c086bd,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1801ms (09:24:09.275) Trace[485217394]: ---"Txn call completed" 1800ms (09:24:11.076)] Trace[485217394]: [1.801525385s] [1.801525385s] END I0516 09:24:11.077375 1 trace.go:236] Trace[2089989893]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5c8e98c9-b5fa-434a-b525-48ffbd364e22,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (16-May-2026 09:24:09.275) (total time: 1801ms): Trace[2089989893]: ["GuaranteedUpdate etcd3" audit-id:5c8e98c9-b5fa-434a-b525-48ffbd364e22,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1801ms (09:24:09.275) Trace[2089989893]: ---"Txn call completed" 1801ms (09:24:11.077)] Trace[2089989893]: [1.801788488s] [1.801788488s] END I0516 09:24:11.541317 1 trace.go:236] Trace[497857068]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f1ebbaf6-6e4c-4d64-9b08-dcbe295f8f5f,client:10.0.0.244,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:10.685) (total time: 855ms): Trace[497857068]: ["GuaranteedUpdate etcd3" audit-id:f1ebbaf6-6e4c-4d64-9b08-dcbe295f8f5f,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 855ms (09:24:10.686) Trace[497857068]: ---"Txn call completed" 854ms (09:24:11.541)] Trace[497857068]: [855.37884ms] [855.37884ms] END I0516 09:24:11.541968 1 trace.go:236] Trace[568972824]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:82f726bb-e572-4af3-9e40-85f884130f12,client:10.0.0.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:09.980) (total time: 1560ms): Trace[568972824]: ["GuaranteedUpdate etcd3" audit-id:82f726bb-e572-4af3-9e40-85f884130f12,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1560ms (09:24:09.980) Trace[568972824]: ---"Txn call completed" 1559ms (09:24:11.541)] Trace[568972824]: [1.56083036s] [1.56083036s] END I0516 09:24:11.543793 1 trace.go:236] Trace[840739022]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:53c5040c-c57f-44ff-8a62-974ad08649ac,client:199.204.45.223,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (16-May-2026 09:24:10.760) (total time: 782ms): Trace[840739022]: ["GuaranteedUpdate etcd3" audit-id:53c5040c-c57f-44ff-8a62-974ad08649ac,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 782ms (09:24:10.761) Trace[840739022]: ---"Txn call completed" 781ms (09:24:11.543)] Trace[840739022]: [782.914317ms] [782.914317ms] END I0516 09:24:11.544218 1 trace.go:236] Trace[764241659]: "Get" accept:application/json, */*,audit-id:2d9f08c3-8dd7-4bd6-9461-621dad6dfda9,client:10.0.0.68,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-9e2a1511-0a30-4730-b62a-e5a5af729131,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:10.274) (total time: 1269ms): Trace[764241659]: ---"About to write a response" 1268ms (09:24:11.543) Trace[764241659]: [1.269332521s] [1.269332521s] END I0516 09:24:11.544271 1 trace.go:236] Trace[329098778]: "Get" accept:application/json, */*,audit-id:fe7451ed-bdc5-471f-94bf-df3b2fe621a3,client:10.0.0.68,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-77ba30d2-15ee-4c87-94ff-a9abfc0ec012,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:09.686) (total time: 1857ms): Trace[329098778]: ---"About to write a response" 1857ms (09:24:11.543) Trace[329098778]: [1.857710509s] [1.857710509s] END I0516 09:24:11.544353 1 trace.go:236] Trace[500179968]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:94d86c78-c9df-4439-9e60-15d381439380,client:10.0.0.192,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (16-May-2026 09:24:10.685) (total time: 857ms): Trace[500179968]: ["GuaranteedUpdate etcd3" audit-id:94d86c78-c9df-4439-9e60-15d381439380,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 858ms (09:24:10.686) Trace[500179968]: ---"Txn call completed" 856ms (09:24:11.543)] Trace[500179968]: [857.829054ms] [857.829054ms] END I0516 09:24:11.668109 1 trace.go:236] Trace[977263868]: "Get" accept:application/json, */*,audit-id:1f141b64-ba0e-4f1d-85ef-eaa07b35cdf8,client:10.0.0.192,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (16-May-2026 09:24:09.274) (total time: 2393ms): Trace[977263868]: ---"About to write a response" 2389ms (09:24:11.664) Trace[977263868]: [2.393314302s] [2.393314302s] END I0516 09:24:19.214695 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0516 09:24:19.418849 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.98.56.254"} I0516 09:24:35.259157 1 trace.go:236] Trace[450432807]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ac5fde1a-f2df-4083-aa93-560c2da83dae,client:199.204.45.223,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/monitoring/deployments/kube-prometheus-stack-grafana/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (16-May-2026 09:24:34.700) (total time: 558ms): Trace[450432807]: ["GuaranteedUpdate etcd3" audit-id:ac5fde1a-f2df-4083-aa93-560c2da83dae,key:/deployments/monitoring/kube-prometheus-stack-grafana,type:*apps.Deployment,resource:deployments.apps 558ms (09:24:34.701) Trace[450432807]: ---"Txn call completed" 550ms (09:24:35.258)] Trace[450432807]: [558.609061ms] [558.609061ms] END I0516 09:24:35.338919 1 trace.go:236] Trace[619770558]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:42433fcd-350c-42ba-bb87-8165b01fe963,client:10.0.0.244,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/openstack/secrets/rabbitmq-keystone-default-user,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (16-May-2026 09:24:34.736) (total time: 602ms): Trace[619770558]: ---"About to write a response" 602ms (09:24:35.338) Trace[619770558]: [602.664484ms] [602.664484ms] END I0516 09:24:35.338971 1 trace.go:236] Trace[986023028]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e6331493-3a40-46c2-a023-fa18e669105a,client:199.204.45.223,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (16-May-2026 09:24:34.796) (total time: 542ms): Trace[986023028]: ---"About to write a response" 542ms (09:24:35.338) Trace[986023028]: [542.478643ms] [542.478643ms] END I0516 09:25:09.263218 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.110.46.65"} I0516 09:25:09.277631 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0516 09:28:01.345413 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.99.121.50"} I0516 09:28:01.360367 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.111.204.149"}