I0407 09:36:33.106620 1 options.go:220] external host was not specified, using 199.204.45.229 I0407 09:36:33.109423 1 server.go:148] Version: v1.28.13 I0407 09:36:33.109449 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0407 09:36:33.633840 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0407 09:36:33.649688 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0407 09:36:33.649712 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0407 09:36:33.649982 1 instance.go:298] Using reconciler: lease I0407 09:36:33.695931 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0407 09:36:33.695967 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0407 09:36:33.923773 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0407 09:36:33.924027 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0407 09:36:34.348459 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0407 09:36:34.368457 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0407 09:36:34.368487 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.368493 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.369010 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0407 09:36:34.369025 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0407 09:36:34.369954 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0407 09:36:34.370744 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0407 09:36:34.370760 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0407 09:36:34.370765 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0407 09:36:34.372190 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0407 09:36:34.372206 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0407 09:36:34.373097 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0407 09:36:34.373113 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.373118 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.373750 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0407 09:36:34.373767 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.373801 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0407 09:36:34.374362 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0407 09:36:34.376087 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0407 09:36:34.376104 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.376109 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.376545 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0407 09:36:34.376559 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.376564 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.377361 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0407 09:36:34.377376 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0407 09:36:34.379075 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0407 09:36:34.379093 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.379099 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.379669 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0407 09:36:34.379688 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.379693 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.381770 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0407 09:36:34.381787 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.381792 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.383369 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0407 09:36:34.384507 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0407 09:36:34.384524 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.384529 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.388162 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0407 09:36:34.388179 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0407 09:36:34.388184 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0407 09:36:34.389274 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0407 09:36:34.389290 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0407 09:36:34.389295 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0407 09:36:34.390109 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0407 09:36:34.390125 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0407 09:36:34.421941 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0407 09:36:34.421963 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0407 09:36:34.808752 1 secure_serving.go:213] Serving securely on [::]:6443 I0407 09:36:34.808850 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0407 09:36:34.808970 1 system_namespaces_controller.go:67] Starting system namespaces controller I0407 09:36:34.809008 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0407 09:36:34.809037 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0407 09:36:34.809031 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0407 09:36:34.809106 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0407 09:36:34.809135 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0407 09:36:34.809312 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:36:34.808874 1 aggregator.go:164] waiting for initial CRD sync... I0407 09:36:34.808892 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:36:34.809178 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0407 09:36:34.809395 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0407 09:36:34.809450 1 controller.go:78] Starting OpenAPI AggregationController I0407 09:36:34.809472 1 available_controller.go:423] Starting AvailableConditionController I0407 09:36:34.809475 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0407 09:36:34.809480 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0407 09:36:34.809493 1 controller.go:80] Starting OpenAPI V3 AggregationController I0407 09:36:34.809545 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0407 09:36:34.810406 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0407 09:36:34.809456 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0407 09:36:34.810264 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0407 09:36:34.810534 1 controller.go:116] Starting legacy_token_tracking_controller I0407 09:36:34.810543 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0407 09:36:34.810569 1 gc_controller.go:78] Starting apiserver lease garbage collector I0407 09:36:34.810293 1 controller.go:134] Starting OpenAPI controller I0407 09:36:34.810315 1 controller.go:85] Starting OpenAPI V3 controller I0407 09:36:34.810326 1 naming_controller.go:291] Starting NamingConditionController I0407 09:36:34.810336 1 establishing_controller.go:76] Starting EstablishingController I0407 09:36:34.810343 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0407 09:36:34.810352 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0407 09:36:34.810358 1 crd_finalizer.go:266] Starting CRDFinalizer I0407 09:36:34.808923 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0407 09:36:34.811417 1 gc_controller.go:78] Starting apiserver lease garbage collector E0407 09:36:34.902380 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0407 09:36:34.909503 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0407 09:36:34.909562 1 apf_controller.go:379] Running API Priority and Fairness config worker I0407 09:36:34.909579 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0407 09:36:34.909751 1 cache.go:39] Caches are synced for AvailableConditionController controller I0407 09:36:34.909751 1 shared_informer.go:318] Caches are synced for crd-autoregister I0407 09:36:34.909804 1 aggregator.go:166] initial CRD sync complete... I0407 09:36:34.909818 1 autoregister_controller.go:141] Starting autoregister controller I0407 09:36:34.909827 1 cache.go:32] Waiting for caches to sync for autoregister controller I0407 09:36:34.909840 1 cache.go:39] Caches are synced for autoregister controller I0407 09:36:34.910559 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0407 09:36:34.910616 1 shared_informer.go:318] Caches are synced for configmaps I0407 09:36:34.912632 1 controller.go:624] quota admission added evaluator for: namespaces I0407 09:36:34.936576 1 shared_informer.go:318] Caches are synced for node_authorizer I0407 09:36:35.106617 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0407 09:36:35.818877 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0407 09:36:35.823628 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0407 09:36:35.823653 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0407 09:36:36.396877 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0407 09:36:36.450394 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0407 09:36:36.530076 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0407 09:36:36.540687 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.229] I0407 09:36:36.542018 1 controller.go:624] quota admission added evaluator for: endpoints I0407 09:36:36.545712 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0407 09:36:37.932849 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0407 09:36:37.942526 1 controller.go:624] quota admission added evaluator for: deployments.apps I0407 09:36:38.070495 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0407 09:36:38.267812 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0407 09:36:42.341217 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0407 09:36:43.353112 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0407 09:36:51.500059 1 trace.go:236] Trace[334953475]: "Get" accept:application/json,audit-id:69f48d73-9a13-4569-b37a-7201420dae1e,client:199.204.45.229,protocol:HTTP/1.1,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (07-Apr-2026 09:36:50.963) (total time: 536ms): Trace[334953475]: ---"About to write a response" 535ms (09:36:51.499) Trace[334953475]: [536.15328ms] [536.15328ms] END I0407 09:37:05.173292 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:37:05.179143 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:37:05.196659 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:37:05.216819 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:37:05.262280 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0407 09:37:05.288811 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:37:05.288873 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:37:05.326463 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:37:05.358836 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0407 09:37:05.358929 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0407 09:37:05.390741 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:37:05.390805 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:37:05.454492 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:37:05.454607 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:37:05.478870 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:37:05.592310 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:05.665936 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:05.833093 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0407 09:37:05.833217 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0407 09:37:05.863019 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:05.927684 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:05.937207 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:06.556582 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:06.693520 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0407 09:37:11.818982 1 trace.go:236] Trace[251633211]: "Update" accept:application/json, */*,audit-id:6fa97aae-b69f-4d81-965d-3818a5f5fd47,client:199.204.45.229,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (07-Apr-2026 09:37:11.115) (total time: 703ms): Trace[251633211]: ---"Conversion done" 26ms (09:37:11.144) Trace[251633211]: ["GuaranteedUpdate etcd3" audit-id:6fa97aae-b69f-4d81-965d-3818a5f5fd47,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 673ms (09:37:11.145) Trace[251633211]: ---"Txn call completed" 634ms (09:37:11.785)] Trace[251633211]: ---"Writing http response done" 32ms (09:37:11.818) Trace[251633211]: [703.87683ms] [703.87683ms] END I0407 09:37:13.064793 1 controller.go:624] quota admission added evaluator for: jobs.batch I0407 09:37:13.872575 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:37:13.883224 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:37:14.068757 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:37:14.351637 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:37:14.480670 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:37:14.667190 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0407 09:37:14.868105 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:37:15.113318 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:37:17.355745 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:37:18.050050 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0407 09:37:18.359388 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0407 09:37:19.268118 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0407 09:37:19.268159 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0407 09:37:22.327992 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0407 09:37:30.310355 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.105.24.216"} W0407 09:37:30.335925 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.24.216:9443: connect: connection refused E0407 09:37:30.335961 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.24.216:9443: connect: connection refused I0407 09:37:44.534784 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0407 09:37:44.549444 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:44.578860 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:44.583994 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.7.7"} I0407 09:37:44.596899 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.101.230.221"} I0407 09:37:44.602073 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0407 09:37:44.720935 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0407 09:37:44.787746 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager W0407 09:37:54.790819 1 dispatcher.go:225] Failed calling webhook, failing closed webhook.cert-manager.io: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/mutate?timeout=10s": dial tcp 10.108.7.7:443: connect: connection refused I0407 09:37:59.789504 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0407 09:38:04.717181 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0407 09:38:19.175987 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.111.175.195"} I0407 09:38:19.182704 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.111.158.24"} I0407 09:38:19.191559 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.101.86.11"} I0407 09:38:19.197405 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.106.151.94"} I0407 09:38:26.105543 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.121028 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.144654 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.166347 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.194328 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.223043 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.238988 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.301216 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.325778 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.347337 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0407 09:38:26.364719 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.385335 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:26.406082 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:27.621421 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0407 09:38:31.645447 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0407 09:38:31.699015 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.105.49.161"} I0407 09:38:31.734144 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0407 09:38:34.135475 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:38:34.183551 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:38:34.882198 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0407 09:38:34.882270 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0407 09:38:34.883504 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0407 09:38:42.116000 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0407 09:38:44.227586 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.100.218.237"} I0407 09:38:44.506080 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0407 09:38:44.660830 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.106.252.93"} I0407 09:38:44.680347 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.98.197.180"} I0407 09:38:45.435372 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0407 09:40:04.943017 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.101.249.51"} I0407 09:40:07.354452 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.106.9.81"} I0407 09:40:08.207097 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.99.185.79"} I0407 09:40:15.837093 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.111.120.60"} I0407 09:40:15.844531 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.104.202.244"} I0407 09:42:39.711214 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0407 09:42:41.679402 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:41.689771 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:41.709102 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0407 09:42:41.718607 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:41.729417 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:41.756713 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:41.832708 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0407 09:42:53.911020 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0407 09:43:32.944267 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0407 09:43:47.744026 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:43:47.929634 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:47.963753 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:47.982298 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:48.200713 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:43:48.628576 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:48.736199 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:48.858649 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0407 09:43:48.878213 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:43:49.007655 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0407 09:44:13.991415 1 trace.go:236] Trace[1927913973]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:2803e548-326a-44e9-b621-726db91becef,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:13.215) (total time: 776ms): Trace[1927913973]: ["GuaranteedUpdate etcd3" audit-id:2803e548-326a-44e9-b621-726db91becef,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 776ms (09:44:13.215) Trace[1927913973]: ---"Txn call completed" 775ms (09:44:13.991)] Trace[1927913973]: [776.338698ms] [776.338698ms] END I0407 09:44:13.994079 1 trace.go:236] Trace[57107569]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9483dd1f-d781-4363-994d-87f261935a5c,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:13.264) (total time: 729ms): Trace[57107569]: ["GuaranteedUpdate etcd3" audit-id:9483dd1f-d781-4363-994d-87f261935a5c,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 729ms (09:44:13.264) Trace[57107569]: ---"Txn call completed" 729ms (09:44:13.993)] Trace[57107569]: [729.90302ms] [729.90302ms] END I0407 09:44:13.998435 1 trace.go:236] Trace[2060741233]: "Get" accept:application/json, */*,audit-id:7e0089e6-c4a0-4e95-91d7-fbe35afd836c,client:10.0.0.135,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0/log,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:CONNECT (07-Apr-2026 09:44:13.077) (total time: 920ms): Trace[2060741233]: ---"About to write a response" 916ms (09:44:13.994) Trace[2060741233]: [920.624687ms] [920.624687ms] END I0407 09:44:21.139876 1 trace.go:236] Trace[1805078095]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3021ddbe-17a5-4733-84e1-648ab1901c09,client:199.204.45.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (07-Apr-2026 09:44:18.020) (total time: 3119ms): Trace[1805078095]: ---"About to write a response" 3119ms (09:44:21.139) Trace[1805078095]: [3.119684245s] [3.119684245s] END I0407 09:44:21.139963 1 trace.go:236] Trace[854929501]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:59f06c25-035c-443c-82e1-3045e0f4f803,client:199.204.45.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (07-Apr-2026 09:44:18.017) (total time: 3122ms): Trace[854929501]: ["GuaranteedUpdate etcd3" audit-id:59f06c25-035c-443c-82e1-3045e0f4f803,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 3121ms (09:44:18.018) Trace[854929501]: ---"Txn call completed" 3121ms (09:44:21.139)] Trace[854929501]: [3.122047726s] [3.122047726s] END I0407 09:44:21.158059 1 trace.go:236] Trace[715622905]: "Update" accept:application/json, */*,audit-id:26e07be2-07d9-4dfb-9f78-19528139f54d,client:10.0.0.98,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:18.020) (total time: 3137ms): Trace[715622905]: ["GuaranteedUpdate etcd3" audit-id:26e07be2-07d9-4dfb-9f78-19528139f54d,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 3136ms (09:44:18.021) Trace[715622905]: ---"Txn call completed" 3136ms (09:44:21.157)] Trace[715622905]: [3.137160668s] [3.137160668s] END I0407 09:44:21.202889 1 trace.go:236] Trace[657843903]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:460c3cb6-678b-4baa-a3ef-f5f3bedbb443,client:199.204.45.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (07-Apr-2026 09:44:19.239) (total time: 1963ms): Trace[657843903]: ["GuaranteedUpdate etcd3" audit-id:460c3cb6-678b-4baa-a3ef-f5f3bedbb443,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1963ms (09:44:19.239) Trace[657843903]: ---"Txn call completed" 1962ms (09:44:21.202)] Trace[657843903]: [1.96344105s] [1.96344105s] END I0407 09:44:21.203031 1 trace.go:236] Trace[1186242390]: "Update" accept:application/json, */*,audit-id:f1b63b92-1be6-4105-956f-0ff583dfea7b,client:10.0.0.174,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:18.865) (total time: 2337ms): Trace[1186242390]: ["GuaranteedUpdate etcd3" audit-id:f1b63b92-1be6-4105-956f-0ff583dfea7b,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 2337ms (09:44:18.865) Trace[1186242390]: ---"Txn call completed" 2336ms (09:44:21.202)] Trace[1186242390]: [2.337278358s] [2.337278358s] END I0407 09:44:21.203278 1 trace.go:236] Trace[850244984]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:5375334a-2e3f-4a3d-84e3-b1999b716a22,client:10.0.0.135,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:20.006) (total time: 1196ms): Trace[850244984]: ["GuaranteedUpdate etcd3" audit-id:5375334a-2e3f-4a3d-84e3-b1999b716a22,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 1196ms (09:44:20.006) Trace[850244984]: ---"Txn call completed" 1195ms (09:44:21.203)] Trace[850244984]: [1.196426802s] [1.196426802s] END I0407 09:44:21.203108 1 trace.go:236] Trace[2144753504]: "Get" accept:application/json, */*,audit-id:4dbd0f0a-e1ee-4877-a375-b81ab4fdbb8c,client:199.204.45.229,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (07-Apr-2026 09:44:19.057) (total time: 2145ms): Trace[2144753504]: ---"About to write a response" 2145ms (09:44:21.202) Trace[2144753504]: [2.145739315s] [2.145739315s] END I0407 09:44:21.203060 1 trace.go:236] Trace[829178744]: "Get" accept:application/json, */*,audit-id:9fab1fc8-a10e-4953-ac72-0593b6840b8a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:18.020) (total time: 3182ms): Trace[829178744]: ---"About to write a response" 3182ms (09:44:21.202) Trace[829178744]: [3.18235705s] [3.18235705s] END I0407 09:44:21.203185 1 trace.go:236] Trace[1105788400]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:17e4241b-ba9e-4334-8d25-d9695760f0a9,client:10.0.0.224,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (07-Apr-2026 09:44:20.006) (total time: 1196ms): Trace[1105788400]: ["GuaranteedUpdate etcd3" audit-id:17e4241b-ba9e-4334-8d25-d9695760f0a9,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 1196ms (09:44:20.006) Trace[1105788400]: ---"Txn call completed" 1195ms (09:44:21.202)] Trace[1105788400]: [1.196662237s] [1.196662237s] END I0407 09:44:21.202930 1 trace.go:236] Trace[1179687707]: "Get" accept:application/json, */*,audit-id:e8cdd1c1-7736-471d-b151-0cd5d6a3932d,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:18.028) (total time: 3174ms): Trace[1179687707]: ---"About to write a response" 3174ms (09:44:21.202) Trace[1179687707]: [3.174288786s] [3.174288786s] END I0407 09:44:21.205551 1 trace.go:236] Trace[269526177]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cc38455a-bb31-4bf5-941b-54c150e1258a,client:10.0.0.135,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (07-Apr-2026 09:44:19.083) (total time: 2121ms): Trace[269526177]: ---"About to write a response" 2119ms (09:44:21.203) Trace[269526177]: [2.121967903s] [2.121967903s] END I0407 09:44:27.109754 1 trace.go:236] Trace[1679148384]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.229,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:44:26.546) (total time: 563ms): Trace[1679148384]: ---"initial value restored" 221ms (09:44:26.767) Trace[1679148384]: ---"Txn call completed" 303ms (09:44:27.109) Trace[1679148384]: [563.098463ms] [563.098463ms] END I0407 09:44:33.445865 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.111.12.87"} I0407 09:44:33.460812 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.98.187.40"} I0407 09:44:33.471742 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.107.161.14"} I0407 09:44:33.480549 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.100.57.164"} I0407 09:44:33.487413 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.102.189.72"} I0407 09:44:33.497874 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.106.145.44"} I0407 09:44:33.546360 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0407 09:44:33.561938 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0407 09:44:33.657323 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0407 09:44:33.672498 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0407 09:44:33.712617 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0407 09:44:33.732224 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.732252 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.734043 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.734082 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.735313 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.735356 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.735826 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.735860 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.735970 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.735998 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.735978 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.736014 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.736686 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.736720 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.736843 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.736865 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.737184 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.737212 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.737651 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.737758 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.737777 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.737866 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.738004 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.738063 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.738160 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.738176 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.739258 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.739285 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.740112 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.740149 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused W0407 09:44:33.741548 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused E0407 09:44:33.741585 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.187.40:443: connect: connection refused I0407 09:44:48.049015 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0407 09:44:48.274655 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.100.45.47"} I0407 09:44:54.526066 1 trace.go:236] Trace[1600994569]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d109fe1b-e0ff-461b-ace2-c474fa8ac3e4,client:199.204.45.229,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events/kube-prometheus-stack-prometheus-node-exporter-h2qzd.18a409f0e58f721f,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:44:53.848) (total time: 676ms): Trace[1600994569]: ["GuaranteedUpdate etcd3" audit-id:d109fe1b-e0ff-461b-ace2-c474fa8ac3e4,key:/events/monitoring/kube-prometheus-stack-prometheus-node-exporter-h2qzd.18a409f0e58f721f,type:*core.Event,resource:events 676ms (09:44:53.849) Trace[1600994569]: ---"initial value restored" 201ms (09:44:54.050) Trace[1600994569]: ---"Txn call completed" 474ms (09:44:54.525)] Trace[1600994569]: ---"Object stored in database" 474ms (09:44:54.525) Trace[1600994569]: [676.97367ms] [676.97367ms] END I0407 09:44:54.792528 1 trace.go:236] Trace[2102211861]: "Delete" accept:application/json, */*,audit-id:2c57eb9c-38c8-4a67-a52a-8ca96f30d0d1,client:10.0.0.1,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-1dec694b-6b34-4773-bc2b-cddf55a8c457,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (07-Apr-2026 09:44:53.845) (total time: 946ms): Trace[2102211861]: ---"Object deleted from database" 299ms (09:44:54.791) Trace[2102211861]: [946.953472ms] [946.953472ms] END I0407 09:44:55.183554 1 trace.go:236] Trace[1110865298]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9c016166-630c-4725-a164-16cd4bf0d48b,client:199.204.45.229,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events/kube-prometheus-stack-grafana-fc95fb499-p5lr8.18a409f24ed178df,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:44:54.528) (total time: 655ms): Trace[1110865298]: ["GuaranteedUpdate etcd3" audit-id:9c016166-630c-4725-a164-16cd4bf0d48b,key:/events/monitoring/kube-prometheus-stack-grafana-fc95fb499-p5lr8.18a409f24ed178df,type:*core.Event,resource:events 655ms (09:44:54.528) Trace[1110865298]: ---"initial value restored" 261ms (09:44:54.790) Trace[1110865298]: ---"Txn call completed" 391ms (09:44:55.183)] Trace[1110865298]: ---"Object stored in database" 392ms (09:44:55.183) Trace[1110865298]: [655.37367ms] [655.37367ms] END I0407 09:44:55.654009 1 trace.go:236] Trace[855676170]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5235661e-c47d-4444-9c18-165467cbc66c,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (07-Apr-2026 09:44:54.939) (total time: 714ms): Trace[855676170]: ["GuaranteedUpdate etcd3" audit-id:5235661e-c47d-4444-9c18-165467cbc66c,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 713ms (09:44:54.940) Trace[855676170]: ---"Txn call completed" 712ms (09:44:55.653)] Trace[855676170]: [714.178373ms] [714.178373ms] END I0407 09:44:56.455138 1 trace.go:236] Trace[1835533192]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:bdb769c0-aba5-4b24-95e6-f7cb56183843,client:199.204.45.229,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:persistent-volume-binder,verb:PUT (07-Apr-2026 09:44:55.894) (total time: 561ms): Trace[1835533192]: ["GuaranteedUpdate etcd3" audit-id:bdb769c0-aba5-4b24-95e6-f7cb56183843,key:/persistentvolumeclaims/openstack/persistence-rabbitmq-keystone-server-0,type:*core.PersistentVolumeClaim,resource:persistentvolumeclaims 560ms (09:44:55.894) Trace[1835533192]: ---"Txn call completed" 559ms (09:44:56.454)] Trace[1835533192]: [561.045441ms] [561.045441ms] END I0407 09:44:56.811459 1 trace.go:236] Trace[2082211446]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:76ac0c3b-b770-4088-b032-a7f15543a25b,client:199.204.45.229,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events/kube-prometheus-stack-prometheus-node-exporter-h2qzd.18a409eef8519f1e,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:44:56.007) (total time: 803ms): Trace[2082211446]: ["GuaranteedUpdate etcd3" audit-id:76ac0c3b-b770-4088-b032-a7f15543a25b,key:/events/monitoring/kube-prometheus-stack-prometheus-node-exporter-h2qzd.18a409eef8519f1e,type:*core.Event,resource:events 803ms (09:44:56.007) Trace[2082211446]: ---"initial value restored" 447ms (09:44:56.455) Trace[2082211446]: ---"Txn call completed" 353ms (09:44:56.810)] Trace[2082211446]: ---"Object stored in database" 354ms (09:44:56.810) Trace[2082211446]: [803.615171ms] [803.615171ms] END I0407 09:44:57.393911 1 trace.go:236] Trace[1338555615]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:64b34ce0-3e9f-4e77-b12e-b52928be075a,client:199.204.45.229,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (07-Apr-2026 09:44:56.813) (total time: 580ms): Trace[1338555615]: ["Create etcd3" audit-id:64b34ce0-3e9f-4e77-b12e-b52928be075a,key:/events/openstack/rabbitmq-keystone-server-0.18a409f408a0567a,type:*core.Event,resource:events 579ms (09:44:56.814) Trace[1338555615]: ---"Txn call succeeded" 579ms (09:44:57.393)] Trace[1338555615]: [580.500754ms] [580.500754ms] END I0407 09:44:57.394149 1 trace.go:236] Trace[31600558]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6cdbdecc-8d74-4d97-9fa1-d9c09402e71c,client:199.204.45.229,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-keystone-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (07-Apr-2026 09:44:56.848) (total time: 545ms): Trace[31600558]: ---"About to write a response" 545ms (09:44:57.393) Trace[31600558]: [545.349835ms] [545.349835ms] END I0407 09:44:57.395690 1 trace.go:236] Trace[1634865307]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0e6b0889-675d-463d-a0ea-d3bd5c37e9b3,client:199.204.45.229,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/kube-prometheus-stack-prometheus-node-exporter-h2qzd/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (07-Apr-2026 09:44:56.815) (total time: 580ms): Trace[1634865307]: ["GuaranteedUpdate etcd3" audit-id:0e6b0889-675d-463d-a0ea-d3bd5c37e9b3,key:/pods/monitoring/kube-prometheus-stack-prometheus-node-exporter-h2qzd,type:*core.Pod,resource:pods 579ms (09:44:56.815) Trace[1634865307]: ---"Txn call completed" 572ms (09:44:57.394)] Trace[1634865307]: ---"Object stored in database" 572ms (09:44:57.394) Trace[1634865307]: [580.284428ms] [580.284428ms] END I0407 09:44:57.815336 1 trace.go:236] Trace[650888253]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.229,type:*v1.Endpoints,resource:apiServerIPInfo (07-Apr-2026 09:44:56.548) (total time: 1266ms): Trace[650888253]: ---"initial value restored" 263ms (09:44:56.812) Trace[650888253]: ---"Transaction prepared" 581ms (09:44:57.393) Trace[650888253]: ---"Txn call completed" 421ms (09:44:57.815) Trace[650888253]: [1.266244267s] [1.266244267s] END I0407 09:45:33.304145 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.99.66.213"} I0407 09:45:33.323687 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0407 09:48:30.248642 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon" clusterIPs={"IPv4":"10.110.181.41"} I0407 09:48:30.258188 1 alloc.go:330] "allocated clusterIPs" service="openstack/horizon-int" clusterIPs={"IPv4":"10.98.214.116"}