I0320 01:36:42.656689 1 options.go:220] external host was not specified, using 199.204.45.235 I0320 01:36:42.657797 1 server.go:148] Version: v1.28.13 I0320 01:36:42.657862 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0320 01:36:43.023394 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0320 01:36:43.027720 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0320 01:36:43.027736 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0320 01:36:43.027904 1 instance.go:298] Using reconciler: lease I0320 01:36:43.456933 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0320 01:36:43.456958 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0320 01:36:43.721262 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0320 01:36:43.721665 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0320 01:36:44.213172 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0320 01:36:44.227149 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0320 01:36:44.227173 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.227179 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.227735 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0320 01:36:44.227748 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0320 01:36:44.228558 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0320 01:36:44.229252 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0320 01:36:44.229265 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0320 01:36:44.229269 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0320 01:36:44.230883 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0320 01:36:44.230896 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0320 01:36:44.231646 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0320 01:36:44.231659 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.231662 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.232154 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0320 01:36:44.232166 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.232191 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0320 01:36:44.240703 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0320 01:36:44.245221 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0320 01:36:44.245239 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.245246 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.245785 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0320 01:36:44.245797 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.245802 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.246708 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0320 01:36:44.246720 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0320 01:36:44.248604 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0320 01:36:44.248618 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.248622 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.249087 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0320 01:36:44.249101 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.249105 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.251439 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0320 01:36:44.251453 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.251457 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.252654 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0320 01:36:44.253808 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0320 01:36:44.253821 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.253825 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.257535 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0320 01:36:44.257550 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0320 01:36:44.257554 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0320 01:36:44.258377 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0320 01:36:44.258390 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0320 01:36:44.258394 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0320 01:36:44.258843 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0320 01:36:44.258855 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0320 01:36:44.308247 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0320 01:36:44.308285 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0320 01:36:44.716881 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0320 01:36:44.716971 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0320 01:36:44.716880 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0320 01:36:44.717069 1 secure_serving.go:213] Serving securely on [::]:6443 I0320 01:36:44.717146 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0320 01:36:44.717219 1 aggregator.go:164] waiting for initial CRD sync... I0320 01:36:44.717425 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0320 01:36:44.717476 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0320 01:36:44.717515 1 system_namespaces_controller.go:67] Starting system namespaces controller I0320 01:36:44.717567 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0320 01:36:44.717571 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0320 01:36:44.717600 1 available_controller.go:423] Starting AvailableConditionController I0320 01:36:44.717631 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0320 01:36:44.717594 1 controller.go:78] Starting OpenAPI AggregationController I0320 01:36:44.717607 1 controller.go:80] Starting OpenAPI V3 AggregationController I0320 01:36:44.717636 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0320 01:36:44.717573 1 gc_controller.go:78] Starting apiserver lease garbage collector I0320 01:36:44.717812 1 gc_controller.go:78] Starting apiserver lease garbage collector I0320 01:36:44.717827 1 controller.go:116] Starting legacy_token_tracking_controller I0320 01:36:44.717846 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0320 01:36:44.717816 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0320 01:36:44.717910 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0320 01:36:44.718048 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0320 01:36:44.718234 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0320 01:36:44.718336 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0320 01:36:44.718376 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0320 01:36:44.718392 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0320 01:36:44.718400 1 controller.go:134] Starting OpenAPI controller I0320 01:36:44.718418 1 controller.go:85] Starting OpenAPI V3 controller I0320 01:36:44.718454 1 naming_controller.go:291] Starting NamingConditionController I0320 01:36:44.718481 1 establishing_controller.go:76] Starting EstablishingController I0320 01:36:44.718509 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0320 01:36:44.718532 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0320 01:36:44.718554 1 crd_finalizer.go:266] Starting CRDFinalizer E0320 01:36:44.785087 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0320 01:36:44.817906 1 apf_controller.go:379] Running API Priority and Fairness config worker I0320 01:36:44.817926 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0320 01:36:44.818031 1 cache.go:39] Caches are synced for AvailableConditionController controller I0320 01:36:44.818119 1 shared_informer.go:318] Caches are synced for configmaps I0320 01:36:44.818158 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0320 01:36:44.818120 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0320 01:36:44.818434 1 shared_informer.go:318] Caches are synced for crd-autoregister I0320 01:36:44.818494 1 aggregator.go:166] initial CRD sync complete... I0320 01:36:44.818511 1 autoregister_controller.go:141] Starting autoregister controller I0320 01:36:44.818520 1 cache.go:32] Waiting for caches to sync for autoregister controller I0320 01:36:44.818528 1 cache.go:39] Caches are synced for autoregister controller I0320 01:36:44.820397 1 controller.go:624] quota admission added evaluator for: namespaces I0320 01:36:44.823646 1 shared_informer.go:318] Caches are synced for node_authorizer I0320 01:36:44.990810 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0320 01:36:45.726737 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0320 01:36:45.732507 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0320 01:36:45.732528 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0320 01:36:46.528294 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0320 01:36:46.589928 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0320 01:36:46.733237 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0320 01:36:46.741996 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.235] I0320 01:36:46.743572 1 controller.go:624] quota admission added evaluator for: endpoints I0320 01:36:46.751549 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0320 01:36:47.870787 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0320 01:36:48.959638 1 controller.go:624] quota admission added evaluator for: deployments.apps I0320 01:36:48.975648 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0320 01:36:49.040269 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0320 01:36:52.578389 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0320 01:36:52.975713 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0320 01:36:57.285043 1 trace.go:236] Trace[182500455]: "Get" accept:application/json, */*,audit-id:e0417f7c-48da-467c-b5f8-57a951d0bca0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:36:56.546) (total time: 738ms): Trace[182500455]: ---"About to write a response" 738ms (01:36:57.284) Trace[182500455]: [738.499256ms] [738.499256ms] END I0320 01:36:57.581926 1 trace.go:236] Trace[968353872]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.235,type:*v1.Endpoints,resource:apiServerIPInfo (20-Mar-2026 01:36:56.725) (total time: 856ms): Trace[968353872]: ---"initial value restored" 560ms (01:36:57.285) Trace[968353872]: ---"Txn call completed" 246ms (01:36:57.581) Trace[968353872]: [856.362262ms] [856.362262ms] END I0320 01:37:03.038465 1 trace.go:236] Trace[763547123]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1eaa3efa-c83c-418a-9503-0a495416977a,client:199.204.45.235,protocol:HTTP/2.0,resource:replicasets,scope:resource,url:/apis/apps/v1/namespaces/kube-system/replicasets/coredns-7c96b6546b/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:PUT (20-Mar-2026 01:37:02.411) (total time: 627ms): Trace[763547123]: ["GuaranteedUpdate etcd3" audit-id:1eaa3efa-c83c-418a-9503-0a495416977a,key:/replicasets/kube-system/coredns-7c96b6546b,type:*apps.ReplicaSet,resource:replicasets.apps 626ms (01:37:02.411) Trace[763547123]: ---"Txn call completed" 624ms (01:37:03.038)] Trace[763547123]: [627.035249ms] [627.035249ms] END I0320 01:37:03.038516 1 trace.go:236] Trace[1497859854]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3fe1ea8f-a092-4e8a-8d78-61bdbdae9c38,client:199.204.45.235,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:POST (20-Mar-2026 01:37:02.421) (total time: 616ms): Trace[1497859854]: ["Create etcd3" audit-id:3fe1ea8f-a092-4e8a-8d78-61bdbdae9c38,key:/events/kube-system/coredns.189e68e1d733d4da,type:*core.Event,resource:events 616ms (01:37:02.422) Trace[1497859854]: ---"Txn call succeeded" 615ms (01:37:03.038)] Trace[1497859854]: [616.829785ms] [616.829785ms] END I0320 01:37:03.038778 1 trace.go:236] Trace[440464055]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ef5eff75-8bb7-4386-805b-2c8e95c3d89f,client:199.204.45.235,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/kube-system/deployments/coredns/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:deployment-controller,verb:PUT (20-Mar-2026 01:37:02.421) (total time: 617ms): Trace[440464055]: ["GuaranteedUpdate etcd3" audit-id:ef5eff75-8bb7-4386-805b-2c8e95c3d89f,key:/deployments/kube-system/coredns,type:*apps.Deployment,resource:deployments.apps 617ms (01:37:02.421) Trace[440464055]: ---"Txn call completed" 613ms (01:37:03.038)] Trace[440464055]: [617.361777ms] [617.361777ms] END I0320 01:37:03.038921 1 trace.go:236] Trace[793815434]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0e41b69c-2292-48d3-9cea-bfab8a9b85aa,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:replicaset-controller,verb:POST (20-Mar-2026 01:37:02.418) (total time: 620ms): Trace[793815434]: ["Create etcd3" audit-id:0e41b69c-2292-48d3-9cea-bfab8a9b85aa,key:/pods/kube-system/coredns-67659f764b-sps7p,type:*core.Pod,resource:pods 618ms (01:37:02.420) Trace[793815434]: ---"Txn call succeeded" 617ms (01:37:03.038)] Trace[793815434]: [620.015584ms] [620.015584ms] END I0320 01:37:18.050731 1 trace.go:236] Trace[1412267563]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.235,type:*v1.Endpoints,resource:apiServerIPInfo (20-Mar-2026 01:37:16.727) (total time: 1323ms): Trace[1412267563]: ---"Transaction prepared" 1268ms (01:37:17.997) Trace[1412267563]: [1.323393395s] [1.323393395s] END I0320 01:37:26.925787 1 trace.go:236] Trace[857860041]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:863ebffb-7159-4c51-83ac-f849712d13e2,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:37:26.146) (total time: 779ms): Trace[857860041]: ["GuaranteedUpdate etcd3" audit-id:863ebffb-7159-4c51-83ac-f849712d13e2,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 779ms (01:37:26.146) Trace[857860041]: ---"Txn call completed" 778ms (01:37:26.925)] Trace[857860041]: [779.702471ms] [779.702471ms] END I0320 01:37:27.904403 1 trace.go:236] Trace[363442204]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:9103f592-b063-4b58-a1ea-7c9202f77664,client:::1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/apiserver-f3tcohoifagyom4bbi4wgeu7te,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (20-Mar-2026 01:37:26.212) (total time: 1691ms): Trace[363442204]: ["GuaranteedUpdate etcd3" audit-id:9103f592-b063-4b58-a1ea-7c9202f77664,key:/leases/kube-system/apiserver-f3tcohoifagyom4bbi4wgeu7te,type:*coordination.Lease,resource:leases.coordination.k8s.io 1691ms (01:37:26.212) Trace[363442204]: ---"Txn call completed" 1690ms (01:37:27.904)] Trace[363442204]: [1.691670889s] [1.691670889s] END I0320 01:37:27.904683 1 trace.go:236] Trace[1863684171]: "Get" accept:application/json, */*,audit-id:630b46ff-cab0-4b26-8219-be89b007eede,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:37:26.419) (total time: 1485ms): Trace[1863684171]: ---"About to write a response" 1484ms (01:37:27.904) Trace[1863684171]: [1.485012064s] [1.485012064s] END I0320 01:37:27.905227 1 trace.go:236] Trace[1180458948]: "Get" accept:application/json, */*,audit-id:3770598a-01c4-44c9-b3e6-cf508d601e98,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:37:26.441) (total time: 1463ms): Trace[1180458948]: ---"About to write a response" 1463ms (01:37:27.904) Trace[1180458948]: [1.463446483s] [1.463446483s] END I0320 01:37:27.905259 1 trace.go:236] Trace[159386585]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a8a4e600-7052-4b00-b8a4-aabfa81aaee1,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:37:26.436) (total time: 1468ms): Trace[159386585]: ---"About to write a response" 1468ms (01:37:27.905) Trace[159386585]: [1.468919903s] [1.468919903s] END I0320 01:37:27.956243 1 trace.go:236] Trace[514485782]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.235,type:*v1.Endpoints,resource:apiServerIPInfo (20-Mar-2026 01:37:26.727) (total time: 1228ms): Trace[514485782]: ---"initial value restored" 1177ms (01:37:27.905) Trace[514485782]: [1.228424226s] [1.228424226s] END I0320 01:37:28.259012 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0320 01:37:28.431186 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0320 01:37:28.457672 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0320 01:37:28.476246 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.111.77.107"} I0320 01:37:28.506708 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.110.36.113"} I0320 01:37:28.513641 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0320 01:37:28.560491 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0320 01:37:28.595911 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0320 01:37:29.072098 1 controller.go:624] quota admission added evaluator for: jobs.batch I0320 01:37:29.654459 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0320 01:37:29.669579 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0320 01:37:29.674073 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:29.851698 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0320 01:37:30.254323 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0320 01:37:30.450919 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0320 01:37:30.687971 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:31.499782 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:32.745231 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:33.778275 1 trace.go:236] Trace[1101316156]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:cfd1a035-9a8f-4cc4-ba4a-990f2710544a,client:199.204.45.235,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (20-Mar-2026 01:37:33.201) (total time: 576ms): Trace[1101316156]: ["Create etcd3" audit-id:cfd1a035-9a8f-4cc4-ba4a-990f2710544a,key:/events/kube-system/cilium-q96ms.189e68e901f3ce60,type:*core.Event,resource:events 575ms (01:37:33.202) Trace[1101316156]: ---"Txn call succeeded" 575ms (01:37:33.777)] Trace[1101316156]: [576.630056ms] [576.630056ms] END I0320 01:37:33.778716 1 trace.go:236] Trace[918676319]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1fadc525-e2ed-48a2-bc8b-a0da364eaace,client:199.204.45.235,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/ciliumidentities.cilium.io,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:GET (20-Mar-2026 01:37:33.226) (total time: 552ms): Trace[918676319]: ---"About to write a response" 552ms (01:37:33.778) Trace[918676319]: [552.469356ms] [552.469356ms] END I0320 01:37:33.787111 1 trace.go:236] Trace[1722505086]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b79ab6ec-b702-4191-b618-18f9a69bfb84,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-q96ms/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (20-Mar-2026 01:37:33.261) (total time: 526ms): Trace[1722505086]: ["GuaranteedUpdate etcd3" audit-id:b79ab6ec-b702-4191-b618-18f9a69bfb84,key:/pods/kube-system/cilium-q96ms,type:*core.Pod,resource:pods 525ms (01:37:33.261) Trace[1722505086]: ---"Txn call completed" 513ms (01:37:33.786)] Trace[1722505086]: ---"Object stored in database" 514ms (01:37:33.786) Trace[1722505086]: [526.006357ms] [526.006357ms] END I0320 01:37:33.803658 1 trace.go:236] Trace[889553291]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f0bc8ddf-c1f3-4132-ad00-7302598590a3,client:::1,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/ciliumnetworkpolicies.cilium.io/status,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (20-Mar-2026 01:37:33.279) (total time: 523ms): Trace[889553291]: ["GuaranteedUpdate etcd3" audit-id:f0bc8ddf-c1f3-4132-ad00-7302598590a3,key:/apiextensions.k8s.io/customresourcedefinitions/ciliumnetworkpolicies.cilium.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 521ms (01:37:33.282) Trace[889553291]: ---"About to Encode" 56ms (01:37:33.344) Trace[889553291]: ---"Txn call completed" 437ms (01:37:33.786)] Trace[889553291]: [523.640464ms] [523.640464ms] END I0320 01:37:33.807383 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:33.966818 1 trace.go:236] Trace[228978949]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:eb792b0b-1c96-4645-8b8f-ad8327da6fb1,client:199.204.45.235,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (20-Mar-2026 01:37:33.426) (total time: 539ms): Trace[228978949]: ["Create etcd3" audit-id:eb792b0b-1c96-4645-8b8f-ad8327da6fb1,key:/apiextensions.k8s.io/customresourcedefinitions/ciliumclusterwidenetworkpolicies.cilium.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 512ms (01:37:33.454) Trace[228978949]: ---"Txn call succeeded" 490ms (01:37:33.949)] Trace[228978949]: [539.91211ms] [539.91211ms] END I0320 01:37:34.328092 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0320 01:37:37.821735 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0320 01:37:51.128155 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0320 01:37:55.488688 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0320 01:38:09.542157 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.100.254.155"} I0320 01:38:09.561069 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.107.11.147"} I0320 01:38:09.564114 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.98.192.12"} I0320 01:38:09.577364 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.102.68.194"} I0320 01:38:17.320849 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.343953 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.377000 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.395907 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.420148 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.447508 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.469920 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.489087 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.515524 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.529053 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0320 01:38:17.549088 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.568391 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:17.594725 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:18.891710 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0320 01:38:22.400099 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0320 01:38:22.406585 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0320 01:38:22.471673 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.104.166.52"} I0320 01:38:22.506114 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0320 01:38:24.999638 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0320 01:38:25.040063 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0320 01:38:25.643045 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0320 01:38:25.643084 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0320 01:38:25.643126 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0320 01:38:32.090941 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0320 01:38:35.172487 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.103.226.11"} I0320 01:38:35.444383 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0320 01:38:35.590786 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.102.89.102"} I0320 01:38:35.604090 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.102.99.234"} I0320 01:38:38.393958 1 trace.go:236] Trace[1551802920]: "Get" accept:application/json, */*,audit-id:d5c90bd9-61ed-4abb-a5e1-3c4d874f33aa,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:38:37.259) (total time: 1134ms): Trace[1551802920]: ---"About to write a response" 1133ms (01:38:38.393) Trace[1551802920]: [1.134103117s] [1.134103117s] END I0320 01:38:38.394312 1 trace.go:236] Trace[1911593825]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:51267d53-984d-4a1e-8bfc-f46832953e2f,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:38:37.244) (total time: 1150ms): Trace[1911593825]: ["GuaranteedUpdate etcd3" audit-id:51267d53-984d-4a1e-8bfc-f46832953e2f,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1150ms (01:38:37.244) Trace[1911593825]: ---"Txn call completed" 1148ms (01:38:38.393)] Trace[1911593825]: [1.150066478s] [1.150066478s] END I0320 01:38:38.448397 1 trace.go:236] Trace[1735954608]: "Get" accept:application/json, */*,audit-id:c7951178-2363-45d2-909b-56b9a51f3575,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:38:37.264) (total time: 1184ms): Trace[1735954608]: ---"About to write a response" 1184ms (01:38:38.448) Trace[1735954608]: [1.184227635s] [1.184227635s] END I0320 01:38:38.448599 1 trace.go:236] Trace[1089150243]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:c31ace54-d9c4-4c49-af92-ee88d15b4b66,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:38:37.320) (total time: 1127ms): Trace[1089150243]: ---"About to write a response" 1127ms (01:38:38.448) Trace[1089150243]: [1.127909071s] [1.127909071s] END I0320 01:38:38.448823 1 trace.go:236] Trace[65347687]: "Get" accept:application/json, */*,audit-id:9b05860d-2cf0-49e7-b720-bac292e46bfc,client:10.0.0.40,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d9f02ab1-d634-400b-afd5-9ea94f6a1cb4,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:38:37.546) (total time: 902ms): Trace[65347687]: ---"About to write a response" 901ms (01:38:38.448) Trace[65347687]: [902.44161ms] [902.44161ms] END I0320 01:38:38.448909 1 trace.go:236] Trace[787517486]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:520511ee-efe7-4e19-a144-5358b548ad54,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d9f02ab1-d634-400b-afd5-9ea94f6a1cb4,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:38:37.525) (total time: 923ms): Trace[787517486]: ---"About to write a response" 923ms (01:38:38.448) Trace[787517486]: [923.328849ms] [923.328849ms] END I0320 01:38:39.050767 1 trace.go:236] Trace[1332226258]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ed64e7d8-1449-4414-a5a2-00266cf91596,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:38:38.450) (total time: 600ms): Trace[1332226258]: ["GuaranteedUpdate etcd3" audit-id:ed64e7d8-1449-4414-a5a2-00266cf91596,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 600ms (01:38:38.450) Trace[1332226258]: ---"Txn call completed" 599ms (01:38:39.050)] Trace[1332226258]: [600.159525ms] [600.159525ms] END I0320 01:38:39.051463 1 trace.go:236] Trace[77248619]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7babf130-d20a-4892-a9f3-75180c351c17,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d9f02ab1-d634-400b-afd5-9ea94f6a1cb4/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (20-Mar-2026 01:38:38.450) (total time: 600ms): Trace[77248619]: ["GuaranteedUpdate etcd3" audit-id:7babf130-d20a-4892-a9f3-75180c351c17,key:/pods/local-path-storage/helper-pod-create-pvc-d9f02ab1-d634-400b-afd5-9ea94f6a1cb4,type:*core.Pod,resource:pods 600ms (01:38:38.451) Trace[77248619]: ---"Txn call completed" 597ms (01:38:39.051)] Trace[77248619]: ---"Object stored in database" 597ms (01:38:39.051) Trace[77248619]: [600.477273ms] [600.477273ms] END I0320 01:38:39.051661 1 trace.go:236] Trace[1641525430]: "Update" accept:application/json, */*,audit-id:81cc5cee-e6d2-48a4-a066-f45d53b22ae8,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (20-Mar-2026 01:38:38.451) (total time: 600ms): Trace[1641525430]: ["GuaranteedUpdate etcd3" audit-id:81cc5cee-e6d2-48a4-a066-f45d53b22ae8,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 600ms (01:38:38.451) Trace[1641525430]: ---"Txn call completed" 599ms (01:38:39.051)] Trace[1641525430]: [600.528014ms] [600.528014ms] END I0320 01:38:39.692190 1 trace.go:236] Trace[188761509]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fe964219-a955-4d76-8566-3ad45916e9f4,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:38:38.797) (total time: 894ms): Trace[188761509]: ["GuaranteedUpdate etcd3" audit-id:fe964219-a955-4d76-8566-3ad45916e9f4,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 894ms (01:38:38.797) Trace[188761509]: ---"Txn call completed" 893ms (01:38:39.691)] Trace[188761509]: [894.334183ms] [894.334183ms] END I0320 01:38:39.764792 1 trace.go:236] Trace[863859018]: "Get" accept:application/json, */*,audit-id:35718438-b8d7-448c-af1e-1255b4dada8b,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:38:38.949) (total time: 815ms): Trace[863859018]: ---"About to write a response" 814ms (01:38:39.764) Trace[863859018]: [815.033575ms] [815.033575ms] END I0320 01:38:39.764963 1 trace.go:236] Trace[605939280]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b359a328-358d-4390-b6aa-2712b542a525,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:38:38.994) (total time: 770ms): Trace[605939280]: ["GuaranteedUpdate etcd3" audit-id:b359a328-358d-4390-b6aa-2712b542a525,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 770ms (01:38:38.994) Trace[605939280]: ---"Txn call completed" 769ms (01:38:39.764)] Trace[605939280]: [770.418317ms] [770.418317ms] END I0320 01:38:39.765129 1 trace.go:236] Trace[366698327]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a88c2ea-4829-46f1-837f-fcd6ccc4fbe0,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-d9f02ab1-d634-400b-afd5-9ea94f6a1cb4,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:38:39.055) (total time: 709ms): Trace[366698327]: ---"About to write a response" 709ms (01:38:39.764) Trace[366698327]: [709.822479ms] [709.822479ms] END I0320 01:38:55.852603 1 trace.go:236] Trace[288070723]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:42099dac-2649-4dd4-81c6-7a881dd828fa,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:38:54.793) (total time: 1058ms): Trace[288070723]: ["GuaranteedUpdate etcd3" audit-id:42099dac-2649-4dd4-81c6-7a881dd828fa,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 1058ms (01:38:54.794) Trace[288070723]: ---"Txn call completed" 1057ms (01:38:55.852)] Trace[288070723]: [1.058538343s] [1.058538343s] END I0320 01:38:56.003237 1 trace.go:236] Trace[2116429373]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:c8efec21-9431-4e2e-ad63-c6e0f50872a4,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/ingress-nginx/leases/ingress-nginx-leader,user-agent:nginx-ingress-controller/v1.12.1 (linux/amd64) ingress-nginx/51c2b819690bbf1709b844dbf321a9acf6eda5a7,verb:PUT (20-Mar-2026 01:38:54.887) (total time: 1115ms): Trace[2116429373]: ["GuaranteedUpdate etcd3" audit-id:c8efec21-9431-4e2e-ad63-c6e0f50872a4,key:/leases/ingress-nginx/ingress-nginx-leader,type:*coordination.Lease,resource:leases.coordination.k8s.io 1115ms (01:38:54.887) Trace[2116429373]: ---"Txn call completed" 1114ms (01:38:56.002)] Trace[2116429373]: [1.115519481s] [1.115519481s] END I0320 01:38:56.003659 1 trace.go:236] Trace[122135658]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a6abaf42-330e-4529-a032-f009f7646a39,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:38:55.166) (total time: 837ms): Trace[122135658]: ["GuaranteedUpdate etcd3" audit-id:a6abaf42-330e-4529-a032-f009f7646a39,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 837ms (01:38:55.166) Trace[122135658]: ---"Txn call completed" 836ms (01:38:56.003)] Trace[122135658]: [837.337693ms] [837.337693ms] END I0320 01:38:56.057507 1 trace.go:236] Trace[1115058993]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:d98ed33b-7978-4cf5-a434-d9ed9fde1015,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:38:55.195) (total time: 862ms): Trace[1115058993]: ---"About to write a response" 862ms (01:38:56.057) Trace[1115058993]: [862.211449ms] [862.211449ms] END I0320 01:38:56.057790 1 trace.go:236] Trace[1469258260]: "Get" accept:application/json, */*,audit-id:c2f5270a-3232-4846-b848-3b2fd33a16e0,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:38:55.200) (total time: 857ms): Trace[1469258260]: ---"About to write a response" 857ms (01:38:56.057) Trace[1469258260]: [857.158278ms] [857.158278ms] END I0320 01:38:56.057960 1 trace.go:236] Trace[546860331]: "Get" accept:application/json, */*,audit-id:547b4140-ac57-47d9-8ce1-4003a5d257e2,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:38:55.200) (total time: 857ms): Trace[546860331]: ---"About to write a response" 857ms (01:38:56.057) Trace[546860331]: [857.551056ms] [857.551056ms] END I0320 01:38:56.061249 1 trace.go:236] Trace[1788832376]: "Get" accept:application/json,audit-id:6f1a7735-7444-4b96-a9a2-7026bbed87ff,client:199.204.45.235,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (20-Mar-2026 01:38:55.192) (total time: 869ms): Trace[1788832376]: ---"About to write a response" 867ms (01:38:56.059) Trace[1788832376]: [869.151862ms] [869.151862ms] END I0320 01:39:33.419399 1 trace.go:236] Trace[16068937]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:0bfdda57-cedc-40ea-86af-65a646317fcd,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:39:32.786) (total time: 632ms): Trace[16068937]: ---"About to write a response" 632ms (01:39:33.419) Trace[16068937]: [632.368503ms] [632.368503ms] END I0320 01:39:33.419737 1 trace.go:236] Trace[844791323]: "Get" accept:application/json, */*,audit-id:dbd0a8b4-d62c-4211-9e5f-7d63c16b23fb,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:39:32.818) (total time: 601ms): Trace[844791323]: ---"About to write a response" 601ms (01:39:33.419) Trace[844791323]: [601.172754ms] [601.172754ms] END I0320 01:39:33.419744 1 trace.go:236] Trace[205480789]: "Get" accept:application/json, */*,audit-id:1410bf32-6742-4d59-bcf5-738e18825319,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:39:32.803) (total time: 616ms): Trace[205480789]: ---"About to write a response" 616ms (01:39:33.419) Trace[205480789]: [616.214277ms] [616.214277ms] END I0320 01:39:33.420635 1 trace.go:236] Trace[1258976651]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:27851144-7c5b-4e43-a217-5f3bdc548b2f,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:39:32.818) (total time: 601ms): Trace[1258976651]: ---"About to write a response" 601ms (01:39:33.420) Trace[1258976651]: [601.743688ms] [601.743688ms] END I0320 01:39:33.420950 1 trace.go:236] Trace[283063340]: "Get" accept:application/json, */*,audit-id:04e3880d-7c43-440a-9862-1ce83c9d5c32,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:39:32.818) (total time: 601ms): Trace[283063340]: ---"About to write a response" 601ms (01:39:33.420) Trace[283063340]: [601.911182ms] [601.911182ms] END I0320 01:39:34.330964 1 trace.go:236] Trace[2067437967]: "Get" accept:application/json,audit-id:b3c36785-2c02-492f-967a-41b92a3aa195,client:199.204.45.235,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (20-Mar-2026 01:39:33.750) (total time: 580ms): Trace[2067437967]: ---"About to write a response" 580ms (01:39:34.330) Trace[2067437967]: [580.545781ms] [580.545781ms] END I0320 01:39:35.421644 1 trace.go:236] Trace[1453297017]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e74590f6-e17a-4864-b067-19f1b0efbf70,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:39:34.746) (total time: 675ms): Trace[1453297017]: ["GuaranteedUpdate etcd3" audit-id:e74590f6-e17a-4864-b067-19f1b0efbf70,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 674ms (01:39:34.746) Trace[1453297017]: ---"Txn call completed" 673ms (01:39:35.421)] Trace[1453297017]: [675.017792ms] [675.017792ms] END I0320 01:39:35.421699 1 trace.go:236] Trace[1657616636]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9d09c951-24d0-4299-9b0b-03aa274cbc8a,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:39:34.746) (total time: 675ms): Trace[1657616636]: ["GuaranteedUpdate etcd3" audit-id:9d09c951-24d0-4299-9b0b-03aa274cbc8a,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 675ms (01:39:34.746) Trace[1657616636]: ---"Txn call completed" 673ms (01:39:35.421)] Trace[1657616636]: [675.189696ms] [675.189696ms] END I0320 01:39:47.323331 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.99.160.170"} I0320 01:39:49.766932 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.101.1.160"} I0320 01:39:49.773636 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.106.33.8"} I0320 01:39:56.098399 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.100.41.135"} I0320 01:39:56.108906 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.96.90.9"} I0320 01:42:29.927863 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0320 01:42:33.772629 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0320 01:42:33.800239 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0320 01:42:37.314721 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0320 01:42:37.326974 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0320 01:42:37.344770 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0320 01:42:37.359947 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0320 01:42:37.378287 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0320 01:42:37.385301 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0320 01:42:37.397440 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0320 01:42:39.483944 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0320 01:42:49.292693 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0320 01:43:29.582750 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0320 01:43:44.065015 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0320 01:43:44.277597 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:44.298214 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:44.305499 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:44.561384 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0320 01:43:44.894928 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:44.895057 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:45.024867 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0320 01:43:45.057940 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:43:45.164629 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0320 01:44:25.434022 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.97.23.18"} I0320 01:44:25.446117 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.97.131.61"} I0320 01:44:25.453784 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.102.24.132"} I0320 01:44:25.462522 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.99.164.158"} I0320 01:44:25.471419 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.98.250.117"} I0320 01:44:25.479964 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.107.172.20"} I0320 01:44:25.544966 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0320 01:44:25.555605 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0320 01:44:25.587534 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0320 01:44:25.601302 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0320 01:44:25.625577 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0320 01:44:25.636728 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.636774 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.636873 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.636965 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.637065 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.637104 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.637065 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.637126 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.637562 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.637612 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.638257 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.638302 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.638336 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.638332 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.638352 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.638400 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.638359 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.638306 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.638570 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.638593 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.639188 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.639212 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.639293 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.639324 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.639633 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.639680 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.640026 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.640055 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.640804 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.640837 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused W0320 01:44:25.641028 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused E0320 01:44:25.641049 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.102.24.132:443: connect: connection refused I0320 01:44:35.992654 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.96.161.196"} I0320 01:44:35.999447 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.97.40.235"} I0320 01:44:37.661661 1 trace.go:236] Trace[1412701564]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:66c0b788-d015-4aa1-a2a1-c20cf01ad85a,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:37.107) (total time: 554ms): Trace[1412701564]: ["GuaranteedUpdate etcd3" audit-id:66c0b788-d015-4aa1-a2a1-c20cf01ad85a,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 554ms (01:44:37.107) Trace[1412701564]: ---"Txn call completed" 553ms (01:44:37.661)] Trace[1412701564]: [554.514723ms] [554.514723ms] END I0320 01:44:37.761036 1 trace.go:236] Trace[489721373]: "Delete" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e5f317b4-af5d-42c3-b65f-2bc499fba562,client:10.0.0.161,protocol:HTTP/2.0,resource:deployments,scope:resource,url:/apis/apps/v1/namespaces/openstack/deployments/percona-xtradb-pitr,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:DELETE (20-Mar-2026 01:44:37.122) (total time: 638ms): Trace[489721373]: [638.587405ms] [638.587405ms] END I0320 01:44:37.761208 1 trace.go:236] Trace[2014462335]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:16bf917f-b311-40ae-8751-250fb4c41a9c,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:37.107) (total time: 653ms): Trace[2014462335]: ["GuaranteedUpdate etcd3" audit-id:16bf917f-b311-40ae-8751-250fb4c41a9c,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 653ms (01:44:37.107) Trace[2014462335]: ---"Txn call completed" 651ms (01:44:37.760)] Trace[2014462335]: [653.422208ms] [653.422208ms] END I0320 01:44:37.761860 1 trace.go:236] Trace[646834805]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ba25c6a1-5d78-4276-b605-70069019fe05,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:37.128) (total time: 633ms): Trace[646834805]: ["GuaranteedUpdate etcd3" audit-id:ba25c6a1-5d78-4276-b605-70069019fe05,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 633ms (01:44:37.128) Trace[646834805]: ---"Txn call completed" 632ms (01:44:37.761)] Trace[646834805]: [633.214314ms] [633.214314ms] END I0320 01:44:37.761937 1 trace.go:236] Trace[755292760]: "Get" accept:application/json, */*,audit-id:8e4d300a-e393-4f06-b7a1-e8fa67729141,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-5m87b,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:44:37.218) (total time: 543ms): Trace[755292760]: ---"About to write a response" 542ms (01:44:37.761) Trace[755292760]: [543.041895ms] [543.041895ms] END I0320 01:44:40.636957 1 trace.go:236] Trace[1330415504]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:af1f45ae-3c2b-4d12-a1db-1fb03b3254ba,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:39.768) (total time: 868ms): Trace[1330415504]: ["GuaranteedUpdate etcd3" audit-id:af1f45ae-3c2b-4d12-a1db-1fb03b3254ba,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 868ms (01:44:39.768) Trace[1330415504]: ---"Txn call completed" 866ms (01:44:40.636)] Trace[1330415504]: [868.608498ms] [868.608498ms] END I0320 01:44:40.636956 1 trace.go:236] Trace[1354394114]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:674f77d7-c2a8-488d-9da1-974b31968baa,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:44:39.770) (total time: 866ms): Trace[1354394114]: ---"About to write a response" 866ms (01:44:40.636) Trace[1354394114]: [866.52195ms] [866.52195ms] END I0320 01:44:40.711587 1 trace.go:236] Trace[219252068]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:a388b291-dcad-4931-9873-de12f1d7adf9,client:10.0.0.63,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:39.768) (total time: 942ms): Trace[219252068]: ["GuaranteedUpdate etcd3" audit-id:a388b291-dcad-4931-9873-de12f1d7adf9,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 942ms (01:44:39.768) Trace[219252068]: ---"Txn call completed" 941ms (01:44:40.711)] Trace[219252068]: [942.97358ms] [942.97358ms] END I0320 01:44:40.713114 1 trace.go:236] Trace[597924805]: "Get" accept:application/json, */*,audit-id:a7eeb5a0-1e10-4938-bca2-eae21ac50f2e,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:44:39.783) (total time: 929ms): Trace[597924805]: ---"About to write a response" 928ms (01:44:40.712) Trace[597924805]: [929.089786ms] [929.089786ms] END I0320 01:44:40.713125 1 trace.go:236] Trace[259188281]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:94981755-38bd-42cd-ad34-507eef7fa7f9,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:44:39.796) (total time: 917ms): Trace[259188281]: ---"About to write a response" 916ms (01:44:40.712) Trace[259188281]: [917.024246ms] [917.024246ms] END I0320 01:44:40.713301 1 trace.go:236] Trace[1023324195]: "Get" accept:application/json, */*,audit-id:7bc5e312-4902-4f3b-b2c4-a3a4b73acc01,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:44:39.776) (total time: 936ms): Trace[1023324195]: ---"About to write a response" 936ms (01:44:40.713) Trace[1023324195]: [936.908324ms] [936.908324ms] END I0320 01:44:40.713785 1 trace.go:236] Trace[520771386]: "Get" accept:application/json, */*,audit-id:b88c6e08-5385-4703-b400-724a764f5713,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:44:39.775) (total time: 937ms): Trace[520771386]: ---"About to write a response" 937ms (01:44:40.713) Trace[520771386]: [937.707941ms] [937.707941ms] END I0320 01:44:40.714685 1 trace.go:236] Trace[951646870]: "Get" accept:application/json, */*,audit-id:55adbf23-18fd-4ed0-b980-d6fcce4bdef6,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-5m87b,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:44:39.774) (total time: 940ms): Trace[951646870]: ---"About to write a response" 939ms (01:44:40.713) Trace[951646870]: [940.545296ms] [940.545296ms] END I0320 01:44:40.718049 1 trace.go:236] Trace[1153407216]: "List" accept:application/json, */*,audit-id:496fa00e-6c90-447a-8875-ab200e088c5b,client:199.204.45.235,protocol:HTTP/2.0,resource:secrets,scope:namespace,url:/api/v1/namespaces/monitoring/secrets,user-agent:Helm/3.11.2,verb:LIST (20-Mar-2026 01:44:40.116) (total time: 601ms): Trace[1153407216]: ["List(recursive=true) etcd3" audit-id:496fa00e-6c90-447a-8875-ab200e088c5b,key:/secrets/monitoring,resourceVersion:,resourceVersionMatch:,limit:0,continue: 601ms (01:44:40.116)] Trace[1153407216]: [601.10233ms] [601.10233ms] END I0320 01:44:40.800179 1 trace.go:236] Trace[43744981]: "Update" accept:application/json, */*,audit-id:cdb2e2f7-2e2a-4b8b-b38d-5720d65beb9e,client:10.0.0.140,protocol:HTTP/2.0,resource:nodefeatures,scope:resource,url:/apis/nfd.k8s-sigs.io/v1alpha1/namespaces/monitoring/nodefeatures/instance,user-agent:nfd-worker/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (20-Mar-2026 01:44:39.542) (total time: 1257ms): Trace[43744981]: ---"Conversion done" 35ms (01:44:39.579) Trace[43744981]: ["GuaranteedUpdate etcd3" audit-id:cdb2e2f7-2e2a-4b8b-b38d-5720d65beb9e,key:/nfd.k8s-sigs.io/nodefeatures/monitoring/instance,type:*unstructured.Unstructured,resource:nodefeatures.nfd.k8s-sigs.io 1217ms (01:44:39.582) Trace[43744981]: ---"About to Encode" 148ms (01:44:39.742) Trace[43744981]: ---"Txn call completed" 938ms (01:44:40.712) Trace[43744981]: ---"decode succeeded" len:413722 63ms (01:44:40.776)] Trace[43744981]: ---"Writing http response done" 23ms (01:44:40.800) Trace[43744981]: [1.257755971s] [1.257755971s] END I0320 01:44:41.166717 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.108.112.176"} I0320 01:44:44.039943 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.105.127.234"} I0320 01:44:48.668527 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.97.56.113"} I0320 01:44:49.913775 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.103.158.182"} I0320 01:44:57.475803 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0320 01:44:57.640238 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.107.232.207"} I0320 01:44:59.659366 1 trace.go:236] Trace[1953486437]: "List" accept:application/json, */*,audit-id:e2818a0b-2403-4bf0-89af-59f389ea73a3,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:namespace,url:/api/v1/namespaces/openstack/pods,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (20-Mar-2026 01:44:59.157) (total time: 501ms): Trace[1953486437]: ["List(recursive=true) etcd3" audit-id:e2818a0b-2403-4bf0-89af-59f389ea73a3,key:/pods/openstack,resourceVersion:,resourceVersionMatch:,limit:0,continue: 501ms (01:44:59.158)] Trace[1953486437]: [501.383748ms] [501.383748ms] END I0320 01:45:00.282183 1 trace.go:236] Trace[1411229893]: "Update" accept:application/json, */*,audit-id:c52da140-fd4a-4bf5-9ec0-39f984c19394,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (20-Mar-2026 01:44:59.157) (total time: 1124ms): Trace[1411229893]: ["GuaranteedUpdate etcd3" audit-id:c52da140-fd4a-4bf5-9ec0-39f984c19394,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1124ms (01:44:59.157) Trace[1411229893]: ---"Txn call completed" 1123ms (01:45:00.281)] Trace[1411229893]: [1.124987285s] [1.124987285s] END I0320 01:45:00.282459 1 trace.go:236] Trace[722282761]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f1a7012a-266b-4295-a5ac-4a69ed238a95,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:44:59.157) (total time: 1125ms): Trace[722282761]: ["GuaranteedUpdate etcd3" audit-id:f1a7012a-266b-4295-a5ac-4a69ed238a95,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 1124ms (01:44:59.157) Trace[722282761]: ---"Txn call completed" 1123ms (01:45:00.281)] Trace[722282761]: [1.125309932s] [1.125309932s] END I0320 01:45:00.283400 1 trace.go:236] Trace[1460178695]: "Update" accept:application/json, */*,audit-id:2c6b4c40-35ca-4ebf-b009-ecb08e03c193,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (20-Mar-2026 01:44:59.157) (total time: 1126ms): Trace[1460178695]: ["GuaranteedUpdate etcd3" audit-id:2c6b4c40-35ca-4ebf-b009-ecb08e03c193,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1125ms (01:44:59.157) Trace[1460178695]: ---"Txn call completed" 1124ms (01:45:00.283)] Trace[1460178695]: [1.126186221s] [1.126186221s] END I0320 01:45:00.283650 1 trace.go:236] Trace[342002945]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:05fe73f6-cf3f-4f41-874b-4bdd6b1e99ce,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-167b04f8-e85d-4f83-87f8-ad3017a30b57,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:44:59.598) (total time: 684ms): Trace[342002945]: ---"About to write a response" 684ms (01:45:00.283) Trace[342002945]: [684.977147ms] [684.977147ms] END I0320 01:45:00.283722 1 trace.go:236] Trace[1837023274]: "Update" accept:application/json, */*,audit-id:ca0da362-0b3c-46c9-9937-6b0fdc1cb4d2,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:44:59.157) (total time: 1126ms): Trace[1837023274]: ["GuaranteedUpdate etcd3" audit-id:ca0da362-0b3c-46c9-9937-6b0fdc1cb4d2,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 1126ms (01:44:59.157) Trace[1837023274]: ---"Txn call completed" 1124ms (01:45:00.283)] Trace[1837023274]: [1.126368655s] [1.126368655s] END I0320 01:45:00.304721 1 trace.go:236] Trace[1811224494]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b64969f3-3830-4257-a644-94a061050d7a,client:199.204.45.235,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/storage-loki-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:44:59.671) (total time: 633ms): Trace[1811224494]: ---"About to write a response" 632ms (01:45:00.304) Trace[1811224494]: [633.045279ms] [633.045279ms] END I0320 01:45:03.891934 1 trace.go:236] Trace[1988040821]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:37d85073-c7d1-4e5a-91c3-0c75cbfb944d,client:10.0.0.161,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-pxc-0,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:45:03.227) (total time: 664ms): Trace[1988040821]: ---"About to write a response" 663ms (01:45:03.891) Trace[1988040821]: [664.133078ms] [664.133078ms] END I0320 01:45:03.892295 1 trace.go:236] Trace[76860101]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9fad2975-289c-4eaa-b94e-f6ea75d67859,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:45:03.166) (total time: 725ms): Trace[76860101]: ["GuaranteedUpdate etcd3" audit-id:9fad2975-289c-4eaa-b94e-f6ea75d67859,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 725ms (01:45:03.166) Trace[76860101]: ---"Txn call completed" 723ms (01:45:03.890)] Trace[76860101]: [725.57651ms] [725.57651ms] END I0320 01:45:03.893497 1 trace.go:236] Trace[1796484817]: "Get" accept:application/json, */*,audit-id:f78a1cd4-51fc-423d-9323-8bba5bca3fe8,client:10.0.0.40,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/local-path-storage/pods/helper-pod-create-pvc-167b04f8-e85d-4f83-87f8-ad3017a30b57,user-agent:local-path-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:45:03.317) (total time: 576ms): Trace[1796484817]: ---"About to write a response" 575ms (01:45:03.892) Trace[1796484817]: [576.210571ms] [576.210571ms] END I0320 01:45:48.391238 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.100.73.235"} I0320 01:45:48.408679 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0320 01:46:01.770395 1 trace.go:236] Trace[1387309587]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fc81a90e-eabd-40db-a8d5-cbb00094c2f3,client:10.0.0.161,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:46:00.936) (total time: 833ms): Trace[1387309587]: ["GuaranteedUpdate etcd3" audit-id:fc81a90e-eabd-40db-a8d5-cbb00094c2f3,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 833ms (01:46:00.936) Trace[1387309587]: ---"Txn call completed" 832ms (01:46:01.770)] Trace[1387309587]: [833.893145ms] [833.893145ms] END I0320 01:46:01.770767 1 trace.go:236] Trace[95464460]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:fdb7d7cd-20d2-4c71-8b85-72dfefd24a63,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:46:00.945) (total time: 825ms): Trace[95464460]: ---"About to write a response" 824ms (01:46:01.770) Trace[95464460]: [825.126226ms] [825.126226ms] END I0320 01:46:01.787692 1 trace.go:236] Trace[200624446]: "Get" accept:application/json, */*,audit-id:8904a9e0-4205-4806-aa9b-2ee87286ae28,client:10.0.0.199,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-cainjector-leader-election,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:46:01.270) (total time: 517ms): Trace[200624446]: ---"About to write a response" 516ms (01:46:01.787) Trace[200624446]: [517.091723ms] [517.091723ms] END I0320 01:46:01.788346 1 trace.go:236] Trace[1754810471]: "Get" accept:application/json, */*,audit-id:33699c7f-510b-4716-a073-1275729b0766,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:46:01.180) (total time: 608ms): Trace[1754810471]: ---"About to write a response" 608ms (01:46:01.788) Trace[1754810471]: [608.257387ms] [608.257387ms] END I0320 01:46:01.788540 1 trace.go:236] Trace[415527943]: "Get" accept:application/json, */*,audit-id:00dcbb7b-b27b-4bb3-9e1a-66d5e048214a,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:46:01.266) (total time: 522ms): Trace[415527943]: ---"About to write a response" 521ms (01:46:01.788) Trace[415527943]: [522.163769ms] [522.163769ms] END I0320 01:46:01.788712 1 trace.go:236] Trace[541368886]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:54e9f735-5e95-45d1-9a79-ad5f9ca73c84,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:46:01.036) (total time: 751ms): Trace[541368886]: ---"About to write a response" 751ms (01:46:01.788) Trace[541368886]: [751.775356ms] [751.775356ms] END I0320 01:46:01.788815 1 trace.go:236] Trace[1655486495]: "Get" accept:application/json, */*,audit-id:49ff7c5e-0532-48bb-b886-00fd345648c5,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:46:01.179) (total time: 608ms): Trace[1655486495]: ---"About to write a response" 608ms (01:46:01.788) Trace[1655486495]: [608.832951ms] [608.832951ms] END I0320 01:46:19.134252 1 trace.go:236] Trace[1164077310]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:dc99e1c4-0c37-4c8d-8b09-2f6ccb7def70,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:46:18.365) (total time: 769ms): Trace[1164077310]: ---"About to write a response" 768ms (01:46:19.133) Trace[1164077310]: [769.106517ms] [769.106517ms] END I0320 01:46:19.134365 1 trace.go:236] Trace[1045478435]: "Get" accept:application/json, */*,audit-id:96ddf6f4-acc3-4968-94d4-e9860bae4599,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:46:18.444) (total time: 690ms): Trace[1045478435]: ---"About to write a response" 690ms (01:46:19.134) Trace[1045478435]: [690.175081ms] [690.175081ms] END I0320 01:46:19.134564 1 trace.go:236] Trace[1972724528]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:58742676-f93d-46ef-af70-d004522d1034,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:46:18.491) (total time: 642ms): Trace[1972724528]: ["GuaranteedUpdate etcd3" audit-id:58742676-f93d-46ef-af70-d004522d1034,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 642ms (01:46:18.491) Trace[1972724528]: ---"Txn call completed" 641ms (01:46:19.134)] Trace[1972724528]: [642.746619ms] [642.746619ms] END I0320 01:46:19.134694 1 trace.go:236] Trace[1322940845]: "Get" accept:application/json, */*,audit-id:c3f9a20b-ea5c-44cb-8459-ad3c32500a10,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (20-Mar-2026 01:46:18.444) (total time: 690ms): Trace[1322940845]: ---"About to write a response" 689ms (01:46:19.134) Trace[1322940845]: [690.024908ms] [690.024908ms] END I0320 01:46:19.134700 1 trace.go:236] Trace[753226011]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:57942bd9-ef99-4914-8a15-1ef37a508abc,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (20-Mar-2026 01:46:18.532) (total time: 601ms): Trace[753226011]: ["GuaranteedUpdate etcd3" audit-id:57942bd9-ef99-4914-8a15-1ef37a508abc,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 601ms (01:46:18.532) Trace[753226011]: ---"Txn call completed" 600ms (01:46:19.134)] Trace[753226011]: [601.73232ms] [601.73232ms] END I0320 01:46:19.135108 1 trace.go:236] Trace[833321733]: "Get" accept:application/json, */*,audit-id:d6ef79db-c32d-4230-a5c9-4c6c24297c7f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (20-Mar-2026 01:46:18.411) (total time: 723ms): Trace[833321733]: ---"About to write a response" 722ms (01:46:19.134) Trace[833321733]: [723.25578ms] [723.25578ms] END I0320 01:48:46.714098 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.110.243.74"} E0320 01:49:13.137326 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 199.204.45.235:60640->199.204.45.235:10250: write: broken pipe I0320 01:49:20.082363 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.106.245.182"} I0320 01:51:09.541261 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.560764 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.563926 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0320 01:51:09.576844 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.585132 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.592458 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0320 01:51:09.625836 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.645350 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.655238 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.665088 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.692608 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.703465 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.720684 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.736375 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.760363 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.788982 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.839434 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:09.875319 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:10.005603 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0320 01:51:50.285768 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0320 01:51:50.295951 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0320 01:51:55.379102 1 trace.go:236] Trace[1546000237]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:6537d935-14a6-434b-91ef-329f313a0088,client:199.204.45.235,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (20-Mar-2026 01:51:54.831) (total time: 547ms): Trace[1546000237]: ---"About to write a response" 547ms (01:51:55.378) Trace[1546000237]: [547.602041ms] [547.602041ms] END I0320 01:51:55.379420 1 trace.go:236] Trace[1260024249]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b6a05980-51fd-44c1-bc30-d612f83c7244,client:10.0.0.108,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (20-Mar-2026 01:51:54.718) (total time: 661ms): Trace[1260024249]: ["GuaranteedUpdate etcd3" audit-id:b6a05980-51fd-44c1-bc30-d612f83c7244,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 660ms (01:51:54.718) Trace[1260024249]: ---"Txn call completed" 660ms (01:51:55.379)] Trace[1260024249]: [661.047436ms] [661.047436ms] END I0320 01:52:08.882961 1 trace.go:236] Trace[180292001]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:ffbcd5d9-5f59-4c4d-b8bf-1dc60d43c88d,client:199.204.45.235,protocol:HTTP/2.0,resource:jobs,scope:resource,url:/apis/batch/v1/namespaces/openstack/jobs/rook-ceph-detect-version/status,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:job-controller,verb:PUT (20-Mar-2026 01:52:08.306) (total time: 576ms): Trace[180292001]: ["GuaranteedUpdate etcd3" audit-id:ffbcd5d9-5f59-4c4d-b8bf-1dc60d43c88d,key:/jobs/openstack/rook-ceph-detect-version,type:*batch.Job,resource:jobs.batch 575ms (01:52:08.307) Trace[180292001]: ---"Txn call completed" 573ms (01:52:08.882)] Trace[180292001]: [576.01821ms] [576.01821ms] END I0320 01:52:08.883104 1 trace.go:236] Trace[611659522]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:b8f8aa21-3db9-4835-a7d6-10dbb2d33c03,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rook-ceph-detect-version-ltqql,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:52:08.298) (total time: 584ms): Trace[611659522]: ---"About to write a response" 583ms (01:52:08.882) Trace[611659522]: [584.479427ms] [584.479427ms] END I0320 01:52:24.130277 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.96.143.164"} I0320 01:52:25.056410 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.109.241.84"} I0320 01:52:59.897941 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.98.244.196"} I0320 01:53:27.609293 1 trace.go:236] Trace[1372428151]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/199.204.45.235,type:*v1.Endpoints,resource:apiServerIPInfo (20-Mar-2026 01:53:26.783) (total time: 826ms): Trace[1372428151]: ---"Transaction prepared" 354ms (01:53:27.139) Trace[1372428151]: ---"Txn call completed" 469ms (01:53:27.609) Trace[1372428151]: [826.173047ms] [826.173047ms] END I0320 01:53:28.252004 1 trace.go:236] Trace[398833405]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f423572f-0bef-4d29-8b74-2aa981d4aa41,client:::1,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:kube-apiserver/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (20-Mar-2026 01:53:27.610) (total time: 641ms): Trace[398833405]: ---"About to write a response" 641ms (01:53:28.251) Trace[398833405]: [641.821416ms] [641.821416ms] END I0320 01:53:28.252842 1 trace.go:236] Trace[1099217812]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:d9f33f8e-0184-4a26-a474-2f2066238020,client:199.204.45.235,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rook-ceph-rgw-ceph-a-699b8bdb59-9m4t7/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (20-Mar-2026 01:53:27.611) (total time: 641ms): Trace[1099217812]: ["GuaranteedUpdate etcd3" audit-id:d9f33f8e-0184-4a26-a474-2f2066238020,key:/pods/openstack/rook-ceph-rgw-ceph-a-699b8bdb59-9m4t7,type:*core.Pod,resource:pods 640ms (01:53:27.611) Trace[1099217812]: ---"Txn call completed" 632ms (01:53:28.251)] Trace[1099217812]: ---"Object stored in database" 633ms (01:53:28.252) Trace[1099217812]: [641.153411ms] [641.153411ms] END I0320 01:56:22.102591 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.101.249.216"}