I0331 01:18:40.256838 1 options.go:220] external host was not specified, using 162.253.55.36 I0331 01:18:40.257666 1 server.go:148] Version: v1.28.13 I0331 01:18:40.257765 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0331 01:18:40.873610 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0331 01:18:40.882736 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0331 01:18:40.882770 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0331 01:18:40.883018 1 instance.go:298] Using reconciler: lease I0331 01:18:41.276774 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0331 01:18:41.276805 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0331 01:18:41.544169 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0331 01:18:41.544385 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0331 01:18:42.010607 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0331 01:18:42.021784 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0331 01:18:42.021820 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.021827 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.022469 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0331 01:18:42.022486 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0331 01:18:42.023606 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0331 01:18:42.024581 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0331 01:18:42.024598 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0331 01:18:42.024603 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0331 01:18:42.026318 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0331 01:18:42.026337 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0331 01:18:42.027506 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0331 01:18:42.027519 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.027523 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.028085 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0331 01:18:42.028099 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.028149 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0331 01:18:42.028638 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0331 01:18:42.030193 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0331 01:18:42.030207 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.030211 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.030795 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0331 01:18:42.030809 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.030812 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.031396 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0331 01:18:42.031410 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0331 01:18:42.032664 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0331 01:18:42.032679 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.032683 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.033074 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0331 01:18:42.033089 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.033093 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.034683 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0331 01:18:42.034697 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.034701 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.035784 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0331 01:18:42.036619 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0331 01:18:42.036634 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.036638 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.039471 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0331 01:18:42.039486 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0331 01:18:42.039490 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0331 01:18:42.040225 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0331 01:18:42.040246 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0331 01:18:42.040250 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0331 01:18:42.040693 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0331 01:18:42.040707 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0331 01:18:42.088057 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0331 01:18:42.088099 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0331 01:18:42.507410 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0331 01:18:42.507454 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0331 01:18:42.507938 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0331 01:18:42.508158 1 secure_serving.go:213] Serving securely on [::]:6443 I0331 01:18:42.508258 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0331 01:18:42.508280 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0331 01:18:42.508319 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0331 01:18:42.508360 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0331 01:18:42.508491 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0331 01:18:42.508527 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0331 01:18:42.508808 1 gc_controller.go:78] Starting apiserver lease garbage collector I0331 01:18:42.508965 1 gc_controller.go:78] Starting apiserver lease garbage collector I0331 01:18:42.509077 1 controller.go:116] Starting legacy_token_tracking_controller I0331 01:18:42.509119 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0331 01:18:42.509179 1 system_namespaces_controller.go:67] Starting system namespaces controller I0331 01:18:42.509218 1 aggregator.go:164] waiting for initial CRD sync... I0331 01:18:42.509248 1 controller.go:80] Starting OpenAPI V3 AggregationController I0331 01:18:42.509273 1 controller.go:78] Starting OpenAPI AggregationController I0331 01:18:42.509319 1 controller.go:134] Starting OpenAPI controller I0331 01:18:42.509391 1 controller.go:85] Starting OpenAPI V3 controller I0331 01:18:42.509434 1 naming_controller.go:291] Starting NamingConditionController I0331 01:18:42.509467 1 establishing_controller.go:76] Starting EstablishingController I0331 01:18:42.509497 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0331 01:18:42.509528 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0331 01:18:42.509560 1 crd_finalizer.go:266] Starting CRDFinalizer I0331 01:18:42.509319 1 available_controller.go:423] Starting AvailableConditionController I0331 01:18:42.509599 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0331 01:18:42.509499 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0331 01:18:42.509635 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0331 01:18:42.509276 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0331 01:18:42.509847 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0331 01:18:42.509977 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0331 01:18:42.509994 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0331 01:18:42.510079 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0331 01:18:42.574091 1 shared_informer.go:318] Caches are synced for node_authorizer E0331 01:18:42.581261 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0331 01:18:42.608639 1 apf_controller.go:379] Running API Priority and Fairness config worker I0331 01:18:42.608661 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0331 01:18:42.608733 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0331 01:18:42.609187 1 shared_informer.go:318] Caches are synced for configmaps I0331 01:18:42.609677 1 cache.go:39] Caches are synced for AvailableConditionController controller I0331 01:18:42.609834 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0331 01:18:42.610297 1 shared_informer.go:318] Caches are synced for crd-autoregister I0331 01:18:42.610348 1 aggregator.go:166] initial CRD sync complete... I0331 01:18:42.610369 1 autoregister_controller.go:141] Starting autoregister controller I0331 01:18:42.610378 1 cache.go:32] Waiting for caches to sync for autoregister controller I0331 01:18:42.610387 1 cache.go:39] Caches are synced for autoregister controller I0331 01:18:42.611258 1 controller.go:624] quota admission added evaluator for: namespaces I0331 01:18:42.785021 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0331 01:18:43.516044 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0331 01:18:43.525238 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0331 01:18:43.525269 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0331 01:18:44.167448 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0331 01:18:44.221077 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0331 01:18:44.323845 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0331 01:18:44.332322 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.36] I0331 01:18:44.334490 1 controller.go:624] quota admission added evaluator for: endpoints I0331 01:18:44.340693 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0331 01:18:46.192353 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0331 01:18:46.258632 1 controller.go:624] quota admission added evaluator for: deployments.apps I0331 01:18:46.276711 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0331 01:18:46.446048 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0331 01:18:51.086052 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0331 01:18:51.387025 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0331 01:19:13.950224 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0331 01:19:14.004317 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0331 01:19:14.004422 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0331 01:19:14.026763 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0331 01:19:14.042172 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0331 01:19:14.056959 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0331 01:19:14.095457 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0331 01:19:14.095515 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0331 01:19:14.113219 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0331 01:19:14.142665 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0331 01:19:14.142721 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0331 01:19:14.178303 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0331 01:19:14.178360 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0331 01:19:14.233125 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0331 01:19:14.363922 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0331 01:19:14.364033 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0331 01:19:14.383714 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0331 01:19:14.399040 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:14.455368 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:14.494790 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:14.534669 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:14.553889 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:15.283500 1 trace.go:236] Trace[100791563]: "Create" accept:application/json,audit-id:6bb8d746-31f2-4a56-80b2-923cdaefb706,client:162.253.55.36,protocol:HTTP/2.0,resource:customresourcedefinitions,scope:resource,url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:Helm/3.11.2,verb:POST (31-Mar-2026 01:19:14.373) (total time: 909ms): Trace[100791563]: ---"Conversion done" 25ms (01:19:14.402) Trace[100791563]: ["Create etcd3" audit-id:6bb8d746-31f2-4a56-80b2-923cdaefb706,key:/apiextensions.k8s.io/customresourcedefinitions/envoyproxies.gateway.envoyproxy.io,type:*apiextensions.CustomResourceDefinition,resource:customresourcedefinitions.apiextensions.k8s.io 699ms (01:19:14.583) Trace[100791563]: ---"Txn call succeeded" 619ms (01:19:15.213)] Trace[100791563]: ---"Writing http response done" 23ms (01:19:15.283) Trace[100791563]: [909.706387ms] [909.706387ms] END I0331 01:19:15.795666 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:15.802202 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:15.887182 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0331 01:19:21.823575 1 trace.go:236] Trace[2090876471]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.693) (total time: 1129ms): Trace[2090876471]: [1.129829428s] [1.129829428s] END I0331 01:19:21.824606 1 trace.go:236] Trace[69696138]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:21664174-2764-498f-b0b6-dfa271abbcaf,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/cilium-lqwff/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 01:19:20.638) (total time: 1185ms): Trace[69696138]: ["GuaranteedUpdate etcd3" audit-id:21664174-2764-498f-b0b6-dfa271abbcaf,key:/pods/kube-system/cilium-lqwff,type:*core.Pod,resource:pods 1185ms (01:19:20.639) Trace[69696138]: ---"Txn call completed" 1173ms (01:19:21.823)] Trace[69696138]: ---"Object stored in database" 1175ms (01:19:21.823) Trace[69696138]: [1.185751928s] [1.185751928s] END I0331 01:19:21.827121 1 trace.go:236] Trace[861417254]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.865) (total time: 961ms): Trace[861417254]: [961.64043ms] [961.64043ms] END I0331 01:19:21.827344 1 trace.go:236] Trace[1310329536]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:a6dd9066-ea42-4bcc-bed3-0a749c9846e5,client:162.253.55.36,protocol:HTTP/2.0,resource:clienttrafficpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/clienttrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:21.041) (total time: 786ms): Trace[1310329536]: ["List(recursive=true) etcd3" audit-id:a6dd9066-ea42-4bcc-bed3-0a749c9846e5,key:/gateway.envoyproxy.io/clienttrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 786ms (01:19:21.041)] Trace[1310329536]: [786.193639ms] [786.193639ms] END I0331 01:19:21.827609 1 trace.go:236] Trace[1815645299]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/referencegrants,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:21.055) (total time: 772ms): Trace[1815645299]: [772.48997ms] [772.48997ms] END I0331 01:19:21.827660 1 trace.go:236] Trace[1601804742]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/securitypolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:21.003) (total time: 824ms): Trace[1601804742]: [824.013835ms] [824.013835ms] END I0331 01:19:21.827718 1 trace.go:236] Trace[2114856401]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/clienttrafficpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:21.040) (total time: 787ms): Trace[2114856401]: [787.144992ms] [787.144992ms] END I0331 01:19:21.827620 1 trace.go:236] Trace[1131044076]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:b1b41098-348d-4ec4-bef8-2f61745103ec,client:162.253.55.36,protocol:HTTP/2.0,resource:securitypolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/securitypolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:21.004) (total time: 823ms): Trace[1131044076]: ["List(recursive=true) etcd3" audit-id:b1b41098-348d-4ec4-bef8-2f61745103ec,key:/gateway.envoyproxy.io/securitypolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 823ms (01:19:21.004)] Trace[1131044076]: [823.122622ms] [823.122622ms] END I0331 01:19:21.828684 1 trace.go:236] Trace[1322986546]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:2cfb3cc6-ea66-4542-8294-d78cd29ff8bd,client:162.253.55.36,protocol:HTTP/2.0,resource:tcproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1alpha2/tcproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.805) (total time: 1023ms): Trace[1322986546]: ["List(recursive=true) etcd3" audit-id:2cfb3cc6-ea66-4542-8294-d78cd29ff8bd,key:/gateway.networking.k8s.io/tcproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1023ms (01:19:20.805)] Trace[1322986546]: [1.023172784s] [1.023172784s] END I0331 01:19:21.828884 1 trace.go:236] Trace[1216182812]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:7c63a7ad-9471-41b2-9439-42d77e6f93ae,client:162.253.55.36,protocol:HTTP/2.0,resource:xbackendtrafficpolicies,scope:cluster,url:/apis/gateway.networking.x-k8s.io/v1alpha1/xbackendtrafficpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.828) (total time: 999ms): Trace[1216182812]: ["List(recursive=true) etcd3" audit-id:7c63a7ad-9471-41b2-9439-42d77e6f93ae,key:/gateway.networking.x-k8s.io/xbackendtrafficpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 999ms (01:19:20.829)] Trace[1216182812]: [999.864975ms] [999.864975ms] END I0331 01:19:21.828978 1 trace.go:236] Trace[6223927]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:f8ca0892-6cea-4b8e-9c4e-cd4cd4c0eb07,client:162.253.55.36,protocol:HTTP/2.0,resource:referencegrants,scope:cluster,url:/apis/gateway.networking.k8s.io/v1beta1/referencegrants,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:21.055) (total time: 773ms): Trace[6223927]: ["List(recursive=true) etcd3" audit-id:f8ca0892-6cea-4b8e-9c4e-cd4cd4c0eb07,key:/gateway.networking.k8s.io/referencegrants,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 773ms (01:19:21.055)] Trace[6223927]: [773.271829ms] [773.271829ms] END I0331 01:19:21.829120 1 trace.go:236] Trace[749643005]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/tcproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.804) (total time: 1024ms): Trace[749643005]: [1.024272741s] [1.024272741s] END I0331 01:19:21.829576 1 trace.go:236] Trace[1933705776]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.x-k8s.io/xbackendtrafficpolicies,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.828) (total time: 1001ms): Trace[1933705776]: [1.001231438s] [1.001231438s] END I0331 01:19:21.830121 1 trace.go:236] Trace[1310582401]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gateways,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.740) (total time: 1089ms): Trace[1310582401]: [1.089270997s] [1.089270997s] END I0331 01:19:21.830232 1 trace.go:236] Trace[687292639]: "List(recursive=true) etcd3" audit-id:,key:/gateway.envoyproxy.io/httproutefilters,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.850) (total time: 979ms): Trace[687292639]: [979.622021ms] [979.622021ms] END I0331 01:19:21.830236 1 trace.go:236] Trace[2066043952]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:21.192) (total time: 637ms): Trace[2066043952]: [637.833085ms] [637.833085ms] END I0331 01:19:21.830242 1 trace.go:236] Trace[1558717301]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:4b28488c-4df3-4e30-9e83-96a77df63529,client:162.253.55.36,protocol:HTTP/2.0,resource:envoypatchpolicies,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/envoypatchpolicies,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.865) (total time: 964ms): Trace[1558717301]: ["List(recursive=true) etcd3" audit-id:4b28488c-4df3-4e30-9e83-96a77df63529,key:/gateway.envoyproxy.io/envoypatchpolicies,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 964ms (01:19:20.865)] Trace[1558717301]: [964.358466ms] [964.358466ms] END I0331 01:19:21.830286 1 trace.go:236] Trace[1309737395]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/httproutes,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:21.316) (total time: 513ms): Trace[1309737395]: [513.479967ms] [513.479967ms] END I0331 01:19:21.831122 1 trace.go:236] Trace[533181078]: "List(recursive=true) etcd3" audit-id:,key:/gateway.networking.k8s.io/gateways,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (31-Mar-2026 01:19:20.779) (total time: 1052ms): Trace[533181078]: [1.052030425s] [1.052030425s] END I0331 01:19:21.831713 1 trace.go:236] Trace[1728531910]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:57c585ea-f0ed-4709-8692-9ba858441d7f,client:162.253.55.36,protocol:HTTP/2.0,resource:gateways,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/gateways,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.778) (total time: 1052ms): Trace[1728531910]: ["List(recursive=true) etcd3" audit-id:57c585ea-f0ed-4709-8692-9ba858441d7f,key:/gateway.networking.k8s.io/gateways,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1052ms (01:19:20.779)] Trace[1728531910]: [1.052739172s] [1.052739172s] END I0331 01:19:21.833328 1 trace.go:236] Trace[413937582]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:4aa028ca-52ab-456d-a1df-964526703229,client:162.253.55.36,protocol:HTTP/2.0,resource:grpcroutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/grpcroutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.694) (total time: 1138ms): Trace[413937582]: ["List(recursive=true) etcd3" audit-id:4aa028ca-52ab-456d-a1df-964526703229,key:/gateway.networking.k8s.io/grpcroutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 1138ms (01:19:20.694)] Trace[413937582]: [1.138494015s] [1.138494015s] END I0331 01:19:21.833531 1 trace.go:236] Trace[1484721407]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:3edc8980-aeb5-4066-92ba-8a42d35df2fb,client:162.253.55.36,protocol:HTTP/2.0,resource:httproutefilters,scope:cluster,url:/apis/gateway.envoyproxy.io/v1alpha1/httproutefilters,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:20.851) (total time: 982ms): Trace[1484721407]: ["List(recursive=true) etcd3" audit-id:3edc8980-aeb5-4066-92ba-8a42d35df2fb,key:/gateway.envoyproxy.io/httproutefilters,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 982ms (01:19:20.851)] Trace[1484721407]: [982.432398ms] [982.432398ms] END I0331 01:19:21.833922 1 trace.go:236] Trace[1601752382]: "List" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadataList;g=meta.k8s.io;v=v1,application/json,audit-id:6cca2c4b-0f01-4a08-9adc-86200a57aa93,client:162.253.55.36,protocol:HTTP/2.0,resource:httproutes,scope:cluster,url:/apis/gateway.networking.k8s.io/v1/httproutes,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/metadata-informers,verb:LIST (31-Mar-2026 01:19:21.317) (total time: 516ms): Trace[1601752382]: ["List(recursive=true) etcd3" audit-id:6cca2c4b-0f01-4a08-9adc-86200a57aa93,key:/gateway.networking.k8s.io/httproutes,resourceVersion:0,resourceVersionMatch:,limit:500,continue: 516ms (01:19:21.317)] Trace[1601752382]: [516.314005ms] [516.314005ms] END I0331 01:19:21.858471 1 trace.go:236] Trace[1157442696]: "Update" accept:application/json, */*,audit-id:73041a53-e023-41d7-8c3b-d2aa832dd753,client:162.253.55.36,protocol:HTTP/2.0,resource:secrets,scope:resource,url:/api/v1/namespaces/envoy-gateway-system/secrets/sh.helm.release.v1.envoy-gateway.v1,user-agent:Helm/3.11.2,verb:PUT (31-Mar-2026 01:19:20.998) (total time: 859ms): Trace[1157442696]: ---"Conversion done" 26ms (01:19:21.030) Trace[1157442696]: ["GuaranteedUpdate etcd3" audit-id:73041a53-e023-41d7-8c3b-d2aa832dd753,key:/secrets/envoy-gateway-system/sh.helm.release.v1.envoy-gateway.v1,type:*core.Secret,resource:secrets 827ms (01:19:21.030) Trace[1157442696]: ---"Txn call completed" 792ms (01:19:21.828)] Trace[1157442696]: ---"Writing http response done" 29ms (01:19:21.858) Trace[1157442696]: [859.411212ms] [859.411212ms] END I0331 01:19:22.365955 1 controller.go:624] quota admission added evaluator for: jobs.batch I0331 01:19:23.314666 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0331 01:19:23.369538 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0331 01:19:23.406932 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0331 01:19:23.508508 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0331 01:19:24.195507 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0331 01:19:24.215709 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0331 01:19:24.322168 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0331 01:19:26.083659 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0331 01:19:26.405304 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0331 01:19:26.972333 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0331 01:19:27.324974 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0331 01:19:32.385795 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0331 01:19:32.385835 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0331 01:19:32.909806 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0331 01:19:38.764880 1 trace.go:236] Trace[1265735770]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:643850a2-cb10-45ca-874c-61fbf809e34d,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/instance,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PUT (31-Mar-2026 01:19:38.251) (total time: 512ms): Trace[1265735770]: ["GuaranteedUpdate etcd3" audit-id:643850a2-cb10-45ca-874c-61fbf809e34d,key:/leases/kube-node-lease/instance,type:*coordination.Lease,resource:leases.coordination.k8s.io 512ms (01:19:38.252) Trace[1265735770]: ---"Txn call completed" 511ms (01:19:38.764)] Trace[1265735770]: [512.932763ms] [512.932763ms] END I0331 01:19:42.684839 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.108.68.165"} W0331 01:19:42.721098 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.68.165:9443: connect: connection refused E0331 01:19:42.721159 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.108.68.165:9443: connect: connection refused I0331 01:19:56.493837 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0331 01:19:56.766612 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0331 01:19:56.824526 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0331 01:19:56.840828 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager" clusterIPs={"IPv4":"10.96.136.221"} I0331 01:19:56.856804 1 alloc.go:330] "allocated clusterIPs" service="cert-manager/cert-manager-webhook" clusterIPs={"IPv4":"10.108.184.204"} I0331 01:19:56.866371 1 handler.go:275] Adding GroupVersion acme.cert-manager.io v1 to ResourceManager I0331 01:19:56.914490 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0331 01:19:56.979970 1 handler.go:275] Adding GroupVersion cert-manager.io v1 to ResourceManager I0331 01:20:09.317137 1 controller.go:624] quota admission added evaluator for: certificates.cert-manager.io I0331 01:20:14.722183 1 controller.go:624] quota admission added evaluator for: certificaterequests.cert-manager.io I0331 01:20:29.097802 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-defaultbackend" clusterIPs={"IPv4":"10.104.135.112"} I0331 01:20:29.126806 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-metrics" clusterIPs={"IPv4":"10.97.173.132"} I0331 01:20:29.170750 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs={"IPv4":"10.97.247.113"} I0331 01:20:29.200624 1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs={"IPv4":"10.102.163.167"} I0331 01:20:36.589383 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.614990 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.638943 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.659233 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.678385 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.699386 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.719438 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.740326 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.796247 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.819991 1 handler.go:275] Adding GroupVersion rabbitmq.com v1alpha1 to ResourceManager I0331 01:20:36.836983 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.865089 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:36.884861 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:38.300354 1 handler.go:275] Adding GroupVersion rabbitmq.com v1beta1 to ResourceManager I0331 01:20:42.247671 1 controller.go:624] quota admission added evaluator for: networkpolicies.networking.k8s.io I0331 01:20:42.255542 1 controller.go:624] quota admission added evaluator for: poddisruptionbudgets.policy I0331 01:20:42.338979 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-messaging-topology-operator-webhook" clusterIPs={"IPv4":"10.102.232.208"} I0331 01:20:42.367220 1 controller.go:624] quota admission added evaluator for: issuers.cert-manager.io I0331 01:20:44.865436 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0331 01:20:44.938030 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0331 01:20:45.756396 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-10-0 to ResourceManager I0331 01:20:45.756440 1 handler.go:275] Adding GroupVersion pxc.percona.com v1-11-0 to ResourceManager I0331 01:20:45.756482 1 handler.go:275] Adding GroupVersion pxc.percona.com v1 to ResourceManager I0331 01:20:52.538300 1 controller.go:624] quota admission added evaluator for: perconaxtradbclusters.pxc.percona.com I0331 01:20:56.479893 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-cluster-operator" clusterIPs={"IPv4":"10.97.117.185"} I0331 01:20:56.758182 1 controller.go:624] quota admission added evaluator for: statefulsets.apps I0331 01:20:56.926205 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy" clusterIPs={"IPv4":"10.96.43.207"} I0331 01:20:56.939313 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-replicas" clusterIPs={"IPv4":"10.104.40.29"} I0331 01:21:00.096128 1 trace.go:236] Trace[403830457]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6765b32b-e635-457c-a9c4-77883501eb79,client:10.0.0.214,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:20:59.528) (total time: 567ms): Trace[403830457]: ["GuaranteedUpdate etcd3" audit-id:6765b32b-e635-457c-a9c4-77883501eb79,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 567ms (01:20:59.528) Trace[403830457]: ---"Txn call completed" 565ms (01:21:00.095)] Trace[403830457]: [567.258911ms] [567.258911ms] END I0331 01:21:00.290982 1 trace.go:236] Trace[266599538]: "Get" accept:application/json, */*,audit-id:850ff30a-36bb-4c81-adba-53332aee7c69,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:20:59.426) (total time: 864ms): Trace[266599538]: ---"About to write a response" 864ms (01:21:00.290) Trace[266599538]: [864.741142ms] [864.741142ms] END I0331 01:21:00.291017 1 trace.go:236] Trace[76382]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:5e680775-6f5c-4fa6-b025-b73ee1227473,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:20:59.739) (total time: 551ms): Trace[76382]: ---"About to write a response" 551ms (01:21:00.290) Trace[76382]: [551.280151ms] [551.280151ms] END I0331 01:21:00.291089 1 trace.go:236] Trace[1636585623]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:566aeb91-113b-4d39-b397-310fbc7da2b3,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:20:59.734) (total time: 556ms): Trace[1636585623]: ---"About to write a response" 556ms (01:21:00.290) Trace[1636585623]: [556.191488ms] [556.191488ms] END I0331 01:21:00.291217 1 trace.go:236] Trace[467790051]: "Get" accept:application/json, */*,audit-id:e883b6e9-b615-476e-8e2e-038b9ccc5803,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:20:59.742) (total time: 548ms): Trace[467790051]: ---"About to write a response" 548ms (01:21:00.290) Trace[467790051]: [548.70969ms] [548.70969ms] END I0331 01:21:00.292049 1 trace.go:236] Trace[2140705483]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:54d56343-3c6e-4c8f-b6f6-9da6ec963b32,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/percona-xtradb-haproxy-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:20:59.554) (total time: 737ms): Trace[2140705483]: ---"About to write a response" 736ms (01:21:00.290) Trace[2140705483]: [737.77702ms] [737.77702ms] END I0331 01:21:00.292093 1 trace.go:236] Trace[778732000]: "Get" accept:application/json,audit-id:ecbdda60-4410-489d-ba7c-5550dadf6958,client:162.253.55.36,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 01:20:59.609) (total time: 682ms): Trace[778732000]: ---"About to write a response" 681ms (01:21:00.291) Trace[778732000]: [682.342421ms] [682.342421ms] END I0331 01:21:12.829073 1 trace.go:236] Trace[1745939340]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:9bc47fe5-f01c-419e-8b65-f15963e83f83,client:10.0.0.214,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:21:12.259) (total time: 569ms): Trace[1745939340]: ["GuaranteedUpdate etcd3" audit-id:9bc47fe5-f01c-419e-8b65-f15963e83f83,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 569ms (01:21:12.259) Trace[1745939340]: ---"Txn call completed" 568ms (01:21:12.828)] Trace[1745939340]: [569.514745ms] [569.514745ms] END I0331 01:21:52.046289 1 trace.go:236] Trace[1043879842]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:179e2d30-2882-4154-a86b-fd87ebd00e78,client:10.0.0.214,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:21:51.254) (total time: 791ms): Trace[1043879842]: ["GuaranteedUpdate etcd3" audit-id:179e2d30-2882-4154-a86b-fd87ebd00e78,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 791ms (01:21:51.254) Trace[1043879842]: ---"Txn call completed" 790ms (01:21:52.046)] Trace[1043879842]: [791.397345ms] [791.397345ms] END I0331 01:21:52.046705 1 trace.go:236] Trace[989267003]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:4becf005-fb4a-43c0-ab61-ac3730ec5fce,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:21:51.366) (total time: 680ms): Trace[989267003]: ---"About to write a response" 679ms (01:21:52.046) Trace[989267003]: [680.020585ms] [680.020585ms] END I0331 01:21:52.046722 1 trace.go:236] Trace[125374697]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:22900eed-2c19-4e19-b3c8-f042c2428bde,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:21:51.366) (total time: 680ms): Trace[125374697]: ---"About to write a response" 679ms (01:21:52.046) Trace[125374697]: [680.191809ms] [680.191809ms] END I0331 01:21:52.046803 1 trace.go:236] Trace[2051857059]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:91ca0953-9544-4171-8c9d-07b8ad613807,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:21:51.254) (total time: 792ms): Trace[2051857059]: ["GuaranteedUpdate etcd3" audit-id:91ca0953-9544-4171-8c9d-07b8ad613807,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 792ms (01:21:51.254) Trace[2051857059]: ---"Txn call completed" 791ms (01:21:52.046)] Trace[2051857059]: [792.508222ms] [792.508222ms] END I0331 01:21:52.046884 1 trace.go:236] Trace[2127662546]: "Get" accept:application/json, */*,audit-id:5fb5ddcb-d31c-4ecf-9ab6-bc6a0fc81453,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:21:51.280) (total time: 765ms): Trace[2127662546]: ---"About to write a response" 765ms (01:21:52.046) Trace[2127662546]: [765.901049ms] [765.901049ms] END I0331 01:21:52.046946 1 trace.go:236] Trace[1146849858]: "Get" accept:application/json, */*,audit-id:76176c13-9bd9-4c44-accf-8b3a3ca3ae3e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:21:51.366) (total time: 680ms): Trace[1146849858]: ---"About to write a response" 680ms (01:21:52.046) Trace[1146849858]: [680.571018ms] [680.571018ms] END I0331 01:21:52.049641 1 trace.go:236] Trace[2052233982]: "Get" accept:application/json,audit-id:a17798bb-9bae-4a8c-aab3-50b1c3e57a23,client:162.253.55.36,protocol:HTTP/1.1,resource:perconaxtradbclusters,scope:resource,url:/apis/pxc.percona.com/v1/namespaces/openstack/perconaxtradbclusters/percona-xtradb,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 01:21:51.282) (total time: 766ms): Trace[2052233982]: ---"About to write a response" 766ms (01:21:52.049) Trace[2052233982]: [766.725489ms] [766.725489ms] END I0331 01:21:52.707435 1 trace.go:236] Trace[828722509]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:15d60093-d1ee-44b3-b149-21bffd6e9cde,client:162.253.55.36,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/percona-xtradb-haproxy-0.18a1c869a44dbdf5,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 01:21:52.156) (total time: 550ms): Trace[828722509]: ["GuaranteedUpdate etcd3" audit-id:15d60093-d1ee-44b3-b149-21bffd6e9cde,key:/events/openstack/percona-xtradb-haproxy-0.18a1c869a44dbdf5,type:*core.Event,resource:events 550ms (01:21:52.156) Trace[828722509]: ---"initial value restored" 264ms (01:21:52.421) Trace[828722509]: ---"Txn call completed" 284ms (01:21:52.707)] Trace[828722509]: ---"Object stored in database" 284ms (01:21:52.707) Trace[828722509]: [550.78308ms] [550.78308ms] END I0331 01:22:29.129713 1 alloc.go:330] "allocated clusterIPs" service="openstack/percona-xtradb-haproxy-metrics" clusterIPs={"IPv4":"10.100.237.146"} I0331 01:22:31.911058 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey" clusterIPs={"IPv4":"10.97.41.235"} I0331 01:22:31.917838 1 alloc.go:330] "allocated clusterIPs" service="openstack/valkey-metrics" clusterIPs={"IPv4":"10.102.178.147"} I0331 01:22:38.767858 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak-metrics" clusterIPs={"IPv4":"10.100.162.188"} I0331 01:22:38.783014 1 alloc.go:330] "allocated clusterIPs" service="auth-system/keycloak" clusterIPs={"IPv4":"10.111.145.44"} I0331 01:22:43.177673 1 trace.go:236] Trace[2103063682]: "Update" accept:application/json, */*,audit-id:9856ec00-a340-4063-becf-a62c839f0e22,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:22:42.665) (total time: 511ms): Trace[2103063682]: ["GuaranteedUpdate etcd3" audit-id:9856ec00-a340-4063-becf-a62c839f0e22,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 511ms (01:22:42.666) Trace[2103063682]: ---"Txn call completed" 510ms (01:22:43.177)] Trace[2103063682]: [511.755177ms] [511.755177ms] END I0331 01:23:18.138912 1 trace.go:236] Trace[2126735324]: "Update" accept:application/json, */*,audit-id:5af21c47-709b-4608-acf1-cde23ad41cba,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:23:17.574) (total time: 564ms): Trace[2126735324]: ["GuaranteedUpdate etcd3" audit-id:5af21c47-709b-4608-acf1-cde23ad41cba,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 564ms (01:23:17.574) Trace[2126735324]: ---"Txn call completed" 563ms (01:23:18.138)] Trace[2126735324]: [564.378191ms] [564.378191ms] END I0331 01:23:18.180167 1 trace.go:236] Trace[272705949]: "Update" accept:application/json, */*,audit-id:708cba3b-c193-4b60-9aab-43a3aff0ccdc,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 01:23:17.591) (total time: 588ms): Trace[272705949]: ["GuaranteedUpdate etcd3" audit-id:708cba3b-c193-4b60-9aab-43a3aff0ccdc,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 588ms (01:23:17.591) Trace[272705949]: ---"Txn call completed" 587ms (01:23:18.179)] Trace[272705949]: [588.616764ms] [588.616764ms] END I0331 01:23:18.180681 1 trace.go:236] Trace[1165856654]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:7f4df790-7356-4340-853e-3c4c258b6757,client:162.253.55.36,protocol:HTTP/2.0,resource:persistentvolumes,scope:resource,url:/api/v1/persistentvolumes/pvc-37090dd1-0ca0-4596-9d28-657f7ece3955,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:23:17.590) (total time: 589ms): Trace[1165856654]: ---"About to write a response" 589ms (01:23:18.180) Trace[1165856654]: [589.885784ms] [589.885784ms] END I0331 01:23:18.181099 1 trace.go:236] Trace[1477448681]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:ccd812fa-a142-4b79-9885-03852b44b9d6,client:10.0.0.164,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:23:17.618) (total time: 562ms): Trace[1477448681]: ["GuaranteedUpdate etcd3" audit-id:ccd812fa-a142-4b79-9885-03852b44b9d6,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 562ms (01:23:17.618) Trace[1477448681]: ---"Txn call completed" 561ms (01:23:18.180)] Trace[1477448681]: [562.651811ms] [562.651811ms] END I0331 01:23:18.181132 1 trace.go:236] Trace[1603785808]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:a28b0f88-aed3-4cbe-8223-817938943f99,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 01:23:17.591) (total time: 589ms): Trace[1603785808]: ["GuaranteedUpdate etcd3" audit-id:a28b0f88-aed3-4cbe-8223-817938943f99,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 589ms (01:23:17.591) Trace[1603785808]: ---"Txn call completed" 588ms (01:23:18.180)] Trace[1603785808]: [589.383532ms] [589.383532ms] END I0331 01:23:18.181906 1 trace.go:236] Trace[1590303501]: "Update" accept:application/json, */*,audit-id:096b7751-cdb6-45a7-9240-eadec6545e4f,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 01:23:17.591) (total time: 590ms): Trace[1590303501]: ["GuaranteedUpdate etcd3" audit-id:096b7751-cdb6-45a7-9240-eadec6545e4f,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 590ms (01:23:17.591) Trace[1590303501]: ---"Txn call completed" 589ms (01:23:18.181)] Trace[1590303501]: [590.266973ms] [590.266973ms] END I0331 01:23:18.182143 1 trace.go:236] Trace[1508917918]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:3f6f6b02-6249-4bce-b1ba-1fb92388afbd,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 01:23:17.590) (total time: 591ms): Trace[1508917918]: ["GuaranteedUpdate etcd3" audit-id:3f6f6b02-6249-4bce-b1ba-1fb92388afbd,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 591ms (01:23:17.590) Trace[1508917918]: ---"Txn call completed" 590ms (01:23:18.181)] Trace[1508917918]: [591.261847ms] [591.261847ms] END I0331 01:23:18.184304 1 trace.go:236] Trace[371710815]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:016705e1-d341-4a66-9ffd-d484983c0cbd,client:162.253.55.36,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events/valkey-node-0.18a1c881b88c6b3a,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 01:23:17.574) (total time: 609ms): Trace[371710815]: ["GuaranteedUpdate etcd3" audit-id:016705e1-d341-4a66-9ffd-d484983c0cbd,key:/events/openstack/valkey-node-0.18a1c881b88c6b3a,type:*core.Event,resource:events 609ms (01:23:17.574) Trace[371710815]: ---"initial value restored" 605ms (01:23:18.180)] Trace[371710815]: [609.642731ms] [609.642731ms] END I0331 01:25:18.702529 1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io I0331 01:25:22.734413 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0331 01:25:22.773769 1 handler.go:275] Adding GroupVersion nfd.k8s-sigs.io v1alpha1 to ResourceManager I0331 01:25:26.955020 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0331 01:25:26.960010 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0331 01:25:26.975387 1 handler.go:275] Adding GroupVersion secretgen.carvel.dev v1alpha1 to ResourceManager I0331 01:25:26.987195 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0331 01:25:26.997289 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0331 01:25:27.007177 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0331 01:25:27.021361 1 handler.go:275] Adding GroupVersion secretgen.k14s.io v1alpha1 to ResourceManager I0331 01:25:29.009211 1 controller.go:624] quota admission added evaluator for: nodefeatures.nfd.k8s-sigs.io I0331 01:25:40.652889 1 controller.go:624] quota admission added evaluator for: passwords.secretgen.k14s.io I0331 01:26:19.976671 1 controller.go:624] quota admission added evaluator for: secrettemplates.secretgen.carvel.dev I0331 01:26:34.534981 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0331 01:26:34.682873 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:26:34.731593 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:26:34.987120 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0331 01:26:35.283655 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:26:35.287761 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:26:35.401101 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1alpha1 to ResourceManager I0331 01:26:35.419237 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:26:35.563745 1 handler.go:275] Adding GroupVersion monitoring.coreos.com v1 to ResourceManager I0331 01:27:14.225206 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-grafana" clusterIPs={"IPv4":"10.97.188.200"} I0331 01:27:14.260245 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-kube-state-metrics" clusterIPs={"IPv4":"10.97.134.248"} I0331 01:27:14.268385 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus" clusterIPs={"IPv4":"10.109.232.140"} I0331 01:27:14.276612 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-alertmanager" clusterIPs={"IPv4":"10.97.83.28"} I0331 01:27:14.282132 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-operator" clusterIPs={"IPv4":"10.98.28.156"} I0331 01:27:14.291523 1 alloc.go:330] "allocated clusterIPs" service="monitoring/kube-prometheus-stack-prometheus-node-exporter" clusterIPs={"IPv4":"10.107.207.41"} I0331 01:27:14.332926 1 controller.go:624] quota admission added evaluator for: alertmanagers.monitoring.coreos.com I0331 01:27:14.349871 1 controller.go:624] quota admission added evaluator for: prometheusrules.monitoring.coreos.com I0331 01:27:14.386378 1 controller.go:624] quota admission added evaluator for: podmonitors.monitoring.coreos.com I0331 01:27:14.398019 1 controller.go:624] quota admission added evaluator for: servicemonitors.monitoring.coreos.com I0331 01:27:14.417284 1 controller.go:624] quota admission added evaluator for: prometheuses.monitoring.coreos.com W0331 01:27:14.424860 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.424997 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425020 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.424915 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.424870 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425142 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.425230 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425290 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.425547 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425595 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.425781 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425859 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.425869 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.425907 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.426264 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.426329 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.426436 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.426468 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.426844 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.426844 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.426863 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.426911 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.426970 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.426984 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.427416 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.427441 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.427522 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.427592 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.427632 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.428037 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused W0331 01:27:14.429302 1 dispatcher.go:210] Failed calling webhook, failing open prometheusrulemutate.monitoring.coreos.com: failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused E0331 01:27:14.429349 1 dispatcher.go:214] failed calling webhook "prometheusrulemutate.monitoring.coreos.com": failed to call webhook: Post "https://kube-prometheus-stack-operator.monitoring.svc:443/admission-prometheusrules/mutate?timeout=10s": dial tcp 10.98.28.156:443: connect: connection refused I0331 01:27:24.795232 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki" clusterIPs={"IPv4":"10.110.146.176"} I0331 01:27:24.806055 1 alloc.go:330] "allocated clusterIPs" service="monitoring/loki-gateway" clusterIPs={"IPv4":"10.111.151.139"} I0331 01:27:25.897909 1 trace.go:236] Trace[1408866510]: "Create" accept:application/json, */*,audit-id:a4dae710-4790-45e7-93d6-bf604f39be02,client:162.253.55.36,protocol:HTTP/2.0,resource:ciliumidentities,scope:resource,url:/apis/cilium.io/v2/ciliumidentities,user-agent:cilium-agent/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:POST (31-Mar-2026 01:27:25.357) (total time: 540ms): Trace[1408866510]: ["Create etcd3" audit-id:a4dae710-4790-45e7-93d6-bf604f39be02,key:/cilium.io/ciliumidentities/43939,type:*unstructured.Unstructured,resource:ciliumidentities.cilium.io 539ms (01:27:25.358) Trace[1408866510]: ---"Txn call succeeded" 538ms (01:27:25.896)] Trace[1408866510]: [540.297766ms] [540.297766ms] END I0331 01:27:29.078546 1 alloc.go:330] "allocated clusterIPs" service="monitoring/goldpinger" clusterIPs={"IPv4":"10.111.214.138"} I0331 01:27:31.945661 1 alloc.go:330] "allocated clusterIPs" service="monitoring/prometheus-pushgateway" clusterIPs={"IPv4":"10.105.98.53"} I0331 01:27:36.433065 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached" clusterIPs={"IPv4":"10.108.202.156"} I0331 01:27:37.299277 1 alloc.go:330] "allocated clusterIPs" service="openstack/memcached-metrics" clusterIPs={"IPv4":"10.99.233.76"} I0331 01:27:38.838967 1 trace.go:236] Trace[1815392404]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:95f49067-a416-48f6-bbbf-a9a3e54b32a5,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 01:27:38.189) (total time: 649ms): Trace[1815392404]: ["GuaranteedUpdate etcd3" audit-id:95f49067-a416-48f6-bbbf-a9a3e54b32a5,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 649ms (01:27:38.189) Trace[1815392404]: ---"Txn call completed" 648ms (01:27:38.838)] Trace[1815392404]: [649.112853ms] [649.112853ms] END I0331 01:27:38.846720 1 trace.go:236] Trace[624857716]: "Update" accept:application/json, */*,audit-id:7c05f40c-f5c7-499e-83c6-eed3696bd7c6,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 01:27:38.189) (total time: 657ms): Trace[624857716]: ["GuaranteedUpdate etcd3" audit-id:7c05f40c-f5c7-499e-83c6-eed3696bd7c6,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 656ms (01:27:38.189) Trace[624857716]: ---"Txn call completed" 655ms (01:27:38.846)] Trace[624857716]: [657.00707ms] [657.00707ms] END I0331 01:27:38.846888 1 trace.go:236] Trace[3823438]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:940d4e38-f133-4b14-89d6-b73b87410cc8,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (31-Mar-2026 01:27:38.189) (total time: 657ms): Trace[3823438]: ["GuaranteedUpdate etcd3" audit-id:940d4e38-f133-4b14-89d6-b73b87410cc8,key:/leases/kube-system/kube-controller-manager,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (01:27:38.189) Trace[3823438]: ---"Txn call completed" 656ms (01:27:38.846)] Trace[3823438]: [657.113662ms] [657.113662ms] END I0331 01:27:38.847338 1 trace.go:236] Trace[25363082]: "Update" accept:application/json, */*,audit-id:4e78678c-1161-45a9-8a77-1a100b070a69,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:27:38.189) (total time: 657ms): Trace[25363082]: ["GuaranteedUpdate etcd3" audit-id:4e78678c-1161-45a9-8a77-1a100b070a69,key:/leases/kube-system/cilium-operator-resource-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (01:27:38.189) Trace[25363082]: ---"Txn call completed" 656ms (01:27:38.846)] Trace[25363082]: [657.713616ms] [657.713616ms] END I0331 01:27:38.848425 1 trace.go:236] Trace[575185854]: "Update" accept:application/json, */*,audit-id:1ed44df5-823b-49fd-908c-37805c44fe2e,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 01:27:38.190) (total time: 657ms): Trace[575185854]: ["GuaranteedUpdate etcd3" audit-id:1ed44df5-823b-49fd-908c-37805c44fe2e,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 657ms (01:27:38.190) Trace[575185854]: ---"Txn call completed" 656ms (01:27:38.848)] Trace[575185854]: [657.792259ms] [657.792259ms] END I0331 01:27:38.849020 1 trace.go:236] Trace[1175096202]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fdc77072-25e2-44e2-99f8-ce6f7c3e2138,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/memcached-memcached-6479589586-8v8r6,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:27:38.285) (total time: 563ms): Trace[1175096202]: ---"About to write a response" 562ms (01:27:38.848) Trace[1175096202]: [563.489451ms] [563.489451ms] END I0331 01:27:38.849144 1 trace.go:236] Trace[1962185449]: "Get" accept:application/json, */*,audit-id:8b0e2a2f-804f-4788-a12d-33b13b296491,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/keepalived-bjvnr,user-agent:kubernetes-entrypoint/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:27:38.313) (total time: 535ms): Trace[1962185449]: ---"About to write a response" 534ms (01:27:38.848) Trace[1962185449]: [535.359926ms] [535.359926ms] END I0331 01:27:38.859882 1 trace.go:236] Trace[873721204]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:e9a1d62b-d1c1-4264-abb7-60e6ae55c72b,client:162.253.55.36,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/monitoring/events/kube-prometheus-stack-prometheus-node-exporter-fp7fj.18a1c8bc439a8159,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 01:27:38.345) (total time: 514ms): Trace[873721204]: ["GuaranteedUpdate etcd3" audit-id:e9a1d62b-d1c1-4264-abb7-60e6ae55c72b,key:/events/monitoring/kube-prometheus-stack-prometheus-node-exporter-fp7fj.18a1c8bc439a8159,type:*core.Event,resource:events 514ms (01:27:38.345) Trace[873721204]: ---"initial value restored" 502ms (01:27:38.848)] Trace[873721204]: [514.507154ms] [514.507154ms] END I0331 01:27:46.967588 1 controller.go:624] quota admission added evaluator for: rabbitmqclusters.rabbitmq.com I0331 01:27:47.126158 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-keystone" clusterIPs={"IPv4":"10.105.17.42"} I0331 01:27:49.204051 1 trace.go:236] Trace[388005116]: "Patch" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:f4e7b42d-56c3-4658-81cd-5173d7c51ad1,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/prometheus-pushgateway-7b8659c68b-fbk54/status,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:PATCH (31-Mar-2026 01:27:48.683) (total time: 520ms): Trace[388005116]: ["GuaranteedUpdate etcd3" audit-id:f4e7b42d-56c3-4658-81cd-5173d7c51ad1,key:/pods/monitoring/prometheus-pushgateway-7b8659c68b-fbk54,type:*core.Pod,resource:pods 520ms (01:27:48.683) Trace[388005116]: ---"Txn call completed" 516ms (01:27:49.203)] Trace[388005116]: ---"Object stored in database" 516ms (01:27:49.203) Trace[388005116]: [520.588597ms] [520.588597ms] END I0331 01:28:02.673093 1 trace.go:236] Trace[506545244]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:0a78a8ef-ffd1-48bf-afa7-fed60ca957b9,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/monitoring/pods/prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:28:01.530) (total time: 1142ms): Trace[506545244]: ---"About to write a response" 1141ms (01:28:02.672) Trace[506545244]: [1.142254342s] [1.142254342s] END I0331 01:28:02.673129 1 trace.go:236] Trace[1532633943]: "Get" accept:application/json, */*,audit-id:70fadea3-7c3c-4ea6-b5b7-d793bc89880b,client:10.0.0.52,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/cert-manager/leases/cert-manager-controller,user-agent:cert-manager-leader-election/v1.12.17 (linux/amd64) cert-manager/37b853ff34a6c093e946c657c189f40413c0f628,verb:GET (31-Mar-2026 01:28:01.530) (total time: 1142ms): Trace[1532633943]: ---"About to write a response" 1142ms (01:28:02.672) Trace[1532633943]: [1.142133509s] [1.142133509s] END I0331 01:28:02.673419 1 trace.go:236] Trace[2061597489]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:087aa35b-90f2-4127-9771-b4fd769f34ad,client:162.253.55.36,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/monitoring/persistentvolumeclaims/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:28:01.599) (total time: 1073ms): Trace[2061597489]: ---"About to write a response" 1073ms (01:28:02.673) Trace[2061597489]: [1.073851846s] [1.073851846s] END I0331 01:28:02.674764 1 trace.go:236] Trace[1775448753]: "Get" accept:application/json,audit-id:ae4422cf-32c8-4989-96f3-46dfb9a5bc28,client:162.253.55.36,protocol:HTTP/1.1,resource:rabbitmqclusters,scope:resource,url:/apis/rabbitmq.com/v1beta1/namespaces/openstack/rabbitmqclusters/rabbitmq-keystone,user-agent:OpenAPI-Generator/35.0.0/python,verb:GET (31-Mar-2026 01:28:01.999) (total time: 675ms): Trace[1775448753]: ---"About to write a response" 675ms (01:28:02.674) Trace[1775448753]: [675.64033ms] [675.64033ms] END I0331 01:28:02.675148 1 trace.go:236] Trace[1430626199]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:62e1ab6b-5b1d-41c3-995a-506b78f8f1f4,client:10.0.0.45,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/envoy-gateway-system/leases/5b9825d2.gateway.envoyproxy.io,user-agent:envoy-gateway/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:28:02.142) (total time: 532ms): Trace[1430626199]: ["GuaranteedUpdate etcd3" audit-id:62e1ab6b-5b1d-41c3-995a-506b78f8f1f4,key:/leases/envoy-gateway-system/5b9825d2.gateway.envoyproxy.io,type:*coordination.Lease,resource:leases.coordination.k8s.io 532ms (01:28:02.142) Trace[1430626199]: ---"Txn call completed" 531ms (01:28:02.674)] Trace[1430626199]: [532.99543ms] [532.99543ms] END I0331 01:28:33.289578 1 alloc.go:330] "allocated clusterIPs" service="openstack/keystone-api" clusterIPs={"IPv4":"10.108.225.22"} I0331 01:28:33.309720 1 controller.go:624] quota admission added evaluator for: cronjobs.batch I0331 01:31:33.855505 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-barbican" clusterIPs={"IPv4":"10.111.127.212"} I0331 01:32:07.195019 1 alloc.go:330] "allocated clusterIPs" service="openstack/barbican-api" clusterIPs={"IPv4":"10.109.7.79"} I0331 01:33:56.168035 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.218649 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0331 01:33:56.233577 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.233903 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.247809 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.256549 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.268234 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.278892 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.289296 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.296167 1 handler.go:275] Adding GroupVersion objectbucket.io v1alpha1 to ResourceManager I0331 01:33:56.317616 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.335010 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.352521 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.369958 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.387234 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.417169 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.449172 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.487597 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:33:56.596640 1 handler.go:275] Adding GroupVersion ceph.rook.io v1 to ResourceManager I0331 01:34:01.573388 1 trace.go:236] Trace[1157678386]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:194b6a3f-2cc8-45c3-8ae4-8653118bff61,client:10.0.0.214,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:00.898) (total time: 674ms): Trace[1157678386]: ["GuaranteedUpdate etcd3" audit-id:194b6a3f-2cc8-45c3-8ae4-8653118bff61,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 674ms (01:34:00.898) Trace[1157678386]: ---"Txn call completed" 673ms (01:34:01.573)] Trace[1157678386]: [674.964515ms] [674.964515ms] END I0331 01:34:01.573504 1 trace.go:236] Trace[794059359]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:331a24ab-1746-4848-b9f4-081f580e6347,client:10.0.0.164,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:00.898) (total time: 675ms): Trace[794059359]: ["GuaranteedUpdate etcd3" audit-id:331a24ab-1746-4848-b9f4-081f580e6347,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 675ms (01:34:00.898) Trace[794059359]: ---"Txn call completed" 674ms (01:34:01.573)] Trace[794059359]: [675.326454ms] [675.326454ms] END I0331 01:34:01.573743 1 trace.go:236] Trace[271354019]: "Update" accept:application/json, */*,audit-id:72ca166c-9645-4463-99e4-7ef4e48f493a,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (31-Mar-2026 01:34:00.744) (total time: 828ms): Trace[271354019]: ["GuaranteedUpdate etcd3" audit-id:72ca166c-9645-4463-99e4-7ef4e48f493a,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 828ms (01:34:00.744) Trace[271354019]: ---"Txn call completed" 826ms (01:34:01.572)] Trace[271354019]: [828.76552ms] [828.76552ms] END I0331 01:34:01.575230 1 trace.go:236] Trace[1123089026]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:85dcd74a-b400-4797-a1c8-6ed0b27ae4fc,client:10.0.0.21,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:00.897) (total time: 677ms): Trace[1123089026]: ["GuaranteedUpdate etcd3" audit-id:85dcd74a-b400-4797-a1c8-6ed0b27ae4fc,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 677ms (01:34:00.897) Trace[1123089026]: ---"Txn call completed" 676ms (01:34:01.575)] Trace[1123089026]: [677.342382ms] [677.342382ms] END I0331 01:34:01.575344 1 trace.go:236] Trace[1094101071]: "Get" accept:application/json, */*,audit-id:ad260e62-23cd-48fa-8fc3-552951a79dff,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 01:34:00.749) (total time: 826ms): Trace[1094101071]: ---"About to write a response" 825ms (01:34:01.575) Trace[1094101071]: [826.064036ms] [826.064036ms] END I0331 01:34:01.575754 1 trace.go:236] Trace[1336105086]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f83e843b-572e-4d49-a0b5-16e636a23a81,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:34:00.748) (total time: 827ms): Trace[1336105086]: ---"About to write a response" 827ms (01:34:01.575) Trace[1336105086]: [827.252834ms] [827.252834ms] END I0331 01:34:38.846933 1 controller.go:624] quota admission added evaluator for: cephclusters.ceph.rook.io I0331 01:34:38.856288 1 controller.go:624] quota admission added evaluator for: cephobjectstores.ceph.rook.io I0331 01:34:44.793793 1 trace.go:236] Trace[1770575487]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2a3e8163-81c3-424c-b6a6-69058c211962,client:10.0.0.164,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/messaging-topology-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:44.277) (total time: 515ms): Trace[1770575487]: ["GuaranteedUpdate etcd3" audit-id:2a3e8163-81c3-424c-b6a6-69058c211962,key:/leases/openstack/messaging-topology-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 515ms (01:34:44.278) Trace[1770575487]: ---"Txn call completed" 514ms (01:34:44.793)] Trace[1770575487]: [515.711838ms] [515.711838ms] END I0331 01:34:45.212648 1 trace.go:236] Trace[465975876]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2742abd1-459f-4135-be5e-99c4fc1c9c85,client:162.253.55.36,protocol:HTTP/2.0,resource:persistentvolumeclaims,scope:resource,url:/api/v1/namespaces/openstack/persistentvolumeclaims/persistence-rabbitmq-barbican-server-0,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:34:44.422) (total time: 789ms): Trace[465975876]: ---"About to write a response" 789ms (01:34:45.212) Trace[465975876]: [789.951369ms] [789.951369ms] END I0331 01:34:45.213380 1 trace.go:236] Trace[982959027]: "Get" accept:application/json, */*,audit-id:260e1f75-28c2-4fa2-be8e-7fc7b555e172,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/cilium-operator-resource-lock,user-agent:cilium-operator-generic/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:GET (31-Mar-2026 01:34:44.407) (total time: 805ms): Trace[982959027]: ---"About to write a response" 805ms (01:34:45.213) Trace[982959027]: [805.68554ms] [805.68554ms] END I0331 01:34:45.212893 1 trace.go:236] Trace[325750130]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:96d12c5b-5738-4ba1-891f-a77f3088db87,client:10.0.0.21,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/08db1feb.percona.com,user-agent:percona-xtradb-cluster-operator/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:44.315) (total time: 897ms): Trace[325750130]: ["GuaranteedUpdate etcd3" audit-id:96d12c5b-5738-4ba1-891f-a77f3088db87,key:/leases/openstack/08db1feb.percona.com,type:*coordination.Lease,resource:leases.coordination.k8s.io 897ms (01:34:44.315) Trace[325750130]: ---"Txn call completed" 896ms (01:34:45.212)] Trace[325750130]: [897.647813ms] [897.647813ms] END I0331 01:34:45.212910 1 trace.go:236] Trace[1934454895]: "Update" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:fccb875b-093f-4419-991d-f4b5ad1335db,client:10.0.0.214,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/openstack/leases/rabbitmq-cluster-operator-leader-election,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,verb:PUT (31-Mar-2026 01:34:44.327) (total time: 885ms): Trace[1934454895]: ["GuaranteedUpdate etcd3" audit-id:fccb875b-093f-4419-991d-f4b5ad1335db,key:/leases/openstack/rabbitmq-cluster-operator-leader-election,type:*coordination.Lease,resource:leases.coordination.k8s.io 885ms (01:34:44.327) Trace[1934454895]: ---"Txn call completed" 884ms (01:34:45.212)] Trace[1934454895]: [885.234501ms] [885.234501ms] END I0331 01:34:45.213070 1 trace.go:236] Trace[694274577]: "Get" accept:application/json, */*,audit-id:9cac3cf9-74a0-4696-955a-8bbc2e0522cd,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (31-Mar-2026 01:34:44.388) (total time: 824ms): Trace[694274577]: ---"About to write a response" 824ms (01:34:45.212) Trace[694274577]: [824.162027ms] [824.162027ms] END I0331 01:34:45.213221 1 trace.go:236] Trace[1688516516]: "Get" accept:application/vnd.kubernetes.protobuf, */*,audit-id:e3e49a26-fb65-41f4-b858-14a519f7768e,client:162.253.55.36,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:GET (31-Mar-2026 01:34:44.389) (total time: 824ms): Trace[1688516516]: ---"About to write a response" 824ms (01:34:45.213) Trace[1688516516]: [824.097945ms] [824.097945ms] END I0331 01:34:45.216647 1 trace.go:236] Trace[354041371]: "GuaranteedUpdate etcd3" audit-id:,key:/masterleases/162.253.55.36,type:*v1.Endpoints,resource:apiServerIPInfo (31-Mar-2026 01:34:44.376) (total time: 840ms): Trace[354041371]: ---"initial value restored" 835ms (01:34:45.212) Trace[354041371]: [840.357019ms] [840.357019ms] END I0331 01:34:57.271815 1 trace.go:236] Trace[2026248505]: "Patch" accept:application/vnd.kubernetes.protobuf;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json;as=PartialObjectMetadata;g=meta.k8s.io;v=v1,application/json,audit-id:9b9cc430-a9f8-410e-bedd-562b25f19154,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rook-ceph-detect-version-ccngx,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:PATCH (31-Mar-2026 01:34:56.751) (total time: 520ms): Trace[2026248505]: ["GuaranteedUpdate etcd3" audit-id:9b9cc430-a9f8-410e-bedd-562b25f19154,key:/pods/openstack/rook-ceph-detect-version-ccngx,type:*core.Pod,resource:pods 519ms (01:34:56.751) Trace[2026248505]: ---"Txn call completed" 515ms (01:34:57.271)] Trace[2026248505]: ---"Object stored in database" 517ms (01:34:57.271) Trace[2026248505]: [520.066791ms] [520.066791ms] END I0331 01:34:57.312042 1 trace.go:236] Trace[1078921726]: "Create" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2a0b01f7-383c-4dc5-994a-f04d24dc26bb,client:162.253.55.36,protocol:HTTP/2.0,resource:events,scope:resource,url:/api/v1/namespaces/openstack/events,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:POST (31-Mar-2026 01:34:56.806) (total time: 505ms): Trace[1078921726]: ["Create etcd3" audit-id:2a0b01f7-383c-4dc5-994a-f04d24dc26bb,key:/events/openstack/rook-ceph-detect-version-ccngx.18a1c926d6791401,type:*core.Event,resource:events 504ms (01:34:56.807) Trace[1078921726]: ---"Txn call succeeded" 504ms (01:34:57.311)] Trace[1078921726]: [505.332132ms] [505.332132ms] END I0331 01:34:57.312360 1 trace.go:236] Trace[2030196020]: "Get" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:6805a114-704b-4f0d-9e6c-d2a4484ef35d,client:162.253.55.36,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/openstack/pods/rook-ceph-detect-version-ccngx,user-agent:kubelet/v1.28.13 (linux/amd64) kubernetes/024ab2a,verb:GET (31-Mar-2026 01:34:56.805) (total time: 506ms): Trace[2030196020]: ---"About to write a response" 506ms (01:34:57.312) Trace[2030196020]: [506.338096ms] [506.338096ms] END I0331 01:34:57.312814 1 trace.go:236] Trace[751960737]: "Delete" accept:application/vnd.kubernetes.protobuf,application/json,audit-id:2ceca08f-6beb-42b3-a7d8-d4c71b45e65a,client:162.253.55.36,protocol:HTTP/2.0,resource:ciliumendpoints,scope:resource,url:/apis/cilium.io/v2/namespaces/openstack/ciliumendpoints/rook-ceph-detect-version-ccngx,user-agent:kube-controller-manager/v1.28.13 (linux/amd64) kubernetes/024ab2a/system:serviceaccount:kube-system:generic-garbage-collector,verb:DELETE (31-Mar-2026 01:34:56.754) (total time: 558ms): Trace[751960737]: ---"Object deleted from database" 558ms (01:34:57.312) Trace[751960737]: [558.491619ms] [558.491619ms] END I0331 01:35:12.420158 1 alloc.go:330] "allocated clusterIPs" service="openstack/rabbitmq-glance" clusterIPs={"IPv4":"10.104.185.100"} I0331 01:35:12.561953 1 alloc.go:330] "allocated clusterIPs" service="openstack/rook-ceph-rgw-ceph" clusterIPs={"IPv4":"10.107.102.231"} E0331 01:35:38.765539 1 upgradeaware.go:425] Error proxying data from client to backend: write tcp 162.253.55.36:40536->162.253.55.36:10250: write: connection reset by peer I0331 01:35:46.287596 1 alloc.go:330] "allocated clusterIPs" service="openstack/glance-api" clusterIPs={"IPv4":"10.109.41.17"} I0331 01:38:26.836184 1 alloc.go:330] "allocated clusterIPs" service="openstack/staffeln-api" clusterIPs={"IPv4":"10.100.34.235"}