I0427 20:59:43.851419 1 options.go:220] external host was not specified, using 199.19.213.76 I0427 20:59:43.852340 1 server.go:148] Version: v1.28.13 I0427 20:59:43.852369 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0427 20:59:44.516600 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0427 20:59:44.526687 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0427 20:59:44.526725 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0427 20:59:44.527143 1 instance.go:298] Using reconciler: lease I0427 20:59:44.578032 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0427 20:59:44.578056 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0427 20:59:44.815821 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0427 20:59:44.816051 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0427 20:59:45.284081 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0427 20:59:45.293901 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0427 20:59:45.293926 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.293932 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.294277 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0427 20:59:45.294289 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0427 20:59:45.294873 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0427 20:59:45.295452 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0427 20:59:45.295464 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0427 20:59:45.295468 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0427 20:59:45.296541 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0427 20:59:45.296554 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0427 20:59:45.297184 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0427 20:59:45.297197 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.297201 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.297635 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0427 20:59:45.297647 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.297712 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0427 20:59:45.298199 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0427 20:59:45.299313 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0427 20:59:45.299327 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.299331 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.299616 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0427 20:59:45.299627 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.299630 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.300353 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0427 20:59:45.300364 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0427 20:59:45.301512 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0427 20:59:45.301528 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.301532 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.301963 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0427 20:59:45.301979 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.301983 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.303454 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0427 20:59:45.303467 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.303471 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.304234 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0427 20:59:45.305323 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0427 20:59:45.305335 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.305339 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.307873 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0427 20:59:45.307889 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0427 20:59:45.307892 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0427 20:59:45.308734 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0427 20:59:45.308747 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0427 20:59:45.308750 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0427 20:59:45.309113 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0427 20:59:45.309124 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0427 20:59:45.350951 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0427 20:59:45.351399 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0427 20:59:45.759265 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0427 20:59:45.759269 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0427 20:59:45.759562 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0427 20:59:45.760296 1 secure_serving.go:213] Serving securely on [::]:6443 I0427 20:59:45.760354 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0427 20:59:45.760568 1 controller.go:78] Starting OpenAPI AggregationController I0427 20:59:45.760575 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0427 20:59:45.760666 1 available_controller.go:423] Starting AvailableConditionController I0427 20:59:45.760676 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0427 20:59:45.760770 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0427 20:59:45.760797 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0427 20:59:45.760928 1 gc_controller.go:78] Starting apiserver lease garbage collector I0427 20:59:45.760948 1 gc_controller.go:78] Starting apiserver lease garbage collector I0427 20:59:45.760973 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0427 20:59:45.761007 1 controller.go:134] Starting OpenAPI controller I0427 20:59:45.761045 1 system_namespaces_controller.go:67] Starting system namespaces controller I0427 20:59:45.761072 1 establishing_controller.go:76] Starting EstablishingController I0427 20:59:45.761080 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0427 20:59:45.761091 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0427 20:59:45.761125 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0427 20:59:45.761156 1 crd_finalizer.go:266] Starting CRDFinalizer I0427 20:59:45.760932 1 controller.go:80] Starting OpenAPI V3 AggregationController I0427 20:59:45.760908 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0427 20:59:45.761048 1 controller.go:85] Starting OpenAPI V3 controller I0427 20:59:45.761056 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0427 20:59:45.761061 1 naming_controller.go:291] Starting NamingConditionController I0427 20:59:45.762238 1 controller.go:116] Starting legacy_token_tracking_controller I0427 20:59:45.762269 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0427 20:59:45.762324 1 aggregator.go:164] waiting for initial CRD sync... I0427 20:59:45.760975 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0427 20:59:45.762531 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0427 20:59:45.760956 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0427 20:59:45.762697 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0427 20:59:45.762714 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0427 20:59:45.817404 1 shared_informer.go:318] Caches are synced for node_authorizer E0427 20:59:45.857790 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0427 20:59:45.860834 1 cache.go:39] Caches are synced for AvailableConditionController controller I0427 20:59:45.860938 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0427 20:59:45.862145 1 apf_controller.go:379] Running API Priority and Fairness config worker I0427 20:59:45.862172 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0427 20:59:45.862457 1 shared_informer.go:318] Caches are synced for configmaps I0427 20:59:45.862594 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0427 20:59:45.862782 1 shared_informer.go:318] Caches are synced for crd-autoregister I0427 20:59:45.862882 1 aggregator.go:166] initial CRD sync complete... I0427 20:59:45.862898 1 autoregister_controller.go:141] Starting autoregister controller I0427 20:59:45.862905 1 cache.go:32] Waiting for caches to sync for autoregister controller I0427 20:59:45.862971 1 cache.go:39] Caches are synced for autoregister controller I0427 20:59:45.864826 1 controller.go:624] quota admission added evaluator for: namespaces I0427 20:59:45.938010 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0427 20:59:45.938013 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0427 20:59:46.767636 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0427 20:59:46.773475 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0427 20:59:46.773496 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0427 20:59:47.381120 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0427 20:59:47.432367 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0427 20:59:47.575853 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0427 20:59:47.583688 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.76] I0427 20:59:47.585073 1 controller.go:624] quota admission added evaluator for: endpoints I0427 20:59:47.590021 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0427 20:59:48.972435 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0427 20:59:49.434233 1 controller.go:624] quota admission added evaluator for: deployments.apps I0427 20:59:49.492233 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0427 20:59:49.684466 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0427 20:59:53.969508 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0427 20:59:54.064306 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0427 21:00:14.876663 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 21:00:14.916325 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 21:00:14.941216 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 21:00:14.987017 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 21:00:15.004570 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 21:00:15.004633 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 21:00:15.033909 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 21:00:15.034174 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0427 21:00:15.048838 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0427 21:00:15.108587 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 21:00:15.108653 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0427 21:00:15.138290 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0427 21:00:15.201403 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 21:00:15.201477 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 21:00:15.243006 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 21:00:15.334396 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:15.458326 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:15.472648 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:15.646396 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0427 21:00:15.646475 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0427 21:00:15.693009 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:15.734076 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:15.734266 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:15.757803 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:15.774173 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:16.377257 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:16.387877 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 21:00:16.409159 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:16.416242 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 21:00:16.510088 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0427 21:00:16.519945 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 21:00:16.529092 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 21:00:16.680944 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:16.866692 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0427 21:00:19.078745 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:19.522992 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0427 21:00:21.901743 1 controller.go:624] quota admission added evaluator for: jobs.batch W0427 21:00:33.816069 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0427 21:00:33.816125 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0427 21:00:34.241898 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0427 21:00:42.851688 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.109.97.231"} W0427 21:00:42.881378 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.97.231:9443: connect: connection refused E0427 21:00:42.881421 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.109.97.231:9443: connect: connection refused I0427 21:01:49.030921 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.111.102.29"} I0427 21:01:49.043203 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.107.231.44"}