I0428 05:01:43.803570 1 options.go:220] external host was not specified, using 199.204.45.23 I0428 05:01:43.804649 1 server.go:148] Version: v1.28.13 I0428 05:01:43.804687 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0428 05:01:44.302263 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0428 05:01:44.312396 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0428 05:01:44.312415 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0428 05:01:44.312593 1 instance.go:298] Using reconciler: lease I0428 05:01:44.844068 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0428 05:01:44.844084 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0428 05:01:45.086463 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0428 05:01:45.086754 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0428 05:01:45.529074 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0428 05:01:45.548788 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0428 05:01:45.548815 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.548824 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.549447 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0428 05:01:45.549467 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0428 05:01:45.550521 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0428 05:01:45.551598 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0428 05:01:45.551618 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0428 05:01:45.551624 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0428 05:01:45.553197 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0428 05:01:45.553217 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0428 05:01:45.554092 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0428 05:01:45.554109 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.554114 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.554857 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0428 05:01:45.554874 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.554994 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0428 05:01:45.555729 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0428 05:01:45.557486 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0428 05:01:45.557500 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.557506 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.558037 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0428 05:01:45.558054 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.558059 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.558920 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0428 05:01:45.558933 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0428 05:01:45.560480 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0428 05:01:45.560494 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.560499 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.560984 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0428 05:01:45.561000 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.561006 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.562963 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0428 05:01:45.562978 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.562982 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.564055 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0428 05:01:45.565341 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0428 05:01:45.565357 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.565362 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.568505 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0428 05:01:45.568518 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0428 05:01:45.568522 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0428 05:01:45.569521 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0428 05:01:45.569535 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0428 05:01:45.569539 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0428 05:01:45.570061 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0428 05:01:45.570073 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0428 05:01:45.616133 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0428 05:01:45.616176 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0428 05:01:46.041071 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 05:01:46.041116 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 05:01:46.041286 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0428 05:01:46.041512 1 secure_serving.go:213] Serving securely on [::]:6443 I0428 05:01:46.041586 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0428 05:01:46.041657 1 available_controller.go:423] Starting AvailableConditionController I0428 05:01:46.041659 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0428 05:01:46.041667 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0428 05:01:46.041676 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0428 05:01:46.041676 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0428 05:01:46.041699 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0428 05:01:46.041737 1 system_namespaces_controller.go:67] Starting system namespaces controller I0428 05:01:46.041844 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0428 05:01:46.041869 1 controller.go:80] Starting OpenAPI V3 AggregationController I0428 05:01:46.042053 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0428 05:01:46.042072 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0428 05:01:46.042083 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 05:01:46.042109 1 controller.go:78] Starting OpenAPI AggregationController I0428 05:01:46.042159 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0428 05:01:46.042178 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0428 05:01:46.042287 1 controller.go:134] Starting OpenAPI controller I0428 05:01:46.042114 1 controller.go:116] Starting legacy_token_tracking_controller I0428 05:01:46.042318 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0428 05:01:46.042748 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0428 05:01:46.042917 1 controller.go:85] Starting OpenAPI V3 controller I0428 05:01:46.042974 1 naming_controller.go:291] Starting NamingConditionController I0428 05:01:46.043006 1 establishing_controller.go:76] Starting EstablishingController I0428 05:01:46.043032 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0428 05:01:46.043062 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0428 05:01:46.043083 1 crd_finalizer.go:266] Starting CRDFinalizer I0428 05:01:46.048509 1 gc_controller.go:78] Starting apiserver lease garbage collector I0428 05:01:46.048541 1 aggregator.go:164] waiting for initial CRD sync... I0428 05:01:46.058464 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0428 05:01:46.058477 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0428 05:01:46.102687 1 shared_informer.go:318] Caches are synced for node_authorizer I0428 05:01:46.142152 1 cache.go:39] Caches are synced for AvailableConditionController controller I0428 05:01:46.142241 1 apf_controller.go:379] Running API Priority and Fairness config worker I0428 05:01:46.142264 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0428 05:01:46.142583 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0428 05:01:46.143138 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0428 05:01:46.143202 1 shared_informer.go:318] Caches are synced for configmaps I0428 05:01:46.146564 1 controller.go:624] quota admission added evaluator for: namespaces I0428 05:01:46.151958 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0428 05:01:46.158643 1 shared_informer.go:318] Caches are synced for crd-autoregister I0428 05:01:46.158675 1 aggregator.go:166] initial CRD sync complete... I0428 05:01:46.158681 1 autoregister_controller.go:141] Starting autoregister controller I0428 05:01:46.158685 1 cache.go:32] Waiting for caches to sync for autoregister controller I0428 05:01:46.158690 1 cache.go:39] Caches are synced for autoregister controller I0428 05:01:47.049520 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0428 05:01:47.055249 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0428 05:01:47.055265 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0428 05:01:48.100537 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0428 05:01:48.145314 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0428 05:01:48.258834 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0428 05:01:48.266428 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.23] I0428 05:01:48.268193 1 controller.go:624] quota admission added evaluator for: endpoints I0428 05:01:48.273350 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0428 05:01:48.816202 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0428 05:01:49.840471 1 controller.go:624] quota admission added evaluator for: deployments.apps I0428 05:01:49.925663 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0428 05:01:50.125163 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0428 05:01:53.909585 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0428 05:01:53.919200 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0428 05:02:11.470661 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 05:02:11.522846 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 05:02:11.576699 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 05:02:11.604035 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 05:02:11.643115 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 05:02:11.643166 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 05:02:11.677004 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0428 05:02:11.780914 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 05:02:11.829469 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0428 05:02:11.829515 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0428 05:02:12.117487 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 05:02:12.117559 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 05:02:12.131980 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 05:02:12.132028 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 05:02:12.191231 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 05:02:12.325035 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0428 05:02:12.325091 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0428 05:02:12.350711 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:12.410995 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:12.466985 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:12.501995 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:12.515789 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:13.162428 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:13.178118 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:13.613085 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0428 05:02:18.825234 1 controller.go:624] quota admission added evaluator for: jobs.batch I0428 05:02:20.669684 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 05:02:20.675131 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 05:02:21.057192 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 05:02:21.259182 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 05:02:21.460170 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 05:02:21.664771 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 05:02:21.868510 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0428 05:02:22.089978 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 05:02:22.680099 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 05:02:24.828210 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0428 05:02:24.912469 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W0428 05:02:31.757844 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E0428 05:02:31.757903 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I0428 05:02:32.250598 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0428 05:02:40.241622 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.99.225.141"} W0428 05:02:40.281074 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.225.141:9443: connect: connection refused E0428 05:02:40.281117 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.99.225.141:9443: connect: connection refused I0428 05:06:45.417681 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.99.110.140"} I0428 05:06:45.428393 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.110.38.101"}