I0203 17:23:05.653371 1 options.go:220] external host was not specified, using 199.204.45.250 I0203 17:23:05.657960 1 server.go:148] Version: v1.28.13 I0203 17:23:05.657993 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0203 17:23:06.224966 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0203 17:23:06.242528 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0203 17:23:06.242616 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0203 17:23:06.242819 1 instance.go:298] Using reconciler: lease I0203 17:23:06.323577 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0203 17:23:06.323590 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0203 17:23:06.677114 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0203 17:23:06.677402 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0203 17:23:07.141905 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0203 17:23:07.150919 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0203 17:23:07.151007 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.151028 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.151375 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0203 17:23:07.151432 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0203 17:23:07.152988 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0203 17:23:07.154807 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0203 17:23:07.154834 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0203 17:23:07.154951 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0203 17:23:07.161914 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0203 17:23:07.161932 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0203 17:23:07.163113 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0203 17:23:07.163124 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.163129 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.164155 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0203 17:23:07.164170 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.172025 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0203 17:23:07.173016 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0203 17:23:07.175170 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0203 17:23:07.175377 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.175553 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.175977 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0203 17:23:07.176033 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.176047 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.176867 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0203 17:23:07.176919 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0203 17:23:07.178392 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0203 17:23:07.178472 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.178520 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.179167 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0203 17:23:07.179237 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.179281 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.180976 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0203 17:23:07.181033 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.181051 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.182013 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0203 17:23:07.183127 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0203 17:23:07.183181 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.183290 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.186084 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0203 17:23:07.186137 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0203 17:23:07.186213 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0203 17:23:07.187096 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0203 17:23:07.187155 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0203 17:23:07.187173 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0203 17:23:07.187824 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0203 17:23:07.187880 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0203 17:23:07.223148 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0203 17:23:07.224376 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0203 17:23:07.760378 1 secure_serving.go:213] Serving securely on [::]:6443 I0203 17:23:07.760713 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0203 17:23:07.760899 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0203 17:23:07.761038 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0203 17:23:07.768088 1 gc_controller.go:78] Starting apiserver lease garbage collector I0203 17:23:07.768126 1 system_namespaces_controller.go:67] Starting system namespaces controller I0203 17:23:07.768403 1 gc_controller.go:78] Starting apiserver lease garbage collector I0203 17:23:07.768470 1 available_controller.go:423] Starting AvailableConditionController I0203 17:23:07.768480 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0203 17:23:07.768890 1 controller.go:78] Starting OpenAPI AggregationController I0203 17:23:07.768991 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0203 17:23:07.769000 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0203 17:23:07.769080 1 aggregator.go:164] waiting for initial CRD sync... I0203 17:23:07.769142 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0203 17:23:07.769368 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0203 17:23:07.769379 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0203 17:23:07.769857 1 controller.go:80] Starting OpenAPI V3 AggregationController I0203 17:23:07.770311 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0203 17:23:07.770665 1 controller.go:116] Starting legacy_token_tracking_controller I0203 17:23:07.770678 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0203 17:23:07.770740 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0203 17:23:07.770961 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0203 17:23:07.771030 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0203 17:23:07.810072 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0203 17:23:07.810089 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0203 17:23:07.810258 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0203 17:23:07.810426 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0203 17:23:07.812906 1 controller.go:134] Starting OpenAPI controller I0203 17:23:07.812941 1 controller.go:85] Starting OpenAPI V3 controller I0203 17:23:07.812982 1 naming_controller.go:291] Starting NamingConditionController I0203 17:23:07.813001 1 establishing_controller.go:76] Starting EstablishingController I0203 17:23:07.813012 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0203 17:23:07.813022 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0203 17:23:07.813104 1 crd_finalizer.go:266] Starting CRDFinalizer I0203 17:23:07.868628 1 cache.go:39] Caches are synced for AvailableConditionController controller I0203 17:23:07.869488 1 controller.go:624] quota admission added evaluator for: namespaces I0203 17:23:07.870110 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0203 17:23:07.870327 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0203 17:23:07.870984 1 apf_controller.go:379] Running API Priority and Fairness config worker I0203 17:23:07.871046 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0203 17:23:07.871171 1 shared_informer.go:318] Caches are synced for configmaps I0203 17:23:07.907871 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0203 17:23:07.911825 1 shared_informer.go:318] Caches are synced for crd-autoregister I0203 17:23:07.912005 1 aggregator.go:166] initial CRD sync complete... I0203 17:23:07.912018 1 autoregister_controller.go:141] Starting autoregister controller I0203 17:23:07.912024 1 cache.go:32] Waiting for caches to sync for autoregister controller I0203 17:23:07.912031 1 cache.go:39] Caches are synced for autoregister controller I0203 17:23:07.930874 1 shared_informer.go:318] Caches are synced for node_authorizer I0203 17:23:08.777401 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0203 17:23:08.783421 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0203 17:23:08.783481 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0203 17:23:09.210518 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0203 17:23:09.241541 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0203 17:23:09.394308 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0203 17:23:09.408120 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.250] I0203 17:23:09.409526 1 controller.go:624] quota admission added evaluator for: endpoints I0203 17:23:09.427009 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0203 17:23:11.254505 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0203 17:23:11.268469 1 controller.go:624] quota admission added evaluator for: deployments.apps I0203 17:23:11.281533 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0203 17:23:11.375620 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0203 17:23:16.240705 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0203 17:23:16.422329 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0203 17:23:47.686032 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0203 17:23:47.893957 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:48.049780 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:48.225554 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:48.418028 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0203 17:23:48.618269 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0203 17:23:48.844650 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:49.022342 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0203 17:23:49.244360 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0203 17:23:49.904652 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:52.103518 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0203 17:23:56.340697 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0203 17:24:38.427607 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.110.33.192"} I0203 17:24:38.449181 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.109.138.174"}