I0318 17:23:18.910892 1 options.go:220] external host was not specified, using 162.253.55.209 I0318 17:23:18.911824 1 server.go:148] Version: v1.28.13 I0318 17:23:18.911870 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0318 17:23:19.423550 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0318 17:23:19.434030 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0318 17:23:19.434050 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0318 17:23:19.434292 1 instance.go:298] Using reconciler: lease I0318 17:23:19.476675 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0318 17:23:19.476698 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0318 17:23:19.747940 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0318 17:23:19.748119 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0318 17:23:20.210509 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0318 17:23:20.221659 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0318 17:23:20.221691 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.221698 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.222281 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0318 17:23:20.222297 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0318 17:23:20.223302 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0318 17:23:20.224207 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0318 17:23:20.224223 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0318 17:23:20.224228 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0318 17:23:20.225731 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0318 17:23:20.225749 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0318 17:23:20.226635 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0318 17:23:20.226651 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.226656 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.227170 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0318 17:23:20.227182 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.227208 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0318 17:23:20.227665 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0318 17:23:20.229080 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0318 17:23:20.229092 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.229096 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.229461 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0318 17:23:20.229473 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.229477 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.230065 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0318 17:23:20.230077 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0318 17:23:20.231423 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0318 17:23:20.231436 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.231440 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.231831 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0318 17:23:20.231845 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.231849 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.233584 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0318 17:23:20.233599 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.233602 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.234557 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0318 17:23:20.235497 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0318 17:23:20.235511 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.235514 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.250852 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0318 17:23:20.250908 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0318 17:23:20.250925 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0318 17:23:20.251828 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0318 17:23:20.251865 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0318 17:23:20.251880 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0318 17:23:20.252451 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0318 17:23:20.252487 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0318 17:23:20.290859 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0318 17:23:20.290905 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0318 17:23:20.712471 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0318 17:23:20.712486 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0318 17:23:20.712870 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0318 17:23:20.712909 1 secure_serving.go:213] Serving securely on [::]:6443 I0318 17:23:20.712985 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0318 17:23:20.713058 1 aggregator.go:164] waiting for initial CRD sync... I0318 17:23:20.713064 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0318 17:23:20.713132 1 controller.go:80] Starting OpenAPI V3 AggregationController I0318 17:23:20.713224 1 available_controller.go:423] Starting AvailableConditionController I0318 17:23:20.713269 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0318 17:23:20.713289 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0318 17:23:20.713406 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0318 17:23:20.713428 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0318 17:23:20.713432 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0318 17:23:20.713444 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0318 17:23:20.713550 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0318 17:23:20.713651 1 controller.go:116] Starting legacy_token_tracking_controller I0318 17:23:20.713664 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0318 17:23:20.713717 1 gc_controller.go:78] Starting apiserver lease garbage collector I0318 17:23:20.713868 1 system_namespaces_controller.go:67] Starting system namespaces controller I0318 17:23:20.713882 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0318 17:23:20.713959 1 gc_controller.go:78] Starting apiserver lease garbage collector I0318 17:23:20.713989 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0318 17:23:20.714157 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0318 17:23:20.713269 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0318 17:23:20.714528 1 controller.go:78] Starting OpenAPI AggregationController I0318 17:23:20.713140 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0318 17:23:20.715209 1 controller.go:134] Starting OpenAPI controller I0318 17:23:20.715257 1 controller.go:85] Starting OpenAPI V3 controller I0318 17:23:20.715332 1 naming_controller.go:291] Starting NamingConditionController I0318 17:23:20.715394 1 establishing_controller.go:76] Starting EstablishingController I0318 17:23:20.716643 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0318 17:23:20.716824 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0318 17:23:20.716859 1 crd_finalizer.go:266] Starting CRDFinalizer E0318 17:23:20.794684 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0318 17:23:20.814025 1 shared_informer.go:318] Caches are synced for crd-autoregister I0318 17:23:20.814084 1 aggregator.go:166] initial CRD sync complete... I0318 17:23:20.814097 1 autoregister_controller.go:141] Starting autoregister controller I0318 17:23:20.814108 1 cache.go:32] Waiting for caches to sync for autoregister controller I0318 17:23:20.814118 1 cache.go:39] Caches are synced for autoregister controller I0318 17:23:20.814128 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0318 17:23:20.814181 1 shared_informer.go:318] Caches are synced for configmaps I0318 17:23:20.814323 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0318 17:23:20.814575 1 cache.go:39] Caches are synced for AvailableConditionController controller I0318 17:23:20.814769 1 apf_controller.go:379] Running API Priority and Fairness config worker I0318 17:23:20.814802 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0318 17:23:20.816996 1 controller.go:624] quota admission added evaluator for: namespaces I0318 17:23:20.823786 1 shared_informer.go:318] Caches are synced for node_authorizer I0318 17:23:20.999101 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0318 17:23:21.725201 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0318 17:23:21.729275 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0318 17:23:21.729296 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0318 17:23:22.377382 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0318 17:23:22.428636 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0318 17:23:22.533365 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0318 17:23:22.545608 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.209] I0318 17:23:22.547145 1 controller.go:624] quota admission added evaluator for: endpoints I0318 17:23:22.554666 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0318 17:23:22.780481 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0318 17:23:24.312556 1 controller.go:624] quota admission added evaluator for: deployments.apps I0318 17:23:24.384129 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0318 17:23:24.584492 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0318 17:23:27.776801 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0318 17:23:28.025053 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0318 17:23:57.276330 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:23:57.289550 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0318 17:23:57.298208 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0318 17:23:57.479573 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0318 17:23:57.874473 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0318 17:23:58.070743 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:23:58.285018 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0318 17:23:59.102344 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:24:00.297203 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:24:00.913533 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:24:01.300838 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0318 17:24:06.984478 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0318 17:24:57.796195 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.99.102.99"} I0318 17:24:57.805015 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.102.249.33"}