I0330 20:39:00.217971 1 options.go:249] external host was not specified, using 199.204.45.238 I0330 20:39:00.220087 1 server.go:147] Version: v1.33.4 I0330 20:39:00.220110 1 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0330 20:39:00.771873 1 shared_informer.go:350] "Waiting for caches to sync" controller="node_authorizer" I0330 20:39:00.779942 1 shared_informer.go:350] "Waiting for caches to sync" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]" I0330 20:39:00.787160 1 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. I0330 20:39:00.787185 1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0330 20:39:00.787542 1 instance.go:233] Using reconciler: lease I0330 20:39:01.046314 1 handler.go:288] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0330 20:39:01.046342 1 genericapiserver.go:778] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0330 20:39:01.059872 1 storage_core.go:375] kube-apiserver started with IP allocator and dual write enabled but bitmap allocator does not exist, recreating it ... I0330 20:39:01.067860 1 cidrallocator.go:197] starting ServiceCIDR Allocator Controller I0330 20:39:01.274172 1 handler.go:288] Adding GroupVersion v1 to ResourceManager I0330 20:39:01.275514 1 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0330 20:39:01.531279 1 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. I0330 20:39:01.685868 1 apis.go:112] API group "resource.k8s.io" is not enabled, skipping. I0330 20:39:01.707377 1 handler.go:288] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0330 20:39:01.707480 1 genericapiserver.go:778] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.707521 1 genericapiserver.go:778] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.709403 1 handler.go:288] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0330 20:39:01.709570 1 genericapiserver.go:778] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0330 20:39:01.711581 1 handler.go:288] Adding GroupVersion autoscaling v2 to ResourceManager I0330 20:39:01.714742 1 handler.go:288] Adding GroupVersion autoscaling v1 to ResourceManager W0330 20:39:01.716130 1 genericapiserver.go:778] Skipping API autoscaling/v2beta1 because it has no resources. W0330 20:39:01.716203 1 genericapiserver.go:778] Skipping API autoscaling/v2beta2 because it has no resources. I0330 20:39:01.718642 1 handler.go:288] Adding GroupVersion batch v1 to ResourceManager W0330 20:39:01.718724 1 genericapiserver.go:778] Skipping API batch/v1beta1 because it has no resources. I0330 20:39:01.719871 1 handler.go:288] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0330 20:39:01.719950 1 genericapiserver.go:778] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.720005 1 genericapiserver.go:778] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.720677 1 handler.go:288] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0330 20:39:01.720731 1 genericapiserver.go:778] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.720762 1 genericapiserver.go:778] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. I0330 20:39:01.721425 1 handler.go:288] Adding GroupVersion discovery.k8s.io v1 to ResourceManager W0330 20:39:01.721468 1 genericapiserver.go:778] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0330 20:39:01.723824 1 handler.go:288] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0330 20:39:01.723871 1 genericapiserver.go:778] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.723893 1 genericapiserver.go:778] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.724401 1 handler.go:288] Adding GroupVersion node.k8s.io v1 to ResourceManager W0330 20:39:01.724442 1 genericapiserver.go:778] Skipping API node.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.724464 1 genericapiserver.go:778] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.725289 1 handler.go:288] Adding GroupVersion policy v1 to ResourceManager W0330 20:39:01.725331 1 genericapiserver.go:778] Skipping API policy/v1beta1 because it has no resources. I0330 20:39:01.727100 1 handler.go:288] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0330 20:39:01.727137 1 genericapiserver.go:778] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.727163 1 genericapiserver.go:778] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.727681 1 handler.go:288] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0330 20:39:01.727715 1 genericapiserver.go:778] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.727740 1 genericapiserver.go:778] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.730039 1 handler.go:288] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0330 20:39:01.730087 1 genericapiserver.go:778] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.730110 1 genericapiserver.go:778] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.731573 1 handler.go:288] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager W0330 20:39:01.731617 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. W0330 20:39:01.731645 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. W0330 20:39:01.731664 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. I0330 20:39:01.735349 1 handler.go:288] Adding GroupVersion apps v1 to ResourceManager W0330 20:39:01.735399 1 genericapiserver.go:778] Skipping API apps/v1beta2 because it has no resources. W0330 20:39:01.735418 1 genericapiserver.go:778] Skipping API apps/v1beta1 because it has no resources. I0330 20:39:01.737461 1 handler.go:288] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0330 20:39:01.737507 1 genericapiserver.go:778] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0330 20:39:01.737526 1 genericapiserver.go:778] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0330 20:39:01.738194 1 handler.go:288] Adding GroupVersion events.k8s.io v1 to ResourceManager W0330 20:39:01.738237 1 genericapiserver.go:778] Skipping API events.k8s.io/v1beta1 because it has no resources. I0330 20:39:01.749018 1 handler.go:288] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0330 20:39:01.749054 1 genericapiserver.go:778] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0330 20:39:02.119388 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 20:39:02.119426 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 20:39:02.119536 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0330 20:39:02.119669 1 secure_serving.go:211] Serving securely on [::]:6443 I0330 20:39:02.119726 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I0330 20:39:02.120008 1 aggregator.go:169] waiting for initial CRD sync... I0330 20:39:02.120033 1 controller.go:78] Starting OpenAPI AggregationController I0330 20:39:02.120117 1 crdregistration_controller.go:114] Starting crd-autoregister controller I0330 20:39:02.120107 1 local_available_controller.go:156] Starting LocalAvailability controller I0330 20:39:02.120131 1 shared_informer.go:350] "Waiting for caches to sync" controller="crd-autoregister" I0330 20:39:02.120230 1 cache.go:32] Waiting for caches to sync for LocalAvailability controller I0330 20:39:02.120248 1 customresource_discovery_controller.go:294] Starting DiscoveryController I0330 20:39:02.120379 1 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller I0330 20:39:02.120571 1 shared_informer.go:350] "Waiting for caches to sync" controller="cluster_authentication_trust_controller" I0330 20:39:02.120705 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 20:39:02.120847 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 20:39:02.121369 1 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0330 20:39:02.120609 1 remote_available_controller.go:411] Starting RemoteAvailability controller I0330 20:39:02.121643 1 cache.go:32] Waiting for caches to sync for RemoteAvailability controller I0330 20:39:02.121702 1 controller.go:119] Starting legacy_token_tracking_controller I0330 20:39:02.121737 1 shared_informer.go:350] "Waiting for caches to sync" controller="configmaps" I0330 20:39:02.120677 1 repairip.go:200] Starting ipallocator-repair-controller I0330 20:39:02.121807 1 shared_informer.go:350] "Waiting for caches to sync" controller="ipallocator-repair-controller" I0330 20:39:02.121816 1 system_namespaces_controller.go:66] Starting system namespaces controller I0330 20:39:02.121017 1 controller.go:142] Starting OpenAPI controller I0330 20:39:02.121045 1 controller.go:90] Starting OpenAPI V3 controller I0330 20:39:02.121062 1 naming_controller.go:299] Starting NamingConditionController I0330 20:39:02.121079 1 establishing_controller.go:81] Starting EstablishingController I0330 20:39:02.121873 1 apf_controller.go:377] Starting API Priority and Fairness config controller I0330 20:39:02.121108 1 nonstructuralschema_controller.go:195] Starting NonStructuralSchemaConditionController I0330 20:39:02.121121 1 apiapproval_controller.go:189] Starting KubernetesAPIApprovalPolicyConformantConditionController I0330 20:39:02.121136 1 crd_finalizer.go:269] Starting CRDFinalizer I0330 20:39:02.121945 1 gc_controller.go:78] Starting apiserver lease garbage collector I0330 20:39:02.122072 1 apiservice_controller.go:100] Starting APIServiceRegistrationController I0330 20:39:02.122099 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0330 20:39:02.122119 1 controller.go:80] Starting OpenAPI V3 AggregationController I0330 20:39:02.126846 1 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller I0330 20:39:02.126862 1 shared_informer.go:350] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" I0330 20:39:02.172222 1 shared_informer.go:357] "Caches are synced" controller="node_authorizer" I0330 20:39:02.181007 1 shared_informer.go:357] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]" I0330 20:39:02.181038 1 policy_source.go:240] refreshing policies E0330 20:39:02.199403 1 controller.go:145] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0330 20:39:02.220971 1 shared_informer.go:357] "Caches are synced" controller="cluster_authentication_trust_controller" I0330 20:39:02.221086 1 cache.go:39] Caches are synced for LocalAvailability controller I0330 20:39:02.221160 1 shared_informer.go:357] "Caches are synced" controller="crd-autoregister" I0330 20:39:02.221196 1 aggregator.go:171] initial CRD sync complete... I0330 20:39:02.221206 1 autoregister_controller.go:144] Starting autoregister controller I0330 20:39:02.221215 1 cache.go:32] Waiting for caches to sync for autoregister controller I0330 20:39:02.221222 1 cache.go:39] Caches are synced for autoregister controller I0330 20:39:02.221777 1 shared_informer.go:357] "Caches are synced" controller="configmaps" I0330 20:39:02.221796 1 cache.go:39] Caches are synced for RemoteAvailability controller I0330 20:39:02.221910 1 apf_controller.go:382] Running API Priority and Fairness config worker I0330 20:39:02.221924 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process I0330 20:39:02.221978 1 shared_informer.go:357] "Caches are synced" controller="ipallocator-repair-controller" I0330 20:39:02.222133 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0330 20:39:02.222209 1 handler_discovery.go:451] Starting ResourceDiscoveryManager I0330 20:39:02.225473 1 controller.go:667] quota admission added evaluator for: namespaces I0330 20:39:02.226924 1 shared_informer.go:357] "Caches are synced" controller="kubernetes-service-cidr-controller" I0330 20:39:02.227146 1 default_servicecidr_controller.go:165] Creating default ServiceCIDR with CIDRs: [10.96.0.0/12] I0330 20:39:02.238925 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:39:02.240538 1 default_servicecidr_controller.go:214] Setting default ServiceCIDR condition Ready to True I0330 20:39:02.240546 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io I0330 20:39:02.249780 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:39:02.249892 1 default_servicecidr_controller.go:136] Shutting down kubernetes-service-cidr-controller I0330 20:39:03.128432 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0330 20:39:03.134669 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0330 20:39:03.134683 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0330 20:39:03.829930 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0330 20:39:03.876743 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0330 20:39:03.939501 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0330 20:39:03.947682 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [199.204.45.238] I0330 20:39:03.948669 1 controller.go:667] quota admission added evaluator for: endpoints I0330 20:39:03.952888 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io I0330 20:39:05.519586 1 controller.go:667] quota admission added evaluator for: serviceaccounts I0330 20:39:05.531414 1 controller.go:667] quota admission added evaluator for: deployments.apps I0330 20:39:05.728606 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0330 20:39:05.926577 1 controller.go:667] quota admission added evaluator for: daemonsets.apps I0330 20:39:10.603706 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:39:10.611931 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:39:11.498408 1 controller.go:667] quota admission added evaluator for: replicasets.apps I0330 20:39:11.698879 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps I0330 20:40:46.260486 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:40:46.288001 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:40:46.323867 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:40:46.337877 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:40:46.360947 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:40:46.388839 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:40:46.388894 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 20:40:46.433152 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:40:46.433198 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 20:40:46.492910 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:40:46.492946 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:40:46.539436 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:40:46.552942 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:40:46.598805 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:40:46.598930 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:40:46.659679 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:40:46.659742 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:40:46.675811 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:46.759299 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:46.787319 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:46.818049 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:46.842225 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:47.470459 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:47.488468 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:47.560834 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:40:52.566145 1 controller.go:667] quota admission added evaluator for: jobs.batch