I0330 20:15:06.833273 1 options.go:249] external host was not specified, using 199.204.45.6 I0330 20:15:06.835689 1 server.go:147] Version: v1.33.4 I0330 20:15:06.835723 1 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0330 20:15:07.768062 1 shared_informer.go:350] "Waiting for caches to sync" controller="node_authorizer" I0330 20:15:07.787138 1 shared_informer.go:350] "Waiting for caches to sync" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]" I0330 20:15:07.795952 1 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. I0330 20:15:07.795981 1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0330 20:15:07.796209 1 instance.go:233] Using reconciler: lease I0330 20:15:07.840400 1 handler.go:288] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0330 20:15:07.840433 1 genericapiserver.go:778] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0330 20:15:07.856179 1 storage_core.go:375] kube-apiserver started with IP allocator and dual write enabled but bitmap allocator does not exist, recreating it ... I0330 20:15:07.859130 1 cidrallocator.go:197] starting ServiceCIDR Allocator Controller I0330 20:15:08.052923 1 handler.go:288] Adding GroupVersion v1 to ResourceManager I0330 20:15:08.053203 1 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0330 20:15:08.314386 1 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. I0330 20:15:08.468725 1 apis.go:112] API group "resource.k8s.io" is not enabled, skipping. I0330 20:15:08.480721 1 handler.go:288] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0330 20:15:08.480746 1 genericapiserver.go:778] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.480751 1 genericapiserver.go:778] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.481265 1 handler.go:288] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0330 20:15:08.481280 1 genericapiserver.go:778] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0330 20:15:08.482207 1 handler.go:288] Adding GroupVersion autoscaling v2 to ResourceManager I0330 20:15:08.482969 1 handler.go:288] Adding GroupVersion autoscaling v1 to ResourceManager W0330 20:15:08.482983 1 genericapiserver.go:778] Skipping API autoscaling/v2beta1 because it has no resources. W0330 20:15:08.482987 1 genericapiserver.go:778] Skipping API autoscaling/v2beta2 because it has no resources. I0330 20:15:08.484391 1 handler.go:288] Adding GroupVersion batch v1 to ResourceManager W0330 20:15:08.484406 1 genericapiserver.go:778] Skipping API batch/v1beta1 because it has no resources. I0330 20:15:08.485331 1 handler.go:288] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0330 20:15:08.485347 1 genericapiserver.go:778] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.485351 1 genericapiserver.go:778] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.485977 1 handler.go:288] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0330 20:15:08.485993 1 genericapiserver.go:778] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.485998 1 genericapiserver.go:778] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. I0330 20:15:08.486682 1 handler.go:288] Adding GroupVersion discovery.k8s.io v1 to ResourceManager W0330 20:15:08.486699 1 genericapiserver.go:778] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0330 20:15:08.489233 1 handler.go:288] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0330 20:15:08.489250 1 genericapiserver.go:778] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.489254 1 genericapiserver.go:778] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.489980 1 handler.go:288] Adding GroupVersion node.k8s.io v1 to ResourceManager W0330 20:15:08.489995 1 genericapiserver.go:778] Skipping API node.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.490000 1 genericapiserver.go:778] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.490618 1 handler.go:288] Adding GroupVersion policy v1 to ResourceManager W0330 20:15:08.490633 1 genericapiserver.go:778] Skipping API policy/v1beta1 because it has no resources. I0330 20:15:08.491870 1 handler.go:288] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0330 20:15:08.491884 1 genericapiserver.go:778] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.491889 1 genericapiserver.go:778] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.492306 1 handler.go:288] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0330 20:15:08.492322 1 genericapiserver.go:778] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.492325 1 genericapiserver.go:778] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.493915 1 handler.go:288] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0330 20:15:08.493932 1 genericapiserver.go:778] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.493936 1 genericapiserver.go:778] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.495066 1 handler.go:288] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager W0330 20:15:08.495082 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. W0330 20:15:08.495086 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. W0330 20:15:08.495089 1 genericapiserver.go:778] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. I0330 20:15:08.497372 1 handler.go:288] Adding GroupVersion apps v1 to ResourceManager W0330 20:15:08.497389 1 genericapiserver.go:778] Skipping API apps/v1beta2 because it has no resources. W0330 20:15:08.497394 1 genericapiserver.go:778] Skipping API apps/v1beta1 because it has no resources. I0330 20:15:08.498990 1 handler.go:288] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0330 20:15:08.499004 1 genericapiserver.go:778] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0330 20:15:08.499008 1 genericapiserver.go:778] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0330 20:15:08.501693 1 handler.go:288] Adding GroupVersion events.k8s.io v1 to ResourceManager W0330 20:15:08.501750 1 genericapiserver.go:778] Skipping API events.k8s.io/v1beta1 because it has no resources. I0330 20:15:08.519715 1 handler.go:288] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0330 20:15:08.519741 1 genericapiserver.go:778] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0330 20:15:08.882935 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 20:15:08.882948 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 20:15:08.883527 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0330 20:15:08.884348 1 secure_serving.go:211] Serving securely on [::]:6443 I0330 20:15:08.884492 1 apiservice_controller.go:100] Starting APIServiceRegistrationController I0330 20:15:08.884504 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0330 20:15:08.884571 1 controller.go:78] Starting OpenAPI AggregationController I0330 20:15:08.884605 1 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0330 20:15:08.884635 1 controller.go:119] Starting legacy_token_tracking_controller I0330 20:15:08.884637 1 gc_controller.go:78] Starting apiserver lease garbage collector I0330 20:15:08.884643 1 shared_informer.go:350] "Waiting for caches to sync" controller="configmaps" I0330 20:15:08.884798 1 apf_controller.go:377] Starting API Priority and Fairness config controller I0330 20:15:08.884880 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I0330 20:15:08.884976 1 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller I0330 20:15:08.885016 1 shared_informer.go:350] "Waiting for caches to sync" controller="cluster_authentication_trust_controller" I0330 20:15:08.884996 1 local_available_controller.go:156] Starting LocalAvailability controller I0330 20:15:08.885172 1 cache.go:32] Waiting for caches to sync for LocalAvailability controller I0330 20:15:08.885227 1 aggregator.go:169] waiting for initial CRD sync... I0330 20:15:08.885425 1 system_namespaces_controller.go:66] Starting system namespaces controller I0330 20:15:08.885080 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0330 20:15:08.885662 1 remote_available_controller.go:411] Starting RemoteAvailability controller I0330 20:15:08.885681 1 cache.go:32] Waiting for caches to sync for RemoteAvailability controller I0330 20:15:08.885747 1 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller I0330 20:15:08.885763 1 shared_informer.go:350] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" I0330 20:15:08.885110 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0330 20:15:08.885946 1 repairip.go:200] Starting ipallocator-repair-controller I0330 20:15:08.885975 1 shared_informer.go:350] "Waiting for caches to sync" controller="ipallocator-repair-controller" I0330 20:15:08.885176 1 controller.go:80] Starting OpenAPI V3 AggregationController I0330 20:15:08.886219 1 customresource_discovery_controller.go:294] Starting DiscoveryController I0330 20:15:08.886416 1 crdregistration_controller.go:114] Starting crd-autoregister controller I0330 20:15:08.886435 1 shared_informer.go:350] "Waiting for caches to sync" controller="crd-autoregister" I0330 20:15:08.886498 1 controller.go:142] Starting OpenAPI controller I0330 20:15:08.886801 1 controller.go:90] Starting OpenAPI V3 controller I0330 20:15:08.886919 1 naming_controller.go:299] Starting NamingConditionController I0330 20:15:08.886999 1 establishing_controller.go:81] Starting EstablishingController I0330 20:15:08.887171 1 nonstructuralschema_controller.go:195] Starting NonStructuralSchemaConditionController I0330 20:15:08.887269 1 apiapproval_controller.go:189] Starting KubernetesAPIApprovalPolicyConformantConditionController I0330 20:15:08.887375 1 crd_finalizer.go:269] Starting CRDFinalizer I0330 20:15:08.968374 1 shared_informer.go:357] "Caches are synced" controller="node_authorizer" E0330 20:15:08.977288 1 controller.go:145] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0330 20:15:08.984711 1 shared_informer.go:357] "Caches are synced" controller="configmaps" I0330 20:15:08.984896 1 apf_controller.go:382] Running API Priority and Fairness config worker I0330 20:15:08.984985 1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process I0330 20:15:08.984958 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0330 20:15:08.985061 1 handler_discovery.go:451] Starting ResourceDiscoveryManager I0330 20:15:08.985098 1 shared_informer.go:357] "Caches are synced" controller="cluster_authentication_trust_controller" I0330 20:15:08.985581 1 cache.go:39] Caches are synced for LocalAvailability controller I0330 20:15:08.985748 1 cache.go:39] Caches are synced for RemoteAvailability controller I0330 20:15:08.985797 1 shared_informer.go:357] "Caches are synced" controller="kubernetes-service-cidr-controller" I0330 20:15:08.985975 1 default_servicecidr_controller.go:165] Creating default ServiceCIDR with CIDRs: [10.96.0.0/12] I0330 20:15:08.986190 1 shared_informer.go:357] "Caches are synced" controller="ipallocator-repair-controller" I0330 20:15:08.986460 1 shared_informer.go:357] "Caches are synced" controller="crd-autoregister" I0330 20:15:08.986579 1 aggregator.go:171] initial CRD sync complete... I0330 20:15:08.986637 1 autoregister_controller.go:144] Starting autoregister controller I0330 20:15:08.986714 1 cache.go:32] Waiting for caches to sync for autoregister controller I0330 20:15:08.986990 1 cache.go:39] Caches are synced for autoregister controller I0330 20:15:08.987549 1 shared_informer.go:357] "Caches are synced" controller="*generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]" I0330 20:15:08.987583 1 policy_source.go:240] refreshing policies I0330 20:15:08.990636 1 controller.go:667] quota admission added evaluator for: namespaces I0330 20:15:08.992710 1 default_servicecidr_controller.go:214] Setting default ServiceCIDR condition Ready to True I0330 20:15:08.992743 1 cidrallocator.go:301] created ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:15:09.004389 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:15:09.005473 1 default_servicecidr_controller.go:136] Shutting down kubernetes-service-cidr-controller I0330 20:15:09.180460 1 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io I0330 20:15:09.892316 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0330 20:15:09.897680 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0330 20:15:09.897692 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0330 20:15:10.460946 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0330 20:15:10.504954 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0330 20:15:10.596974 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0330 20:15:10.605407 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [199.204.45.6] I0330 20:15:10.606511 1 controller.go:667] quota admission added evaluator for: endpoints I0330 20:15:10.614445 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io I0330 20:15:11.361342 1 controller.go:667] quota admission added evaluator for: serviceaccounts I0330 20:15:12.225065 1 controller.go:667] quota admission added evaluator for: deployments.apps I0330 20:15:12.428710 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0330 20:15:12.622546 1 controller.go:667] quota admission added evaluator for: daemonsets.apps I0330 20:15:16.814961 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:15:16.820199 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12 I0330 20:15:16.905101 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps I0330 20:15:16.955549 1 controller.go:667] quota admission added evaluator for: replicasets.apps I0330 20:16:54.922695 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:16:54.996436 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:16:55.022768 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:16:55.045370 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:16:55.082220 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:16:55.103452 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:16:55.103494 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 20:16:55.130877 1 handler.go:288] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I0330 20:16:55.135194 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:16:55.135253 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:16:55.172605 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I0330 20:16:55.172658 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I0330 20:16:55.223436 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:16:55.223483 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:16:55.276978 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:16:55.347998 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:55.428650 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:55.555886 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I0330 20:16:55.556010 1 handler.go:288] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I0330 20:16:55.610620 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:55.648681 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:55.663678 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:56.290034 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:56.312849 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:16:56.413814 1 handler.go:288] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I0330 20:17:01.444903 1 controller.go:667] quota admission added evaluator for: jobs.batch