I1014 09:12:18.680533 1 options.go:220] external host was not specified, using 199.19.213.59 I1014 09:12:18.687776 1 server.go:148] Version: v1.28.13 I1014 09:12:18.687824 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I1014 09:12:19.079573 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I1014 09:12:19.105919 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I1014 09:12:19.105943 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I1014 09:12:19.106343 1 instance.go:298] Using reconciler: lease I1014 09:12:19.146814 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W1014 09:12:19.147094 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I1014 09:12:19.400636 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I1014 09:12:19.400993 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I1014 09:12:19.882718 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I1014 09:12:19.898276 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W1014 09:12:19.898327 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.898339 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.899139 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W1014 09:12:19.899168 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I1014 09:12:19.900523 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I1014 09:12:19.901718 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W1014 09:12:19.901745 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W1014 09:12:19.901753 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I1014 09:12:19.903643 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W1014 09:12:19.903661 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I1014 09:12:19.904542 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W1014 09:12:19.904559 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.904565 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.905186 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W1014 09:12:19.905204 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.905239 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I1014 09:12:19.905839 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I1014 09:12:19.907697 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W1014 09:12:19.907714 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.907720 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.908227 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W1014 09:12:19.908244 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.908249 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.909073 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W1014 09:12:19.909090 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I1014 09:12:19.910777 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W1014 09:12:19.910795 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.910801 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.911272 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W1014 09:12:19.911292 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.911296 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.913629 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W1014 09:12:19.913648 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.913653 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.914846 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I1014 09:12:19.916119 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W1014 09:12:19.916138 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.916143 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.919969 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W1014 09:12:19.919987 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W1014 09:12:19.919993 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I1014 09:12:19.920867 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W1014 09:12:19.920885 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W1014 09:12:19.920890 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I1014 09:12:19.921461 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W1014 09:12:19.921479 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I1014 09:12:19.959260 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W1014 09:12:19.959290 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I1014 09:12:20.437140 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I1014 09:12:20.437147 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I1014 09:12:20.437416 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I1014 09:12:20.437519 1 secure_serving.go:213] Serving securely on [::]:6443 I1014 09:12:20.437602 1 controller.go:80] Starting OpenAPI V3 AggregationController I1014 09:12:20.437692 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I1014 09:12:20.437713 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I1014 09:12:20.437724 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I1014 09:12:20.437792 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I1014 09:12:20.437870 1 system_namespaces_controller.go:67] Starting system namespaces controller I1014 09:12:20.437919 1 controller.go:78] Starting OpenAPI AggregationController I1014 09:12:20.437992 1 aggregator.go:164] waiting for initial CRD sync... I1014 09:12:20.438024 1 crdregistration_controller.go:111] Starting crd-autoregister controller I1014 09:12:20.438067 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I1014 09:12:20.438118 1 gc_controller.go:78] Starting apiserver lease garbage collector I1014 09:12:20.438211 1 gc_controller.go:78] Starting apiserver lease garbage collector I1014 09:12:20.438635 1 apf_controller.go:374] Starting API Priority and Fairness config controller I1014 09:12:20.438736 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I1014 09:12:20.438863 1 available_controller.go:423] Starting AvailableConditionController I1014 09:12:20.438875 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I1014 09:12:20.439045 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I1014 09:12:20.439067 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I1014 09:12:20.439103 1 controller.go:116] Starting legacy_token_tracking_controller I1014 09:12:20.439116 1 shared_informer.go:311] Waiting for caches to sync for configmaps I1014 09:12:20.439616 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I1014 09:12:20.439754 1 customresource_discovery_controller.go:289] Starting DiscoveryController I1014 09:12:20.439830 1 controller.go:134] Starting OpenAPI controller I1014 09:12:20.439864 1 controller.go:85] Starting OpenAPI V3 controller I1014 09:12:20.439894 1 naming_controller.go:291] Starting NamingConditionController I1014 09:12:20.439937 1 establishing_controller.go:76] Starting EstablishingController I1014 09:12:20.439960 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I1014 09:12:20.439990 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I1014 09:12:20.440065 1 crd_finalizer.go:266] Starting CRDFinalizer I1014 09:12:20.439957 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I1014 09:12:20.479818 1 shared_informer.go:318] Caches are synced for node_authorizer E1014 09:12:20.519676 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I1014 09:12:20.538368 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I1014 09:12:20.538459 1 shared_informer.go:318] Caches are synced for crd-autoregister I1014 09:12:20.538496 1 aggregator.go:166] initial CRD sync complete... I1014 09:12:20.538512 1 autoregister_controller.go:141] Starting autoregister controller I1014 09:12:20.538521 1 cache.go:32] Waiting for caches to sync for autoregister controller I1014 09:12:20.538530 1 cache.go:39] Caches are synced for autoregister controller I1014 09:12:20.538733 1 apf_controller.go:379] Running API Priority and Fairness config worker I1014 09:12:20.538750 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I1014 09:12:20.538932 1 cache.go:39] Caches are synced for AvailableConditionController controller I1014 09:12:20.539190 1 shared_informer.go:318] Caches are synced for configmaps I1014 09:12:20.539341 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I1014 09:12:20.541464 1 controller.go:624] quota admission added evaluator for: namespaces I1014 09:12:20.723844 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I1014 09:12:21.445340 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I1014 09:12:21.450613 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I1014 09:12:21.450636 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I1014 09:12:22.064537 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I1014 09:12:22.116494 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I1014 09:12:22.252398 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W1014 09:12:22.261536 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.19.213.59] I1014 09:12:22.263187 1 controller.go:624] quota admission added evaluator for: endpoints I1014 09:12:22.269338 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I1014 09:12:22.950137 1 controller.go:624] quota admission added evaluator for: serviceaccounts I1014 09:12:23.940792 1 controller.go:624] quota admission added evaluator for: deployments.apps I1014 09:12:23.961376 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I1014 09:12:24.118868 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I1014 09:12:27.990324 1 controller.go:624] quota admission added evaluator for: replicasets.apps I1014 09:12:28.044478 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I1014 09:13:03.960976 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1014 09:13:03.999801 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1014 09:13:04.054349 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1014 09:13:04.054396 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I1014 09:13:04.087653 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1014 09:13:04.110666 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1014 09:13:04.110708 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I1014 09:13:04.122291 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1014 09:13:04.131292 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1014 09:13:04.131329 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1014 09:13:04.143121 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1014 09:13:04.149680 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1014 09:13:04.221288 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1014 09:13:04.221334 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1014 09:13:04.247063 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1014 09:13:04.651755 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1014 09:13:04.651821 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1014 09:13:04.681629 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:04.734193 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:04.781336 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:04.814936 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:04.850372 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:05.636846 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:05.638338 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:05.696454 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1014 09:13:11.501733 1 controller.go:624] quota admission added evaluator for: jobs.batch I1014 09:13:11.912799 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1014 09:13:11.929256 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1014 09:13:11.939181 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1014 09:13:12.309442 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1014 09:13:12.500817 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1014 09:13:12.703149 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1014 09:13:13.163123 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1014 09:13:13.728197 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1014 09:13:14.743861 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1014 09:13:15.585051 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1014 09:13:15.739978 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W1014 09:13:21.616461 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E1014 09:13:21.616512 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I1014 09:13:22.061367 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I1014 09:13:30.429514 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.105.72.214"} W1014 09:13:30.473576 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.72.214:9443: connect: connection refused E1014 09:13:30.473631 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.105.72.214:9443: connect: connection refused I1014 09:14:03.150895 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.107.168.250"} I1014 09:14:03.161469 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.96.121.72"}