I1013 14:58:39.472897 1 options.go:220] external host was not specified, using 162.253.55.24 I1013 14:58:39.473684 1 server.go:148] Version: v1.28.13 I1013 14:58:39.473722 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I1013 14:58:40.005778 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I1013 14:58:40.014363 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I1013 14:58:40.014427 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I1013 14:58:40.014673 1 instance.go:298] Using reconciler: lease I1013 14:58:40.743249 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W1013 14:58:40.743273 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I1013 14:58:41.074158 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I1013 14:58:41.074530 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I1013 14:58:41.617110 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I1013 14:58:41.639715 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W1013 14:58:41.639754 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.639764 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.640593 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W1013 14:58:41.640619 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I1013 14:58:41.641952 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I1013 14:58:41.643346 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W1013 14:58:41.643371 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W1013 14:58:41.643378 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I1013 14:58:41.645833 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W1013 14:58:41.645859 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I1013 14:58:41.647366 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W1013 14:58:41.647392 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.647399 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.648597 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W1013 14:58:41.648624 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.648685 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I1013 14:58:41.649666 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I1013 14:58:41.652405 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W1013 14:58:41.652432 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.652440 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.653262 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W1013 14:58:41.653286 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.653293 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.654839 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W1013 14:58:41.654866 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I1013 14:58:41.657755 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W1013 14:58:41.657785 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.657794 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.658498 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W1013 14:58:41.658524 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.658530 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.661059 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W1013 14:58:41.661078 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.661093 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.662365 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I1013 14:58:41.663622 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W1013 14:58:41.663639 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.663644 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.667744 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W1013 14:58:41.667763 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W1013 14:58:41.667768 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I1013 14:58:41.668757 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W1013 14:58:41.668775 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W1013 14:58:41.668780 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I1013 14:58:41.669540 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W1013 14:58:41.669557 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I1013 14:58:41.703639 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W1013 14:58:41.703675 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I1013 14:58:42.182346 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I1013 14:58:42.182374 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I1013 14:58:42.182771 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I1013 14:58:42.183429 1 secure_serving.go:213] Serving securely on [::]:6443 I1013 14:58:42.183642 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I1013 14:58:42.183673 1 apf_controller.go:374] Starting API Priority and Fairness config controller I1013 14:58:42.183656 1 system_namespaces_controller.go:67] Starting system namespaces controller I1013 14:58:42.183714 1 controller.go:80] Starting OpenAPI V3 AggregationController I1013 14:58:42.183739 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I1013 14:58:42.183774 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I1013 14:58:42.183807 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I1013 14:58:42.183785 1 available_controller.go:423] Starting AvailableConditionController I1013 14:58:42.183848 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I1013 14:58:42.183891 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I1013 14:58:42.183910 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I1013 14:58:42.183951 1 customresource_discovery_controller.go:289] Starting DiscoveryController I1013 14:58:42.184048 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I1013 14:58:42.184118 1 controller.go:85] Starting OpenAPI V3 controller I1013 14:58:42.184168 1 naming_controller.go:291] Starting NamingConditionController I1013 14:58:42.184227 1 establishing_controller.go:76] Starting EstablishingController I1013 14:58:42.184249 1 gc_controller.go:78] Starting apiserver lease garbage collector I1013 14:58:42.184298 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I1013 14:58:42.184318 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I1013 14:58:42.184372 1 crd_finalizer.go:266] Starting CRDFinalizer I1013 14:58:42.184611 1 aggregator.go:164] waiting for initial CRD sync... I1013 14:58:42.184055 1 controller.go:134] Starting OpenAPI controller I1013 14:58:42.184303 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I1013 14:58:42.185306 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I1013 14:58:42.185514 1 controller.go:78] Starting OpenAPI AggregationController I1013 14:58:42.185873 1 gc_controller.go:78] Starting apiserver lease garbage collector I1013 14:58:42.186200 1 controller.go:116] Starting legacy_token_tracking_controller I1013 14:58:42.186281 1 shared_informer.go:311] Waiting for caches to sync for configmaps I1013 14:58:42.199183 1 crdregistration_controller.go:111] Starting crd-autoregister controller I1013 14:58:42.199213 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I1013 14:58:42.199223 1 shared_informer.go:318] Caches are synced for crd-autoregister I1013 14:58:42.199312 1 aggregator.go:166] initial CRD sync complete... I1013 14:58:42.199321 1 autoregister_controller.go:141] Starting autoregister controller I1013 14:58:42.199329 1 cache.go:32] Waiting for caches to sync for autoregister controller I1013 14:58:42.199336 1 cache.go:39] Caches are synced for autoregister controller I1013 14:58:42.284687 1 cache.go:39] Caches are synced for AvailableConditionController controller I1013 14:58:42.284731 1 apf_controller.go:379] Running API Priority and Fairness config worker I1013 14:58:42.284795 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I1013 14:58:42.284813 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I1013 14:58:42.284767 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I1013 14:58:42.286355 1 shared_informer.go:318] Caches are synced for configmaps I1013 14:58:42.286553 1 controller.go:624] quota admission added evaluator for: namespaces I1013 14:58:42.305944 1 shared_informer.go:318] Caches are synced for node_authorizer I1013 14:58:42.363718 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I1013 14:58:43.214898 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I1013 14:58:43.222999 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I1013 14:58:43.223077 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I1013 14:58:46.167911 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I1013 14:58:46.328999 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I1013 14:58:46.570115 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W1013 14:58:46.600347 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [162.253.55.24] I1013 14:58:46.602772 1 controller.go:624] quota admission added evaluator for: endpoints I1013 14:58:46.620859 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I1013 14:58:47.240649 1 controller.go:624] quota admission added evaluator for: serviceaccounts I1013 14:58:48.460928 1 controller.go:624] quota admission added evaluator for: deployments.apps I1013 14:58:48.487203 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I1013 14:58:48.690058 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I1013 14:58:51.982735 1 controller.go:624] quota admission added evaluator for: replicasets.apps I1013 14:58:52.381520 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I1013 14:59:27.527102 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1013 14:59:27.542703 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1013 14:59:27.542746 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1013 14:59:27.572043 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1013 14:59:27.593050 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1013 14:59:27.602530 1 handler.go:275] Adding GroupVersion gateway.networking.x-k8s.io v1alpha1 to ResourceManager I1013 14:59:27.616190 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1013 14:59:27.616221 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I1013 14:59:27.626566 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1013 14:59:27.637039 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1013 14:59:27.656007 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha2 to ResourceManager I1013 14:59:27.656042 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1alpha3 to ResourceManager I1013 14:59:27.709911 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1013 14:59:27.709978 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1013 14:59:27.753280 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1013 14:59:27.882481 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1 to ResourceManager I1013 14:59:27.882588 1 handler.go:275] Adding GroupVersion gateway.networking.k8s.io v1beta1 to ResourceManager I1013 14:59:27.882618 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:27.954590 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:27.997702 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:28.032165 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:28.046317 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:28.754396 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:28.760734 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:28.873417 1 handler.go:275] Adding GroupVersion gateway.envoyproxy.io v1alpha1 to ResourceManager I1013 14:59:34.875283 1 controller.go:624] quota admission added evaluator for: jobs.batch I1013 14:59:35.577698 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1013 14:59:35.585412 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1013 14:59:35.592787 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1013 14:59:35.771139 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1013 14:59:35.975801 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1013 14:59:36.162990 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1013 14:59:36.572029 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I1013 14:59:38.192792 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1013 14:59:38.801467 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1013 14:59:39.233844 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I1013 14:59:39.621117 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager W1013 14:59:44.070940 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found E1013 14:59:44.071000 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": service "envoy-gateway" not found I1013 14:59:44.553762 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I1013 14:59:52.914282 1 alloc.go:330] "allocated clusterIPs" service="envoy-gateway-system/envoy-gateway" clusterIPs={"IPv4":"10.107.216.144"} W1013 14:59:52.948006 1 dispatcher.go:210] Failed calling webhook, failing open topology.webhook.gateway.envoyproxy.io: failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.107.216.144:9443: connect: connection refused E1013 14:59:52.948029 1 dispatcher.go:214] failed calling webhook "topology.webhook.gateway.envoyproxy.io": failed to call webhook: Post "https://envoy-gateway.envoy-gateway-system.svc:9443/inject-pod-topology?timeout=10s": dial tcp 10.107.216.144:9443: connect: connection refused I1013 15:00:26.808960 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.110.147.74"} I1013 15:00:26.818676 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.109.254.57"}