I0305 07:06:19.571014 1 options.go:220] external host was not specified, using 199.204.45.210 I0305 07:06:19.571845 1 server.go:148] Version: v1.28.13 I0305 07:06:19.571893 1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" I0305 07:06:19.805222 1 shared_informer.go:311] Waiting for caches to sync for node_authorizer I0305 07:06:19.816073 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0305 07:06:19.816090 1 plugins.go:161] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. I0305 07:06:19.816363 1 instance.go:298] Using reconciler: lease I0305 07:06:20.257812 1 handler.go:275] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager W0305 07:06:20.257846 1 genericapiserver.go:744] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. I0305 07:06:20.509667 1 handler.go:275] Adding GroupVersion v1 to ResourceManager I0305 07:06:20.509991 1 instance.go:709] API group "internal.apiserver.k8s.io" is not enabled, skipping. I0305 07:06:20.932473 1 instance.go:709] API group "resource.k8s.io" is not enabled, skipping. I0305 07:06:20.944275 1 handler.go:275] Adding GroupVersion authentication.k8s.io v1 to ResourceManager W0305 07:06:20.944305 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.944311 1 genericapiserver.go:744] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.944799 1 handler.go:275] Adding GroupVersion authorization.k8s.io v1 to ResourceManager W0305 07:06:20.944810 1 genericapiserver.go:744] Skipping API authorization.k8s.io/v1beta1 because it has no resources. I0305 07:06:20.945617 1 handler.go:275] Adding GroupVersion autoscaling v2 to ResourceManager I0305 07:06:20.946302 1 handler.go:275] Adding GroupVersion autoscaling v1 to ResourceManager W0305 07:06:20.946315 1 genericapiserver.go:744] Skipping API autoscaling/v2beta1 because it has no resources. W0305 07:06:20.946318 1 genericapiserver.go:744] Skipping API autoscaling/v2beta2 because it has no resources. I0305 07:06:20.947608 1 handler.go:275] Adding GroupVersion batch v1 to ResourceManager W0305 07:06:20.947622 1 genericapiserver.go:744] Skipping API batch/v1beta1 because it has no resources. I0305 07:06:20.948491 1 handler.go:275] Adding GroupVersion certificates.k8s.io v1 to ResourceManager W0305 07:06:20.948504 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.948508 1 genericapiserver.go:744] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.948922 1 handler.go:275] Adding GroupVersion coordination.k8s.io v1 to ResourceManager W0305 07:06:20.948934 1 genericapiserver.go:744] Skipping API coordination.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.948960 1 genericapiserver.go:744] Skipping API discovery.k8s.io/v1beta1 because it has no resources. I0305 07:06:20.949419 1 handler.go:275] Adding GroupVersion discovery.k8s.io v1 to ResourceManager I0305 07:06:20.950580 1 handler.go:275] Adding GroupVersion networking.k8s.io v1 to ResourceManager W0305 07:06:20.950594 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.950597 1 genericapiserver.go:744] Skipping API networking.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.950925 1 handler.go:275] Adding GroupVersion node.k8s.io v1 to ResourceManager W0305 07:06:20.950937 1 genericapiserver.go:744] Skipping API node.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.950940 1 genericapiserver.go:744] Skipping API node.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.951514 1 handler.go:275] Adding GroupVersion policy v1 to ResourceManager W0305 07:06:20.951527 1 genericapiserver.go:744] Skipping API policy/v1beta1 because it has no resources. I0305 07:06:20.952844 1 handler.go:275] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager W0305 07:06:20.952856 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.952860 1 genericapiserver.go:744] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.953244 1 handler.go:275] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager W0305 07:06:20.953261 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.953265 1 genericapiserver.go:744] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.954924 1 handler.go:275] Adding GroupVersion storage.k8s.io v1 to ResourceManager W0305 07:06:20.954937 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.954941 1 genericapiserver.go:744] Skipping API storage.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.955728 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta3 to ResourceManager I0305 07:06:20.956572 1 handler.go:275] Adding GroupVersion flowcontrol.apiserver.k8s.io v1beta2 to ResourceManager W0305 07:06:20.956586 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.956589 1 genericapiserver.go:744] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.959349 1 handler.go:275] Adding GroupVersion apps v1 to ResourceManager W0305 07:06:20.959363 1 genericapiserver.go:744] Skipping API apps/v1beta2 because it has no resources. W0305 07:06:20.959366 1 genericapiserver.go:744] Skipping API apps/v1beta1 because it has no resources. I0305 07:06:20.959983 1 handler.go:275] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager W0305 07:06:20.959996 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. W0305 07:06:20.960000 1 genericapiserver.go:744] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. I0305 07:06:20.960530 1 handler.go:275] Adding GroupVersion events.k8s.io v1 to ResourceManager W0305 07:06:20.960542 1 genericapiserver.go:744] Skipping API events.k8s.io/v1beta1 because it has no resources. I0305 07:06:21.001677 1 handler.go:275] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager W0305 07:06:21.001696 1 genericapiserver.go:744] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0305 07:06:21.461109 1 secure_serving.go:213] Serving securely on [::]:6443 I0305 07:06:21.461322 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0305 07:06:21.461459 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key" I0305 07:06:21.461588 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0305 07:06:21.462579 1 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key" I0305 07:06:21.462689 1 aggregator.go:164] waiting for initial CRD sync... I0305 07:06:21.462847 1 available_controller.go:423] Starting AvailableConditionController I0305 07:06:21.462859 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0305 07:06:21.462891 1 controller.go:78] Starting OpenAPI AggregationController I0305 07:06:21.462921 1 handler_discovery.go:412] Starting ResourceDiscoveryManager I0305 07:06:21.463066 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0305 07:06:21.463102 1 shared_informer.go:311] Waiting for caches to sync for cluster_authentication_trust_controller I0305 07:06:21.463250 1 gc_controller.go:78] Starting apiserver lease garbage collector I0305 07:06:21.463305 1 controller.go:80] Starting OpenAPI V3 AggregationController I0305 07:06:21.463515 1 gc_controller.go:78] Starting apiserver lease garbage collector I0305 07:06:21.463557 1 apf_controller.go:374] Starting API Priority and Fairness config controller I0305 07:06:21.463714 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0305 07:06:21.464247 1 system_namespaces_controller.go:67] Starting system namespaces controller I0305 07:06:21.464442 1 customresource_discovery_controller.go:289] Starting DiscoveryController I0305 07:06:21.464748 1 controller.go:116] Starting legacy_token_tracking_controller I0305 07:06:21.464757 1 shared_informer.go:311] Waiting for caches to sync for configmaps I0305 07:06:21.464797 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0305 07:06:21.464802 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0305 07:06:21.465955 1 controller.go:134] Starting OpenAPI controller I0305 07:06:21.465986 1 controller.go:85] Starting OpenAPI V3 controller I0305 07:06:21.466003 1 naming_controller.go:291] Starting NamingConditionController I0305 07:06:21.466034 1 establishing_controller.go:76] Starting EstablishingController I0305 07:06:21.468273 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0305 07:06:21.468299 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0305 07:06:21.468322 1 crd_finalizer.go:266] Starting CRDFinalizer I0305 07:06:21.469186 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0305 07:06:21.469219 1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister I0305 07:06:21.469269 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" I0305 07:06:21.470304 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/etc/kubernetes/pki/front-proxy-ca.crt" I0305 07:06:21.505953 1 shared_informer.go:318] Caches are synced for node_authorizer I0305 07:06:21.563005 1 cache.go:39] Caches are synced for AvailableConditionController controller I0305 07:06:21.563153 1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller I0305 07:06:21.564799 1 shared_informer.go:318] Caches are synced for configmaps I0305 07:06:21.564910 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0305 07:06:21.566109 1 apf_controller.go:379] Running API Priority and Fairness config worker I0305 07:06:21.566136 1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process I0305 07:06:21.567360 1 controller.go:624] quota admission added evaluator for: namespaces I0305 07:06:21.569965 1 shared_informer.go:318] Caches are synced for crd-autoregister I0305 07:06:21.570003 1 aggregator.go:166] initial CRD sync complete... I0305 07:06:21.570020 1 autoregister_controller.go:141] Starting autoregister controller I0305 07:06:21.570061 1 cache.go:32] Waiting for caches to sync for autoregister controller I0305 07:06:21.570079 1 cache.go:39] Caches are synced for autoregister controller E0305 07:06:21.664184 1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found E0305 07:06:21.664748 1 controller.go:146] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" I0305 07:06:21.869358 1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io I0305 07:06:22.471260 1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000 I0305 07:06:22.476354 1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000 I0305 07:06:22.476547 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist. I0305 07:06:23.045786 1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0305 07:06:23.086582 1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0305 07:06:23.177132 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"} W0305 07:06:23.184763 1 lease.go:263] Resetting endpoints for master service "kubernetes" to [199.204.45.210] I0305 07:06:23.185954 1 controller.go:624] quota admission added evaluator for: endpoints I0305 07:06:23.194719 1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io I0305 07:06:24.465196 1 controller.go:624] quota admission added evaluator for: serviceaccounts I0305 07:06:24.914433 1 controller.go:624] quota admission added evaluator for: deployments.apps I0305 07:06:24.927599 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"} I0305 07:06:25.070197 1 controller.go:624] quota admission added evaluator for: daemonsets.apps I0305 07:06:29.052084 1 controller.go:624] quota admission added evaluator for: replicasets.apps I0305 07:06:29.450842 1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps I0305 07:06:56.458258 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0305 07:06:56.464948 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:06:56.472942 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0305 07:06:57.048121 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:06:57.266567 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:06:57.455710 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0305 07:06:57.652336 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0305 07:06:58.257234 1 handler.go:275] Adding GroupVersion cilium.io v2alpha1 to ResourceManager I0305 07:06:58.486424 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:06:59.854321 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:07:00.251566 1 handler.go:275] Adding GroupVersion cilium.io v2 to ResourceManager I0305 07:07:15.404899 1 trace.go:236] Trace[1609362418]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:1c07520e-5439-4481-8011-7e486e28c68c,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-67659f764b-6x9kx/binding,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (05-Mar-2026 07:07:14.876) (total time: 528ms): Trace[1609362418]: ["GuaranteedUpdate etcd3" audit-id:1c07520e-5439-4481-8011-7e486e28c68c,key:/pods/kube-system/coredns-67659f764b-6x9kx,type:*core.Pod,resource:pods 527ms (07:07:14.877) Trace[1609362418]: ---"Txn call completed" 527ms (07:07:15.404)] Trace[1609362418]: [528.422695ms] [528.422695ms] END I0305 07:07:15.405036 1 trace.go:236] Trace[1457260882]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:b3fda8da-b25a-4c80-92e2-a42ff5244289,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-7c96b6546b-qzztj/binding,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (05-Mar-2026 07:07:14.876) (total time: 528ms): Trace[1457260882]: ["GuaranteedUpdate etcd3" audit-id:b3fda8da-b25a-4c80-92e2-a42ff5244289,key:/pods/kube-system/coredns-7c96b6546b-qzztj,type:*core.Pod,resource:pods 527ms (07:07:14.877) Trace[1457260882]: ---"Txn call completed" 527ms (07:07:15.404)] Trace[1457260882]: [528.093266ms] [528.093266ms] END I0305 07:07:15.404916 1 trace.go:236] Trace[1736108342]: "Create" accept:application/vnd.kubernetes.protobuf, */*,audit-id:69901847-4329-4a48-ad8d-74544ba15cb4,client:199.204.45.210,protocol:HTTP/2.0,resource:pods,scope:resource,url:/api/v1/namespaces/kube-system/pods/coredns-67659f764b-zrlr8/binding,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/scheduler,verb:POST (05-Mar-2026 07:07:14.876) (total time: 528ms): Trace[1736108342]: ["GuaranteedUpdate etcd3" audit-id:69901847-4329-4a48-ad8d-74544ba15cb4,key:/pods/kube-system/coredns-67659f764b-zrlr8,type:*core.Pod,resource:pods 527ms (07:07:14.877) Trace[1736108342]: ---"Txn call completed" 527ms (07:07:15.404)] Trace[1736108342]: [528.388805ms] [528.388805ms] END I0305 07:07:15.405201 1 trace.go:236] Trace[211167820]: "Patch" accept:application/vnd.kubernetes.protobuf, */*,audit-id:f5d404de-6ac1-4026-91b8-9c550dcdd587,client:199.204.45.210,protocol:HTTP/2.0,resource:nodes,scope:resource,url:/api/v1/nodes/instance/status,user-agent:cilium-operator-generic/1.14.8 cf6e022e 2024-03-13T12:23:35-04:00 go version go1.21.8 linux/amd64,verb:PATCH (05-Mar-2026 07:07:14.876) (total time: 528ms): Trace[211167820]: ["GuaranteedUpdate etcd3" audit-id:f5d404de-6ac1-4026-91b8-9c550dcdd587,key:/minions/instance,type:*core.Node,resource:nodes 528ms (07:07:14.876) Trace[211167820]: ---"Txn call completed" 525ms (07:07:15.404)] Trace[211167820]: ---"Object stored in database" 525ms (07:07:15.404) Trace[211167820]: [528.708173ms] [528.708173ms] END I0305 07:07:15.966515 1 controller.go:624] quota admission added evaluator for: ciliumendpoints.cilium.io I0305 07:07:46.480689 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-provisioner-http-metrics" clusterIPs={"IPv4":"10.97.119.164"} I0305 07:07:46.488948 1 alloc.go:330] "allocated clusterIPs" service="kube-system/ceph-csi-rbd-nodeplugin-http-metrics" clusterIPs={"IPv4":"10.105.207.166"} I0305 07:08:07.820949 1 trace.go:236] Trace[1882823476]: "Get" accept:application/json, */*,audit-id:3adf94ab-9e9a-4251-abc5-e4dd45b08488,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (05-Mar-2026 07:08:07.260) (total time: 560ms): Trace[1882823476]: ---"About to write a response" 560ms (07:08:07.820) Trace[1882823476]: [560.572469ms] [560.572469ms] END I0305 07:08:08.409820 1 trace.go:236] Trace[2012950317]: "Update" accept:application/vnd.kubernetes.protobuf, */*,audit-id:33e7a857-7220-4694-b829-17d52bad322a,client:199.204.45.210,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.28.13 (linux/amd64) kubernetes/024ab2a/leader-election,verb:PUT (05-Mar-2026 07:08:07.822) (total time: 586ms): Trace[2012950317]: ["GuaranteedUpdate etcd3" audit-id:33e7a857-7220-4694-b829-17d52bad322a,key:/leases/kube-system/kube-scheduler,type:*coordination.Lease,resource:leases.coordination.k8s.io 586ms (07:08:07.822) Trace[2012950317]: ---"Txn call completed" 586ms (07:08:08.409)] Trace[2012950317]: [586.987359ms] [586.987359ms] END I0305 07:08:08.410026 1 trace.go:236] Trace[1471488127]: "Update" accept:application/json, */*,audit-id:79b4fad3-bf85-4fc3-a32d-8b897c1f6610,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-svcs-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (05-Mar-2026 07:08:07.822) (total time: 587ms): Trace[1471488127]: ["GuaranteedUpdate etcd3" audit-id:79b4fad3-bf85-4fc3-a32d-8b897c1f6610,key:/leases/kube-system/plndr-svcs-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 587ms (07:08:07.822) Trace[1471488127]: ---"Txn call completed" 586ms (07:08:08.409)] Trace[1471488127]: [587.095581ms] [587.095581ms] END I0305 07:08:08.410173 1 trace.go:236] Trace[1310407159]: "Update" accept:application/json, */*,audit-id:547515fd-5aad-4b33-819c-402822104736,client:127.0.0.1,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (05-Mar-2026 07:08:07.824) (total time: 585ms): Trace[1310407159]: ["GuaranteedUpdate etcd3" audit-id:547515fd-5aad-4b33-819c-402822104736,key:/leases/kube-system/plndr-cp-lock,type:*coordination.Lease,resource:leases.coordination.k8s.io 585ms (07:08:07.824) Trace[1310407159]: ---"Txn call completed" 585ms (07:08:08.409)] Trace[1310407159]: [585.852668ms] [585.852668ms] END