Title
K-Ns: A Classifier By The Distance To The Nearest Subspace
Abstract
To improve the classification performance of k-NN, this paper presents a classifier, called k-NS, based on the Euclidian distances from a query sample to the nearest subspaces. Each nearest subspace is spanned by k nearest samples of a same class. A simple discriminant is derived to calculate the distances due to the geometric meaning of the Grammian, and the calculation stability of the discriminant is guaranteed by embedding Tikhonov regularization. The proposed classifier, k-NS, categorizes a query sample into the class whose corresponding subspace is proximal. Because the Grammian only involves inner products, the classifier is naturally extended into the high-dimensional feature space induced by kernel functions. The experimental results on 13 publicly available benchmark datasets show that k-NS is quite promising compared to several other classifiers founded on nearest neighbors in terms of training and test accuracy and efficiency.
Year
DOI
Venue
2011
10.1109/TNN.2011.2153210
IEEE TRANSACTIONS ON NEURAL NETWORKS
Keywords
DocType
Volume
Grammian geometric meaning, kernel function nearest subspace, Tikhonov regularization
Journal
22
Issue
ISSN
Citations 
8
1045-9227
1
PageRank 
References 
Authors
0.39
13
4
Name
Order
Citations
PageRank
Yiguang Liu133837.15
Shuzhi Sam Ge27786444.41
Chunguang Li374863.37
Zhisheng You441752.22