Title
Overlap pattern synthesis with an efficient nearest neighbor classifier
Abstract
Nearest neighbor (NN) classifier is the most popular non-parametric classifier. It is a simple classifier with no design phase and shows good performance. Important factors affecting the efficiency and performance of NN classifier are (i) memory required to store the training set, (ii) classification time required to search the nearest neighbor of a given test pattern, and (iii) due to the curse of dimensionality the number of training patterns needed by it to achieve a given classification accuracy becomes prohibitively large when the dimensionality of the data is high. In this paper, we propose novel techniques to improve the performance of NN classifier and at the same time to reduce its computational burden. These techniques are broadly based on: (i) overlap based pattern synthesis which can generate a larger number of artificial patterns than the number of input patterns and thus can reduce the curse of dimensionality effect, (ii) a compact representation of the given set of training patterns called overlap pattern graph (OLP-graph) which can be incrementally built by scanning the training set only once and (iii) an efficient NN classifier called OLP-NNC which directly works with OLP-graph and does implicit overlap based pattern synthesis. A comparison based on experimental results is given between some of the relevant classifiers. The proposed schemes are suitable for applications dealing with large and high dimensional datasets like those in data mining.
Year
DOI
Venue
2005
10.1016/j.patcog.2004.10.007
Pattern Recognition
Keywords
Field
DocType
input pattern,efficient nn classifier,data mining,efficient nearest neighbor classifier,nearest neighbor classifier,simple classifier,nn classifier,relevant classifier,training pattern,compact representation,artificial pattern,popular non-parametric classifier,nearest neighbor,pattern synthesis
k-nearest neighbors algorithm,Graph,Pattern recognition,Computer science,Curse of dimensionality,Pattern synthesis,Artificial intelligence,Margin classifier,Classifier (linguistics),Machine learning,Quadratic classifier,Nearest neighbor classifier
Journal
Volume
Issue
ISSN
38
8
Pattern Recognition
Citations 
PageRank 
References 
6
0.48
15
Authors
3
Name
Order
Citations
PageRank
P. Viswanath114811.77
M. Narasimha Murty282486.07
Shalabh Bhatnagar380287.78