Title
A probabilistic approach to nearest-neighbor classification: naive hubness bayesian kNN
Abstract
Most machine-learning tasks, including classification, involve dealing with high-dimensional data. It was recently shown that the phenomenon of hubness, inherent to high-dimensional data, can be exploited to improve methods based on nearest neighbors (NNs). Hubness refers to the emergence of points (hubs) that appear among the k NNs of many other points in the data, and constitute influential points for kNN classification. In this paper, we present a new probabilistic approach to kNN classification, naive hubness Bayesian k-nearest neighbor (NHBNN), which employs hubness for computing class likelihood estimates. Experiments show that NHBNN compares favorably to different variants of the kNN classifier, including probabilistic kNN (PNN) which is often used as an underlying probabilistic framework for NN classification, signifying that NHBNN is a promising alternative framework for developing probabilistic NN algorithms.
Year
DOI
Venue
2011
10.1145/2063576.2063919
CIKM
Keywords
Field
DocType
bayesian knn,high-dimensional data,probabilistic nn algorithm,nn classification,underlying probabilistic framework,k nns,knn classifier,naive hubness,probabilistic knn,new probabilistic approach,knn classification,machine learning,bayesian,high dimensional data,k nearest neighbor,nearest neighbor,classification,bayesian classification
k-nearest neighbors algorithm,Data mining,Pattern recognition,Computer science,Artificial intelligence,Probabilistic logic,Classifier (linguistics),Machine learning,Bayesian probability,Probabilistic framework
Conference
Citations 
PageRank 
References 
20
0.81
6
Authors
4
Name
Order
Citations
PageRank
Nenad Tomasev1987.60
Miloa Radovanović2200.81
Dunja Mladenic31484170.14
Mirjana Ivanović444929.24