Title | ||
---|---|---|
A probabilistic approach to nearest-neighbor classification: naive hubness bayesian kNN |
Abstract | ||
---|---|---|
Most machine-learning tasks, including classification, involve dealing with high-dimensional data. It was recently shown that the phenomenon of hubness, inherent to high-dimensional data, can be exploited to improve methods based on nearest neighbors (NNs). Hubness refers to the emergence of points (hubs) that appear among the k NNs of many other points in the data, and constitute influential points for kNN classification. In this paper, we present a new probabilistic approach to kNN classification, naive hubness Bayesian k-nearest neighbor (NHBNN), which employs hubness for computing class likelihood estimates. Experiments show that NHBNN compares favorably to different variants of the kNN classifier, including probabilistic kNN (PNN) which is often used as an underlying probabilistic framework for NN classification, signifying that NHBNN is a promising alternative framework for developing probabilistic NN algorithms. |
Year | DOI | Venue |
---|---|---|
2011 | 10.1145/2063576.2063919 | CIKM |
Keywords | Field | DocType |
bayesian knn,high-dimensional data,probabilistic nn algorithm,nn classification,underlying probabilistic framework,k nns,knn classifier,naive hubness,probabilistic knn,new probabilistic approach,knn classification,machine learning,bayesian,high dimensional data,k nearest neighbor,nearest neighbor,classification,bayesian classification | k-nearest neighbors algorithm,Data mining,Pattern recognition,Computer science,Artificial intelligence,Probabilistic logic,Classifier (linguistics),Machine learning,Bayesian probability,Probabilistic framework | Conference |
Citations | PageRank | References |
20 | 0.81 | 6 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Nenad Tomasev | 1 | 98 | 7.60 |
Miloa Radovanović | 2 | 20 | 0.81 |
Dunja Mladenic | 3 | 1484 | 170.14 |
Mirjana Ivanović | 4 | 449 | 29.24 |