Title
Fast Nearest Neighbor Search Through Sparse Random Projections And Voting
Abstract
Efficient index structures for fast approximate nearest neighbor queries are required in many applications such as recommendation systems. In high-dimensional spaces, many conventional methods suffer from excessive usage of memory and slow response times. We propose a method where multiple random projection trees are combined by a novel voting scheme. The key idea is to exploit the redundancy in a large number of candidate sets obtained by independently generated random projections in order to reduce the number of expensive exact distance evaluations. The method is straightforward to implement using sparse projections which leads to a reduced memory footprint and fast index construction. Furthermore, it enables grouping of the required computations into big matrix multiplications, which leads to additional savings due to cache effects and low-level parallelization. We demonstrate by extensive experiments on a wide variety of data sets that the method is faster than existing partitioning tree or hashing based approaches, making it the fastest available technique on high accuracy levels.
Year
DOI
Venue
2016
10.1109/bigdata.2016.7840682
2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA)
Keywords
DocType
Citations 
Nearest Neighbor Search, Random Projections, High Dimensionality, Approximation Algorithms
Conference
4
PageRank 
References 
Authors
0.40
16
8
Name
Order
Citations
PageRank
Ville Hyvönen160.77
Teemu Pitkanen2142.04
Sotiris Tasoulis340.40
Elias Jääsaari460.77
Risto Tuomainen540.40
Liang Wang61567158.46
jukka corander730232.66
Teemu Roos843661.32