Title
PCAF: Scalable, High Precision k-NN Search Using Principal Component Analysis Based Filtering
Abstract
Approximate k Nearest Neighbours (AkNN) search is widely used in domains such as computer vision and machine learning. However, AkNN search in high dimensional datasets does not work well on multicore platforms. It scales poorly due to its large memory footprint. Current parallel AkNN search using space subdivision for filtering helps reduce the memory footprint, but leads to loss of precision. We propose a new data filtering method -- PCAF -- for parallel AkNN search based on principal components analysis. PCAF improves on previous methods by demonstrating sustained, high scalability for a wide range of high dimensional datasets on both Intel and AMD multicore platforms. Moreover, PCAF maintains high precision in terms of the AkNN search results.
Year
DOI
Venue
2016
10.1109/ICPP.2016.79
2016 45th International Conference on Parallel Processing (ICPP)
Keywords
Field
DocType
PCAF,approximate k nearest neighbour search,parallel AkNN search,high-dimensional datasets,memory footprint,data filtering method,principal component analysis,Intel multicore platforms,AMD multicore platforms
Algorithm design,Computer science,Parallel computing,Filter (signal processing),Subdivision,Memory footprint,Multi-core processor,Principal component analysis,Scalability,PCAF
Conference
ISSN
ISBN
Citations 
0190-3918
978-1-5090-2824-5
0
PageRank 
References 
Authors
0.34
30
5
Name
Order
Citations
PageRank
huan feng1454.43
David M. Eyers247745.90
Steven Mills34117.74
Yongwei Wu466965.71
Zhiyi Huang59119.14