Title
Scalability and Total Recall with Fast CoveringLSH.
Abstract
Locality-sensitive hashing (LSH) has emerged as the dominant algorithmic technique for similarity search with strong performance guarantees in high-dimensional spaces. A drawback of traditional LSH schemes is that they may have \emph{false negatives}, i.e., the recall is less than 100\%. This limits the applicability of LSH in settings requiring precise performance guarantees. Building on the recent theoretical ``CoveringLSH'' construction that eliminates false negatives, we propose a fast and practical covering LSH scheme for Hamming space called \emph{Fast CoveringLSH (fcLSH)}. Inheriting the design benefits of CoveringLSH our method avoids false negatives and always reports all near neighbors. Compared to CoveringLSH we achieve an asymptotic improvement to the hash function computation time from $\BO{dL}$ to $\BO{d + L\log{L}}$, where $d$ is the dimensionality of data and $L$ is the number of hash tables. Our experiments on synthetic and real-world data sets demonstrate that \emph{fcLSH} is comparable (and often superior) to traditional hashing-based approaches for search radius up to 20 in high-dimensional Hamming space.
Year
DOI
Venue
2016
10.1145/2983323.2983742
ACM International Conference on Information and Knowledge Management
Keywords
DocType
Volume
Similarity Search,LSH,False Negatives
Conference
abs/1602.02620
Citations 
PageRank 
References 
5
0.40
30
Authors
2
Name
Order
Citations
PageRank
Ninh Pham11697.68
Rasmus Pagh2134486.08