Title
The PatchMatch randomized matching algorithm for image manipulation
Abstract
This paper presents a new randomized algorithm for quickly finding approximate nearest neighbor matches between image patches. Our algorithm offers substantial performance improvements over the previous state of the art (20--100×), enabling its use in new interactive image editing tools, computer vision, and video applications. Previously, the cost of computing such matches for an entire image had eluded efforts to provide interactive performance. The key insight driving our algorithm is that the elements of our search domain---patches of image pixels---are correlated, and thus the search strategy takes advantage of these statistics. Our algorithm uses two principles: first, that good patch matches can be found via random sampling, and second, that natural coherence in the imagery allows us to propagate such matches quickly to surrounding areas. Our simple algorithm allows finding a single nearest neighbor match across translations only, whereas our general algorithm additionally allows matching of k-nearest neighbors, across all rotations and scales, and matching arbitrary descriptors. This one simple algorithm forms the basis for a variety of applications including image retargeting, completion, reshuffling, object detection, digital forgery detection, and video summarization.
Year
DOI
Venue
2011
10.1145/2018396.2018421
Commun. ACM
Keywords
Field
DocType
image manipulation,new randomized algorithm,new interactive image editing,entire image,digital forgery detection,general algorithm,image patch,image retargeting,image pixel,approximate nearest neighbor,simple algorithm,k nearest neighbor,generic algorithm,nearest neighbor,random sampling,randomized algorithm
Automatic summarization,Randomized algorithm,Object detection,Pattern recognition,Computer science,Best bin first,Seam carving,Image editing,Theoretical computer science,Artificial intelligence,Nearest neighbor search,Blossom algorithm
Journal
Volume
Issue
ISSN
54
11
0001-0782
Citations 
PageRank 
References 
14
0.60
19
Authors
4
Name
Order
Citations
PageRank
Connelly Barnes1172959.07
Dan B. Goldman2232185.23
Eli Shechtman34340177.94
Adam Finkelstein44041299.42