Title
Image melding: combining inconsistent images using patch-based synthesis
Abstract
Current methods for combining two different images produce visible artifacts when the sources have very different textures and structures. We present a new method for synthesizing a transition region between two source images, such that inconsistent color, texture, and structural properties all change gradually from one source to the other. We call this process image melding. Our method builds upon a patch-based optimization foundation with three key generalizations: First, we enrich the patch search space with additional geometric and photometric transformations. Second, we integrate image gradients into the patch representation and replace the usual color averaging with a screened Poisson equation solver. And third, we propose a new energy based on mixed L2/L0 norms for colors and gradients that produces a gradual transition between sources without sacrificing texture sharpness. Together, all three generalizations enable patch-based solutions to a broad class of image melding problems involving inconsistent sources: object cloning, stitching challenging panoramas, hole filling from multiple photos, and image harmonization. In several cases, our unified method outperforms previous state-of-the-art methods specifically designed for those applications.
Year
DOI
Venue
2012
10.1145/2185520.2185578
ACM Trans. Graph.
Keywords
Field
DocType
previous state-of-the-art method,image melding problem,image harmonization,image gradient,new method,source image,patch-based synthesis,inconsistent image,different image,current method,process image melding,unified method,morphing,image stitching
Computer vision,Morphing,Gradual transition,Image stitching,Screened Poisson equation,Computer graphics (images),Generalization,Computer science,Artificial intelligence,Solver
Journal
Volume
Issue
ISSN
31
4
0730-0301
Citations 
PageRank 
References 
153
3.53
31
Authors
5
Search Limit
100153
Name
Order
Citations
PageRank
Soheil Darabi141512.37
Eli Shechtman24340177.94
Connelly Barnes3172959.07
Dan B. Goldman4232185.23
Pradeep Sen588253.01