Paper Info
Title
Moving gradients: a path-based method for plausible image interpolation
Abstract
We describe a method for plausible interpolation of images, with a wide range of applications like temporal up-sampling for smooth playback of lower frame rate video, smooth view interpolation, and animation of still images. The method is based on the intuitive idea, that a given pixel in the interpolated frames traces out a path in the source images. Therefore, we simply move and copy pixel gradients from the input images along this path. A key innovation is to allow arbitrary (asymmetric) transition points, where the path moves from one image to the other. This flexible transition preserves the frequency content of the originals without ghosting or blurring, and maintains temporal coherence. Perhaps most importantly, our framework makes occlusion handling particularly simple. The transition points allow for matches away from the occluded regions, at any suitable point along the path. Indeed, occlusions do not need to be handled explicitly at all in our initial graph-cut optimization. Moreover, a simple comparison of computed path lengths after the optimization, allows us to robustly identify occluded regions, and compute the most plausible interpolation in those areas. Finally, we show that significant improvements are obtained by moving gradients and using Poisson reconstruction.
Year
DOI
Venue
2009
10.1145/1576246.1531348
ACM Trans. Graph.
Keywords
Field
DocType
image interpolation,graph cut,interpolation,transition point
Nearest-neighbor interpolation,Computer vision,Mathematical optimization,Computer science,Interpolation,Stairstep interpolation,Pixel,Artificial intelligence,Frame rate,Trilinear interpolation,Image scaling,Bilinear interpolation
Journal
Volume
Issue
ISSN
28
3
0730-0301
Citations 
PageRank 
References 
73
2.90
25
Authors
5
Name
Order
Citations
PageRank
Dhruv K. Mahajan137822.92
Fu-Chung Huang218112.31
Wojciech Matusik34771254.42
Ravi Ramamoorthi44481237.21
Peter N. Belhumeur5122421001.27