Title
Patch-based high dynamic range video
Abstract
Despite significant progress in high dynamic range (HDR) imaging over the years, it is still difficult to capture high-quality HDR video with a conventional, off-the-shelf camera. The most practical way to do this is to capture alternating exposures for every LDR frame and then use an alignment method based on optical flow to register the exposures together. However, this results in objectionable artifacts whenever there is complex motion and optical flow fails. To address this problem, we propose a new approach for HDR reconstruction from alternating exposure video sequences that combines the advantages of optical flow and recently introduced patch-based synthesis for HDR images. We use patch-based synthesis to enforce similarity between adjacent frames, increasing temporal continuity. To synthesize visually plausible solutions, we enforce constraints from motion estimation coupled with a search window map that guides the patch-based synthesis. This results in a novel reconstruction algorithm that can produce high-quality HDR videos with a standard camera. Furthermore, our method is able to synthesize plausible texture and motion in fast-moving regions, where either patch-based synthesis or optical flow alone would exhibit artifacts. We present results of our reconstructed HDR video sequences that are superior to those produced by current approaches.
Year
DOI
Venue
2013
10.1145/2508363.2508402
ACM Trans. Graph.
Keywords
Field
DocType
alignment method,motion estimation,complex motion,high-quality hdr video,hdr reconstruction,optical flow,reconstructed hdr video sequence,patch-based synthesis,patch-based high dynamic range,hdr image,exposure video sequence
Computer vision,Temporal continuity,Computer graphics (images),Computer science,High-dynamic-range video,Reconstruction algorithm,Artificial intelligence,Motion estimation,High dynamic range,Optical flow
Journal
Volume
Issue
ISSN
32
6
0730-0301
Citations 
PageRank 
References 
36
0.88
15
Authors
6
Name
Order
Citations
PageRank
N. K. Kalantari151120.87
Eli Shechtman24340177.94
Connelly Barnes3172959.07
Soheil Darabi441512.37
Dan B. Goldman5232185.23
Pradeep Sen688253.01