Title
Depth from Combining Defocus and Correspondence Using Light-Field Cameras
Abstract
Light-field cameras have recently become available to the consumer market. An array of micro-lenses captures enough information that one can refocus images after acquisition, as well as shift one's viewpoint within the sub-apertures of the main lens, effectively obtaining multiple views. Thus, depth cues from both defocus and correspondence are available simultaneously in a single capture. Previously, defocus could be achieved only through multiple image exposures focused at different depths, while correspondence cues needed multiple exposures at different viewpoints or multiple cameras, moreover, both cues could not easily be obtained together. In this paper, we present a novel simple and principled algorithm that computes dense depth estimation by combining both defocus and correspondence depth cues. We analyze the x-u 2D epipolar image (EPI), where by convention we assume the spatial x coordinate is horizontal and the angular u coordinate is vertical (our final algorithm uses the full 4D EPI). We show that defocus depth cues are obtained by computing the horizontal (spatial) variance after vertical (angular) integration, and correspondence depth cues by computing the vertical (angular) variance. We then show how to combine the two cues into a high quality depth map, suitable for computer vision applications such as matting, full control of depth-of-field, and surface reconstruction.
Year
DOI
Venue
2013
10.1109/ICCV.2013.89
ICCV
Keywords
Field
DocType
multiple camera,defocus depth cue,high quality depth map,dense depth estimation,multiple exposure,different depth,multiple image exposure,combining defocus,correspondence cue,correspondence depth cue,depth cue,light-field cameras,computer vision
Surface reconstruction,Computer vision,Epipolar geometry,Pattern recognition,Computer science,Light field,X-Coordinate,Artificial intelligence,Depth perception,Depth map,Consumer market
Conference
Volume
Issue
ISSN
2013
1
1550-5499
Citations 
PageRank 
References 
116
3.74
26
Authors
4
Search Limit
100116
Name
Order
Citations
PageRank
Michael W. Tao122511.75
Sunil Hadap21163.74
Jitendra Malik3394453782.10
Ravi Ramamoorthi44481237.21