Title
Generative Adversarial Networks for Depth Map Estimation from RGB Video
Abstract
Depth cues are essential to achieving high-level scene understanding, and in particular to determining geometric relations between objects. The ability to reason about depth information in scene analysis tasks can often result in improved decision-making capabilities. Unfortunately, depth-capable sensors are not as ubiquitous as traditional RGB cameras, which limits the availability of depth-related cues. In this work, we investigate data-driven approaches for depth estimation from images or videos captured with monocular cameras. We propose three different approaches and demonstrate their efficacy through extensive experimental validation. The proposed methods rely on processing of (i) a single 3-channel RGB image frame, (ii) a sequence of RGB frames, and (iii) a single RGB frame plus the optical flow field computed between the frame and a neighboring frame in the video stream, and map the respective inputs to an estimated depth map representation. In contrast to existing literature, the input-output mapping is not directly regressed; rather, it is learned through adversarial techniques that leverage conditional generative adversarial networks (cGANs).
Year
DOI
Venue
2018
10.1109/CVPRW.2018.00163
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Keywords
Field
DocType
RGB frames sequence,single 3-channel RGB image frame,geometric relation determination,conditional generative adversarial networks,high-level scene understanding,adversarial techniques,estimated depth map representation,video stream,neighboring frame,optical flow field,single RGB frame,monocular cameras,data-driven approaches,depth-related cues,traditional RGB cameras,improved decision-making capabilities,scene analysis tasks,depth information,depth cues,RGB video,depth map estimation
Computer vision,Pattern recognition,Computer science,RGB color model,Artificial intelligence,Depth perception,Generative grammar,Geometric relations,Depth map,Monocular,Optical flow,Adversarial system
Conference
ISSN
ISBN
Citations 
2160-7508
978-1-5386-6101-7
0
PageRank 
References 
Authors
0.34
5
4
Name
Order
Citations
PageRank
Kin Gwn Lore100.68
Kishore Reddy2754.26
Michael Giering3232.24
Edgar A. Bernal45810.32