Title
Single View Stereo Matching
Abstract
Previous monocular depth estimation methods take a single view and directly regress the expected results. Though recent advances are made by applying geometrically inspired loss functions during training, the inference procedure does not explicitly impose any geometrical constraint. Therefore these models purely rely on the quality of data and the effectiveness of learning to generalize. This either leads to suboptimal results or the demand of huge amount of expensive ground truth labelled data to generate reasonable results. In this paper, we show for the first time that the monocular depth estimation problem can be reformulated as two sub-problems, a view synthesis procedure followed by stereo matching, with two intriguing properties, namely i) geometrical constraints can be explicitly imposed during inference; ii) demand on labelled depth data can be greatly alleviated. We show that the whole pipeline can still be trained in an end-to-end fashion and this new formulation plays a critical role in advancing the performance. The resulting model outperforms all the previous monocular depth estimation methods as well as the stereo block matching method in the challenging KITTI dataset by only using a small number of real training data. The model also generalizes well to other monocular depth estimation benchmarks. We also discuss the implications and the advantages of solving monocular depth estimation using stereo methods.
Year
DOI
Venue
2018
10.1109/CVPR.2018.00024
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Keywords
DocType
Volume
geometrically inspired loss functions,inference procedure,geometrical constraint,view synthesis procedure,stereo block matching method,training data,single view stereo matching,monocular depth estimation methods,data quality,ground truth labelled data,KITTI dataset
Conference
abs/1803.02612
ISSN
ISBN
Citations 
1063-6919
978-1-5386-6421-6
15
PageRank 
References 
Authors
0.68
24
7
Name
Order
Citations
PageRank
Yue Luo1150.68
Jimmy S. J. Ren232423.85
Mude Lin3151.36
Jiahao Pang414912.42
Wenxiu Sun516020.79
Hongsheng Li6151685.29
Liang Lin73007151.07