Title
Dense and Occlusion-Robust Multi-view Stereo for Unstructured Videos
Abstract
We present an efficient multi-view stereo system for dense reconstruction of homogeneous areas from videos with arbitrary camera trajectories. Most techniques have difficulties in recovering textureless areas, weak robustness for occlusion, and low efficiency on the massive redundant data provided by densely sampled frames. Our key idea is to use the measurable depth at object edges to recover the enclosed geometries assuming smooth surfaces, which is appropriate for most scenes. The depth values at edges are calculated by considering individual viewing rays to allow for sharp discontinuities. Then we employ perspective diffusion to create smooth surfaces between edges. The wrong interpolants between fore-and background edges are effectively invalidated by detecting large depth standard deviation which is approximated using the edge depth from other views. For reliable invalidation, the accuracy of edge depth is improved by advanced score evaluation and two-scale image sampling. Finally, we fill up holes and correct the wrongly sunken surfaces by propagating the closest valid depth across views. The pixel-level operations throughout support high parallelism, and our high-quality depth maps allow dense scene representation by point clouds.
Year
DOI
Venue
2016
10.1109/CRV.2016.42
2016 13th Conference on Computer and Robot Vision (CRV)
Keywords
Field
DocType
multi-view stereo,depth map,homogeneous surface,dense reconstruction,diffusion,occlusion,GPU,video
Computer vision,Stereo camera,Classification of discontinuities,Occlusion,Measure (mathematics),Computer science,Robustness (computer science),Artificial intelligence,Depth map,Point cloud,Standard deviation
Conference
ISBN
Citations 
PageRank 
978-1-5090-2492-6
0
0.34
References 
Authors
12
3
Name
Order
Citations
PageRank
Jian Wei161.42
Benjamin Resch262.10
Hendrik P. A. Lensch3147196.59