Title
Multi-view image and ToF sensor fusion for dense 3D reconstruction
Abstract
Multi-view stereo methods frequently fail to properly reconstruct 3D scene geometry if visible texture is sparse or the scene exhibits difficult self-occlusions. Time-of-Flight (ToF) depth sensors can provide 3D information regardless of texture but with only limited resolution and accuracy. To find an optimal reconstruction, we propose an integrated multi-view sensor fusion approach that combines information from multiple color cameras and multiple ToF depth sensors. First, multi-view ToF sensor measurements are combined to obtain a coarse but complete model. Then, the initial model is refined by means of a probabilistic multi-view fusion framework, optimizing over an energy function that aggregates ToF depth sensor information with multi-view stereo and silhouette constraints. We obtain high quality dense and detailed 3D models of scenes challenging for stereo alone, while simultaneously reducing complex noise of ToF sensors.
Year
DOI
Venue
2009
10.1109/ICCVW.2009.5457430
Computer Vision Workshops
Keywords
Field
DocType
energy function,silhouette constraints,3d information,self-occlusions,image fusion,multiview stereo methods,3d scene geometry,multiple tof depth sensors,tof sensor fusion,multiview image,multiple color cameras,image reconstruction,optimal reconstruction,probabilistic multiview fusion framework,integrated multiview sensor fusion,dense 3d reconstruction,stereo image processing,time-of-flight depth sensors,image colour analysis,probability,3d reconstruction,stereo vision,noise,sensor fusion,surface reconstruction
Iterative reconstruction,Computer vision,Surface reconstruction,Image fusion,Pattern recognition,Silhouette,Computer science,Stereopsis,Sensor fusion,Artificial intelligence,Probabilistic logic,3D reconstruction
Conference
Volume
Issue
ISBN
2009
1
978-1-4244-4441-0
Citations 
PageRank 
References 
60
3.04
13
Authors
6
Name
Order
Citations
PageRank
Young-Min Kim144246.66
Christian Theobalt23211159.16
James Diebel3160579.08
Jana Kosecká41523129.85
Branislav Miscusik5603.04
Sebastian Thrun6203472302.56