Title
Panoramic 3d Reconstruction Using Stereo Multi-Perspective Panorama
Abstract
In this paper, we present a novel approach to imaging a panoramic (360 degrees) environment and computing its dense depth map. Our approach adopts a multi-baseline stereo strategy using a set of multi-perspective panoramas where large baseline lengths are available. We design two image acquisition rigs for capturing such multi-perspective panoramas. The first one is composed of two parallel stereo cameras. By rotating the rig about a vertical axis, we generate four multi-perspective panoramas by resampling the regular perspective images captured by the stereo cameras. Then a depth map is estimated from the four multi-perspective panoramas and an original perspective image using a multi-baseline matching technique with different types of epipolar constraints. The second one is composed of a single camera and two mirrors. By rotating the rig, we acquire a spatio-temporal volume that is made up of the sequential images captured by the camera. Then we estimate a depth map by extracting trajectories from the spatio-temporal volume by using a multi-baseline stereo technique by considering occlusions. We can consider both rotating rigs as a single rotating camera with a very large field of view (FOV), that offers a large baseline length in depth estimation. In addition, compared with a previous approach using two multi-perspective panoramas from a single rotating camera, our approach can reduce matching errors due to image noise, repeated patterns, and occlusions by multi-baseline stereo techniques. Experimental results using both synthetic and real images show that our approach produces high quality panoramic 3D reconstruction.
Year
DOI
Venue
2010
10.1142/S0218001410008226
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE
Keywords
Field
DocType
Panoramic stereo, multi-perspective panorama, multi-baseline stereo, epipolar constraints
Computer vision,Stereo camera,Stereo cameras,Computer graphics (images),Epipolar geometry,Panorama,Artificial intelligence,Real image,Depth map,Mathematics,Computer stereo vision,3D reconstruction
Journal
Volume
Issue
ISSN
24
6
0218-0014
Citations 
PageRank 
References 
0
0.34
1
Authors
3
Name
Order
Citations
PageRank
Wei Jiang11208.52
shigeki sugimoto211511.82
Masatoshi Okutomi3869103.67