Title
Sparse To Dense 3d Reconstruction From Rolling Shutter Images
Abstract
It is well known that the rolling shutter effect in images captured with a moving rolling shutter camera causes inaccuracies to 3D reconstructions. The problem is further aggravated with weak visual connectivity from wide baseline images captured with a fast moving camera. In this paper, we propose and implement a pipeline for sparse to dense 3D construction with wide baseline images captured from a fast moving rolling shutter camera. Specifically, we propose a cost function for Bundle Adjustment (BA) that models the rolling shutter effect, incorporates GPS/INS readings, and enforces pairwise smoothness between neighboring poses. We optimize over the 3D structures, camera poses and velocities. We also introduce a novel interpolation scheme for the rolling shutter plane sweep stereo algorithm that allows us to achieve a 7x speed up in the depth map computations for dense reconstruction without losing accuracy. We evaluate our proposed pipeline over a 2.6km image sequence captured with a rolling shutter camera mounted on a moving car.
Year
DOI
Venue
2016
10.1109/CVPR.2016.363
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)
Field
DocType
Volume
Rolling shutter,Computer vision,Computer graphics (images),Computer science,Bundle adjustment,Interpolation,Global Positioning System,Artificial intelligence,Depth map,Speedup,3D reconstruction,Computation
Conference
2016
Issue
ISSN
Citations 
1
1063-6919
2
PageRank 
References 
Authors
0.37
15
3
Name
Order
Citations
PageRank
Olivier Saurer1985.32
Marc Pollefeys27671475.90
Lee Gim Hee337231.21