Title
Large-scale 3D Semantic Mapping Using Stereo Vision
Abstract
In recent years, there have been a lot of interests in incorporating semantics into simultaneous localization and mapping (SLAM) systems. This paper presents an approach to generate an outdoor large-scale 3D dense semantic map based on binocular stereo vision. The inputs to system are stereo color images from a moving vehicle. First, dense 3D space around the vehicle is constructed, and the motion of camera is estimated by visual odometry. Meanwhile, semantic segmentation is performed through the deep learning technology online, and the semantic labels are also used to verify the feature matching in visual odometry. These three processes calculate the motion, depth and semantic label of every pixel in the input views. Then, a voxel conditional random field (CRF) inference is introduced to fuse semantic labels to voxel. After that, we present a method to remove the moving objects by incorporating the semantic labels, which improves the motion segmentation accuracy. The last is to generate the dense 3D semantic map of an urban environment from arbitrary long image sequence. We evaluate our approach on KITTI vision benchmark, and the results show that the proposed method is effective.
Year
DOI
Venue
2018
10.1007/s11633-018-1118-y
International Journal of Automation and Computing
Keywords
DocType
Volume
Semantic map,stereo vision,motion segmentation,visual odometry,simultaneous localization and mapping (SLAM).
Journal
15
Issue
ISSN
Citations 
2
1751-8520
0
PageRank 
References 
Authors
0.34
23
6
Name
Order
Citations
PageRank
Yi Yang173.97
Fan Qiu200.34
Hao Li326185.92
Lu Zhang400.34
meiling wang584.54
Meiling Wang63812.05