Title
Unsupervised Collaborative Learning Of Keyframe Detection And Visual Odometry Towards Monocular Deep Slam
Abstract
In this paper we tackle the joint learning problem of keyframe detection and visual odometry towards monocular visual SLAM systems. As an important task in visual SLAM, keyframe selection helps efficient camera relocalization and effective augmentation of visual odometry. To benefit from it, we first present a deep network design for the keyframe selection, which is able to reliably detect keyframes and localize new frames, then an end-to-end unsupervised deep framework further proposed for simultaneously learning the keyframe selection and the visual odometry tasks. As far as we know, it is the first work to jointly optimize these two complementary tasks in a single deep framework. To make the two tasks facilitate each other in the learning, a collaborative optimization loss based on both geometric and visual metrics is proposed. Extensive experiments on publicly available datasets (i.e. KITTI raw dataset and its odometry split [12]) clearly demonstrate the effectiveness of the proposed approach, and new state-ofthe-art results are established on the unsupervised depth and pose estimation from monocular video.
Year
DOI
Venue
2019
10.1109/ICCV.2019.00440
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019)
DocType
Volume
Issue
Conference
2019
1
ISSN
Citations 
PageRank 
1550-5499
0
0.34
References 
Authors
25
4
Name
Order
Citations
PageRank
Lu Sheng112713.50
Dan Xu234216.39
Wanli Ouyang32371105.17
Xiaogang Wang49647386.70