Title
Dual-view 3D object recognition and detection via Lidar point cloud and camera image
Abstract
When it comes to the accuracy of autonomous motion, it is necessary to consider object detection and recognition, especially for the robot application of the complex environment. This paper investigates novel dual-view 3D object detection networks combined with the Lidar point cloud and RGB image in engineering scenarios. The developed system is applied for autonomous vehicles that the detected objects are cars, cyclists, and pedestrians. Firstly, a feature extraction network based on the residual module is presented, and the specific features are from the RGB image. The point cloud is transformed into Bird’s Eye View (BEV), and the BEV feature extraction network is built based on sparse convolution. Besides, the feature maps are input into the region proposal network (RPN) to obtain the optimal proposal so that the object classification and the bounding box regression are obtained. Finally, to evaluate the flexibility of the developed framework, extensive data sets are generated through the CARLA simulator and verified on the KITTI data set and unmanned motion platform (BIT-NAZA robot), indicating that the proposed networks can achieve satisfactory performance in the real-world scenario.
Year
DOI
Venue
2022
10.1016/j.robot.2021.103999
Robotics and Autonomous Systems
Keywords
DocType
Volume
Object detection,Lidar point cloud,RGB image,Sensor fusion,Autonomous system
Journal
150
ISSN
Citations 
PageRank 
0921-8890
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Jing Li1116.08
Li Rui2215.56
Jiehao Li300.34
JunZheng Wang43316.27
Qingbin Wu500.34
X.L. Liu61111.83