Paper Info
Title
Mapless Motion Planning System for an Autonomous Underwater Vehicle Using Policy Gradient-based Deep Reinforcement Learning
Abstract
This research is concerned with the motion planning problem encountered by underactuated autonomous underwater vehicles (AUVs) in a mapless environment. A motion planning system based on deep reinforcement learning is proposed. This system, which directly optimizes the policy, is an end-to-end motion planning system. It uses sensor information as input and continuous surge force and yaw moment as output. It can reach multiple target points in a sequence while simultaneously avoiding obstacles. In addition, this study proposes a reward curriculum training method to solve the problem in which the number of samples required for random exploration increases exponentially with the number of steps needed to obtain a reward. At the same time, the negative impact of intermediate rewards can be avoided. The proposed system demonstrates good planning ability for a mapless environment and excellent ability to migrate to other unknown environments. The system also has resistance to current disturbances. The simulation results show that the proposed mapless motion planning system can guide an underactuated AUV in navigating to its desired targets without colliding with any obstacles.
Year
DOI
Venue
2019
10.1007/s10846-019-01004-2
Journal of Intelligent & Robotic Systems
Keywords
Field
DocType
Autonomous underwater vehicle (AUV), Motion planning, Deep reinforcement learning, Curriculum learning
Motion planning,Control theory,Yaw moment,Control engineering,Engineering,Underwater vehicle,Underactuation,Reinforcement learning,Underwater
Journal
Volume
Issue
ISSN
96
3
0921-0296
Citations 
PageRank 
References 
1
0.36
20
Authors
4
Name
Order
Citations
PageRank
Yu-Shan Sun1115.93
Junhan Cheng210.36
Guocheng Zhang321.74
Hao Xu411.04