Title
Improving Local Motion Planning with a Reinforcement Learning Approach
Abstract
This paper introduces a new Reinforcement Learning (RL) based local motion planning (RL-LMP) approach for mobile robots. This method enables virtual or real mobile platforms, to follow a path and navigate from location A to B. The method consists of two stages: a training stage and an online stage. The training stage consists in the robot iteratively learning to follow previously defined paths in a simulation environment. New RL state representations are proposed as well as a strategy to deal with the delayed reward problem and an approach to guide the exploration-exploitation of the RL model considering prior knowledge. Through training in a virtual environment and assimilation of human driving behaviors (using a gamepad), an RL model is obtained and used in the online stage, enabling a mobile platform, in a simulation or real environment, to move along a path avoiding obstacles. A set of tests and experiments were performed in different scenarios in virtual and real environments in order to assess the performance of the local motion planning approach. Validation of the RL-LMP approach, in a real environment, was carried out in the ISR-InterBot platform with the algorithm developed in ROS. The obtained results show that the RL-LMP approach provides a valid solution to the local motion planning problem (small lateral error while following paths) and suggests promising perspectives for improvement in the future.
Year
DOI
Venue
2020
10.1109/ICARSC49921.2020.9096095
2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC)
Keywords
DocType
ISSN
reinforcement learning approach,local motion planning approach,mobile robots,mobile platform,training stage,defined paths,RL model,virtual environment,path avoiding obstacles,virtual environments,RL-LMP approach,ISR-InterBot platform,local motion planning problem,RL state representations,ROS
Conference
2573-9360
ISBN
Citations 
PageRank 
978-1-7281-7079-4
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Luis Garrote1293.73
Diogo Temporão200.34
Samuel Temporão300.34
Ricardo Pereira431.50
Tiago Barros534.54
Urbano Nunes686772.37