Title
Learning Navigation Behaviors End-To-End With Autorl
Abstract
We learn end-to-end point-to-point and pathfollowing navigation behaviors that avoid moving obstacles. These policies receive noisy lidar observations and output robot linear and angular velocities. The policies are trained in small, static environments with AutoRL, an evolutionary automation layer around reinforcement learning (RL) that searches for a deep RL reward and neural network architecture with large-scale hyper-parameter optimization. AutoRL first finds a reward that maximizes task completion and then finds a neural network architecture that maximizes the cumulative of the found reward. Empirical evaluations, both in simulation and on-robot, show that AutoRL policies do not suffer from the catastrophic forgetfulness that plagues many other deep reinforcement learning algorithms, generalize to new environments and moving obstacles, are robust to sensor, actuator, and localization noise, and can serve as robust building blocks for larger navigation tasks. Our path-following and point-to-point policies are, respectively, 23% and 26% more successful than comparison methods across new environments.
Year
DOI
Venue
2019
10.1109/LRA.2019.2899918
IEEE ROBOTICS AND AUTOMATION LETTERS
Keywords
Field
DocType
Autonomous agents, collision avoidance, deep learning in robotics and automation, motion and path planning
Task analysis,End-to-end principle,Neural network architecture,Control engineering,Automation,Artificial intelligence,Engineering,Robot,Task completion,Actuator,Reinforcement learning
Journal
Volume
Issue
ISSN
4
2
2377-3766
Citations 
PageRank 
References 
8
0.50
23
Authors
4
Name
Order
Citations
PageRank
Hao-Tien Lewis Chiang1164.71
Aleksandra Faust26814.83
Marek Fiser3293.66
Anthony Francis4163.70