Paper Info
Title
A saliency-based reinforcement learning approach for a UAV to avoid flying obstacles.
Abstract
Obstacle avoidance is a necessary behavior to guarantee the safety of an unmanned aerial vehicle (UAV). However, it is a challenge for the UAV to detect and avoid high-speed flying obstacles such as other UAVs or birds. In this paper, we propose a generic framework that integrates an autonomous obstacle detection module and a reinforcement learning (RL) module to develop reactive obstacle avoidance behavior for a UAV. In the obstacle detection module, we design a saliency detection algorithm using deep convolution neural networks (CNNs) to extract monocular visual cues. The algorithm imitates human’s visual detection system, and it can accurately estimate the location of obstacles in the field of view (FOV). The RL module uses an actor–critic structure that chooses the RBF neural network to approximate the value function and control policy in continuous state and action spaces. We have tested the effectiveness of the proposed learning framework in a semi-physical experiment. The results show that the proposed saliency detection algorithm performs better than state-of-the-art, and the RL algorithm can learn the avoidance behavior from the manual experiences.
Year
DOI
Venue
2018
10.1016/j.robot.2017.10.009
Robotics and Autonomous Systems
Keywords
Field
DocType
UAV,Flying obstacle avoidance,Convolution neural networks based saliency detection,Reinforcement learning
Sensory cue,Obstacle avoidance,Obstacle,Computer vision,Simulation,Detect and avoid,Computer science,Salience (neuroscience),Artificial intelligence,Monocular,Artificial neural network,Reinforcement learning
Journal
Volume
ISSN
Citations 
100
0921-8890
1
PageRank 
References 
Authors
0.37
6
5
Name
Order
Citations
PageRank
Zhaowei Ma140.83
chang wang23312.55
Yifeng Niu3207.53
Xiangke Wang410716.49
Lin-Cheng Shen5435.74