Title
Research on Intelligent Merging Decision-making of Unmanned Vehicles Based on Reinforcement Learning
Abstract
The decision-making model of merging behavior is one of the key technologies of unmanned vehicles. In order to solve the problem of unmanned vehicles' merging decision making, this paper presents a merging strategy based on Least squares Policy Iteration (LSPI) algorithm, and selects the basis function which includes reciprocal of TTC, relative distance and relative speed to represent state space and discretizes action space. This study synthetically takes consideration o safety, the success of the task, the merging efficiency and comfort in setting reward function, compares the Q-learning with LSPI algorithm, and verifies its adaptability by using NGSIM data. The algorithm can ultimately achieve a success rate of 86%. This research can provide theoretic support and technical basis for the merging decision-making of unmanned vehicles.
Year
DOI
Venue
2018
10.1109/IVS.2018.8500706
2018 IEEE Intelligent Vehicles Symposium (IV)
Keywords
Field
DocType
intelligent merging decision-making,unmanned vehicles,reinforcement learning,basis function,LSPI algorithm,Least squares Policy Iteration algorithm
Adaptability,Least squares,Reciprocal,Data modeling,Approximation algorithm,Computer science,Basis function,Artificial intelligence,State space,Reinforcement learning
Conference
ISSN
ISBN
Citations 
1931-0587
978-1-5386-4453-9
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Xue-mei Chen121.06
qiang zhang21324.24
Zhen-hua Zhang300.68
Ge-meng Liu400.34
gong59612.48
Ching-Yao Chan67923.48