Title
Receding Horizon Cache And Extreme Learning Machine Based Reinforcement Learning
Abstract
Function approximators have been extensively used in Reinforcement Learning (RL) to deal with large or continuous space problems. However, batch learning Neural Networks (NN), one of the most common approximators, has been rarely applied to RL. In this paper, possible reasons for this are laid out and a solution is proposed. Specifically, a Receding Horizon Cache (RHC) structure is designed to collect training data for NN by dynamically archiving state-action pairs and actively updating their Q-values, which makes batch learning NN much easier to implement. Together with Extreme Learning Machine (ELM), a new RL with function approximation algorithm termed as RHC and ELM based RL (RHC-ELM-RL) is proposed. A mountain car task was carried out to test RHC-ELM-RL and compare its performance with other algorithms.
Year
DOI
Venue
2012
10.1109/ICARCV.2012.6485384
2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV)
Keywords
Field
DocType
neural nets,approximation theory,learning artificial intelligence
Online machine learning,Function approximation,Extreme learning machine,Control theory,Computer science,Cache,Unsupervised learning,Artificial intelligence,Artificial neural network,Machine learning,Learning classifier system,Reinforcement learning
Conference
ISSN
Citations 
PageRank 
2474-2953
1
0.35
References 
Authors
9
3
Name
Order
Citations
PageRank
Zhifei Shao1624.97
J. Meng22793174.51
Guang-Bin Huang311303470.52