Abstract | ||
---|---|---|
Function approximators have been extensively used in Reinforcement Learning (RL) to deal with large or continuous space problems. However, batch learning Neural Networks (NN), one of the most common approximators, has been rarely applied to RL. In this paper, possible reasons for this are laid out and a solution is proposed. Specifically, a Receding Horizon Cache (RHC) structure is designed to collect training data for NN by dynamically archiving state-action pairs and actively updating their Q-values, which makes batch learning NN much easier to implement. Together with Extreme Learning Machine (ELM), a new RL with function approximation algorithm termed as RHC and ELM based RL (RHC-ELM-RL) is proposed. A mountain car task was carried out to test RHC-ELM-RL and compare its performance with other algorithms. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1109/ICARCV.2012.6485384 | 2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV) |
Keywords | Field | DocType |
neural nets,approximation theory,learning artificial intelligence | Online machine learning,Function approximation,Extreme learning machine,Control theory,Computer science,Cache,Unsupervised learning,Artificial intelligence,Artificial neural network,Machine learning,Learning classifier system,Reinforcement learning | Conference |
ISSN | Citations | PageRank |
2474-2953 | 1 | 0.35 |
References | Authors | |
9 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Zhifei Shao | 1 | 62 | 4.97 |
J. Meng | 2 | 2793 | 174.51 |
Guang-Bin Huang | 3 | 11303 | 470.52 |