Name
Title | ||
|---|---|---|
Automated state feature learning for actor-critic reinforcement learning through NEAT. |
Abstract | ||
|---|---|---|
Actor-Critic (AC) algorithms are important approaches to solving sophisticated reinforcement learning problems. However, the learning performance of these algorithms rely heavily on good state features that are often designed manually. To address this issue, we propose to adopt an evolutionary approach based on NeuroEvolution of Augmenting Topology (NEAT) to automatically evolve neural networks that directly transform the raw environmental inputs into state features. Following this idea, we have successfully developed a new algorithm called NEAT+AC which combines Regular-gradient Actor-Critic (RAC) with NEAT. It can simultaneously learn suitable state features as well as good policies that are expected to significantly improve the reinforcement learning performance. Preliminary experiments on two benchmark problems confirm that our new algorithm can clearly outperform the baseline algorithm, i.e., NEAT. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1145/3067695.3076035 | GECCO (Companion) |
Keywords | Field | DocType |
NeuroEvolution, NEAT, Actor-Critic, Reinforcement Learning, Feature Extraction, Feature Learning | Computer science,Feature extraction,Artificial intelligence,Artificial neural network,Neuroevolution,Feature learning,Machine learning,Reinforcement learning,Learning classifier system | Conference |
Citations | PageRank | References |
0 | 0.34 | 5 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yiming Peng | 1 | 37 | 6.33 |
| Gang Chen | 2 | 48 | 16.42 |
| Scott Holdaway | 3 | 0 | 0.34 |
| Mei Yi | 4 | 941 | 53.85 |
| Mengjie Zhang | 5 | 3777 | 300.33 |