Title
Automatic Skill Acquisition in Reinforcement Learning Agents Using Connection Bridge Centrality.
Abstract
Incorporating skills in reinforcement learning methods results in accelerate agents learning performance. The key problem of automatic skill discovery is to find subgoal states and create skills to reach them. Among the proposed algorithms, those based on graph centrality measures have achieved precise results. In this paper we propose a new graph centrality measure for identifying subgoal states that is crucial to develop useful skills. The main advantage of the proposed centrality measure is that this measure considers both local and global information of the agent states to score them that result in identifying real subgoal states. We will show through simulations for three benchmark tasks, namely, "four-room grid world", "taxi driver grid world" and "soccer simulation grid world" that a procedure based on the proposed centrality measure performs better than the procedure based on the other centrality measures.
Year
DOI
Venue
2010
10.1007/978-3-642-17604-3_6
Communications in Computer and Information Science
Keywords
Field
DocType
Reinforcement Learning,Hierarchical Reinforcement Learning,Option,Skill,Graph Centrality Measures,Connection Bridge Centrality
Graph centrality,Computer science,Global information,Centrality,Dreyfus model of skill acquisition,Artificial intelligence,Machine learning,Grid,Reinforcement learning
Conference
Volume
ISSN
Citations 
120
1865-0929
4
PageRank 
References 
Authors
0.39
19
3
Name
Order
Citations
PageRank
Parham Moradi143018.41
Mohammad Ebrahim Shiri215512.24
Negin Entezari350.74