Title
Reinforcement learning with particles for instant optimality
Abstract
In this paper, we propose a new Actor-Critic method in the agent environment and action space based on the normal Actor-Critic method and PSO. In the algorithm, particles are expressed as cluster center of some states or actions, and explore through the space in order to get an appropriate divided space. The purposes of this study are learning efficiency improvement and heuristic space segmentation. In our method, particles move in the space during the agent's learning process. Appropriate segmentation can minimize the learning time and enables us to recognize the evolutionary process. Thus, this method is also designed for humanlike decisions in the learning process. The simulation results indicate that our method shows some clusters in the action and state space. Space segmentation, such as group formation, language systems and culture, will be revealed by multi-agent social simulation with our method.
Year
Venue
Keywords
2012
Joint International Conference on Soft Computing and Intelligent Systems SCIS and International Symposium on Advanced Intelligent Systems ISIS
Actor-Critic,PSO,Particles,Segmentalized space,Reinforcement Learning
Field
DocType
ISSN
Robot learning,Cluster (physics),Heuristic,Segmentation,Computer science,Social simulation,Artificial intelligence,State space,Machine learning,Learning classifier system,Reinforcement learning
Conference
2377-6870
Citations 
PageRank 
References 
0
0.34
1
Authors
4
Name
Order
Citations
PageRank
tsuyoshi beppu100.34
Akira Notsu214642.93
Katsuhiro Honda328963.11
Hidetomo Ichihashi437072.85