Title
An Improved Reinforcement Learning System Using Affective Factors
Abstract
As a powerful and intelligent machine learning method, reinforcement learning (RL) has been widely used in many fields such as game theory, adaptive control, multi-agent system, nonlinear forecasting, and so on. The main contribution of this technique is its exploration and exploitation approaches to find the optimal solution or semi-optimal solution of goal-directed problems. However, when RL is applied to multi-agent systems (MASs), problems such as "curse of dimension", "perceptual aliasing problem", and uncertainty of the environment constitute high hurdles to RL. Meanwhile, although RL is inspired by behavioral psychology and reward/punishment from the environment is used, higher mental factors such as affects, emotions, and motivations are rarely adopted in the learning procedure of RL. In this paper, to challenge agents learning in MASs, we propose a computational motivation function, which adopts two principle affective factors "Arousal" and "Pleasure" of Russell's circumplex model of affects, to improve the learning performance of a conventional RL algorithm named Q-learning (QL). Compared with the conventional QL, computer simulations of pursuit problems with static and dynamic preys were carried out, and the results showed that the proposed method results in agents having a faster and more stable learning performance.
Year
DOI
Venue
2013
10.3390/robotics2030149
ROBOTICS
Keywords
Field
DocType
multi-agent system (MAS), computational motivation function, circumplex model of affect, pursuit problem, reinforcement learning (RL)
Nonlinear system,Aliasing,Pleasure,Artificial intelligence,Game theory,Engineering,Adaptive control,Affect (psychology),Perception,Machine learning,Reinforcement learning
Journal
Volume
Issue
ISSN
2
3
2218-6581
Citations 
PageRank 
References 
3
0.50
18
Authors
5
Name
Order
Citations
PageRank
Takashi Kuremoto119627.73
Tetsuya Tsurusaki240.86
Kunikazu Kobayashi317321.96
Shingo Mabu449377.00
Masanao Obayashi519826.10