Title
Reinforcement learning for dynamic environment: a classification of dynamic environments and a detection method of environmental changes
Abstract
Engineers and researchers are paying more attention to reinforcement learning (RL) as a key technique for realizing computational intelligence such as adaptive and autonomous decentralized systems. In general, it is not easy to put RL into practical use. In prior research our approach mainly dealt with the problem of designing state and action spaces and we have proposed an adaptive co-construction method of state and action spaces. However, it is more difficult to design state and action spaces in dynamic environments than in static ones. Therefore, it is even more effective to use an adaptive co-construction method of state and action spaces in dynamic environments. In this paper, our approach mainly deals with a problem of adaptation in dynamic environments. First, we classify tasks of dynamic environments and propose a detection method of environmental changes to adapt to dynamic environments. Next, we conducted computational experiments using a so-called "path planning problem" with a slowly changing environment where the aging of the system is assumed. The performances of a conventional RL method and the proposed detection method were confirmed.
Year
DOI
Venue
2013
10.1007/s10015-013-0106-0
Artificial Life and Robotics
Keywords
DocType
Volume
computational intelligence,environmental change,conventional rl method,practical use,action space,detection method,path planning problem,adaptive co-construction method,proposed detection method,dynamic environment,computational experiment,Reinforcement learning,Dynamic environment,Slowly changing environment,Detection of environmental changes,Entropy
Journal
18
Issue
ISSN
Citations 
1-2
1433-5298
3
PageRank 
References 
Authors
0.54
0
3
Name
Order
Citations
PageRank
Masato Nagayoshi131.89
Hajime Murao2216.70
hajime tamaki330.54