Title
Handling stochastic reward delays in machine reinforcement learning
Abstract
The main contribution of this work is a novel learning algorithm for machine reinforcement learning when Poissonian stochastic time delays are present in the reinforcement signal. The novel approach can deal with rewards which may be received out of order in time or overlap with one another. A PID controller is simulated with and without a stochastic time delay to demonstrate the difficulties of the problem. Experimental results with mobile robots demonstrate that the proposed method improves the performance over that of traditional Q-learning for a learning agent in an environment with Poissonian-type stochastically delayed rewards.
Year
DOI
Venue
2015
10.1109/CCECE.2015.7129295
2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE)
Keywords
Field
DocType
Reinforcement learning,Markov Decision Process,stochastic time delay,reward,cost,jitter
Online machine learning,PID controller,Computer science,Q-learning,Stochastic process,Artificial intelligence,Reinforcement,Out-of-order execution,Mobile robot,Reinforcement learning
Conference
ISSN
ISBN
Citations 
0840-7789
978-1-4799-5827-6
0
PageRank 
References 
Authors
0.34
9
3
Name
Order
Citations
PageRank
Jeffrey S. Campbell120.69
Sidney Nascimento Givigi26412.40
Howard M. Schwartz313520.29