Title
Reinforcement Learning in Video Games using Nearest Neighbor Interpolation and Metric Learning
Abstract
Reinforcement learning (RL) has had mixed success when applied to games. Large state spaces and the curse of dimensionality have limited the ability for RL techniques to learn to play complex games in a reasonable length of time. We discuss a modification of Q-learning to use nearest neighbor states to exploit previous experience in the early stages of learning. A weighting on the state features is learned using metric learning techniques, such that neighboring states represent similar game situations. Our method is tested on the arcade game Frogger, and it is shown that some of the effects of the curse of dimensionality can be mitigated.
Year
DOI
Venue
2016
10.1109/TCIAIG.2014.2369345
IEEE Trans. Comput. Intellig. and AI in Games
Keywords
DocType
Volume
reinforcement learning,games,metric learning,nearest neighbor
Journal
PP
Issue
ISSN
Citations 
99
1943-068X
8
PageRank 
References 
Authors
0.52
9
5
Name
Order
Citations
PageRank
Matthew Emigh1172.40
Evan G. Kriminger280.52
Austin J. Brockmeier3172.90
Jose C. Principe42295282.29
Panos M. Pardalos514119.60