Title
Towards Integrating Real-Time Crowd Advice with Reinforcement Learning
Abstract
Reinforcement learning is a powerful machine learning paradigm that allows agents to autonomously learn to maximize a scalar reward. However, it often suffers from poor initial performance and long learning times. This paper discusses how collecting on-line human feedback, both in real time and post hoc, can potentially improve the performance of such learning systems. We use the game Pac-Man to simulate a navigation setting and show that workers are able to accurately identify both when a sub-optimal action is executed, and what action should have been performed instead. Demonstrating that the crowd is capable of generating this input, and discussing the types of errors that occur, serves as a critical first step in designing systems that use this real-time feedback to improve systems' learning performance on-the-fly.
Year
DOI
Venue
2015
10.1145/2732158.2732180
IUI Companion
Keywords
Field
DocType
neurofeedback
Robot learning,Active learning (machine learning),Computer science,Human–computer interaction,Artificial intelligence,Error-driven learning,Portable EEG,Neurofeedback,Reinforcement learning
Conference
Citations 
PageRank 
References 
4
0.49
7
Authors
4
Name
Order
Citations
PageRank
Gabriel V. de la Cruz1122.41
Bei Peng2436.96
Walter Lasecki383367.19
Matthew E. Taylor4135294.88