Title
Visceral Machines: Reinforcement Learning with Intrinsic Rewards that Mimic the Human Nervous System.
Abstract
The human autonomic nervous system has evolved over millions of years and is essential for survival and responding to threats. As people learn to navigate the world, fight or flight responses provide intrinsic feedback about the potential consequence of action choices (e.g., becoming nervous when close to a cliff edge or driving fast around a bend.) We present a novel approach to reinforcement learning that leverages a task-independent intrinsic reward function that mimics human autonomic nervous system responses based on peripheral pulse measurements. Our hypothesis is that such reward functions can circumvent the challenges associated with sparse and skewed rewards in reinforcement learning settings and can help improve sample efficiency. We test this in a simulated driving environment and show that it can increase the speed of learning and reduce the number of collisions during the learning stage.
Year
Venue
Field
2018
arXiv: Artificial Intelligence
Fight-or-flight response,Autonomic nervous system,Computer science,Human–computer interaction,Nervous system,Artificial intelligence,Machine learning,Instrumental and intrinsic value,Reinforcement learning
DocType
Volume
Citations 
Journal
abs/1805.09975
0
PageRank 
References 
Authors
0.34
7
2
Name
Order
Citations
PageRank
Daniel J McDuff167261.67
Ashish Kapoor21833119.72