Title
Reinforcement learning and instance-based learning approaches to modeling human decision making in a prognostic foraging task
Abstract
Procedural memory and episodic memory are known to be distinct and both underlie the performance of many tasks. Reinforcement learning (RL) and instance-based learning (IBL) represent common approaches to modeling procedural and episodic memory in that order. In this work, we present a neural model utilizing RL dynamics and an ACT-R model utilizing IBL productions to the task of modeling human decision making in a prognostic foraging task. The task performed was derived from a geospatial intelligence domain wherein agents must choose among information sources to more accurately predict the actions of an adversary. Results from both models are compared to human data and suggest that information gain is an important component in modeling decision-making behavior using either memory system; with respect to the episodic memory approach, the procedural memory approach has a small but significant advantage in fitting human data. Finally, we discuss the interactions of multi-memory systems in complex decision-making tasks.
Year
DOI
Venue
2015
10.1109/DEVLRN.2015.7346127
2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)
Keywords
Field
DocType
Computational Neuroscience,Decision Making,Instance-based learning (IBL),Prognostic foraging,Reinforcement learning (RL)
Geospatial analysis,Data modeling,Episodic memory,Instance-based learning,Procedural memory,Computer science,Geospatial intelligence,Artificial intelligence,Adversary,Machine learning,Reinforcement learning
Conference
Citations 
PageRank 
References 
0
0.34
9
Authors
5
Name
Order
Citations
PageRank
Suhas E. Chelian142.21
Jaehyon Paik2173.54
Peter Pirolli33661538.83
Christian Lebiere41152253.98
Rajan Bhattacharyya5215.60