Title
Integrated accounts of behavioral and neuroimaging data using flexible recurrent neural network models.
Abstract
Neuroscience studies of human decision-making abilities commonly involve subjects completing a decision-making task while BOLD signals are recorded using fMRI. Hypotheses are tested about which brain regions mediate the effect of past experience, such as rewards, on future actions. One standard approach to this is model-based fMRI data analysis, in which a model is fitted to the behavioral data, i.e., a subject's choices, and then the neural data are parsed to find brain regions whose BOLD signals are related to the model's internal signals. However, the internal mechanics of such purely behavioral models are not constrained by the neural data, and therefore might miss or mischaracterize aspects of the brain. To address this limitation, we introduce a new method using recurrent neural network models that are flexible enough to be jointly fitted to the behavioral and neural data. We trained a model so that its internal states were suitably related to neural activity during the task, while at the same time its output predicted the next action a subject would execute. We then used the fitted model to create a novel visualization of the relationship between the activity in brain regions at different times following a reward and the choices the subject subsequently made. Finally, we validated our method using a previously published dataset. We found that the model was able to recover the underlying neural substrates that were discovered by explicit model engineering in the previous work, and also derived new results regarding the temporal pattern of brain activity.
Year
DOI
Venue
2018
10.1101/328849
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018)
Keywords
Field
DocType
the brain,recurrent neural network,neuroscience studies,brain regions,temporal pattern,brain activity,neural substrates,different times
Computer science,Visualization,Recurrent neural network,Neural activity,Brain activity and meditation,Behavioral data,Artificial intelligence,Parsing,Neuroimaging,Model engineering,Machine learning
Conference
Volume
ISSN
Citations 
31
1049-5258
1
PageRank 
References 
Authors
0.40
0
5
Name
Order
Citations
PageRank
Amir Dezfouli1263.09
Richard Morris210.73
Fabio Ramos373373.91
Peter Dayan41201184.29
Bernard W Balleine5141.50