Title
Sparsity-Constrained fMRI Decoding of Visual Saliency in Naturalistic Video Streams
Abstract
Naturalistic stimuli such as video watching have been increasingly used in functional magnetic resonance imaging (fMRI)-based brain encoding and decoding studies since they can provide real and dynamic information that the human brain has to process in everyday life. In this paper, we propose a sparsityconstrained decoding model to explore whether bottom-up visual saliency in continuous video streams can be effectively decoded by brain activity recorded by fMRI, and to examine whether sparsity constraints can improve visual saliency decoding. Specifically, we use a biologically-plausible computational model to quantify the visual saliency in video streams, and adopt a sparse representation algorithm to learn the atomic fMRI signal dictionaries that are representative of the patterns of whole-brain fMRI signals. Sparse representation also links the learned atomic dictionary with the quantified video saliency. Experimental results show that the temporal visual saliency in video stream can be well decoded and the sparse constraints can improve the performance of fMRI decoding models.
Year
DOI
Venue
2015
10.1109/TAMD.2015.2409835
IEEE Trans. Autonomous Mental Development
Keywords
Field
DocType
Functional magnetic resonance imaging (fMRI) decoding, naturalistic stimuli, sparsity constraints, visual saliency
Functional magnetic resonance imaging,Salience (neuroscience),Computer science,Sparse approximation,Brain activity and meditation,Artificial intelligence,Decoding methods,Machine learning,Visual saliency,Encoding (memory)
Journal
Volume
Issue
ISSN
PP
99
1943-0604
Citations 
PageRank 
References 
5
0.41
16
Authors
7
Name
Order
Citations
PageRank
Xintao Hu111813.53
Cheng Lv250.41
Gong Cheng3102040.17
Jinglei Lv420526.70
Lei Guo51661142.63
Junwei Han63501194.57
Tianming Liu71033112.95