Paper Info
Title
A perceptually based spatio-temporal computational framework for visual saliency estimation
Abstract
The purpose of this paper is to demonstrate a perceptually based spatio-temporal computational framework for visual saliency estimation. We have developed a new spatio-temporal visual frontend based on biologically inspired 3D Gabor filters, which is applied on both the luminance and the color streams and produces spatio-temporal energy maps. These volumes are fused for computing a single saliency map and can detect spatio-temporal phenomena that static saliency models cannot find. We also provide a new movie database with eye-tracking annotation. We have evaluated our spatio-temporal saliency model on the widely used CRCNS-ORIG database as well as our new database using different fusion schemes and feature sets. The proposed spatio-temporal computational framework incorporates many ideas based on psychological evidences and yields significant improvements on spatio-temporal saliency estimation. HighlightsSpatio-temporal computational framework based on psychological evidences.Spatio-temporal and static energies by using the same multiscale 3D Gabor filterbank.Motion information in different scales for both luminance and color stream modalities.A new movie database with eye-tracking annotation.Significant improvements on spatio-temporal saliency estimation.
Year
DOI
Venue
2015
10.1016/j.image.2015.08.004
Signal Processing: Image Communication
Keywords
Field
DocType
Spatio-temporal visual frontend,3D Gabor filters,LAB color space,Visual saliency,Eye-tracking database
Computer vision,Saliency map,Pattern recognition,Computer science,Salience (neuroscience),Artificial intelligence,Luminance,Visual saliency,Lab color space
Journal
Volume
Issue
ISSN
38
C
0923-5965
Citations 
PageRank 
References 
3
0.37
50
Authors
2
Name
Order
Citations
PageRank
Petros Koutras1166.35
Petros Maragos23733591.97