Title
Discovering salient objects from videos using spatiotemporal salient region detection
Abstract
Detecting salient objects from images and videos has many useful applications in computer vision. In this paper, a novel spatiotemporal salient region detection approach is proposed. The proposed approach computes spatiotemporal saliency by estimating spatial and temporal saliencies separately. The spatial saliency of an image is computed by estimating the color contrast cue and color distribution cue. The estimations of these cues exploit the patch level and region level image abstractions in a unified way. The aforementioned cues are fused to compute an initial spatial saliency map, which is further refined to emphasize saliencies of objects uniformly, and to suppress saliencies of background noises. The final spatial saliency map is computed by integrating the refined saliency map with center prior map. The temporal saliency is computed based on local and global temporal saliencies estimations using patch level optical flow abstractions. Both local and global temporal saliencies are fused to compute the temporal saliency. Finally, spatial and temporal saliencies are integrated to generate a spatiotemporal saliency map. The proposed temporal and spatiotemporal salient region detection approaches are extensively experimented on challenging salient object detection video datasets. The experimental results show that the proposed approaches achieve an improved performance than several state-of-the-art saliency detection approaches. In order to compensate different needs in respect of the speed/accuracy tradeoff, faster variants of the spatial, temporal and spatiotemporal salient region detection approaches are also presented in this paper. A unified approach for spatiotemporal salient region detection is proposed.A novel temporal salient region detection approach is presented.Experimental study shows an improved performance of the proposed approaches.Faster variants of the proposed approaches also present outperforming results.Proof-of-concept prototype of the proposed framework is provided.
Year
DOI
Venue
2015
10.1016/j.image.2015.07.004
Signal Processing: Image Communication
Keywords
Field
DocType
Salient region detection,Temporal saliency,Optical flow abstraction,Spatiotemporal saliency detection,Saliency map
Computer vision,Color contrast,Saliency map,Salient object detection,Pattern recognition,Computer science,Salience (neuroscience),Salient objects,Artificial intelligence,Region detection,Optical flow,Salient
Journal
Volume
Issue
ISSN
36
C
0923-5965
Citations 
PageRank 
References 
0
0.34
45
Authors
3
Name
Order
Citations
PageRank
Rajkumar Kannan1406.88
Gheorghita Ghinea2979104.23
Swaminathan, S.371.44