Title
Visual Sentiment Analysis by Combining Global and Local Information
Abstract
With the development of visual social networks, the sentiment analysis of images has quickly emerged for opinion mining. Based on the observation that the sentiments conveyed by some images are related to salient objects in them, we propose a scheme for visual sentiment analysis that combines global and local information. First, the sentiment is predicted from the entire images. Second, it is judged whether there are salient objects in an image or not. If there are, sub-images are cropped from the entire image based on the detection window of the salient objects. Moreover, a CNN model is trained for the set of sub-images. Predictions of sentiments from entire images and sub-images are then fused together to obtain the final results. If no salient object is detected in the images, the sentiment predicted directly from entire images is used as the final result. The compared experimental results show that the proposed approach is superior to state-of-the-art algorithms. It also demonstrates that reasonably utilizing the local information could improve the performance for visual sentiment analysis.
Year
DOI
Venue
2020
10.1007/s11063-019-10027-7
Neural Processing Letters
Keywords
DocType
Volume
Visual sentiment analysis, Salient objects, Local information, Global information
Journal
51
Issue
ISSN
Citations 
3
1370-4621
1
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Lifang Wu1134.52
Mingchao Qi210.34
Meng Jian31810.79
Zhang Heng47612.59