Paper Info
Title
A Novel Affective Visualization System for Videos Based on Acoustic and Visual Features.
Abstract
With the fast development of social media in recent years, affective video content analysis has become a hot research topic and the relevant techniques are adopted by quite a few popular applications. In this paper, we firstly propose a novel set of audiovisual movie features to improve the accuracy of affective video content analysis, including seven audio features, eight visual features and two movie grammar features. Then, we propose an iterative method with low time complexity to select a set of more significant features for analyzing a specific emotion. And then, we adopt the BP (Back Propagation) network and circumplex model to map the low-level audiovisual features onto high-level emotions. To validate our approach, a novel video player with affective visualization is designed and implemented, which makes emotion visible and accessible to audience. Finally, we built a video dataset including 2000 video clips with manual affective annotations, and conducted extensive experiments to evaluate our proposed features, algorithms and models. The experimental results reveals that our approach outperforms state-of-the-art methods.
Year
DOI
Venue
2017
10.1007/978-3-319-51814-5_2
Lecture Notes in Computer Science
Keywords
Field
DocType
Affective analysis,Novel features,Feature selection,Emotion visualization
Computer vision,Social media,Feature selection,Computer science,Visualization,Visual analytics,Grammar,Video content analysis,Natural language processing,Artificial intelligence,Time complexity,Backpropagation
Conference
Volume
ISSN
Citations 
10133
0302-9743
0
PageRank 
References 
Authors
0.34
14
4
Name
Order
Citations
PageRank
Jianwei Niu11643141.54
Yiming Su210.71
Shasha Mo332.43
Zeyu Zhu430.73