Title
Multimodal emotion classification in naturalistic user behavior
Abstract
The design of intelligent personalized interactive systems, having knowledge about the user's state, his desires, needs and wishes, currently poses a great challenge to computer scientists. In this study we propose an information fusion approach combining acoustic, and biophysiological data, comprising multiple sensors, to classify emotional states. For this purpose a multimodal corpus has been created, where subjects undergo a controlled emotion eliciting experiment, passing several octants of the valence arousal dominance space. The temporal and decision level fusion of the multiple modalities outperforms the single modality classifiers and shows promising results.
Year
Venue
Keywords
2011
HCI (3)
biophysiological data,great challenge,emotional state,Multimodal emotion classification,multiple modality,decision level fusion,naturalistic user behavior,intelligent personalized interactive system,computer scientist,information fusion approach,multiple sensor,controlled emotion
Field
DocType
Volume
Confusion matrix,Decision level,Multiple modalities,Computer science,Emotion recognition,Emotion classification,Human–computer interaction,Valence arousal,Information fusion,Multiple sensors
Conference
6763
ISSN
Citations 
PageRank 
0302-9743
25
1.18
References 
Authors
6
10
Name
Order
Citations
PageRank
Steffen Walter112713.34
Stefan Scherer2115973.43
Martin Schels327715.88
Michael Glodek429516.76
David Hrabal5736.01
Miriam Schmidt61286.23
Ronald Böck79910.75
Kerstin Limbrecht8271.56
Harald C. Traue912913.48
Friedhelm Schwenker10116096.59