Title
Intraindividual and interindividual multimodal emotion analyses in Human-Machine-Interaction
Abstract
Interactive computer systems today interact nearly effortlessly with humans by menu-driven mouse- and text-based input. In case of other modalities like audio and gesture control systems still lack on flexibility. To respond appropriately, these intelligent systems require specific cues about the user's internal state. Reliable emotion recognition of technical systems is therefore an important issue in computer sciences and applications. In order to develop an appropriate methodology for emotion analyses, a multimodal study is introduced here. Audio and video signals as well as biopsychological signals of the user are applied to detect intraindividual behavioural prototypes that can be used for predictions of the user's emotional states. Additionally, interindividual differences are considered and discussed. Statistical analyses showed results in most cases with statistical significance of probability value p <; 0.05 and an effect size d >; 1.05.
Year
DOI
Venue
2012
10.1109/CogSIMA.2012.6188409
Cognitive Methods in Situation Awareness and Decision Support
Keywords
DocType
ISBN
audio signal processing,emotion recognition,human computer interaction,interactive systems,probability,psychology,statistical analysis,video signal processing,audio control system,audio signals,biopsychological signals,computer science,gesture control system,human-machine-interaction,intelligent system,interactive computer system,interindividual multimodal emotion analysis,intraindividual behavioural prototype,intraindividual multimodal emotion analysis,menu-driven mouse-based input,technical system,text-based input,user emotional state prediction,user internal state,video signals,audio analysis,biopsychological analysis,facs,individual calibration,multimodality,hidden markov models,accuracy,statistical significance,materials,gold,hidden markov model,encoding
Conference
978-1-4673-0343-9
Citations 
PageRank 
References 
5
0.42
12
Authors
7
Name
Order
Citations
PageRank
ronald bock150.42
stefan gluge250.42
andreas wendemuth350.42
kerstin limbrecht450.42
Steffen Walter512713.34
David Hrabal6736.01
Harald C. Traue712913.48