Title
Biosignal-Based Multimodal Emotion Recognition In A Valence-Arousal Affective Framework Applied To Immersive Video Visualization
Abstract
Many emotion recognition schemes have been proposed in the state-of-the-art. They generally differ in terms of the emotion elicitation methods, target emotional states to recognize, data sources or modalities, and classification techniques. In this work several biosignals are explored for emotion assessment during immersive video visualization, collecting multimodal data from Electrocardiography (ECG), Electrodermal Activity (EDA), Blood Volume Pulse (BVP) and Respiration sensors. Participants reported their emotional state of the day (baseline), and provided self-assessment of the emotion experienced in each video through the Self-Assessment Manikin (SAM), in the valence-arousal space. Multiple physiological and statistical features extracted from the biosignals were used as inputs to an emotion recognition workflow, targeting user-independent classification with two classes per dimension. Support Vector Machines (SVM) were used, as it is considered one of the most promising classifiers in the field. The proposed approach lead to accuracies of 69.13% for arousal and 67.75% for valence, which are encouraging for further research with a larger training dataset and population.
Year
DOI
Venue
2019
10.1109/EMBC.2019.8857852
2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC)
Field
DocType
Volume
Modalities,Computer vision,Arousal,Population,Computer science,Support vector machine,Speech recognition,Feature extraction,Artificial intelligence,Affect (psychology),Biosignal,Workflow
Conference
2019
ISSN
Citations 
PageRank 
1557-170X
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Joana Pinto100.34
Ana L. N. Fred21317195.30
Hugo Silva322730.18