Name
Title | ||
|---|---|---|
A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain. |
Abstract | ||
|---|---|---|
The development of conversational agents with human interaction capabilities requires advanced affective state recognition integrating non-verbal cues from the different modalities constituting what in human communication we perceive as an overall affective state. Each of the modalities is often handled by a different subsystem that conveys only a partial interpretation of the whole and, as such, is evaluated only in terms of its partial view. To tackle this shortcoming, we investigate the generation of a unified multimodal annotation schema of non-verbal cues from the perspective of an inter-disciplinary group of experts. We aim at obtaining a common ground-truth with a unique representation using the Valence and Arousal space and a discrete non-linear scale of values. The proposed annotation schema is demonstrated on a corpus in the health-care domain but is scalable to other purposes. Preliminary results on inter-rater variability show a positive correlation of consensus level with high (absolute) values of Valence and Arousal as well as with the number of annotators labeling a given video sequence. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1145/2927006.2927008 | MARMI@ICMR |
DocType | Citations | PageRank |
Conference | 1 | 0.37 |
References | Authors | |
4 | 8 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Federico M. Sukno | 1 | 200 | 20.33 |
| Mónica Domínguez | 2 | 1 | 2.39 |
| Adria Ruiz | 3 | 1 | 0.37 |
| Dominik Schiller | 4 | 3 | 2.79 |
| Florian Lingenfelser | 5 | 1 | 1.04 |
| Louisa Pragst | 6 | 5 | 5.23 |
| Ekeni Kamateri | 7 | 1 | 0.37 |
| Stefanos Vrochidis | 8 | 263 | 73.19 |