Name
Title | ||
|---|---|---|
Speech-based recognition of self-reported and observed emotion in a dimensional space |
Abstract | ||
|---|---|---|
The differences between self-reported and observed emotion have only marginally been investigated in the context of speech-based automatic emotion recognition. We address this issue by comparing self-reported emotion ratings to observed emotion ratings and look at how differences between these two types of ratings affect the development and performance of automatic emotion recognizers developed with these ratings. A dimensional approach to emotion modeling is adopted: the ratings are based on continuous arousal and valence scales. We describe the TNO-Gaming Corpus that contains spontaneous vocal and facial expressions elicited via a multiplayer videogame and that includes emotion annotations obtained via self-report and observation by outside observers. Comparisons show that there are discrepancies between self-reported and observed emotion ratings which are also reflected in the performance of the emotion recognizers developed. Using Support Vector Regression in combination with acoustic and textual features, recognizers of arousal and valence are developed that can predict points in a 2-dimensional arousal-valence space. The results of these recognizers show that the self-reported emotion is much harder to recognize than the observed emotion, and that averaging ratings from multiple observers improves performance. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1016/j.specom.2012.04.006 | Speech Communication |
Keywords | Field | DocType |
speech-based automatic emotion recognition,recognizers show,observed emotion rating,dimensional space,observed emotion,emotion modeling,self-reported emotion rating,self-reported emotion,automatic emotion,valence scale,continuous arousal,speech-based recognition,support vector regression,2 dimensional,affective computing,facial expression | Arousal,Computer science,Emotion recognition,Support vector machine,Emotion perception,Speech recognition,Facial expression,Affective computing | Journal |
Volume | Issue | ISSN |
54 | 9 | 0167-6393 |
Citations | PageRank | References |
11 | 0.59 | 36 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Khiet P. Truong | 1 | 302 | 32.64 |
| David A. van Leeuwen | 2 | 631 | 59.01 |
| Franciska de Jong | 3 | 924 | 84.89 |