Name
Title | ||
|---|---|---|
Assessing Agreement Of Observer- And Self-Annotations In Spontaneous Multimodal Emotion Data |
Abstract | ||
|---|---|---|
We investigated inter-observer agreement and the reliability of self-reported emotion ratings (i.e., self-raters judging their own emotions) in spontaneous multimodal emotion data. During a multiplayer video game, vocal and facial expressions were recorded (including the game content itself) and were annotated by the players themselves on arousal and valence scales. In a perception experiment, observers rated a small part of the data that was provided in 4 conditions: audio only, visual only, audiovisual and audiovisual plus context. Inter-observer agreements varied between 0.32 and 0.52 when the ratings were scaled. Providing multimodal information usually increased agreement. Finally, we found that the averaged agreement between the self-rater and the observers was somewhat lower than the inter-observer agreement. |
Year | Venue | Keywords |
|---|---|---|
2008 | INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5 | emotion, multimodal database, inter-rater agreement, self-reported emotion |
Field | DocType | Citations |
Arousal,Speech communication,Computer science,Speech recognition,Facial expression,Observer (quantum physics),Perception,Inter-rater reliability | Conference | 8 |
PageRank | References | Authors |
0.65 | 5 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Khiet P. Truong | 1 | 302 | 32.64 |
| Khiet P. Truong | 2 | 302 | 32.64 |
| Mark A. Neerincx | 3 | 757 | 96.80 |
| David A. van Leeuwen | 4 | 631 | 59.01 |
| Mark A. Neerincx | 5 | 18 | 1.64 |
| David A. van Leeuwen | 6 | 36 | 3.60 |