Name
Title | ||
|---|---|---|
Human perception of synthetic character emotions in the presence of conflicting and congruent vocal and facial expressions |
Abstract | ||
|---|---|---|
ABSTRACT Audio-visual emotion expression by synthetic agents is widely em- ployed in research, industrial, and commercial applications. How- ever, the mechanism through which people judge the multimodal emotional display of these agents is not yet well understood. This study is an attempt to provide a better understanding of the interac- tion between,video and audio channels through the use of a con- tinuous dimensional evaluation framework of valence, activation, and dominance. The results indicate that the congruent audio-visual presentation contains information allowing users to differentiate be- tween happy and angry emotional,expressions to a greater degree than either of the two channels individually. Interestingly, however, sad and neutral emotions,which exhibit a lesser degree of activation show more confusion when,presented using both channels. Further- more, when faced with a conflicting emotional presentation, users predominantly,attended to the vocal channel. It is speculated that this is most likely due to the limited level of facial emotion expression inherent in the current animated face. The results also indicate that there is no clear integration of audio and visual channels in emotion perception as in speech perception indicated by the McGurk effect. The final judgments were biased toward the modality with stronger expression power. Index Terms— audio-visual emotion perception, facial emotion |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1109/ICASSP.2008.4518081 | Las Vegas, NV |
Keywords | Field | DocType |
emotion recognition,image recognition,visual perception,audio channels,congruent vocal expressions,facial expressions,human perception,speech perception,synthetic agents,synthetic character emotions,video channels,McGurk effect,audio-visual emotion perception,facial emotion expression | Computer science,Cognitive psychology,Emotional expression,Artificial intelligence,McGurk effect,Congruence (geometry),Visual perception,Pattern recognition,Emotion perception,Speech recognition,Facial expression,Speech perception,Perception | Conference |
ISSN | ISBN | Citations |
1520-6149 E-ISBN : 978-1-4244-1484-0 | 978-1-4244-1484-0 | 6 |
PageRank | References | Authors |
0.62 | 2 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Emily Mower | 1 | 1062 | 59.08 |
| Sungbok Lee | 2 | 1394 | 84.13 |
| Maja J. Mataric | 3 | 6423 | 840.58 |
| Narayanan Shrikanth | 4 | 5558 | 439.23 |