Title
Emotion Recognition From Body Expressions With A Neural Network Architecture
Abstract
The recognition of emotions plays an important role in our daily life and is essential for social communication. Although multiple studies have shown that body expressions can strongly convey emotional states, emotion recognition from body motion patterns has received less attention than the use of facial expressions. In this paper, we propose a self-organizing neural architecture that can effectively recognize affective states from full-body motion patterns. To evaluate our system, we designed and collected a data corpus named the Body Expressions of Emotion (BEE) dataset using a depth sensor in a human-robot interaction scenario. For our recordings, nineteen participants were asked to perform six different emotions: anger, fear, happiness, neutral, sadness, and surprise. In order to compare our system with human-like performance, we conducted an additional experiment by asking fifteen annotators to label depth map video sequences as one of the six emotion classes. The labeling results from human annotators were compared to the results predicted by our system. Experimental results showed that the recognition accuracy of the system was competitive with human performance when exposed to body motion patterns from the same dataset.
Year
DOI
Venue
2017
10.1145/3125739.3125772
PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON HUMAN AGENT INTERACTION (HAI'17)
Keywords
Field
DocType
Emotion recognition, neural networks, learning systems
Social psychology,Sadness,Expression (mathematics),Computer science,Facial expression,Anger,Happiness,Surprise,Affect (psychology),Artificial neural network
Conference
Citations 
PageRank 
References 
3
0.48
11
Authors
4
Name
Order
Citations
PageRank
Nourhan Elfaramawy130.48
Pablo V. A. Barros211922.02
German Ignacio Parisi324821.75
Stefan Wermter41100151.62