Name
Abstract | ||
|---|---|---|
In this paper, we target the CCPR 2016 Multimodal Emotion Recognition Challenge (MEC 2016) which is based on the Chinese Natural Audio-Visual Emotion Database (CHEAVD) of movies and TV programs showing (nearly) spontaneous human emotions. Low level descriptors (LLDs) are proposed as audio features. As visual features, we propose using histogram of oriented gradients (HOG), local phase quantisation (LPQ), shape features and behavior-related features such as head pose and eye gaze. The visual features are post processed to delete or smooth the all-zero feature vector segments. Single modal emotion recognition is performed using fully connected hidden Markov models (HMMs). For multimodal emotion recognition, two schemes are proposed: in the first scheme the normalized probability vectors from the HMMs are input to a support vector machine (SVM) for final recognition. For the second scheme, the final emotion is estimated using audio or video features depending if the face has been detected on the full video. Moreover, to make full use of the labeled data and to overcome the problem of unbalanced data, we use the training set and validation set together to train the HMMs and SVMs with parameters optimized via cross-validation experiments. Experimental results on the test set show that the macro average precisions (MAPs) of audio, visual, and multi-modal emotion recognition reach 42.85 %, 54.24 %, and 53.90 %, respectively, which are much higher than the corresponding baseline results of 24.02 %, 34.28 %, and 30.63 %. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1007/978-981-10-3005-5_57 | Communications in Computer and Information Science |
Keywords | Field | DocType |
LLD,HOG,LPQ,Shape,Fully connected HMM | Feature vector,Normalization (statistics),Pattern recognition,Computer science,Support vector machine,Histogram of oriented gradients,Eye tracking,Artificial intelligence,Hidden Markov model,Modal,Test set | Conference |
Volume | ISSN | Citations |
663 | 1865-0929 | 0 |
PageRank | References | Authors |
0.34 | 24 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xiaohan Xia | 1 | 12 | 2.88 |
| Liyong Guo | 2 | 0 | 0.34 |
| Jiang Dongmei | 3 | 115 | 15.28 |
| Ercheng Pei | 4 | 83 | 6.23 |
| Le Yang | 5 | 106 | 13.26 |
| Hichem Sahli | 6 | 475 | 65.19 |