Name
Abstract | ||
|---|---|---|
Emotion recognition is one of the latest challenges in intelligent human/computer communication. Most of previous work on emotion recognition focused on extracting emotions from visual or audio information separately. A novel approach is presented in this paper, including both visual and audio from video clips, to recognize the human emotion. The Facial Animation Parameters (FAPs) compliant facial feature tracking based on GASM (GPU based Active Shape Model) is performed on the video to generate two vector streams which represent the expression feature and the visual speech one. To extract effective speech features, based on geodesic distance estimation, we develop an enhanced Lipschitz embedding to embed high dimensional acoustic features into low dimensional space. Combined with the visual vectors, the audio vector is extracted in terms of low dimensional features. Then, a tripled Hidden Markov Model is introduced to perform the recognition which allows the state asynchrony of the audio and visual observation sequences while preserving their natural correlation over time. The experimental results show that this approach outperforms the conventional approaches for emotion recognition. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1016/j.neucom.2007.07.041 | Neurocomputing |
Keywords | Field | DocType |
low dimensional feature,audio information,lipschitz embedding,audio vector,visual vector,multimodal,emotion recognition,tripled hidden markov model,human emotion,embed high dimensional acoustic,visual speech,robust multimodal approach,visual observation sequence,low dimensional space,facial animation,active shape model,hidden markov model,geodesic distance | Expression Feature,Artificial intelligence,Lipschitz continuity,Computer facial animation,Active shape model,Embedding,Pattern recognition,Speech recognition,Correlation,Hidden Markov model,Geodesic,Mathematics,Machine learning | Journal |
Volume | Issue | ISSN |
71 | 10-12 | Neurocomputing |
Citations | PageRank | References |
22 | 0.98 | 20 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Mingli Song | 1 | 1646 | 98.10 |
| Mingyu You | 2 | 160 | 16.22 |
| Na Li | 3 | 35 | 1.48 |
| Chun Chen | 4 | 4727 | 246.28 |