Title
Dimensional Affect Recognition Using Continuous Conditional Random Fields
Abstract
During everyday interaction people display various non-verbal signals that convey emotions. These signals are multi-modal and range from facial expressions, shifts in posture, head pose, and non-verbal speech. They are subtle, continuous and complex. Our work concentrates on the problem of automatic recognition of emotions from such multimodal signals. Most of the previous work has concentrated on classifying emotions as belonging to a set of categories, or by discretising the continuous dimensional space. We propose the use of Continuous Conditional Random Fields (CCRF) in combination with Support Vector Machines for Regression (SVR) for modeling continuous emotion in dimensional space. Our Correlation Aware Continuous Conditional Random Field (CA-CCRF) exploits the non-orthogonality of emotion dimensions. By using visual features based on geometric shape and appearance, and a carefully selected subset of audio features we show that our CCRF and CA-CCRF approaches outperform previously published baselines for all four affective dimensions of valence, arousal, power and expectancy.
Year
DOI
Venue
2013
10.1109/FG.2013.6553785
2013 10TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG)
Keywords
Field
DocType
vectors,predictive models,facial expression,random processes,geometric shape,shape,emotion classification,feature extraction,support vector machines,regression analysis,face
Conditional random field,Pattern recognition,Regression analysis,Computer science,Support vector machine,Stochastic process,Feature extraction,Facial expression,Correlation,Artificial intelligence,Geometric shape
Conference
ISSN
Citations 
PageRank 
2326-5396
37
1.42
References 
Authors
22
3
Name
Order
Citations
PageRank
Tadas Baltrusaitis168330.42
Ntombikayise Banda2694.09
Peter Robinson31438129.42