Title
Dynamic Pose-Robust Facial Expression Recognition by Multi-View Pairwise Conditional Random Forests.
Abstract
Automatic facial expression classification (FER) from videos is a critical problem for the development of intelligent human-computer interaction systems. Still, it is a challenging problem that involves capturing high-dimensional spatio-temporal patterns describing the variation of one's appearance over time. Such representation undergoes great variability of the facial morphology and environmental factors as well as head pose variations. In this paper, we use Conditional Random Forests to capture low-level expression transition patterns. More specifically, heterogeneous derivative features (e.g., feature point movements or texture variations) are evaluated upon pairs of images. When testing on a video frame, pairs are created between this current frame and previous ones and predictions for each previous frame are used to draw trees from Pairwise Conditional Random Forests (PCRF) whose pairwise outputs are averaged over time to produce robust estimates. Moreover, PCRF collections can also be conditioned on head pose estimation for multi-view dynamic FER. As such, our approach appears as a natural extension of Random Forests for learning spatio-temporal patterns, potentially from multiple viewpoints. Experiments on popular datasets show that our method leads to significant improvements over standard Random Forests as well as state-of-the-art approaches on several scenarios, including a novel multi-view video corpus generated from a publicly available database.
Year
DOI
Venue
2016
10.1109/TAFFC.2017.2708106
IEEE Transactions on Affective Computing
Keywords
Field
DocType
Face,Videos,Training,Vegetation,Three-dimensional displays,Testing
Pairwise comparison,Interaction systems,Pattern recognition,Facial expression recognition,Computer science,Pose,Facial expression,Artificial intelligence,Random forest,Machine learning
Journal
Volume
Issue
ISSN
abs/1607.06250
2
1949-3045
Citations 
PageRank 
References 
5
0.40
31
Authors
3
Name
Order
Citations
PageRank
Arnaud Dapogny1427.06
Kevin Bailly224419.10
Séverine Dubuisson316824.12