Title
MoDuL: Deep Modal and Dual Landmark-wise Gated Network for Facial Expression Recognition
Abstract
Automatic facial expression recognition (FER) is a challenging computer vision problem that finds a number of applications in human-computer interaction. Most recent FER approaches are deep-learning based and involve the extraction of two types of features from face images: geometric features (e.g. distances between aligned facial landmarks) and appearance features extracted using convolutional neural networks applied on patches extracted around each landmark. In this paper, we explore the use of gating networks to learn an optimal combination of these two modalities (modal gate). Furthermore, we also design landmark-wise gates to adaptively weight each landmark as well as the corresponding patch contribution. The proposed MoDuL architecture achieves state-of-the-art results on several FER databases with negligible computational overhead.
Year
DOI
Venue
2020
10.1109/FG47880.2020.00081
2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
Keywords
DocType
ISSN
Facial expression recognition,deep learning,ensemble methods
Conference
2326-5396
ISBN
Citations 
PageRank 
978-1-7281-3080-4
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Sacha Bernheim100.34
Estèphe Arnaud200.34
Arnaud Dapogny3427.06
Kevin Bailly424419.10