Title
Adaptive Multilayer Perceptual Attention Network for Facial Expression Recognition
Abstract
In complex real-world situations, problems such as illumination changes, facial occlusion, and variant poses make facial expression recognition (FER) a challenging task. To solve the robustness problem, this paper proposes an adaptive multilayer perceptual attention network (AMP-Net) that is inspired by the facial attributes and the facial perception mechanism of the human visual system. AMP-Net extracts global, local, and salient facial emotional features with different fine-grained features to learn the underlying diversity and key information of facial emotions. Different from existing methods, AMP-Net can adaptively guide the network to focus on multiple finer and distinguishable local patches with robustness to occlusion and variant poses, improving the effectiveness of learning potential facial diversity information. In addition, the proposed global perception module can learn different receptive field features in the global perception domain, and AMP-Net also supplements salient facial region features with high emotion correlation based on prior knowledge to capture key texture details and avoid important information loss. Many experiments show that AMP-Net achieves good generalizability and state-of-the-art results on several real-world datasets, including RAF-DB, AffectNet-7, AffectNet-8, SFEW 2.0, FER-2013, and FED-RO, with accuracies of 89.25%, 64.54%, 61.74%, 61.17%, 74.48%, and 71.75%, respectively. All codes and training logs are publicly available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/liuhw01/AMP-Net</uri> .
Year
DOI
Venue
2022
10.1109/TCSVT.2022.3165321
IEEE Transactions on Circuits and Systems for Video Technology
Keywords
DocType
Volume
Facial expression recognition,facial perceptual mechanism,occlusion,variant pose
Journal
32
Issue
ISSN
Citations 
9
1051-8215
0
PageRank 
References 
Authors
0.34
20
5
Name
Order
Citations
PageRank
Hanwei Liu100.34
Huiling Cai200.34
Qingcheng Lin300.34
Xuefeng Li400.34
Hui Xiao502.03