Title
Facial Expression Recognition by Expression-Specific Representation Swapping
Abstract
In the field of facial expression recognition (FER), various FER systems have been explored to encode expression information from facial representations. Although significant progress has been made towards improving the expression classification, challenges due to the large variations of individuals and the lack of consistent annotated samples still remain. In this paper, we propose to disentangle facial representations into expression-specific representations and expression-unrelated representations with a representation swapping procedure, called SwER. First, we adopt a variational auto-encoder (VAE) structure to obtain latent vectors (i.e., facial representations) from face images. Next, the representation swapping procedure is introduced for paired face images to disentangle the expression-specific representations from facial representations. Finally, the expression-specific representations and the expression-unrelated representations are jointly learned for facial expression recognition and face comparison tasks, respectively. In this way, better facial representations are obtained by discarding unrelated factors, and the expression-specific representations are more independent. The proposed method has been evaluated on five databases, CK+, Oulu-CASIA, MMI, RAF-DB, and AffectNet. The experimental results demonstrate the superior performance of the proposed method.
Year
DOI
Venue
2021
10.1007/978-3-030-86340-1_7
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II
Keywords
DocType
Volume
Facial expression recognition, Representation swapping
Conference
12892
ISSN
Citations 
PageRank 
0302-9743
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Jie Lei1395.07
Zhao Liu200.34
Zeyu Zou300.34
Tong Li400.34
Juan Xu501.01
Zunlei Feng6218.14
Ronghua Liang737642.60