Title
Facial expression recognition of intercepted video sequences based on feature point movement trend and feature block texture variation
Abstract
Facial Expression Recognition (FER) is an important subject of human–computer interaction and has long been a research area of great interest. Accurate Facial Expression Sequence Interception (FESI) and discriminative expression feature extraction are two enormous challenges for the video-based FER. This paper proposes a framework of FER for the intercepted video sequences by using feature point movement trend and feature block texture variation. Firstly, the feature points are marked by Active Appearance Model (AAM) and the most representative 24 of them are selected. Secondly, facial expression sequence is intercepted from the face video by determining two key frames whose emotional intensities are minimum and maximum, respectively. Thirdly, the trend curve which represents the Euclidean distance variations between any two selected feature points is fitted, and the slopes of specific points on the trend curve are calculated. Finally, combining Slope Set which is composed by the calculated slopes with the proposed Feature Block Texture Difference (FBTD) which refers to the texture variation of facial patch, the final expressional feature are formed and inputted to One-dimensional Convolution Neural Network (1DCNN) for FER. Five experiments are conducted in this research, and three average FER rates 95.2%, 96.5%, and 97% for Beihang University (BHU) facial expression database, MMI facial expression database, and the combination of two databases, respectively, have shown the significant advantages of the proposed method over the existing ones.
Year
DOI
Venue
2019
10.1016/j.asoc.2019.105540
Applied Soft Computing
Keywords
Field
DocType
Facial expression sequence interception (FESI),Slope set,Feature block texture difference (FBTD),Facial expression recognition (FER)
Expression Feature,Pattern recognition,Facial expression recognition,Convolutional neural network,Euclidean distance,Active appearance model,Facial expression,Artificial intelligence,Discriminative model,Mathematics,Machine learning
Journal
Volume
ISSN
Citations 
82
1568-4946
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Jizheng Yi100.34
Aibin Chen245.88
Zixing Cai3152566.96
Yi Sima400.34
Mengna Zhou500.34
Xingyu Wu685.68