Title
Wild facial expression recognition based on incremental active learning.
Abstract
Facial expression recognition in a wild situation is a challenging problem in computer vision research due to different circumstances, such as pose dissimilarity, age, lighting conditions, occlusions, etc. Numerous methods, such as point tracking, piecewise affine transformation, compact Euclidean space, modified local directional pattern, and dictionary-based component separation have been applied to solve this problem. In this paper, we have proposed a deep learning–based automatic wild facial expression recognition system where we have implemented an incremental active learning framework using the VGG16 model developed by the Visual Geometry Group. We have gathered a large amount of unlabeled facial expression data from Intelligent Technology Lab (ITLab) members at Inha University, Republic of Korea, to train our incremental active learning framework. We have collected these data under five different lighting conditions: good lighting, average lighting, close to the camera, far from the camera, and natural lighting and with seven facial expressions: happy, disgusted, sad, angry, surprised, fear, and neutral. Our facial recognition framework has been adapted from a multi-task cascaded convolutional network detector. Repeating the entire process helps obtain better performance. Our experimental results have demonstrated that incremental active learning improves the starting baseline accuracy from 63% to average 88% on ITLab dataset on wild environment. We also present extensive results on face expression benchmark such as Extended Cohn-Kanade Dataset, as well as ITLab face dataset captured in wild environment and obtained better performance than state-of-the-art approaches.
Year
DOI
Venue
2018
10.1016/j.cogsys.2018.06.017
Cognitive Systems Research
Keywords
Field
DocType
Expression recognition,Emotion classification,Face detection,Convolutional neural network,Active learning
Affine transformation,Facial recognition system,Active learning,Pattern recognition,Psychology,Euclidean space,Facial expression,Artificial intelligence,Network detector,Deep learning,Piecewise,Machine learning
Journal
Volume
ISSN
Citations 
52
1389-0417
2
PageRank 
References 
Authors
0.37
22
5
Name
Order
Citations
PageRank
Minhaz Uddin Ahmed173.40
Kim Jin Woo221.04
Kim Yeong Hyeon321.38
Md. Rezaul Bashar4103.95
Phill Kyu Rhee56024.82