Title
Multi-view facial landmark detection by using a 3D shape model
Abstract
An algorithm for accurate localization of facial landmarks coupled with a head pose estimation from a single monocular image is proposed. The algorithm is formulated as an optimization problem where the sum of individual landmark scoring functions is maximized with respect to the camera pose by fitting a parametric 3D shape model. The landmark scoring functions are trained by a structured output SVM classifier that takes a distance to the true landmark position into account when learning. The optimization criterion is non-convex and we propose a robust initialization scheme which employs a global method to detect a raw but reliable initial landmark position. Self-occlusions causing landmarks invisibility are handled explicitly by excluding the corresponding contributions from the data term. This allows the algorithm to operate correctly for a large range of viewing angles. Experiments on standard \"in-the-wild\" datasets demonstrate that the proposed algorithm outperforms several state-of-the-art landmark detectors especially for non-frontal face images. The algorithm achieves the average relative landmark localization error below 10% of the interocular distance in 98.3% of the 300W dataset test images. Accurate facial landmark detector coupled with a 6 DoF head pose estimatorA reliable global method followed by a precise local optimizationNovel learning method based on structured output SVMMulti-view detector working on a wide range of viewing angles (frontal-profile). Self-occlusions handled.Comparison with recent state-of-the-art methods on standard \"in the wild\" datasets with quantitatively favourable results.
Year
DOI
Venue
2016
10.1016/j.imavis.2015.11.003
Image Vision Comput.
Keywords
Field
DocType
Face,Landmarks,Detection,Localization,3D model,Shape,Occlusions
Computer vision,Pattern recognition,Pose,Parametric statistics,Monocular image,Artificial intelligence,Initialization,Landmark,Detector,Optimization problem,Invisibility,Mathematics
Journal
Volume
Issue
ISSN
47
C
0262-8856
Citations 
PageRank 
References 
5
0.47
27
Authors
7
Name
Order
Citations
PageRank
Jan Cech114114.16
Vojtěch Franc258455.78
Michal Uricar3864.31
Jiri Matas4525.77
ČechJan550.47
FrancVojtech650.47
MatasJiří750.47