Title
3D facial landmark localization using combinatorial search and shape regression
Abstract
This paper presents a method for the automatic detection of facial landmarks. The algorithm receives a set of 3D candidate points for each landmark (e.g. from a feature detector) and performs combinatorial search constrained by a deformable shape model. A key assumption of our approach is that for some landmarks there might not be an accurate candidate in the input set. This is tackled by detecting partial subsets of landmarks and inferring those that are missing so that the probability of the deformable model is maximized. The ability of the model to work with incomplete information makes it possible to limit the number of candidates that need to be retained, substantially reducing the number of possible combinations to be tested with respect to the alternative of trying to always detect the complete set of landmarks. We demonstrate the accuracy of the proposed method in a set of 144 facial scans acquired by means of a hand-held laser scanner in the context of clinical craniofacial dysmorphology research. Using spin images to describe the geometry and targeting 11 facial landmarks, we obtain an average error below 3 mm, which compares favorably with other state of the art approaches based on geometric descriptors.
Year
DOI
Venue
2012
10.1007/978-3-642-33863-2_4
ECCV Workshops (1)
Keywords
Field
DocType
input set,complete set,facial landmark,deformable model,deformable shape model,accurate candidate,possible combination,facial landmark localization,combinatorial search,candidate point,shape regression,facial scan,electronic engineering
Computer vision,Laser scanning,Feature detection,Pattern recognition,Regression,Gabor wavelet,Computer science,Artificial intelligence,Landmark,Combinatorial search,Complete information
Conference
Volume
ISSN
Citations 
7583
0302-9743
5
PageRank 
References 
Authors
0.46
14
3
Name
Order
Citations
PageRank
Federico M. Sukno120020.33
John L. Waddington2251.77
Paul F. Whelan356139.95