Title
Face fiducial detection by consensus of exemplars.
Abstract
Facial fiducial detection is a challenging problem for several reasons like varying pose, appearance, expression, partial occlusion and others. In the past, several approaches like mixture of trees [32], regression based methods [8], exemplar based methods [7] have been proposed to tackle this challenge. In this paper, we propose an exemplar based approach to select the best solution from among outputs of regression and mixture of trees based algorithms (which we call candidate algorithms). We show that by using a very simple SIFT and HOG based descriptor, it is possible to identify the most accurate fiducial outputs from a set of results produced by candidate algorithms on any given test image. Our approach manifests as two algorithms, one based on optimizing an objective function with quadratic terms and the other based on simple kNN. Both algorithms take as input fiducial locations produced by running state-of-the-art candidate algorithms on an input image, and output accurate fiducials using a set of automatically selected exemplar images with annotations. Our surprising result is that in this case, a simple algorithm like kNN is able to take advantage of the seemingly huge complementarity of these candidate algorithms, better than optimization based algorithms. We do extensive experiments on several datasets, and show that our approach outperforms state-of-the-art consistently. In some cases, we report as much as a 10% improvement in accuracy. We also extensively analyze each component of our approach, to illustrate its efficacy. An implementation and extended technical report of our approach is available www.sites.google.com/site/wacv2016facefiducialexemplars.
Year
DOI
Venue
2016
10.1109/WACV.2016.7477592
WACV
Field
DocType
ISSN
Scale-invariant feature transform,Computer science,Robustness (computer science),Artificial intelligence,Standard test image,Computer vision,Fiducial marker,Pattern recognition,Quadratic equation,Feature extraction,Active appearance model,SIMPLE algorithm,Machine learning
Conference
2472-6737
Citations 
PageRank 
References 
1
0.36
22
Authors
4
Name
Order
Citations
PageRank
B. R. Mallikarjun153.11
Visesh Chari2566.95
C. V. Jawahar31700148.58
Akshay Asthana410.36