Name
Abstract | ||
|---|---|---|
In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid registration of faces is significant for many applications in computer vision, such as the construction of 3D Morphable face models (3DMMs). Gaussian Process Morphable Models (GPMMs) unify a variety of non-rigid deformation models with B-splines and PCA models as examples. GPMM separate problem specific requirements from the registration algorithm by incorporating domain-specific adaptions as a prior model. The novelties of this paper are the following: (i) We present a strategy and modeling technique for face registration that considers symmetry, multi-scale and spatially-varying details. The registration is applied to neutral faces and facial expressions. (ii) We release an open-source software framework for registration model-building demonstrated on the publicly available BU3D-FE database. The released pipeline also contains an implementation of an Analysis-by-Synthesis model adaption of 2D face images, tested on the Multi-PIE and LFW database. This enables the community to reproduce, evaluate and compare the individual steps of registration to model-building and 3D/2D model fitting. (iii) Along with the framework release, we publish a new version of the Basel Face Model (BFM-2017) with an improved age distribution and an additional facial expression model. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/FG.2018.00021 | 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) |
Keywords | DocType | Volume |
Morphable Model,Gaussian processes,Gaussian Process Morphable Model,Registration,Basel Face Model,Face Reconstruction | Conference | abs/1709.08398 |
ISSN | ISBN | Citations |
2326-5396 | 978-1-5386-2336-7 | 17 |
PageRank | References | Authors |
0.64 | 3 | 7 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Thomas Gerig | 1 | 43 | 4.07 |
| Andreas Forster | 2 | 30 | 3.62 |
| Clemens Blumer | 3 | 26 | 3.19 |
| Bernhard Egger | 4 | 37 | 3.78 |
| Marcel Lüthi | 5 | 131 | 11.01 |
| Sandro Schönborn | 6 | 39 | 4.23 |
| Thomas Vetter | 7 | 4528 | 529.79 |