Title
3D Face Reconstruction from Video Using 3D Morphable Model and Silhouette
Abstract
Capitalizing on the advances of 3D face reconstruction from computer graphics and computer vision, this work presents a system to enable precise and robust 3D facial reconstruction from video in order to improve current approaches for doctor-patient communication tools. The reconstructed face can be used for emulation of aesthetic procedures in 3D. The proposed 3D face reconstruction algorithm uses a statistical shape model as well as information from facial landmarks and silhouette to iteratively model the face of a subject moving the face from front to left. The presented 3D active shape model approach enables the spatio-temporal tracking of facial landmarks and pose estimation based on a few initial facial landmarks defined in the first frame. Silhouette information extracted from key frames allows for better face reconstruction. The proposed methods were rigorously evaluated with experiments using real and artificial data. Results showed that the proposed method can detect facial landmarks with an approximate median error of 5% intraocular distance, can estimate pose with a median error below 5 degrees, and that silhouette information can improve reconstruction accuracy in all facial regions, specially on the cheeks.
Year
DOI
Venue
2014
10.1109/SIBGRAPI.2014.12
Graphics, Patterns and Images
Keywords
DocType
Citations 
computer vision,face recognition,image reconstruction,medical computing,pose estimation,solid modelling,statistical analysis,3D active shape model approach,3D face reconstruction,3D morphable model,aesthetic procedures,approximate median error,cheeks,computer graphics,computer vision,doctor-patient communication tools,facial landmarks,intraocular distance,pose estimation,silhouette,spatio-temporal tracking,statistical shape model,video,computer graphics,face reconstruction,morphable model
Conference
3
PageRank 
References 
Authors
0.38
16
4
Name
Order
Citations
PageRank
Baumberger, C.130.38
Mauricio Reyes27313.74
Constantinescu, M.330.38
Olariu, R.430.38