Title
3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
Abstract
Human faces are remarkably similar in global properties, including size, aspect ratio, and location of main features, but can vary considerably in details across individuals, gender, race, or due to facial expression. We propose a novel method for 3D shape recovery of faces that exploits the similarity of faces. Our method obtains as input a single image and uses a mere single 3D reference model of a different person's face. Classical reconstruction methods from single images, i.e., shape-from-shading, require knowledge of the reflectance properties and lighting as well as depth values for boundary conditions. Recent methods circumvent these requirements by representing input faces as combinations (of hundreds) of stored 3D models. We propose instead to use the input image as a guide to "mold” a single reference model to reach a reconstruction of the sought 3D shape. Our method assumes Lambertian reflectance and uses harmonic representations of lighting. It has been tested on images taken under controlled viewing conditions as well as on uncontrolled images downloaded from the Internet, demonstrating its accuracy and robustness under a variety of imaging conditions and overcoming significant differences in shape between the input and reference individuals including differences in facial expressions, gender, and race.
Year
DOI
Venue
2011
10.1109/TPAMI.2010.63
Pattern Analysis and Machine Intelligence, IEEE Transactions
Keywords
Field
DocType
computer vision,face recognition,image reconstruction,3D face reconstruction,3D shape recovery,Lambertian reflectance,harmonic representation,reflectance properties,shape-from-shading,single image,single reference face shape,3D reconstruction,Computer vision,depth reconstruction.,face,lighting,photometry,shape from shading,single images
Iterative reconstruction,Computer vision,Facial recognition system,Pattern recognition,Reference model,Silhouette,Computer science,Image processing,Artificial intelligence,Photometric stereo,Lambertian reflectance,3D reconstruction
Journal
Volume
Issue
ISSN
33
2
0162-8828
Citations 
PageRank 
References 
136
3.56
18
Authors
2
Search Limit
100136
Name
Order
Citations
PageRank
Ira Kemelmacher-Shlizerman171028.03
Ronen Basri23467403.18