Title
Multiview face capture using polarized spherical gradient illumination
Abstract
We present a novel process for acquiring detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints using polarized spherical gradient illumination. Key to our method is a new pair of linearly polarized lighting patterns which enables multiview diffuse-specular separation under a given spherical illumination condition from just two photographs. The patterns -- one following lines of latitude and one following lines of longitude -- allow the use of fixed linear polarizers in front of the cameras, enabling more efficient acquisition of diffuse and specular albedo and normal maps from multiple viewpoints. In a second step, we employ these albedo and normal maps as input to a novel multi-resolution adaptive domain message passing stereo reconstruction algorithm to create high resolution facial geometry. To do this, we formulate the stereo reconstruction from multiple cameras in a commonly parameterized domain for multiview reconstruction. We show competitive results consisting of high-resolution facial geometry with relightable reflectance maps using five DSLR cameras. Our technique scales well for multiview acquisition without requiring specialized camera systems for sensing multiple polarization states.
Year
DOI
Venue
2011
10.1145/2024156.2024163
ACM Trans. Graph.
Keywords
Field
DocType
facial geometry,following line,multiple camera,multiple polarization state,multiple viewpoint,spherical gradient illumination,detailed facial geometry,multiview acquisition,multiview face,normal map,multiview diffuse-specular separation,high-resolution facial geometry,high resolution,polarization,polarized light,message passing
Computer graphics (images),Computer science,Polarization (waves),Photometry (optics),Artificial intelligence,Message passing,Computer vision,Polarizer,Normal mapping,Specular reflection,Optics,Albedo,Linear polarization
Journal
Volume
Issue
ISSN
30
6
0730-0301
Citations 
PageRank 
References 
60
2.76
23
Authors
6
Name
Order
Citations
PageRank
Abhijeet Ghosh177258.87
Graham Fyffe235622.50
Borom Tunwattanapong31138.54
Jay Busch428323.06
Xueming Yu523918.65
Paul Debevec64955449.10