Title
Appearance-from-motion: recovering spatially varying surface reflectance under unknown lighting
Abstract
We present \"appearance-from-motion\", a novel method for recovering the spatially varying isotropic surface reflectance from a video of a rotating subject, with known geometry, under unknown natural illumination. We formulate the appearance recovery as an iterative process that alternates between estimating surface reflectance and estimating incident lighting. We characterize the surface reflectance by a data-driven microfacet model, and recover the microfacet normal distribution for each surface point separately from temporal changes in the observed radiance. To regularize the recovery of the incident lighting, we rely on the observation that natural lighting is sparse in the gradient domain. Furthermore, we exploit the sparsity of strong edges in the incident lighting to improve the robustness of the surface reflectance estimation. We demonstrate robust recovery of spatially varying isotropic reflectance from captured video as well as an internet video sequence for a wide variety of materials and natural lighting conditions.
Year
DOI
Venue
2014
10.1145/2661229.2661283
ACM Trans. Graph.
Keywords
DocType
Volume
appearance modeling,three-dimensional graphics and realism,unknown lighting
Journal
33
Issue
ISSN
Citations 
6
0730-0301
18
PageRank 
References 
Authors
0.63
25
5
Name
Order
Citations
PageRank
Yue Dong142825.42
Guojun Chen2452.64
Pieter Peers3110955.34
Jiawan Zhang4395.75
Xin Tong52119127.72