Title
Rendering synthetic objects into legacy photographs
Abstract
We propose a method to realistically insert synthetic objects into existing photographs without requiring access to the scene or any additional scene measurements. With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene. We demonstrate in a user study that synthetic images produced by our method are confusable with real scenes, even for people who believe they are good at telling the difference. Further, our study shows that our method is competitive with other insertion methods while requiring less scene information. We also collected new illumination and reflectance datasets; renderings produced by our system compare well to ground truth. Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others.
Year
DOI
Venue
2011
10.1145/2024156.2024191
ACM Trans. Graph.
Keywords
Field
DocType
synthetic image,glowing material,real scene,additional scene measurement,gaming industry,insertion method,scene information,user study,synthetic object,legacy photograph,user content creation,ground truth,image based rendering,physical model,computational photography
Computer vision,Computer graphics (images),Computer science,Computational photography,Image-based lighting,Ground truth,Content creation,Artificial intelligence,Reflectivity,Rendering (computer graphics),Image-based modeling and rendering,Photo editing
Journal
Volume
Issue
ISSN
30
6
0730-0301
Citations 
PageRank 
References 
78
2.38
41
Authors
4
Name
Order
Citations
PageRank
Kevin Karsch131314.91
Varsha Hedau239518.16
D. A. Forsyth392271138.80
Derek Hoiem44998302.66