Title
Projector Compensation Framework Using Differentiable Rendering
Abstract
Projection mapping is a widely adopted technique in various applications. A typically projector-camera system consists of a projector and camera pair where a projector emits an application-specific input image onto a surface, and the camera captures the projected output image. Given an ideal projection surface with white-colored planar geometries, the camera (or a viewer) can observe the projected output image without any visual distortion. The surface, however, can have arbitrary shapes and textured colors in practice, and it often introduces visually distracting artifacts to the output image. It results in lowering the viewing experience drastically. We propose a projector compensation framework that adjusts the projector input image so that the camera can see the projected output image with a much-reduced distortion. Our key contribution is to model the real projection mapping process with a virtual but controllable light simulation and optimize the projector input using differentiable rendering. We demonstrate that our new framework produces a more accurate output than state-of-the-art methods given complex projection surfaces.
Year
DOI
Venue
2022
10.1109/ACCESS.2022.3169861
IEEE ACCESS
Keywords
DocType
Volume
Rendering (computer graphics), Cameras, Image color analysis, Calibration, Estimation, Surface treatment, Neural networks, Projector compensation, geometric calibration, photometric compensation, differentiable rendering
Journal
10
ISSN
Citations 
PageRank 
2169-3536
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Jino Park100.34
Donghyuk Jung200.34
Bochang Moon300.68