Title
Neural holography with camera-in-the-loop training
Abstract
AbstractHolographic displays promise unprecedented capabilities for direct-view displays as well as virtual and augmented reality applications. However, one of the biggest challenges for computer-generated holography (CGH) is the fundamental tradeoff between algorithm runtime and achieved image quality, which has prevented high-quality holographic image synthesis at fast speeds. Moreover, the image quality achieved by most holographic displays is low, due to the mismatch between the optical wave propagation of the display and its simulated model. Here, we develop an algorithmic CGH framework that achieves unprecedented image fidelity and real-time framerates. Our framework comprises several parts, including a novel camera-in-the-loop optimization strategy that allows us to either optimize a hologram directly or train an interpretable model of the optical wave propagation and a neural network architecture that represents the first CGH algorithm capable of generating full-color high-quality holographic images at 1080p resolution in real time.
Year
DOI
Venue
2020
10.1145/3414685.3417802
ACM Transactions on Graphics
Keywords
DocType
Volume
computational displays, holography, virtual reality, augmented reality
Journal
39
Issue
ISSN
Citations 
6
0730-0301
3
PageRank 
References 
Authors
0.45
0
4
Name
Order
Citations
PageRank
Yifan Peng1417.51
Suyeon Choi282.25
Nitish Padmanaban3333.56
Gordon Wetzstein494572.47