Paper Info
Title
An End-to-End Real-Time 3D System for Integral Photography Display.
Abstract
Integrated photography display is a commonly used technology to provide users 3D videos with horizontal and vertical parallaxes. However, 3D video contents under natural scenes are very scarce and many existing methods can only provide parallaxes in one direction using binocular cameras. In this work, we set up an end-to-end real-time virtual view synthesis system for integrated photography display, in which 64 views (4 real views and 60 virtual views) can be synthesized using only 4 cameras placed in a rectangle. This paper mainly makes two contributions. Firstly, we propose a new method of polar alignment for two-dimensional camera placement (2 x 2), which aligns horizontal and vertical polar lines at the same time and preserves the effective area of the final image as large as possible after clipping. Secondly, in the process of virtual view synthesis, we introduce an accelerated strategy by combining CPU thread-level parallelism and GPU data-level parallelism to make full use of the computing resources. Experimental results show that our system can capture 4-way 480P video sequences under natural scenes, synthesize 64-way views and render the resulting 4K video combined from 64-way views on a 3D monitor in real-time.
Year
DOI
Venue
2018
10.1007/978-3-030-00776-8_23
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I
Keywords
Field
DocType
Image-Domain-Warping (IDW),Graphics Processing Unit (GPU),Polar alignment,Real-time,Virtual view synthesis
480p,Computer vision,Horizontal and vertical,End-to-end principle,Computer science,Rectangle,Polar alignment,View synthesis,Photography,Artificial intelligence,Integral photography
Conference
Volume
ISSN
Citations 
11164
0302-9743
0
PageRank 
References 
Authors
0.34
13
4
Name
Order
Citations
PageRank
Shenghao Zhang100.68
Wang Zhenyu2126.10
Mingtong Zhu300.34
Ronggang Wang413436.57