Title
An integrated 6DoF video camera and system design
Abstract
Designing a fully integrated 360° video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our paper is the first to describe a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering 1.
Year
DOI
Venue
2019
10.1145/3355089.3356555
ACM Transactions on Graphics (TOG)
Keywords
Field
DocType
6DoF, video stitching
Computer vision,Systems design,Artificial intelligence,Video camera,Mathematics
Journal
Volume
Issue
ISSN
38
6
0730-0301
Citations 
PageRank 
References 
4
0.41
0
Authors
8
Name
Order
Citations
PageRank
Albert Parra Pozo140.41
Michael Toksvig2171.23
Terry Filiba Schrager340.41
Joyce Hsu440.41
Uday Mathur540.41
Alexander Hornung6132659.29
Richard Szeliski7213002104.74
Brian Cabral840.75