Abstract | ||
---|---|---|
Designing a fully integrated 360° video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our paper is the first to describe a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering 1.
|
Year | DOI | Venue |
---|---|---|
2019 | 10.1145/3355089.3356555 | ACM Transactions on Graphics (TOG) |
Keywords | Field | DocType |
6DoF, video stitching | Computer vision,Systems design,Artificial intelligence,Video camera,Mathematics | Journal |
Volume | Issue | ISSN |
38 | 6 | 0730-0301 |
Citations | PageRank | References |
4 | 0.41 | 0 |
Authors | ||
8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Albert Parra Pozo | 1 | 4 | 0.41 |
Michael Toksvig | 2 | 17 | 1.23 |
Terry Filiba Schrager | 3 | 4 | 0.41 |
Joyce Hsu | 4 | 4 | 0.41 |
Uday Mathur | 5 | 4 | 0.41 |
Alexander Hornung | 6 | 1326 | 59.29 |
Richard Szeliski | 7 | 21300 | 2104.74 |
Brian Cabral | 8 | 4 | 0.75 |