Title
3D Live: Real Time Captured Content for Mixed Reality
Abstract
We present a complete system for live capture of 3D content and simultaneous presentation in augmented reality. The user sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. Fifteen cameras surround the collaborator, and the resulting video streams are used to construct a three-dimensional model of the subject using a shape-from-silhouette algorithm. Users view a two-dimensional fiducial marker using a video-see-through augmented reality interface. The geometric relationship between the marker and head-mounted camera is calculated, and the equivalent view of the subject is computed and drawn into the scene. Our system can generate 384 × 288 pixel images of the models at 25 fps, with a latency of < 100 ms. The result gives the strong impression that the subject is a real part of the 3D scene. We demonstrate applications of this system in 3D videoconferencing and entertainment.
Year
DOI
Venue
2002
10.1109/ISMAR.2002.1115062
ISMAR
Keywords
DocType
ISBN
remote collaborator,fifteen camera,augmented reality,mixed reality,two-dimensional fiducial marker,real time captured content,video-conferencing.,complete system,shape-from- silhouette,3-d reconstruction,video-see-through augmented reality interface,equivalent view,head-mounted camera,3-d content,geometric relationship,layout,pixel,virtual reality,video conferencing,teleconferencing,three dimensional,real time,collaboration
Conference
0-7695-1781-1
Citations 
PageRank 
References 
44
3.08
20
Authors
7
Name
Order
Citations
PageRank
Simon Prince191460.61
Adrian David Cheok22233254.03
Farzam Farbiz347552.46
Todd Williamson4777.07
Nikolas Johnson5777.07
Mark Billinghurst65357542.78
Hirokazu Kato7106688.02