Title
A Framework for Collaborative Real-Time 3D Teleimmersion in a Geographically Distributed Environment
Abstract
In this paper, we present a framework for immersive 3D video conferencing and geographically distributed collaboration. Our multi-camera system performs a full-body 3D reconstruction of users in real time and renders their image in a virtual space allowing remote interaction between users and the virtual environment. The paper features an overview of the technology and algorithms used for calibration, capturing, and reconstruction. We introduce stereo mapping using adaptive triangulation which allows for fast (under 25 ms) and robust real-time 3D reconstruction. The chosen representation of the data provides high compression ratios for transfer to a remote site. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the user. We have successfully demonstrated the use of our system in various applications such as remote dancing and immersive Tai Chi learning.
Year
DOI
Venue
2008
10.1109/ISM.2008.32
ISM
Keywords
Field
DocType
collaborative real-time,remote site,dense point cloud,virtual space,multi-camera system,adaptive triangulation,remote dancing,remote interaction,chosen representation,virtual environment,immersive tai chi learning,3d reconstruction,data compression,image reconstruction,real time,distributed processing,point cloud,virtual reality,compression ratio,solid modeling,system performance,teleconferencing,calibration,real time systems
Computer vision,Virtual machine,Teleconference,Virtual reality,Distributed Computing Environment,Computer graphics (images),Computer science,Artificial intelligence,Point cloud,Rendering (computer graphics),Data compression,3D reconstruction
Conference
Citations 
PageRank 
References 
16
1.38
16
Authors
4
Name
Order
Citations
PageRank
Gregorij Kurillo149434.71
Ramanarayan Vasudevan221728.16
Edgar J. Lobaton323724.38
Ruzena Bajcsy43621869.56