Title
MixIn3D: 3D Mixed Reality with ToF-Camera
Abstract
This work discusses an approach to seamlessly integrate real and virtual scene content by on-the-fly 3D scene modeling and dynamic scene interaction. The key element is a ToF-depth camera, accompanied by color cameras, mounted on a pan-tilt head. The system allows to scan the environment for easy 3D reconstruction, and will track and model dynamically moving objects like human actors in 3D. This allows to compute mutual occlusions between real and virtual objects and correct light and shadow generation with mutual light interaction. No dedicated studio is required, as virtually any room can be turned into a virtual studio with this approach. Since the complete process operates in 3D and produces consistent color and depth sequences, this system can be used for full 3D TV production.
Year
DOI
Venue
2009
10.1007/978-3-642-03778-8_10
Dyn3D
Keywords
Field
DocType
consistent color,mixed reality,scene modeling,virtual scene content,dynamic scene interaction,color camera,virtual studio,mutual light interaction,correct light,virtual object,dedicated studio,3d reconstruction
Computer vision,Shadow,Computer graphics (images),Studio,Artificial intelligence,Mixed reality,Engineering,Virtual studio,3D reconstruction
Conference
Volume
ISSN
Citations 
5742
0302-9743
8
PageRank 
References 
Authors
0.54
19
5
Name
Order
Citations
PageRank
Reinhard Koch12038170.17
Ingo Schiller21199.74
Bogumil Bartczak310110.74
Falko Kellner4382.26
Kevin Köser528215.05