Title
Performance capture of interacting characters with handheld kinects
Abstract
We present an algorithm for marker-less performance capture of interacting humans using only three hand-held Kinect cameras. Our method reconstructs human skeletal poses, deforming surface geometry and camera poses for every time step of the depth video. Skeletal configurations and camera poses are found by solving a joint energy minimization problem which optimizes the alignment of RGBZ data from all cameras, as well as the alignment of human shape templates to the Kinect data. The energy function is based on a combination of geometric correspondence finding, implicit scene segmentation, and correspondence finding using image features. Only the combination of geometric and photometric correspondences and the integration of human pose and camera pose estimation enables reliable performance capture with only three sensors. As opposed to previous performance capture methods, our algorithm succeeds on general uncontrolled indoor scenes with potentially dynamic background, and it succeeds even if the cameras are moving.
Year
DOI
Venue
2012
10.1007/978-3-642-33709-3_59
ECCV (2)
Keywords
Field
DocType
hand-held kinect camera,human skeletal,kinect data,previous performance capture method,marker-less performance capture,human shape template,interacting character,rgbz data,interacting human,handheld kinects,reliable performance capture,correspondence finding
Motion capture,Computer vision,Surface geometry,Computer science,Feature (computer vision),Pose,Mobile device,Artificial intelligence,Point cloud,Scene segmentation,Energy minimization
Conference
Volume
ISSN
Citations 
7573
0302-9743
43
PageRank 
References 
Authors
1.29
25
6
Name
Order
Citations
PageRank
Genzhi Ye1531.81
Yebin Liu268849.05
Nils Hasler327211.28
Xiangyang Ji453373.14
Qionghai Dai53904215.66
Christian Theobalt63211159.16