Name
Abstract | ||
|---|---|---|
Real-time full-body tracking in VR is important for providing realistic experiences, especially for applications such as training, education, and social VR. The Microsoft Kinect v2 sensor can provide skeleton data for a user in real-time, however, due to occlusion issues and front/back ambiguity errors, one Kinect is not always reliable enough for the correct capture of 360-degree movements. In this paper, we present work to provide robust, real-time tracking using multiple Kinect v2 cameras. An adaptive data fusion method is described that constructs a high-quality 3D skeleton which can be used to drive a VR avatar regardless of the user's orientation. We compare three different approaches to fusing the data from the three Kinects, and compare against ground truth using an OptiTrack system. A static pose and a dynamic movement were captured to compare errors of each joint using the three fusion algorithms. Our results show that an adaptive weighting adjustment fusion method for combining skeleton data from the three Kinects according to the current facing direction performed best in terms of joint error. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/VS-Games.2018.8493443 | 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games) |
Keywords | Field | DocType |
robust 3D skeleton tracking,multiple depth sensors,full-body tracking,skeleton data,robust time tracking,adaptive data fusion method,high-quality 3D skeleton,VR avatar,adaptive weighting adjustment fusion method,Microsoft Kinect v2 sensor,Kinect v2 cameras,OptiTrack system | Data integration,Computer vision,Adaptive weighting,Computer science,Sensor fusion,Ground truth,Artificial intelligence,Skeleton (computer programming),Ambiguity,Avatar,Calibration | Conference |
ISSN | ISBN | Citations |
2474-0470 | 978-1-5386-7124-5 | 0 |
PageRank | References | Authors |
0.34 | 0 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yuanjie Wu | 1 | 1 | 0.68 |
| Lei Gao | 2 | 21 | 8.60 |
| Simon Hoermann | 3 | 54 | 13.53 |
| Robert W. Lindeman | 4 | 739 | 108.93 |