Title
Online optical marker-based hand tracking with deep labels.
Abstract
Optical marker-based motion capture is the dominant way for obtaining high-fidelity human body animation for special effects, movies, and video games. However, motion capture has seen limited application to the human hand due to the difficulty of automatically identifying (or labeling) identical markers on self-similar fingers. We propose a technique that frames the labeling problem as a keypoint regression problem conducive to a solution using convolutional neural networks. We demonstrate robustness of our labeling solution to occlusion, ghost markers, hand shape, and even motions involving two hands or handheld objects. Our technique is equally applicable to sparse or dense marker sets and can run in real-time to support interaction prototyping with high-fidelity hand tracking and hand presence in virtual reality.
Year
DOI
Venue
2018
10.1145/3197517.3201399
ACM Trans. Graph.
Keywords
Field
DocType
hand tracking, marker labeling, motion capture
Motion capture,Computer vision,Computer graphics (images),Computer science,Tracking system,Robustness (computer science),Artificial intelligence
Journal
Volume
Issue
ISSN
37
4
0730-0301
Citations 
PageRank 
References 
9
0.54
19
Authors
6
Name
Order
Citations
PageRank
Shangchen Han1120.99
Beibei Liu2111.25
Robert Y. Wang354426.88
Yuting Ye417910.18
Christopher D. Twigg591.56
Kenrick Kin6120.99