Title
Gesture Knitter: A Hand Gesture Design Tool for Head-Mounted Mixed Reality Applications
Abstract
ABSTRACT Hand gestures are a natural and expressive input method enabled by modern mixed reality headsets. However, it remains challenging for developers to create custom gestures for their applications. Conventional strategies to bespoke gesture recognition involve either hand-crafting or data-intensive deep-learning. Neither approach is well suited for rapid prototyping of new interactions. This paper introduces a flexible and efficient alternative approach for constructing hand gestures. We present Gesture Knitter: a design tool for creating custom gesture recognizers with minimal training data. Gesture Knitter allows the specification of gesture primitives that can then be combined to create more complex gestures using a visual declarative script. Designers can build custom recognizers by declaring them from scratch or by providing a demonstration that is automatically decoded into its primitive components. Our developer study shows that Gesture Knitter achieves high recognition accuracy despite minimal training data and delivers an expressive and creative design experience.
Year
DOI
Venue
2021
10.1145/3411764.3445766
Conference on Human Factors in Computing Systems
DocType
Citations 
PageRank 
Conference
1
0.35
References 
Authors
0
3
Name
Order
Citations
PageRank
George B. Mo110.35
John J. Dudley2175.35
Per Ola Kristensson3131791.21