Title
Leveraging Dual-Observable Input for Fine-Grained Thumb Interaction Using Forearm EMG.
Abstract
We introduce the first forearm-based EMG input system that can recognize fine-grained thumb gestures, including left swipes, right swipes, taps, long presses, and more complex thumb motions. EMG signals for thumb motions sensed from the forearm are quite weak and require significant training data to classify. We therefore also introduce a novel approach for minimally-intrusive collection of labeled training data for always-available input devices. Our dual-observable input approach is based on the insight that interaction observed by multiple devices allows recognition by a primary device (e.g., phone recognition of a left swipe gesture) to create labeled training examples for another (e.g., forearm-based EMG data labeled as a left swipe). We implement a wearable prototype with dry EMG electrodes, train with labeled demonstrations from participants using their own phones, and show that our prototype can recognize common fine-grained thumb gestures and user-defined complex gestures.
Year
DOI
Venue
2015
10.1145/2807442.2807506
UIST
Keywords
Field
DocType
Always-Available Interaction, Dual-Observable Input, EMG
Training set,Thumb,Gesture,Wearable computer,Computer science,Speech recognition,SwIPe,Forearm,Input device
Conference
Citations 
PageRank 
References 
5
0.43
18
Authors
5
Name
Order
Citations
PageRank
Donny Huang1321.62
Xiaoyi Zhang2202.73
T. Scott Saponas375843.73
James Fogarty42343164.17
Shyamnath Gollakota52788150.48