Title
Surface Electromyography-based Gesture Recognition by Multi-view Deep Learning.
Abstract
Gesture recognition using sparse multichannel Surface Electromyography (sEMG) is a challenging problem, and the solutions are far from optimal from the point of view of Muscle-Computer Interface (MCI). In this work, we address this problem from the context of multi-view deep learning. A novel multi-view Convolutional Neural Network (CNN) framework is proposed by combining classical sEMG feature sets with a CNN-based deep learning model. The framework consists of two parts. In the first part, multi-view representations of sEMG are modeled in parallel by a multistream CNN, and a performance-based view construction strategy is proposed to choose the most discriminative views from classical feature sets for sEMG-based gesture recognition. In the second part, the learned multi-view deep features are fused through a view aggregation network composed of early and late fusion subnetworks, taking advantage of both early and late fusion of learned multi-view deep features. Evaluations on 11 sparse multichannel sEMG databases as well as 5 databases with both sEMG and Inertial Measurement Unit(IMU) data demonstrate that our multi-view framework outperforms singleview methods on both unimodal and multimodal sEMG data streams.
Year
DOI
Venue
2019
10.1109/TBME.2019.2899222
IEEE transactions on bio-medical engineering
Keywords
Field
DocType
Gesture recognition,Deep learning,Feature extraction,Databases,Electromyography,Human computer interaction,Discrete wavelet transforms
Computer vision,Data stream mining,Pattern recognition,Computer science,Convolutional neural network,Gesture recognition,Feature extraction,Artificial intelligence,Inertial measurement unit,Deep learning,Discriminative model
Journal
Volume
Issue
ISSN
66
10
1558-2531
Citations 
PageRank 
References 
5
0.43
0
Authors
6
Name
Order
Citations
PageRank
Wentao Wei1342.36
Qingfeng Dai250.43
Yongkang Wong337729.30
Yu Hu453776.69
Mohan Kankanhalli53825299.56
weidong671.51