Name
Title | ||
|---|---|---|
Multimodal classification of dance movements using body joint trajectories and step sounds |
Abstract | ||
|---|---|---|
We present a multimodal approach to recognize isolated complex human body movements, namely Salsa dance steps. Our system exploits motion features extracted from 3D sub-trajec-tories of dancers' body-joints (deduced from Kinect depth-map sequences) using principal component analysis (PCA). These sub-trajectories are obtained thanks to a footstep impact detection module (from recordings of piezoelectric sensors installed on the dance floor). Two alternative classifiers are tested with the resulting PCA features, namely Gaussian mixture models and hidden Markov models (HMM). Our experiments on a multimodal Salsa dataset show that our approach is superior to a more traditionnal method. Using HMM classifiers with three hidden states, our system achieves a classification performance of 74% in F-measure when recognizing gestures among six possible classes, which outperforms the reference method by 11 percentage points. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1109/WIAMIS.2013.6616151 | Image Analysis for Multimedia Interactive Services |
Keywords | Field | DocType |
feature extraction,gesture recognition,hidden Markov models,humanities,image segmentation,motion estimation,principal component analysis,3D subtrajectories,Gaussian mixture models,HMM classifiers,Salsa dance steps,body joint trajectories,dance movements,footstep impact detection module,hidden Markov models,isolated complex human body movements,kinect depth map sequences,motion features,multimodal classification,piezoelectric sensors,principal component analysis,step sounds | Computer science,Gesture recognition,Image segmentation,Artificial intelligence,Motion estimation,Computer vision,Dance,Pattern recognition,Feature extraction,Speech recognition,Hidden Markov model,Mixture model,Principal component analysis | Conference |
ISSN | Citations | PageRank |
2158-5873 | 6 | 0.49 |
References | Authors | |
6 | 3 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Aymeric Masurelle | 1 | 6 | 0.83 |
| Slim Essid | 2 | 212 | 32.00 |
| Gaël Richard | 3 | 1220 | 110.40 |