Name
Title | ||
|---|---|---|
Silhouette-based gesture and action recognition via modeling trajectories on Riemannian shape manifolds |
Abstract | ||
|---|---|---|
This paper addresses the problem of recognizing human gestures from videos using models that are built from the Riemannian geometry of shape spaces. We represent a human gesture as a temporal sequence of human poses, each characterized by a contour of the associated human silhouette. The shape of a contour is viewed as a point on the shape space of closed curves and, hence, each gesture is characterized and modeled as a trajectory on this shape space. We propose two approaches for modeling these trajectories. In the first template-based approach, we use dynamic time warping (DTW) to align the different trajectories using elastic geodesic distances on the shape space. The gesture templates are then calculated by averaging the aligned trajectories. In the second approach, we use a graphical model approach similar to an exemplar-based hidden Markov model, where we cluster the gesture shapes on the shape space, and build non-parametric statistical models to capture the variations within each cluster. We model each gesture as a Markov model of transitions between these clusters. To evaluate the proposed approaches, an extensive set of experiments was performed using two different data sets representing gesture and action recognition applications. The proposed approaches not only are successfully able to represent the shape and dynamics of the different classes for recognition, but are also robust against some errors resulting from segmentation and background subtraction. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1016/j.cviu.2010.10.006 | Computer Vision and Image Understanding |
Keywords | Field | DocType |
human gesture,gesture template,human silhouette,shape space,exemplar-based hidden markov model,markov model,action recognition,gesture recognition,riemannian shape manifold,silhouette-based approaches,non-parametric statistical model,silhouette-based gesture,riemannian manifolds,graphical model approach,different class,graphical model,hidden markov model,geodesic distance,non parametric statistics,riemannian geometry,dynamic time warping,background subtraction | Background subtraction,Computer vision,Dynamic time warping,Pattern recognition,Silhouette,Gesture recognition,Artificial intelligence,Graphical model,Hidden Markov model,Riemannian geometry,Mathematics,Manifold | Journal |
Volume | Issue | ISSN |
115 | 3 | Computer Vision and Image Understanding |
Citations | PageRank | References |
42 | 1.27 | 44 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Mohamed F. Abdelkader | 1 | 76 | 4.24 |
| Wael Abd-Almageed | 2 | 248 | 24.52 |
| Anuj Srivastava | 3 | 2853 | 199.47 |
| Chellappa, R. | 4 | 13050 | 1440.56 |