Name
Abstract | ||
|---|---|---|
Communicative hand gestures play important roles in face-to-face conversations. These gestures are arbitrarily used depending on an individual; even when two speakers narrate the same story, they do not always use the same hand gesture (movement, position, and motion trajectory) to describe the same scene. In this paper, we propose a framework for the classification of communicative gestures in small group interactions. We focus on how many times the hands are held in a gesture and how long a speaker continues a hand stroke, instead of observing hand positions and hand motion trajectories. In addition, to model communicative gesture patterns, we use nonverbal features of participants addressed from participant gestures. In this research, we extract features of gesture phases defined by Kendon (2004) and co-occurring nonverbal patterns with gestures, i.e., utterance, head gesture, and head direction of each participant, by using pattern recognition techniques. In the experiments, we collect eight group narrative interaction datasets to evaluate the classification performance. The experimental results show that gesture phase features and nonverbal features of other participants improves the performance to discriminate communicative gestures that are used in narrative speeches and other gestures from 4% to 16%. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1145/2522848.2522898 | ICMI |
Keywords | Field | DocType |
gesture phase,communicative gesture pattern,participant gesture,nonverbal feature,discriminate communicative gesture,communicative gesture,hand gesture,communicative hand gesture,head gesture,gesture phase feature,context-based conversational hand gesture,narrative interaction | Computer vision,Computer science,Context based,Gesture,Gesture recognition,Utterance,Conversation analysis,Speech recognition,Nonverbal communication,Narrative,Artificial intelligence,Gesture classification | Conference |
Citations | PageRank | References |
6 | 0.78 | 19 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Shogo Okada | 1 | 101 | 20.10 |
| Mayumi Bono | 2 | 13 | 4.66 |
| Katsuya Takanashi | 3 | 49 | 13.40 |
| Yasuyuki Sumi | 4 | 389 | 65.44 |
| Katsumi Nitta | 5 | 160 | 44.94 |