Name
Title | ||
|---|---|---|
Improvement of multimodal gesture and speech recognition performance using time intervals between gestures and accompanying speech. |
Abstract | ||
|---|---|---|
We propose an integrative method of recognizing gestures such as pointing, accompanying speech. Speech generated simultaneously with gestures can assist in the recognition of gestures, and since this occurs in a complementary manner, gestures can also assist in the recognition of speech. Our integrative recognition method uses a probability distribution which expresses the distribution of the time interval between the starting times of gestures and of the corresponding utterances. We evaluate the rate of improvement of the proposed integrative recognition method with a task involving the solution of a geometry problem. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1186/1687-4722-2014-2 | EURASIP J. Audio, Speech and Music Processing |
Keywords | Field | DocType |
Speech Recognition, Recognition Performance, Gesture Recognition, Prosodic Feature, Candidate Pair | Speech processing,Computer science,Gesture,Gesture recognition,Speech recognition,Probability distribution,Speech recognition performance | Journal |
Volume | Issue | ISSN |
2014 | 1 | 1687-4722 |
Citations | PageRank | References |
4 | 0.43 | 15 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Madoka Miki | 1 | 9 | 1.02 |
| Norihide Kitaoka | 2 | 277 | 43.70 |
| Chiyomi Miyajima | 3 | 345 | 45.71 |
| Takanori Nishino | 4 | 38 | 9.13 |
| Kazuya Takeda | 5 | 1301 | 195.60 |