Title
Voice and gesture recognition system facilitating Communication between man and virtual agent
Abstract
In this research, a dialog environment between human and virtual environment has been constructed. At preset, if a person wants to interact with virtual environment, special device such a data glove is required, but it makes difficult for general users to manipulate virtual objects. When we cannot manipulate objects directly, it is natural that we ask someone with a privilege to do the operation in place of us. In the case, it is convenient if methods used in daily life are allowed. That is, the method to be proposed here is based on the integration between verbal information through the utterances and non-verbal information by the gestures such as finger pointing. The experimental results have proved the effectiveness of this approach in terms of facilitating man-machine interaction and communication. The environment constructed in this research allows a user to communicate by talking and showing gestures to a personified agent in virtual environment. A user can use his/her finger to point at a virtual object and ask him to manipulate it.
Year
DOI
Venue
2006
10.1109/AINA.2006.347
AINA (2)
Keywords
DocType
ISBN
virtual agent,verbal information,data glove,man-machine interaction,daily life,virtual object,general user,virtual environment,gesture recognition system,non-verbal information,dialog environment,gesture recognition,speech recognition,helium
Conference
0-7695-2466-4-02
Citations 
PageRank 
References 
3
0.80
0
Authors
7
Name
Order
Citations
PageRank
Tatsuya YOSHIKAWA1101.93
Norihiro Abe28935.38
Hirokazu Taki311037.03
Shoujie He4299.59
Shunji UCHINO531.81
Kazuaki Tanaka69017.79
Tetsuya Yagi714027.73