Paper Info
Title
Enabling Multimodal Human–Robot Interaction for the Karlsruhe Humanoid Robot
Abstract
In this paper, we present our work in building technologies for natural multimodal human-robot interaction. We present our systems for spontaneous speech recognition, multimodal dialogue processing, and visual perception of a user, which includes localization, tracking, and identification of the user, recognition of pointing gestures, as well as the recognition of a person's head orientation. Each of the components is described in the paper and experimental results are presented. We also present several experiments on multimodal human-robot interaction, such as interaction using speech and gestures, the automatic determination of the addressee during human-human-robot interaction, as well on interactive learning of dialogue strategies. The work and the components presented here constitute the core building blocks for audiovisual perception of humans and multimodal human-robot interaction used for the humanoid robot developed within the German research project (Sonderforschungsbereich) on humanoid cooperative robots.
Year
DOI
Venue
2007
10.1109/TRO.2007.907484
IEEE Transactions on Robotics
Keywords
Field
DocType
Humanoid robots,Human robot interaction,Speech recognition,Nickel,Automatic speech recognition,Legged locomotion,Interactive systems,Laboratories,Mobile robots,Visual perception
Speech processing,Gesture,Computer science,Gesture recognition,Control engineering,Human–computer interaction,Artificial intelligence,Robotics,Human–robot interaction,Humanoid robot,Multimodal interaction,Computer vision,User interface
Journal
Volume
Issue
ISSN
23
5
1552-3098
Citations 
PageRank 
References 
54
2.42
37
Authors
9
Name
Order
Citations
PageRank
Rainer Stiefelhagen13512274.86
H. K. Ekenel2988.69
C. Fugen3542.42
P. Gieselmann4602.92
H. Holzapfel5542.42
F. Kraft6542.42
Kai Nickel761037.67
M. Voit8674.60
Alex Waibel963431980.68