Title
Closing the Loop: Towards Tightly Synchronized Robot Gesture and Speech
Abstract
To engage in natural interactions with humans, social robots should produce speech-accompanying non-verbal behaviors such as hand and arm gestures. Given the special constraints imposed by the physical properties of a humanoid robot, successful multimodal synchronization is difficult to achieve. Introducingätheäfirstäclosed-loopäapproachätoäspeech and gesture generation for humanoid robots, we propose a multimodal scheduler for improved synchronization based on two novel features, namely an experimentally fitted forward model and a feedback-based adaptation mechanism. Technical results obtained with the implemented scheduler demonstrate the feasibility of our approach; empirical results from an evaluation study highlight the implications of the present work.
Year
DOI
Venue
2013
10.1007/978-3-319-02675-6_38
ICSR
Keywords
Field
DocType
multimodal interaction and conversational skills,robot gesture,social human-robot interaction,speech-gesture synchrony
Social robot,Synchronization,Gesture,Computer science,Simulation,Human–computer interaction,Robot,Humanoid robot
Conference
Volume
ISSN
Citations 
8239
0302-9743
1
PageRank 
References 
Authors
0.35
9
3
Name
Order
Citations
PageRank
Maha Salem121713.30
Stefan Kopp270158.13
Frank Joublin326123.99