Paper Info
Title
Visual cues-based anticipation for percussionist-robot interaction
Abstract
Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We study the case in which a human percussionist is playing a four-piece percussion set, and a robot musician is playing either the marimba, or a three-piece percussion set. Computer Vision is used to embed anticipation in the robotic response to the human gestures. We developed two algorithms for anticipation, predicting the strike location about 10 mili-seconds or about 100 mili-seconds before it occurs. Using the second algorithm, we show that the robot outperforms, on average, a group of human subjects, in synchronizing its gesture with a reference strike. We also show that, in the tested group of users, having some time in advance is important for a human to synchronize the strike with a reference player, but, from a certain time, that good influence stops increasing.
Year
DOI
Venue
2012
10.1145/2157689.2157713
HRI
Keywords
Field
DocType
visual cues-based anticipation,human gesture,group performance,visual gesture anticipation,embed anticipation,human subject,percussionist-robot interaction,certain time,reference strike,robot musician,human percussionist,robot kinematics,acceleration,computer vision,human robot interaction,visual cues,visualization,synchronization,human interaction
Sensory cue,Synchronization,Gesture,Visualization,Simulation,Anticipation,Computer science,Robot kinematics,Human–computer interaction,Robot,Human–robot interaction
Conference
ISSN
Citations 
PageRank 
2167-2121
3
0.42
References 
Authors
4
3
Name
Order
Citations
PageRank
Marcelo Cicconet1287.08
Mason Bretan292.93
Gil Weinberg334642.27