Title
Learning to interpret pointing gestures with a time-of-flight camera
Abstract
Pointing gestures are a common and intuitive way to draw somebody's attention to a certain object. While humans can easily interpret robot gestures, the perception of human behavior using robot sensors is more difficult. In this work, we propose a method for perceiving pointing gestures using a Time-of-Flight (ToF) camera. To determine the intended pointing target, frequently the line between a person's eyes and hand is assumed to be the pointing direction. However, since people tend to keep the line-of-sight free while they are pointing, this simple approximation is inadequate. Moreover, depending on the distance and angle to the pointing target, the line between shoulder and hand or elbow and hand may yield better interpretations of the pointing direction. In order to achieve a better estimate, we extract a set of body features from depth and amplitude images of a ToF camera and train a model of pointing directions using Gaussian Process Regression. We evaluate the accuracy of the estimated pointing direction in a quantitative study. The results show that our learned model achieves far better accuracy than simple criteria like head-hand, shoulder-hand, or elbow-hand line.
Year
DOI
Venue
2011
10.1145/1957656.1957822
HRI
Keywords
Field
DocType
pointing gesture interpretation,head-hand line,elbow-hand line,better estimate,tof camera,robot gesture,simple approximation,learning (artificial intelligence),human-robot interaction,regression analysis,body feature extraction,amplitude images,simple criterion,gaussian process regression,feature extraction,robot sensor,cameras,time-of-flight camera,depth images,pointing direction estimation,gaussian processes,robot sensors,better accuracy,human behavior perception,gesture recognition,shoulder-hand line,learning,better interpretation,robot vision,head,human robot interaction,human behavior,time of flight
Computer vision,Robotic sensing,Computer science,Simulation,Gesture,Gesture recognition,Time-of-flight camera,Artificial intelligence,Robot vision systems,Robot,Perception,Human–robot interaction
Conference
ISSN
ISBN
Citations 
2167-2121 E-ISBN : 978-1-4503-0561-7
978-1-4503-0561-7
34
PageRank 
References 
Authors
1.25
16
3
Name
Order
Citations
PageRank
David Droeschel129221.76
Jörg Stückler262446.80
Sven Behnke31672181.84