Title
Data miming: inferring spatial object descriptions from human gesture
Abstract
Speakers often use hand gestures when talking about or describing physical objects. Such gesture is particularly useful when the speaker is conveying distinctions of shape that are difficult to describe verbally. We present data miming---an approach to making sense of gestures as they are used to describe concrete physical objects. We first observe participants as they use gestures to describe real-world objects to another person. From these observations, we derive the data miming approach, which is based on a voxel representation of the space traced by the speaker's hands over the duration of the gesture. In a final proof-of-concept study, we demonstrate a prototype implementation of matching the input voxel representation to select among a database of known physical objects.
Year
DOI
Venue
2011
10.1145/1978942.1979060
CHI
Keywords
Field
DocType
human gesture,present data,physical object,input voxel representation,voxel representation,final proof-of-concept study,real-world object,prototype implementation,concrete physical object,hand gesture,spatial object description,gestures,proof of concept
Voxel,Computer science,Gesture,Human–computer interaction,Natural language processing,Artificial intelligence,3D modeling
Conference
Citations 
PageRank 
References 
26
1.38
24
Authors
2
Name
Order
Citations
PageRank
Christian Holz187856.58
Andrew D. Wilson25065362.19