Paper Info
Title
Fishing or a Z?: investigating the effects of error on mimetic and alphabet device-based gesture interaction
Abstract
While gesture taxonomies provide a classification of device-based gestures in terms of communicative intent, little work has addressed the usability differences in manually performing these gestures. In this primarily qualitative study, we investigate how two sets of iconic gestures that vary in familiarity, mimetic and alphabetic, are affected under varying failed recognition error rates (0-20%, 20-40%, 40-60%). Drawing on experiment logs, video observations, subjects' feedback, and a subjective workload assessment questionnaire, results revealed two main findings: a) mimetic gestures tend to evolve into diverse variations (within the activities they mimic) under high error rates, while alphabet gestures tend to become more rigid and structured and b) mimetic gestures were tolerated under recognition error rates of up to 40%, while alphabet gestures incur significant overall workload with up to only 20% error rates. Thus, while alphabet gestures are more robust to recognition errors in keeping their signature, mimetic gestures are more robust to recognition errors from a usability and user experience standpoint, and thus better suited for inclusion into mainstream device-based gesture interaction with mobile phones.
Year
DOI
Venue
2012
10.1145/2388676.2388701
ICMI
Keywords
Field
DocType
iconic gesture,recognition error rate,mimetic gesture,mainstream device-based gesture interaction,error rate,alphabet device-based gesture interaction,alphabet gesture,recognition error,gesture taxonomy,device-based gesture,high error rate,usability
Computer vision,User experience design,Gesture,Computer science,Workload,Usability,Gesture recognition,Speech recognition,Human–computer interaction,Artificial intelligence,Alphabet
Conference
Citations 
PageRank 
References 
1
0.35
15
Authors
3
Name
Order
Citations
PageRank
Abdallah El Ali17817.55
Johan Kildal228619.86
Vuokko Lantz333320.79