Title
Proton: multitouch gestures as regular expressions
Abstract
Current multitouch frameworks require application developers to write recognition code for custom gestures; this code is split across multiple event-handling callbacks. As the number of custom gestures grows it becomes increasingly difficult to 1) know if new gestures will conflict with existing gestures, and 2) know how to extend existing code to reliably recognize the complete gesture set. Proton is a novel framework that addresses both of these problems. Using Proton, the application developer declaratively specifies each gesture as a regular expression over a stream of touch events. Proton statically analyzes the set of gestures to report conflicts, and it automatically creates gesture recognizers for the entire set. To simplify the creation of complex multitouch gestures, Proton introduces gesture tablature, a graphical notation that concisely describes the sequencing of multiple interleaved touch actions over time. Proton contributes a graphical editor for authoring tablatures and automatically compiles tablatures into regular expressions. We present the architecture and implementation of Proton, along with three proof-of-concept applications. These applications demonstrate the expressiveness of the framework and show how Proton simplifies gesture definition and conflict resolution.
Year
DOI
Venue
2012
10.1145/2207676.2208694
CHI
Keywords
Field
DocType
complex multitouch gesture,entire set,gesture tablature,gesture recognizers,proton simplifies gesture definition,proton statically,complete gesture set,regular expression,custom gesture,new gesture,application development,conflict resolution,regular expressions,proof of concept
Tablature,Regular expression,Notation,Gesture,Computer science,Conflict resolution,Gesture recognition,Callback,Human–computer interaction,Multimedia,Expressivity
Conference
Citations 
PageRank 
References 
50
1.75
27
Authors
4
Name
Order
Citations
PageRank
Kenrick Kin12067.45
Bjorn-Oliver Hartmann23151177.43
Tony DeRose31152136.22
Maneesh Agrawala45192333.08