Title
Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone
Abstract
PACER is a gesture-based interactive paper system that supports fine-grained paper document content manipulation through the touch screen of a cameraphone. Using the phone's camera, PACER links a paper document to its digital version based on visual features. It adopts camera-based phone motion detection for embodied gestures (e.g. marquees, underlines and lassos), with which users can flexibly select and interact with document details (e.g. individual words, symbols and pixels). The touch input is incorporated to facilitate target selection at fine granularity, and to address some limitations of the embodied interaction, such as hand jitter and low input sampling rate. This hybrid interaction is coupled with other techniques such as semi-real time document tracking and loose physical-digital document registration, offering a gesture-based command system. We demonstrate the use of PACER in various scenarios including work-related reading, maps and music score playing. A preliminary user study on the design has produced encouraging user feedback, and suggested future research for better understanding of embodied vs. touch interaction and one vs. two handed interaction.
Year
DOI
Venue
2010
10.1145/1753326.1753696
CHI
Keywords
Field
DocType
touch screen,document detail,touch interaction,hybrid interaction,semi-real time document tracking,fine-grained paper document content,gesture-based interactive paper system,loose physical-digital document registration,camera-touch hybrid gesture,cell phone,touch input,fine-grained interactive paper,paper document,real time,touch,gesture
Computer vision,Motion detection,Gesture,Computer science,Embodied cognition,Human–computer interaction,Phone,Pixel,Artificial intelligence,Jitter,Multimedia,Paper document
Conference
Citations 
PageRank 
References 
30
1.29
26
Authors
4
Name
Order
Citations
PageRank
Chunyuan Liao168447.57
Qiong Liu2624.28
Bee Liew3593.84
Lynn Wilcox41330180.16