Title
RichReview: blending ink, speech, and gesture to support collaborative document review
Abstract
This paper introduces a novel document annotation system that aims to enable the kinds of rich communication that usually only occur in face-to-face meetings. Our system, RichReview, lets users create annotations on top of digital documents using three main modalities: freeform inking, voice for narration, and deictic gestures in support of voice. RichReview uses novel visual representations and time-synchronization between modalities to simplify annotation access and navigation. Moreover, RichReview's versatile support for multi-modal annotations enables users to mix and interweave different modalities in threaded conversations. A formative evaluation demonstrates early promise for the system finding support for voice, pointing, and the combination of both to be especially valuable. In addition, initial findings point to the ways in which both content and social context affect modality choice.
Year
DOI
Venue
2014
10.1145/2642918.2647390
UIST
Keywords
Field
DocType
user interfaces,annotation,voice,collaborative authoring,pointing gesture,multi-modal input,pen interaction,speech,asynchronous communication
Modalities,Asynchronous communication,Annotation,Computer science,Gesture,Collaborative authoring,Narrative,Human–computer interaction,Deixis,Multimedia,Formative assessment
Conference
Citations 
PageRank 
References 
19
0.87
21
Authors
4
Name
Order
Citations
PageRank
Dongwook Yoon1514.27
Nicholas Chen220011.18
Francois Guimbretière3125783.50
Abigail Sellen45323809.52