Paper Info
Title
Speech, ink, and slides: the interaction of content channels
Abstract
In this paper, we report on an empirical exploration of digital ink and speech usage in lecture presentation. We studied the video archives of five Master's level Computer Science courses to understand how instructors use ink and speech together while lecturing, and to evaluate techniques for analyzing digital ink. Our interest in understanding how ink and speech are used together is to inform the development of future tools for supporting classroom presentation, distance education, and viewing of archived lectures. We want to make it easier to interact with electronic materials and to extract information from them. We want to provide an empirical basis for addressing challenging problems such as automatically generating full text transcripts of lectures, matching speaker audio with slide content, and recognizing the meaning of the instructor's ink. Our results include an evaluation of handwritten word recognition in the lecture domain, an approach for associating attentional marks with content, an analysis of linkage between speech and ink, and an application of recognition techniques to infer speaker actions.
Year
DOI
Venue
2004
10.1145/1027527.1027713
ACM Multimedia 2001
Keywords
Field
DocType
speech recognition
Electronic materials,Digital ink,Inkwell,Computer science,Word recognition,Communication channel,Distance education,Multimedia
Conference
ISBN
Citations 
PageRank 
1-58113-893-8
20
0.91
References 
Authors
11
6
Name
Order
Citations
PageRank
Richard J. Anderson186993.43
Crystal Hoyer2796.59
Craig Prince313212.28
Jonathan Su4251.43
Fred Videon5262.19
Steven A. Wolfman644959.00