Title
Pause-and-play: automatically linking screencast video tutorials with applications
Abstract
Video tutorials provide a convenient means for novices to learn new software applications. Unfortunately, staying in sync with a video while trying to use the target application at the same time requires users to repeatedly switch from the application to the video to pause or scrub backwards to replay missed steps. We present Pause-and-Play, a system that helps users work along with existing video tutorials. Pause-and-Play detects important events in the video and links them with corresponding events in the target application as the user tries to replicate the depicted procedure. This linking allows our system to automatically pause and play the video to stay in sync with the user. Pause-and-Play also supports convenient video navigation controls that are accessible from within the target application and allow the user to easily replay portions of the video without switching focus out of the application. Finally, since our system uses computer vision to detect events in existing videos and leverages application scripting APIs to obtain real time usage traces, our approach is largely independent of the specific target application and does not require access or modifications to application source code. We have implemented Pause-and-Play for two target applications, Google SketchUp and Adobe Photoshop, and we report on a user study that shows our system improves the user experience of working with video tutorials.
Year
DOI
Venue
2011
10.1145/2047196.2047213
UIST
Keywords
Field
DocType
application source code,convenient video navigation control,user experience,user study,new software application,screencast video tutorial,convenient mean,video tutorial,specific target application,target application,leverages application,real time,source code,computer vision
Video processing,User experience design,Computer science,Source code,Video navigation,Software,Human–computer interaction,Video tracking,sync,Multimedia,Scripting language
Conference
Citations 
PageRank 
References 
54
1.74
15
Authors
7
Name
Order
Citations
PageRank
Suporn Pongnumkul11055.10
Mira Dontcheva2148785.48
Wil Li329521.97
Jue Wang42871155.89
Lubomir Bourdev52655147.20
Shai Avidan63291208.12
Michael F. Cohen778961058.75