Title
Reverse engineering time-series interaction data from screen-captured videos
Abstract
In recent years the amount of research on human aspects of software engineering has increased. Many studies use screen-capture software (e.g., Snagit) to record developers' behavior as they work on software development tasks. The recorded task videos capture direct information about which activities the developers carry out with which content and in which applications during the task. Such behavioral data can help researchers and practitioners understand and improve software engineering practices from human perspective. However, extracting time-series interaction data (software usage and application content) from screen-captured videos requires manual transcribing and coding of videos, which is tedious and error-prone. In this paper we present a computer-vision based video scraping technique to automatically reverse-engineer time-series interaction data from screen-captured videos. We report the usefulness, effectiveness and runtime performance of our video scraping technique using a case study of the 29 hours task videos of 20 developers in the two development tasks.
Year
DOI
Venue
2015
10.1109/SANER.2015.7081850
SANER
Keywords
Field
DocType
software engineering practice,video signal processing,task video,screen-captured video,software development task,reverse-engineer time-series interaction data,reverse engineering,reverse engineering time-series interaction data,screen-capture software,behavioral data,computer vision,computer-vision based video scraping technique,application content,software usage,software engineering,time series,encoding,visualization
Software analytics,Computer science,Software system,Software,Software walkthrough,Software visualization,Software construction,Multimedia,Crowdsourcing software development,Software development
Conference
Citations 
PageRank 
References 
1
0.35
39
Authors
5
Name
Order
Citations
PageRank
Lingfeng Bao113414.31
Jing Li210813.74
Zhenchang Xing3138787.95
xinyu459030.19
Bo Zhou5323.26