Name
Abstract | ||
|---|---|---|
Recent years have witnessed the increasing emphasis on human aspects in software engineering research and practices. Our survey of existing studies on human aspects in software engineering shows that screen-captured videos have been widely used to record developers' behavior and study software engineering practices. The screen-captured videos provide direct information about which software tools the developers interact with and which content they access or generate during the task. Such Human-Computer Interaction (HCI) data can help researchers and practitioners understand and improve software engineering practices from human perspective. However, extracting time-series HCI data from screen-captured task videos requires manual transcribing and coding of videos, which is tedious and error-prone. In this paper we report a formative study to understand the challenges in manually transcribing screen-captured videos into time-series HCI data. We then present a computer-vision based video scraping technique to automatically extract time-series HCI data from screen-captured videos. We also present a case study of our scvRipper tool that implements the video scraping technique using 29-hours of task videos of 20 developers in two development tasks. The case study not only evaluates the runtime performance and robustness of the tool, but also performs a detailed quantitative analysis of the tool's ability to extract time-series HCI data from screen-captured task videos. We also study the developer's micro-level behavior patterns in software development from the quantitative analysis. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1007/s10664-015-9417-1 | Empirical Software Engineering |
Keywords | Field | DocType |
Screen-captured video,Video scraping,HCI data,Online search behavior | Transcription (linguistics),Computer science,Coding (social sciences),Robustness (computer science),Study software,Software,Multimedia,Software development,Formative assessment | Journal |
Volume | Issue | ISSN |
22 | 1 | 1382-3256 |
Citations | PageRank | References |
11 | 0.53 | 57 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Lingfeng Bao | 1 | 134 | 14.31 |
| Jing Li | 2 | 108 | 13.74 |
| Zhenchang Xing | 3 | 1387 | 87.95 |
| xinyu | 4 | 590 | 30.19 |
| Xin Xia | 5 | 972 | 65.97 |
| Bo Zhou | 6 | 32 | 3.26 |