Abstract | ||
---|---|---|
Bug reports are crucial software artifacts for both software maintenance researchers and practitioners. A typical use of bug reports by researchers is to evaluate automated software maintenance tools: a large repository of reports is used as input for a tool, and metrics are calculated from the tool's output. But this process is quite different from practitioners, who distinguish between reports written by experts such as programmers, and reports written by non-experts such as users. Practitioners recognize that the content of a bug report depends on its author's expert knowledge. In this paper, we present an empirical study of the textual difference between bug reports written by experts and non-experts. We find that a significance difference exists, and that this difference has a significant impact on the results from a state-of-the-art feature location tool. Our recommendation is that researchers evaluate maintenance tools using different sets of bug reports for experts and non-experts. |
Year | DOI | Venue |
---|---|---|
2014 | 10.1109/ICSME.2014.22 | ICSME |
Keywords | DocType | ISSN |
software maintenance researchers,bug reports,software metrics,large-report repository,textual difference,bug report content,software artifacts,automated software maintenance tool evaluation,expert knowledge,empirical analysis,program debugging,software maintenance,software maintenance practitioners,empirical study,feature location tool,bug reports, empirical study, expert knowledge | Conference | 1063-6773 |
Citations | PageRank | References |
6 | 0.41 | 58 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Da Huo | 1 | 8 | 4.23 |
Tao Ding | 2 | 15 | 8.48 |
Collin McMillan | 3 | 922 | 42.07 |
Malcom Gethers | 4 | 871 | 26.49 |