Paper Info
Title
Assessing individual contributions to software engineering projects: a replication study
Abstract
Background and Context: Assessing team members' indivdival contributions to software development projects poses a key problem for computing instructors. While instructors typically rely on subjective assessments, objective assessments could provide a more robust picture. To explore this possibility, In a 2020 paper, Buffardi presented a correlational analysis of objective metrics and subjective metrics in an advanced software engineering project course (n= 41 students and 10 teams), finding only two significant correlations. Objective: To explore the robustness of Buffardi's findings and gain further insight, we conducted a larger scale replication of the Buffardi study (n = 118 students and 25 teams) in three courses at three institutions. Method: We collected the same data as in the Buffardi study and computed the same measures from those data. We replicated Buffardi's exploratory, correlational and regression analyses of objective and subjective measures. Findings: While replicating four of Buffardi's five significant correlational findings and partially replicating the findings of Buffardi's regression analyses, our results go beyond those of Buffardi by identifying eight additional significant correlations.
Year
DOI
Venue
2022
10.1080/08993408.2022.2071543
COMPUTER SCIENCE EDUCATION
Keywords
DocType
Volume
Team software development projects, individual contributions, GitHub log data analysis, peer evaluation, issues, commits, user stories
Journal
32
Issue
ISSN
Citations 
3
0899-3408
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
C. D. Hundhausen100.34
P. T. Conrad200.34
A. S. Carter300.34
O. Adesope400.34