Title
"Was my contribution fairly reviewed?": a framework to study the perception of fairness in modern code reviews.
Abstract
Modern code reviews improve the quality of software products. Although modern code reviews rely heavily on human interactions, little is known regarding whether they are performed fairly. Fairness plays a role in any process where decisions that affect others are made. When a system is perceived to be unfair, it affects negatively the productivity and motivation of its participants. In this paper, using fairness theory we create a framework that describes how fairness affects modern code reviews. To demonstrate its applicability, and the importance of fairness in code reviews, we conducted an empirical study that asked developers of a large industrial open source ecosystem (OpenStack) what their perceptions are regarding fairness in their code reviewing process. Our study shows that, in general, the code review process in OpenStack is perceived as fair; however, a significant portion of respondents perceive it as unfair. We also show that the variability in the way they prioritize code reviews signals a lack of consistency and the existence of bias (potentially increasing the perception of unfairness). The contributions of this paper are: (1) we propose a framework---based on fairness theory---for studying and managing social behaviour in modern code reviews, (2) we provide support for the framework through the results of a case study on a large industrial-backed open source project, (3) we present evidence that fairness is an issue in the code review process of a large open source ecosystem, and, (4) we present a set of guidelines for practitioners to address unfairness in modern code reviews.
Year
DOI
Venue
2018
10.1145/3180155.3180217
ICSE
Keywords
Field
DocType
Fairness, Software Development, Modern Code Review, Open Source Software, Human and Social Aspects, Transparency
Data science,Transparency (graphic),Systems engineering,Social behaviour,Computer science,Software,Process control,Perception,Software development,Empirical research,Code review
Conference
ISBN
Citations 
PageRank 
978-1-4503-5638-1
1
0.39
References 
Authors
36
6
Name
Order
Citations
PageRank
Daniel M. Germán1182.35
Gregorio Robles2129491.67
Germán Poo-Caamaño3223.43
Xin Yang4403.90
Hajimu Iida528631.95
Katsuro Inoue62424172.31