Investigating Code Review Practices in Defective Files: An Empirical Study of the Qt System

Authors - Patanamon Thongtanunam, Shane McIntosh, Ahmed E. Hassan, Hajimu Iida
Venue - Working Conference on Mining Software Repositories, pp. 168-179, 2015

Related Tags - MSR 2015 code review software quality

Abstract - Software code review is a well-established software quality practice. Recently, Modern Code Review (MCR) has been widely adopted in both open source and industrial projects. To evaluate the impact that characteristics of MCR practices have on software quality, this paper comparatively studies MCR practices in defective and clean source code files. We investigate defective files along two perspectives: 1) files that will eventually have defects (i.e., future-defective files) and 2) files that have historically been defective (i.e., risky files). Through an empirical study of 11,736 reviews of changes to 24,486 files from the Qt open source system, we find that both future-defective files and risky files tend to be reviewed less rigorously than their clean counterparts. We also find that the concerns addressed during the code reviews of both defective and clean files tend to enhance evolvability, i.e., ease future maintenance (like documentation), rather than focus on functional issues (like incorrect program logic). Our findings suggest that although functionality concerns are rarely addressed during code review, the rigour of the reviewing process that is applied to a source code file throughout a development cycle shares a link with its defect proneness.

Preprint - PDF


  Author = {Patanamon Thongtanunam and Shane McIntosh and Ahmed E. Hassan and Hajimu Iida},
  Title = {{Investigating Code Review Practices in Defective Files: An Empirical Study of the Qt System}},
  Year = {2015},
  Booktitle = {Proc. of the Working Conference on Mining Software Repositories (MSR)},
  Pages = {168-179}