Modern Code Reviews—Survey of Literature and Practice

Abstract

Background: Modern Code Review (MCR) is a lightweight alternative to traditional code inspections. While secondary studies on MCR exist; it is unknown whether the research community has targeted themes that practitioners consider important. Objectives: The objectives are to provide an overview of MCR research, analyze the practitioners’ opinions on the importance of MCR research, investigate the alignment between research and practice, and propose future MCR research avenues. Method: We conducted a systematic mapping study to survey state-of-the-art until and including 2021, employed the Q-Methodology to analyze the practitioners’ perception of the relevance of MCR research, and analyzed the primary studies’ research impact. Results: We analyzed 244 primary studies, resulting in five themes. As a result of the 1300 survey data points, we found that the respondents are positive about research investigating the impact of MCR on product quality and MCR process properties. In contrast, they are negative about human factor- and support systems-related research. Conclusion: These results indicate a misalignment between the state-of-the-art and the themes deemed important by most survey respondents. Researchers should focus on solutions that can improve the state of MCR practice. We provide an MCR research agenda, which can potentially increase the impact of MCR research.

On Wasted Contributions: Understanding the Dynamics of Contributor-Abandoned Pull Requests–A Mixed-Methods Study of 10 Large Open-Source Projects

“…To ensure that we have enough historical data for our study, we seek large and popular open-source projects with a rich history of pull-based development. For this purpose, we rely on GitHub as a pioneer in supporting pull-based development and the largest open-source ecosystem [20], which has also been the subject of numerous code review studies [21,22]. To identify such projects, we use the number of stars as a proxy for the popularity of the projects [23] and retrieve the list of the top 1,000 most-starred projects.…”

Only Time Will Tell: Modelling Information Diffusion in Code Review with Time-Varying Hypergraphs

“…2 Background and related work Badampudi et al (2023) identified different research themes on code review in a large systematic mapping study where the authors analyzed 244 primary studies until 2021 (inclusive). They further assessed the practitioners' perceptions on the relevance of those code review research themes through a survey of 25 practitioners.…”

Understanding, Analysis, and Handling of Software Architecture Erosion

“…To address this gap, we conduct an exploratory study to assess the feasibility of automatically identifying violation symptoms of architecture erosion from code review comments. The automated identification of violation symptoms could act in a complementary way to modern code review: the latter addresses code changes in general through knowledge sharing (Badampudi et al, 2023), while the former can offer an extra layer of scrutiny. For example, such an automated approach can issue warnings for potential or ignored violation symptoms, preventing the integration of code changes with architectural violations into the code base, and ensuring a more robust and reliable development process.…”