Automatic Classification of Review Comments in Pull-based Development Model

Li, Zhixing; Yu, Yue; Yin, Gang; Wang, Tao; Fan, Qiang; Wang, Huaimin

doi:10.18293/seke2017-039

Cited by 10 publications

(2 citation statements)

References 23 publications

(33 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Determining the usefulness of code reviews. A study of three projects developed a taxonomy of review comments [163,164]. After training a classifier and categorizing 147K comments, they found that inexperienced contributors tend to produce code that passes tests while still containing issues, and external contributors break project conventions in their early contributions.…”

Section: Mcr Themes and Contributionsmentioning

confidence: 99%

Modern Code Reviews—Survey of Literature and Practice

Badampudi

Unterkalmsteiner

Britto

2023

ACM Trans. Softw. Eng. Methodol.

View full text Add to dashboard Cite

Background: Modern Code Review (MCR) is a lightweight alternative to traditional code inspections. While secondary studies on MCR exist; it is unknown whether the research community has targeted themes that practitioners consider important. Objectives: The objectives are to provide an overview of MCR research, analyze the practitioners’ opinions on the importance of MCR research, investigate the alignment between research and practice, and propose future MCR research avenues. Method: We conducted a systematic mapping study to survey state-of-the-art until and including 2021, employed the Q-Methodology to analyze the practitioners’ perception of the relevance of MCR research, and analyzed the primary studies’ research impact. Results: We analyzed 244 primary studies, resulting in five themes. As a result of the 1300 survey data points, we found that the respondents are positive about research investigating the impact of MCR on product quality and MCR process properties. In contrast, they are negative about human factor- and support systems-related research. Conclusion: These results indicate a misalignment between the state-of-the-art and the themes deemed important by most survey respondents. Researchers should focus on solutions that can improve the state of MCR practice. We provide an MCR research agenda, which can potentially increase the impact of MCR research.

show abstract

Section: Mcr Themes and Contributionsmentioning

confidence: 99%

Modern Code Reviews—Survey of Literature and Practice

Badampudi

Unterkalmsteiner

Britto

2023

ACM Trans. Softw. Eng. Methodol.

View full text Add to dashboard Cite

show abstract

“…LDA is shown to have degraded performance for short text [24] due to reduced word co-occurrence in short texts for topic extraction. Code review comments are relatively short pieces of text [25]. Therefore, we considered topic modeling models suitable for short text, as suggested by Qiang et al [18].…”

Section: B Natural Language Processing Model Selectionmentioning

confidence: 99%

On potential improvements in the analysis of the evolution of themes in code review comments

Iftikhar,

Börstler,

Bin Ali

2023

2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)

View full text Add to dashboard Cite

The modern code review process is considered an essential quality assurance step in software development.The code review comments generated can provide insights regarding source code quality and development practices. However, the large number of code review comments makes it challenging to identify interesting patterns manually. In a recent study, Wen et al. used traditional topic modeling to analyze the evolution of code review comments. Their approach could identify interesting patterns that may lead to improved development practices.Objective: In this study, we investigate potential improvements to Wen et al.'s state-of-the-art approach to analyze the evolution of code review comments.Method: We used 209,166 code review comments from three open-source systems to explore and empirically analyze alternative design and implementation choices and demonstrate their impact.Results: We identified the following potential improvements to the current state-of-the-art as described by Wen et al.: 1) utilize a topic modeling method that is optimized for short texts, 2) a refined approach for identifying a suitable number of topics, and 3) a more elaborate approach for analyzing topic evolution. Our results indicate that the proposed changes have quantitatively different results than the current approach. The qualitative interpretation of the topics generated with our changes indicates their usefulness.Conclusions: Our results indicate the potential usefulness of changes to state-of-the-art approaches to analyzing the evolution of code review comments, with practical implications for researchers and practitioners. However, further research is required to compare the effectiveness of both approaches.

show abstract