Investigating the Correlation between Mutation Score and Coverage Score

Assylbekov, B.; Gaspar, Erick; Uddin, Nasir; Egan, Paul J.

doi:10.1109/uksim.2013.28

Cited by 3 publications

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…PITest is the de facto standard for mutation testing within Java, and it is used as baseline in research concerning mutation testing (e.g. [49,44,79,83,11]).…”

Section: Pitestmentioning

confidence: 99%

Comparing mutation coverage against branch coverage in an industrial setting

Parsai

Demeyer

2020

Int J Softw Tools Technol Transfer

View full text Add to dashboard Cite

The state-of-the-practice in software development is driven by constant change fueled by continuous integration servers. Such constant change demands for frequent and fully automated tests capable to detect faults immediately upon project build. As the fault detection capability of the test suite becomes so important, modern software development teams continuously monitor the quality of the test suite as well. However, it appears that the state-of-the-practice is reluctant to adopt strong coverage metrics (namely mutation coverage), instead relying on weaker kinds of coverage (namely branch coverage). In this paper, we investigate three reasons that prohibit the adoption of mutation coverage in a continuous integration setting: (1) the difficulty of its integration into the build system, (2) the perception that branch coverage is "good enough", and (3) the performance overhead during the build. Our investigation is based on a case study involving four open source systems and one industrial system. We demonstrate that mutation coverage reveals additional weaknesses in the test suite compared to branch coverage, and that it is able to do so with an acceptable performance overhead during project build.

show abstract

“…PITest is the de facto standard for mutation testing within Java, and it is used as baseline in research concerning mutation testing (e.g. [49,44,79,83,11]).…”

Section: Pitestmentioning

confidence: 99%

Comparing mutation coverage against branch coverage in an industrial setting

Parsai

Demeyer

2020

Int J Softw Tools Technol Transfer

View full text Add to dashboard Cite

show abstract

“…The ability of test suite to kill the generated mutants has been used to gauge the effectiveness of the test suite. A study the correlation between the coverage and the mutation score is studied with an open-source application (spojo) [9]. The study showed that there is a strong positive correlation between coverage and mutation score.…”

Section: Debates On Coverage and Mutation Score As Quality Indicatorsmentioning

confidence: 99%