An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection

Hemmati, Hadi; Briand, Lionel C.

doi:10.1109/issre.2010.9

Cited by 56 publications

(48 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Various measures of the similarity or distance between different test cases have been used in attempts to select small test suites that nevertheless have much diversity of tests [74].…”

Section: Test As Objectmentioning

confidence: 99%

A Rational Foundation for Software Metrology

Flater¹,

Black²,

Fong³

et al. 2016

View full text Add to dashboard Cite

“…Various measures of the similarity or distance between different test cases have been used in attempts to select small test suites that nevertheless have much diversity of tests [74].…”

Section: Test As Objectmentioning

confidence: 99%

A Rational Foundation for Software Metrology

Flater¹,

Black²,

Fong³

et al. 2016

View full text Add to dashboard Cite

“…Hemmati et al [11] and Henard et al [12] investigated ways to select an affordable subset with maximum fault detection rate by maximizing diversity among test cases using the dissimilarity measure. The results obtained in those papers suggested that two dissimilar test cases have a higher fault detection rate than similar ones since the former ones are more likely to cover more components than the latter.…”

Section: E Dissimilarity Prioritization Criterionmentioning

confidence: 99%

A Comparison of Test Case Prioritization Criteria for Software Product Lines

Sánchez

Segura

Ruiz–Cortés

2014

2014 IEEE Seventh International Conference on Software Testing, Verification and Validation

View full text Add to dashboard Cite

Abstract-Software Product Line (SPL) testing is challenging due to the potentially huge number of derivable products. To alleviate this problem, numerous contributions have been proposed to reduce the number of products to be tested while still having a good coverage. However, not much attention has been paid to the order in which the products are tested. Test case prioritization techniques reorder test cases to meet a certain performance goal. For instance, testers may wish to order their test cases in order to detect faults as soon as possible, which would translate in faster feedback and earlier fault correction. In this paper, we explore the applicability of test case prioritization techniques to SPL testing. We propose five different prioritization criteria based on common metrics of feature models and we compare their effectiveness in increasing the rate of early fault detection, i.e. a measure of how quickly faults are detected. The results show that different orderings of the same SPL suite may lead to significant differences in the rate of early fault detection. They also show that our approach may contribute to accelerate the detection of faults of SPL test suites based on combinatorial testing.

show abstract

“…Test cases were ordered before executing them. Similarly, Hemmati et al introduced a family of similarity-based test case selection techniques for model-based testing [13], [15]. The above two methods were applied to black-box testing.…”

Section: Related Workmentioning

confidence: 99%

“…Similarity-based test case prioritization techniques assume that test case diversity aids to detect more faults [15], [13]. Clustering-based prioritization techniques assume that the test cases within the same cluster have the same fault detection capability.…”

Section: Introductionmentioning

confidence: 99%

Similarity-based regression test case prioritization

Wang¹,

Jiang²,

Deng³

2015

International Conferences on Software Engineering and Knowledge Engineering

View full text Add to dashboard Cite

Abstract-With the continuous evolution of software systems, test suites often grow very large. Rerunning all test cases may be impractical in regression testing under limited resources. Coverage-based test case prioritization techniques have been proposed to improve the effectiveness of regression testing. The original test suite often contains some test cases which are designed for exercising production features or exceptional behaviors, rather than for code coverage. Therefore, coverage-based prioritization techniques do not always generate satisfactory results. In this context, we propose a global similarity-based regression test case prioritization approach. The approach reschedules the execution order of test cases based on the distances between pair-wise test cases. We designed and conducted empirical studies on four C programs to validate the effectiveness of our proposed approach. Moreover, we also empirically compared the effects of six similarity measures on the global similarity-based test case prioritization approach. Experimental results illustrate that the global similarity-based regression test case prioritization approach using Euclidean distance is the most effective. This study aims at providing practical guidelines for picking the appropriate similarity measures.

show abstract

An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection

Cited by 56 publications

References 12 publications

A Rational Foundation for Software Metrology

A Rational Foundation for Software Metrology

A Comparison of Test Case Prioritization Criteria for Software Product Lines

Similarity-based regression test case prioritization

Contact Info

Product

Resources

About