On fault classes and error detection capability of specification-based testing

Tsuchiya, Tatsuhiro; Kikuno, Tohru

doi:10.1145/504087.504089

Cited by 48 publications

(61 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is shown that ENF are the weakest faults in the sense that any test technique that catches stronger faults is very likely to find ENFs. The results have been further improved by Tsuchiya and Kikuno [27].…”

Section: Related Workmentioning

confidence: 89%

See 1 more Smart Citation

Experimental evaluation of the tolerance for control‐flow test criteria

Kapoor

Bowen

2004

Software Testing Verif & Rel

View full text Add to dashboard Cite

For a given test criterion, the number of test-sets satisfying the criterion may be very large, with varying fault detection effectiveness. In recent work [29], the measure of variation in effectiveness of test criterion was defined as 'tolerance'. This paper presents an experimental evaluation of tolerance for control-flow test criteria. The experimental analysis is done by exhaustive test-set generation, wherever possible, for a given criteria which improves on earlier empirical studies that adopted analysis of some test-sets using random selection techniques. Four industrially used control-flow testing criteria, Condition Coverage (CC), Decision Condition Coverage (DCC), Full Predicate Coverage (FPC) and Modified Condition/Decision Coverage (MC/DC) have been analysed against four types of faults. A new test criteria, Reinforced Condition/Decision Coverage (RC/DC) [28], is also analysed and compared. The Boolean specifications considered were taken from a past research paper and also generated randomly. To ensure that it is the test-set property that influences the effectiveness and not the test-set size, the average test-set size was kept same for all the test criteria except RC/DC. A further analysis of variation in average effectiveness with respect to number of conditions in the decision was also undertaken. The empirical results show that the MC/DC criterion is more reliable and stable when compared to the other considered criteria. Though the number of test-cases is large in RC/DC testsets, no significant improvement in effectiveness and tolerance was observed over MC/DC.

show abstract

Section: Related Workmentioning

confidence: 89%

“…In the past, various types of faults have been defined and used to study effectiveness of test criteria; see for example [16,22,25,30,33]. An analysis of various fault classes and the hierarchy among them is presented in [15,27].…”

Section: Types Of Faultsmentioning

confidence: 99%

Experimental evaluation of the tolerance for control‐flow test criteria

Kapoor

Bowen

2004

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…Tsuchiya and Kikuno extended Kuhns three fault classes to include the fault class of a missing condition [24]. Lau and Yu further extended Kuhns hierarchy by analyzing the relationships between variable faults and literal faults [25].…”

Section: Fault Classes and Fault Coverages Of Testsmentioning

confidence: 99%

Prioritizing MCDC test cases by spectral analysis of Boolean functions

Ayav

2017

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARYTest case prioritization aims at scheduling test cases in an order that improves some performance goal. One performance goal is a measure of how quickly faults are detected. Such prioritization can be performed by exploiting the Fault Exposing Potential (FEP) parameters associated to the test cases. FEP is usually approximated by mutation analysis under certain fault assumptions. Although this technique is effective, it could be relatively expensive compared to the other prioritization techniques. This study proposes a costeffective FEP approximation for prioritizing Modified Condition Decision Coverage (MCDC) test cases. A strict negative correlation between the FEP of a MCDC test case and the influence value of the associated input condition allows to order the test cases easily without the need of an extensive mutation analysis. The method is entirely based on mathematics and it provides useful insight into how spectral analysis of Boolean functions can benefit software testing.

show abstract

“…VRF is further classified as MCF (Missing Condition Fault) and ICF (Incorrect Condition Fault). Tsuchiya and Kikuno [39] further extended Kuhn's hierarchy by analysing the relationship between VRF and MCF, namely (1) M CF ⇒ V N F , when the fault happens to the same variable; (2) V RF ⇒ M CF when the fault happens to the same variable and the faulty term has more than one variable. The identified hierarchy only considers variable related faults, which means all occurrences of a missing or referenced variable in the expression.…”

Section: Fault Classes and Their Detection Hierarchymentioning

confidence: 99%

Evaluating and Comparing Fault-Based Testing Strategies for General Boolean Specifications: A Series of Experiments

Sun

Zai

Liu

2014

The Computer Journal

View full text Add to dashboard Cite

A great amount of fault-based testing strategies have been proposed to generate test cases for detecting certain types of faults in Boolean specifications. However, most of the previous studies on these strategies were focused on the Boolean expressions in the disjunctive normal form, even the irredundant disjunctive normal form -little work has been conducted to comprehensively investigate their performance on general Boolean specifications. In this study, we conducted a series of experiments to evaluate and compare eighteen fault-based testing strategies using over four thousand randomly generated fault-seeded Boolean expressions. In the experiments, a testing strategy is regarded as effective and efficient if it can detect most of the seeded faults using a small number of test cases. Our experimental results show that if a testing strategy is highly effective and efficient when testing the Boolean expressions in the irredundant disjunctive normal form, it also shows high effectiveness and efficiency on general Boolean expressions. It is found that one family of fault-based testing strategies, namely MUMCUT, normally deliver the best performance among all the eighteen strategies. Our study provides an in-depth understanding and insight of fault-based testing for general Boolean expressions.

show abstract

On fault classes and error detection capability of specification-based testing

Cited by 48 publications

References 2 publications

Experimental evaluation of the tolerance for control‐flow test criteria

Experimental evaluation of the tolerance for control‐flow test criteria

Prioritizing MCDC test cases by spectral analysis of Boolean functions

Evaluating and Comparing Fault-Based Testing Strategies for General Boolean Specifications: A Series of Experiments

Contact Info

Product

Resources

About