MUMCUT: a fault-based strategy for testing Boolean specifications

Chen, Tsong Yueh; Lau, Man Fai; Yu, Yaoguang

doi:10.1109/apsec.1999.809656

Cited by 41 publications

(66 citation statements)

References 10 publications

(7 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…of part B of Table II lists the mean sizes of the test suites obtained by the MUMCUT strategy as computed by the GUCN method [10]. As the GUCN method achieves better results than the original method [9], we only compare to the improved values. The second column (Min) of Part B reports the sizes computed by Minimal-MUMCUT [11].…”

Section: Resultsmentioning

confidence: 99%

“…Chen and Lau [8] introduced three testing criteria: Multiple Unique True Point (MUTP), Multiple Near False Point (MNFP), and Corresponding Unique True Point and Near False Point (CUTPNFP). These three strategies were integrated by Chen et al [9], [10] in the MUMCUT testing strategy which (1) guarantees to detect nine types of faults in Boolean expressions in irredundant disjunctive normal form just like MAX-A and MAX-B do, and (2) requires only a subset of the test suites that satisfy the previously proposed MAX-A and MAX-B strategies. Kaminski and Ammann [11] introduced an extension of MUMCUT, called Minimal-MUMCUT, which takes the feasibility of the three components of MUMCUT into account and guarantees to detect the same types of faults with fewer test cases.…”

Section: B Testing Criteria -Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Generating Minimal Fault Detecting Test Suites for Boolean Expressions

Gargantini

2010

2010 Third International Conference on Software Testing, Verification, and Validation Workshops

View full text Add to dashboard Cite

Abstract-New coverage criteria for Boolean expressions are regularly introduced with two goals: to detect specific classes of realistic faults and to produce as small as possible test suites. In this paper we investigate whether an approach targeting specific fault classes using several reduction policies can achieve that less test cases are generated than by previously introduced testing criteria. In our approach, the problem of finding fault detecting test cases can be formalized as a logical satisfiability problem, which can be efficiently solved by a SAT algorithm. We compare this approach with respect to the well-known MUMCUT and Minimal-MUMCUT strategies by applying it to a series of case studies commonly used as benchmarks, and show that it can reduce the number of test cases further than Minimal-MUMCUT.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: B Testing Criteria -Related Workmentioning

confidence: 99%

Generating Minimal Fault Detecting Test Suites for Boolean Expressions

Gargantini

2010

2010 Third International Conference on Software Testing, Verification, and Validation Workshops

View full text Add to dashboard Cite

show abstract

“…The integration of MUTP, MNFP, and CUTPNFP, namely MUMCUT [8], guarantees the detection of all seven types of faults while using fewer test cases than MAX-B. In other words, MUMCUT is more efficient than MAX-B.…”

Section: Test Case Generation Strategiesmentioning

confidence: 99%

Evaluating and Comparing Fault-Based Testing Strategies for General Boolean Specifications: A Series of Experiments

Sun

Zai

Liu

2014

The Computer Journal

View full text Add to dashboard Cite

A great amount of fault-based testing strategies have been proposed to generate test cases for detecting certain types of faults in Boolean specifications. However, most of the previous studies on these strategies were focused on the Boolean expressions in the disjunctive normal form, even the irredundant disjunctive normal form -little work has been conducted to comprehensively investigate their performance on general Boolean specifications. In this study, we conducted a series of experiments to evaluate and compare eighteen fault-based testing strategies using over four thousand randomly generated fault-seeded Boolean expressions. In the experiments, a testing strategy is regarded as effective and efficient if it can detect most of the seeded faults using a small number of test cases. Our experimental results show that if a testing strategy is highly effective and efficient when testing the Boolean expressions in the irredundant disjunctive normal form, it also shows high effectiveness and efficiency on general Boolean expressions. It is found that one family of fault-based testing strategies, namely MUMCUT, normally deliver the best performance among all the eighteen strategies. Our study provides an in-depth understanding and insight of fault-based testing for general Boolean expressions.

show abstract

“…Chen, Lau, and Yu [4] used the greedy MUTP algorithm [3] to see how many tests would be needed to satisfy MUMCUT on these predicates. There were originally 20 predicates but number 12 was excluded due to a missing right parenthesis [38].…”

Section: An Empirical Argument For Preferring Minimal-mumcut To Mcdcmentioning

confidence: 99%

“…Despite the widespread use and confidence in MCDC, MCDC tests are only guaranteed to detect TNF and ENF faults [24]! This fault hierarchy has been used to develop alternative logic-based test criteria, the most powerful being MUMCUT [4]. MUMCUT is guaranteed to detect the entire hierarchy of faults.…”

Section: Introductionmentioning

confidence: 99%

Improving logic-based testing

Kaminski

Ammann

Offutt

2013

Journal of Systems and Software

View full text Add to dashboard Cite

Logic-based testers design tests from logical expressions that appear in software artifacts such as source code, design models, and requirements specifications. This paper presents three improvements to logic-based test design. First, in the context of mutation testing, we present fault hierarchies for the six relational operators. Applying the ROR mutation operator causes each relational operator to generate seven mutants per clause. The fault hierarchies show that only three of these seven mutants are needed. Second, we show how to bring the power of the ROR operator to logic-based test criteria such as the widely used Multiple Condition-Decision Coverage (MCDC) test criterion. Third, we present theoretical results supported by empirical data that show that the more recent coverage criterion of minimal-MUMCUT can find significantly more faults than MCDC. The paper has three specific recommendations: (1) Change the way the ROR mutation operator is defined in existing and future mutation systems; (2) Augment logic-based test criteria to incorporate relational operator replacement from mutation; (3) Replace the use of MCDC with minimal-MUMCUT, both in practice and in standards documents like FAA-DO178B.

show abstract

MUMCUT: a fault-based strategy for testing Boolean specifications

Cited by 41 publications

References 10 publications

Generating Minimal Fault Detecting Test Suites for Boolean Expressions

Generating Minimal Fault Detecting Test Suites for Boolean Expressions

Evaluating and Comparing Fault-Based Testing Strategies for General Boolean Specifications: A Series of Experiments

Improving logic-based testing

Contact Info

Product

Resources

About