Using a Fault Hierarchy to Improve the Efficiency of DNF Logic Mutation Testing

Kaminski, Garrett Kent; Ammann, Paul

doi:10.1109/icst.2009.13

Cited by 27 publications

(35 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In this strategy, there is no restriction on the number and occurance of variables in the given Boolean expressions. Minimal-MUMCUT [7] that improves the MUMCUT strategy by considering the feasibility problem of the three testing constituents of the MUMCUT strategy. It reduces the test suite size as compared to MUMCUT without compromising any fault detection capability.…”

Section: Introductionmentioning

confidence: 99%

“…Consider the following Boolean expression for example: Fig.1 based on how criterion feasibility affects fault detection as indicated by Kaminski and Ammann [7]. A solid arrow from a source fault to a destination fault indicates that if a test detects a source fault, it also detects a corresponding destination fault.…”

Section: Fault Hierarchymentioning

confidence: 99%

“…It reduces the test suite size as compared to MUMCUT without compromising any fault detection capability. Thus, the extra tests required by the MUMCUT criterion are of little, if any, value based on the theoretical and empirical studies conducted [7].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Fault based Test Suite Prioritization based on Minimal MUMCUT Strategy

Badhera¹,

Maheshwari²

2014

IJCA

View full text Add to dashboard Cite

Logic expressions are widely used in specifications and in programs. Testing criteria which covers logic expressions implies a high probability of detecting faults. Fault-based test suite prioritization of test cases has been considered in this study.Test cases are generated from logic expressions in irredundant normal form(IDNF) derived from specifications or source code by applying Minimal-MUMCUT. The proposed approach directly utilizes the theoretical knowledge of fault-detecting ability of test cases. The effectiveness of prioritization techniques has been validated by an empirical study done on bench mark expressions using two different metrics APFD, and FATE.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Fault Hierarchymentioning

confidence: 99%

See 1 more Smart Citation

Fault based Test Suite Prioritization based on Minimal MUMCUT Strategy

Badhera¹,

Maheshwari²

2014

IJCA

View full text Add to dashboard Cite

show abstract

“…However, it should not be forgotten that testing SQL queries is somewhat different to testing imperative programs because of the high input space of test cases and also because a single query can be considered as a small program that performs many complex operations. Furthermore, other additional mutation operators like the one proposed by Kaminski and Amman [27] are able to detect more faults with a lower number of mutants. Also, the mutants used in this study are first order mutants (only one fault is introduced by each mutant); however, some carefully selected high order mutants may be more effective than first order mutants as shown by Jia and Harman [28].…”

Section: Threats To Val Iditymentioning

confidence: 99%

Full predicate coverage for testing SQL database queries

Tuya

Suárez-Cabal

Riva

2010

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARYIn the field of database applications a considerable part of the business logic is implemented using a semi-declarative language: the Structured Query Language (SQL). Because of the different semantics of SQL compared to other procedural languages, the conventional coverage criteria for testing are not directly applicable. This paper presents a criterion specifically tailored for SQL queries (SQLFpc). It is based on Masking Modified Condition Decision Coverage (MCDC) or Full Predicate Coverage and takes into account a wide range of the syntax and semantics of SQL, including selection, joining, grouping, aggregations, subqueries, case expressions and null values. The criterion assesses the coverage of the test data in relation to the query that is executed and it is expressed as a set of rules that are automatically generated and efficiently evaluated against a test database. The use of the criterion is illustrated in a case study which includes complex queries.

show abstract

“…A key property of a subsuming HOM is that a test that kills the HOM is also guaranteed to kill the subsumed mutants, and hence these mutants do not need to be generated. Kaminski and Ammann put both of these ideas together in the context of mutation analysis of logical expressions in disjunctive normal form (DNF) [17]. They showed that not only are many redundant mutants generated for logical expressions, worse, these mutants miss many faults in the Lau and Yu fault hierarchy.…”

Section: Improving Logic-based Testing With Mutationmentioning

confidence: 99%

Improving logic-based testing

Kaminski

Ammann

Offutt

2013

Journal of Systems and Software

Self Cite

View full text Add to dashboard Cite

Logic-based testers design tests from logical expressions that appear in software artifacts such as source code, design models, and requirements specifications. This paper presents three improvements to logic-based test design. First, in the context of mutation testing, we present fault hierarchies for the six relational operators. Applying the ROR mutation operator causes each relational operator to generate seven mutants per clause. The fault hierarchies show that only three of these seven mutants are needed. Second, we show how to bring the power of the ROR operator to logic-based test criteria such as the widely used Multiple Condition-Decision Coverage (MCDC) test criterion. Third, we present theoretical results supported by empirical data that show that the more recent coverage criterion of minimal-MUMCUT can find significantly more faults than MCDC. The paper has three specific recommendations: (1) Change the way the ROR mutation operator is defined in existing and future mutation systems; (2) Augment logic-based test criteria to incorporate relational operator replacement from mutation; (3) Replace the use of MCDC with minimal-MUMCUT, both in practice and in standards documents like FAA-DO178B.

show abstract

Using a Fault Hierarchy to Improve the Efficiency of DNF Logic Mutation Testing

Cited by 27 publications

References 14 publications

Fault based Test Suite Prioritization based on Minimal MUMCUT Strategy

Fault based Test Suite Prioritization based on Minimal MUMCUT Strategy

Full predicate coverage for testing SQL database queries

Improving logic-based testing

Contact Info

Product

Resources

About