Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing

Ahmed, Bestoun S.; Pahim, Amador; Rosa, Cleber R.; Kuhn, D. Richard; Bureš, Miroslav

doi:10.1145/3319008.3319348

Cited by 4 publications

(3 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mainly, CIT used in software testing and program verification. There are many applications in this direction, for example, fault detection and characterisation [9, 10], graphical user interface (GUI) testing [11], model‐based testing, and mutation testing [12, 13]. There are many more applications of CIT in software testing.…”

Section: Basic Concepts and Literaturementioning

confidence: 99%

Code‐aware combinatorial interaction testing

et al. 2019

Self Cite

View full text Add to dashboard Cite

Combinatorial interaction testing (CIT) is a useful testing technique to address the interaction of input parameters in software systems. In many applications, the technique has been used as a systematic sampling technique to sample the enormous possibilities of test cases. In the last decade, most of the research activities focused on the generation of CIT test suites as it is a computationally complex problem. Although promising, less effort has been paid for the application of CIT. In general, to apply the CIT, practitioners must identify the input parameters for the Software-under-test (SUT), feed these parameters to the CIT tool to generate the test suite, and then run

show abstract

Section: Basic Concepts and Literaturementioning

confidence: 99%

Code‐aware combinatorial interaction testing

et al. 2019

Self Cite

View full text Add to dashboard Cite

show abstract

“…Finally, it is added to a final test suite (FTS) one after the other when all interactions are covered by the FTS (i.e., a horizontal extension). Once completed, new test cases (vertical extension) can be added to obtain maximum coverage of interactions [10,12]. The Parameter Order Strategy (IPO) was developed by Lei and Tai and represents innovative research using the OPAT approach [13,14].…”

Section: 1-strategic Approachmentioning

confidence: 99%

Review of Combinatorial Testing Strategy

Altmemi¹

2019

IJATCSE

View full text Add to dashboard Cite

Combinatorial testing (CT) is an essential technique that usually aims for the generation of test cases. The generation of an optimally sized test case is a Non-deterministic Polynomial (NP) problem. The Combinatorial Interaction has been discussed by several researchers in developing different strategies depending on support interactions. Combinatorial testing taxonomy is thus Suggested to facilitate the analysis. In this paper, 12 algorithms were evaluated based on the strategy approach, supported interactions, randomness, and publication year. The year 2011 was noted as the most successful year in which researchers generated t-way algorithms. For them, the one-test-per-time OTAT strategy was the most promising area for Combinatorial t-way analysis. A small variation was seen in the type of interaction support. Nonetheless, uniform strength was the most common form of interaction from the year 2010 to the first half of the year 2018. This article was therefore implemented to review existing t-way strategies to identify their capabilities and limitations, thus providing a valuable guideline for generating the future.

show abstract

“…Here, Avocado is able to generate CCIT test suites from a predefined set of application inputs and constraints among them, execute the generated test cases, and identify the test-cases' status based on a customized test oracle. In our earlier work [11], we illustrated CIT with the Avocado testing framework that can be applied to a new application. In this paper, we present how Avocado handles the constraints and finally generates the combinatorial test suites.…”

Section: Introductionmentioning

confidence: 99%

Avocado: Open-Source Flexible Constrained Interaction Testing for Practical Application

Richter

Ahmed

Bureš

et al. 2020

2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)

Self Cite

View full text Add to dashboard Cite

This paper presents the outcome of a research collaboration between academia and industry to implement and utilize the capabilities of constrained interaction testing for an open-source tool for industrial-scale application. The project helps promote flexibility in generating constrained interaction test suites, executing them, and setting up a test oracle to report them-all within the same tool called Avocado. Avocado employs a constraint solver with computational algorithms to generate constrained interaction test suites. The environment of the application under test can be set up to execute the generated test suite with minimum effort. A test oracle can be set up by the tool to report the status and the results of the executed test cases. Avocado represents a comprehensive and flexible solution for conducting combinatorial interaction testing (CIT) and constrained CIT on an industrial application. In this paper, we present the structure of the tool and our method of implementing the algorithms in detail.

show abstract

Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing

Cited by 4 publications

References 25 publications

Code‐aware combinatorial interaction testing

Code‐aware combinatorial interaction testing

Review of Combinatorial Testing Strategy

Avocado: Open-Source Flexible Constrained Interaction Testing for Practical Application

Contact Info

Product

Resources

About