Applications of Combinatorial Testing Methods for Breakthrough Results in Software Testing

Abstract

In last three decades, lot of research work has been done by statisticians and academicians (others) in the field of Combinatorial testing (CT) and its use in software testing. However, its tremendous potential in terms of test optimization and fault detection is yet to be exploited to its fullest. This paper showcases some of the real-world examples from iGATE Corporation, where CT has been used successfully to achieve breakthrough results in software testing. The paper, through three case studies taken from different domains describes the challenges faced by testing teams in terms of test scenario complexities, schedule and budget constraints; and how CT helped resolve those challenges successfully. Our experience shows 60 to 70 percent benefits in terms of optimization of test efforts while enhancing test case coverage. In the end, the paper highlights some learnings from our experiences in implementing CT approach which may be of help to fellow practitioners.

Evaluation of the IPO-Family algorithms for test case generation in web security testing

“…For example, three different case studies of combinatorial testing methods in software testing have been given in [12]. Applying combinatorial testing to the Siemens Suite and testing ACTS with ACTS have been presented in [13] and [14], respectively.…”