Conditional Testing

Cooperative verifier-based testing with CoVeriTest

“…Generally, testcase generation with symbolic execution [93] has received lots of interest [44,105]. Moreover, conditional testing [33] proposes a template construction that builds an automatic test-case generator from an arbitrary verifier that can produce violation witnesses [17]-a standard exchange format for counterexamples, which is supported by many verifiers. Basically, the template combines the verifier with a transformer [18] that generates tests from witnesses.…”

“…Conditional testing. The concept of conditional testing [33] explains how testing approaches can be combined such that approaches with different strengths can contribute to the test suite, and thus, increase the coverage. From a conceptual viewpoint, CoVeriTest is an instance of conditional testing: CoVeriTest and conditional testing maintain a set of test goals to book-keep what work is done already and what is still left to do (Fig.…”

“…3 [33] explains the passing of test-goal sets for conditional testers). CoVeriTest's sequence of analysis runs and analysis cycles (Fig.…”

“…3) can be expressed as sequential tester (Fig. 8 [33]) and cyclic tester (Fig. 9 [33]), respectively.…”

“…Also, test and verification approaches already employ combinations. Existing approaches can be classified into parallel combinations [19,42,68,82,100,116,117,119], sequential combinations [28,33,51,57,66,83,88], selective combinations [4,15,61,65,91,121], nested combinations [6,7,64,113], and interleaved combinations [8,60,73,98,120]. In this paper, we are particularly interested in interleaved combinations because we think they provide a good trade-off between the effort for their implementation and the efficiency of the combined approaches.…”