Assuring the model evolution of protocol software specifications by regression testing process improvement

Abstract

SUMMARY Model‐based testing helps test engineers automate their testing tasks so that they are more cost‐effective. When the model is changed because of the evolution of the specification, it is important to maintain the test suites up to date for regression testing. A complete regeneration of the whole test suite from the new model, although inefficient, is still frequently used in the industry, including Microsoft. To handle specification evolution effectively, we propose a test case reusability analysis technique to identify reusable test cases of the original test suite based on graph analysis. We also develop a test suite augmentation technique to generate new test cases to cover the change‐related parts of the new model. The experiment on four large protocol document testing projects shows that our technique can successfully identify a high percentage of reusable test cases and generate low‐redundancy new test cases. When compared with a complete regeneration of the whole test suite, our technique significantly reduces regression testing time while maintaining the stability of requirement coverage over the evolution of requirements specifications. Copyright © 2011 John Wiley & Sons, Ltd.

Bypassing Code Coverage Approximation Limitations via Effective Input-Based Randomized Test Case Prioritization

“…Due to the huge experimental effort, we will leave the comparison with the white-box ART techniques [3] as future work. …”

An improved distributed concolic testing approach

“…Jiang et al . proposed a test case re‐usability analysis technique known as reusable test case analysis technique for model‐based regression testing for model‐based regression testing can identify obsolete and reusable test cases effectively to generate new test cases to cover changed parts of the model and combine the re‐usable and new test cases to form a new test suite for future regression testing. They have focused on achieving high percentage of the reusable test cases to significantly reduce regression testing time.…”

“…Like Jiang et al . , our proposed work aims at generating more test cases in order to achieve high MC/DC percentage.…”

“…In our proposed work, we have implemented distributed concolic testing to speed up our test case generation process. Like Jiang et al [28], our proposed work aims at generating more test cases in order to achieve high MC/DC percentage. First, we present an overview of the proposed SMCDCT framework in Section 4.1.…”

Introduction to the Special Issue for the 10th International Conference on Quality Software (QSIC 2010)

“…In ‘Assuring the Model Evolution of Protocol Software Specifications by Regression Testing Process Improvement’ , Bo Jiang, T. H. Tse, Wolfgang Grieskamp, Nicolas Kicillof, Yiming Cao, Xiang Li, and W.K. Chan propose an automatic model‐based technique that discards obsolete test cases from a regression test suite and generates concrete test cases to maintain the regression test suite.…”