Understanding the effects of changes on the cost‐effectiveness of regression testing techniques

Abstract

Regression testing is an expensive testing process used to validate modified software. Regression test selection and test‐case prioritization can reduce the costs of regression testing by selecting a subset of test cases for execution, or scheduling test cases to meet testing objectives better. The cost‐effectiveness of these techniques can vary widely, however, and one cause of this variance is the type and magnitude of changes made in producing a new software version. Engineers unaware of the causes and effects of this variance can make poor choices in designing change integration processes, selecting inappropriate regression testing techniques, designing excessively expensive regression test suites and making unnecessarily costly changes. Engineers aware of causal factors can perform regression testing more cost‐effectively. This article reports the results of an embedded multiple case study investigating the modifications made in the evolution of four software systems and their impact on regression testing techniques. The results of this study expose tradeoffs and constraints that affect the success of techniques and provide guidelines for designing and managing regression testing processes. Copyright © 2003 John Wiley & Sons, Ltd.

Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact

“…It seems reasonable, then, to expect our extended infrastructure to be used for experimentation by others, and to help extend the validity of experimental results through widened scope. Indeed, we ourselves have been able to use several of the newer infrastructure objects that are about to be released in controlled experiments described in recent publications [15,16,29,38], as well as in three publications currently under review.…”

Kỹ Thuật Kiểm Thử Hồi Qui Hiệu Quả Cho Phát Triển Ứng Dụng Di Động

“…-Thuật toán Greedy bổ sung [15]: thuật toán này sử dụng phản hồi từ sự chọn lựa trước đó. Nó chọn các thành phần có trọng số lớn nhất trong phần mà chưa được chọn trước đó.…”

High-Coverage Symbolic Patch Testing

“…[3,10,18,24]. These techniques are particularly useful for very large projects where running the entire test suite at each change of the system is infeasible (for example in the Windows operating system testing infrastructure [26]).…”