Techniques for selective revalidation

Hartmann, Jochen; Robson, D. J.

doi:10.1109/52.43047

Cited by 82 publications

(26 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For instance, if we w ant t o s i m ulate random5, we use random25 with probability 0.2, and do no regression testing at all random0 with probability 0. 8 underestimates the e ectiveness of the true random technique, and, thus, overestimates the value of k that we are looking for. 7 For a xed trial value of k, and program version, we computed the average test suite size using minimization call this x.…”

Section: Minimization Versus Randomizationmentioning

confidence: 99%

An empirical study of regression test selection techniques

Graves

Harrold

Kim

et al. 2001

ACM Trans. Softw. Eng. Methodol.

275

146

View full text Add to dashboard Cite

Regression testing is the process of validating modi ed software to detect whether new errors have been introduced into previously tested code and to provide con dence that modi cations are correct. Since regression testing is an expensive process, researchers have proposed regression test selection techniques as a way to reduce some of this expense. These techniques attempt to reduce costs by selecting and running only a subset of the test cases in a program's existing test suite. Although there have been some analytical and empirical evaluations of individual techniques, to our knowledge only one comparative study, focusing on one aspect of two of these techniques, has been reported in the literature. We conducted an experiment to examine the relative costs and bene ts of several regression test selection techniques. The experiment examined ve techniques for reusing test cases, focusing on their relative abilities to reduce regression testing e ort and uncover faults in modi ed programs. Our results highlight several di erences between the techniques, and expose essential tradeo s that should be considered when choosing a technique for practical application.

show abstract

Section: Minimization Versus Randomizationmentioning

confidence: 99%

An empirical study of regression test selection techniques

Graves

Harrold

Kim

et al. 2001

ACM Trans. Softw. Eng. Methodol.

275

146

View full text Add to dashboard Cite

show abstract

“…Task Type (c.) ∈ {uncategorized, adaptive, corrective, ...} The task type describes the kind of work that is expected to occur in a task [26]. Corrective tasks are bug fixes.…”

Section: Number Of Changed Filesmentioning

confidence: 99%

Modern code reviews in open-source projects: which problems do they fix?

Beller

Bacchelli

Zaidman

et al. 2014

Proceedings of the 11th Working Conference on Mining Software Repositories

197

140

View full text Add to dashboard Cite

Code review is the manual assessment of source code by humans, mainly intended to identify defects and quality problems. Modern Code Review (MCR), a lightweight variant of the code inspections investigated since the 1970s, prevails today both in industry and open-source software (OSS) systems. The objective of this paper is to increase our understanding of the practical benefits that the MCR process produces on reviewed source code. To that end, we empirically explore the problems fixed through MCR in OSS systems. We manually classified over 1,400 changes taking place in reviewed code from two OSS projects into a validated categorization scheme. Surprisingly, results show that the types of changes due to the MCR process in OSS are strikingly similar to those in the industry and academic systems from literature, featuring the similar 75:25 ratio of maintainability-related to functional problems. We also reveal that 7-35% of review comments are discarded and that 10-22% of the changes are not triggered by an explicit review comment. Patterns emerged in the review data; we investigated them revealing the technical factors that influence the number of changes due to the MCR process. We found that bug-fixing tasks lead to fewer changes and tasks with more altered files and a higher code churn have more changes. Contrary to intuition, the person of the reviewer had no impact on the number of changes.

show abstract

“…Over the past two decades, much effort has been expended on research into regression test selection techniques, and many techniques have been described in the literature [1], [3], [4], [5], [6], [7], [8], [9], [10], [12], [15], [16], [17], [18], [21], [22], [23], [24], [25], [28], [35], [36], [37], [38], [39], [40], [41]. These techniques have been evaluated and compared analytically [33], but only recently have attempts been made to evaluate or compare them empirically [6], [8], [11], [29], [30], [34], [40].…”

Section: Introductionmentioning

confidence: 99%

Empirical studies of a safe regression test selection technique

Rothermel

Harrold

1998

IIEEE Trans. Software Eng.

192

132

View full text Add to dashboard Cite

Abstract-Regression testing is an expensive testing procedure utilized to validate modified software. Regression test selection techniques attempt to reduce the cost of regression testing by selecting a subset of a program's existing test suite. Safe regression test selection techniques select subsets that, under certain well-defined conditions, exclude no tests (from the original test suite) that if executed would reveal faults in the modified software. Many regression test selection techniques, including several safe techniques, have been proposed, but few have been subjected to empirical validation. This paper reports empirical studies on a particular safe regression test selection technique, in which the technique is compared to the alternative regression testing strategy of running all tests. The results indicate that safe regression test selection can be cost-effective, but that its costs and benefits vary widely based on a number of factors. In particular, test suite design can significantly affect the effectiveness of test selection, and coverage-based test suites may provide test selection results superior to those provided by test suites that are not coverage-based.

show abstract

Techniques for selective revalidation

Cited by 82 publications

References 5 publications

An empirical study of regression test selection techniques

An empirical study of regression test selection techniques

Modern code reviews in open-source projects: which problems do they fix?

Empirical studies of a safe regression test selection technique

Contact Info

Product

Resources

About