A Systematic Literature Review of Test Case Prioritization Using Genetic Algorithms

Abstract

Regression testing is the essential process of software maintenance and evolution phase of the software development life cycle for assuring the quality and reliability of updated software. Test case prioritization is the technique of regression testing to reduce the time and effort required for regression testing. Search-based algorithms are used to enhance the efficiency and effectiveness of the method. Among these search-based optimization algorithms, genetic algorithms are becoming more popular among researchers since the last decade. In this paper, we are doing a systematic literature review, i.e., a secondary study of test case prioritization using genetic algorithms. The objective of this review is to examine and classify the current state of use of the genetic algorithm in test case prioritization. In other words, to give a base for the advancement of test case prioritization research using genetic algorithms. With the use of the systematic literature review protocol, we selected the most relevant studies (20 out of 384) from the appropriate repositories by using a set of search keywords, inclusion/exclusion criteria and the quality assessment of studies. The data extraction and synthesis process and the taxonomic classification are used to answer the research questions. We also performed a rigorous analysis of the techniques by comparing them on research methodology, the prioritization method, dataset specification, test suite size, types of genetic algorithms used, performance metrics, and the validation criteria. The whole process took four months for comprehensive analysis and classification of primary studies. We observed that the parameter settings, the type of operators, the probabilistic rate of operators, and fitness function design have a significant impact on the quality of the solutions obtained. This systematic literature review yields that genetic algorithms have great potential in solving test case prioritization problems, and the area is open for further improvements. Future researchers can fill the research gaps by following the suggestions given in the review. From this review, we found that the use of the appropriate approach can make a genetic algorithm based test case prioritization one of the effective methods in regression testing.INDEX TERMS Genetic algorithm, NSGA-II, regression testing, systematic review, test case prioritization.

Decision support system choosing software testing strategy

“…The quality of software is the entire range of signs and characteristics of software products, which refers to its ability to satisfy established or anticipated needs [1]. According to the main literature sources, software quality criteria are a set of properties (attributes) of software products according to which all quality is evaluated and described [12,13].…”

A Genetic Algorithm-Based Approach for Composite Metamorphic Relations Construction

“…In order to retain the chromosome with the higher fitness value, the individuals with high fitness value are selected to crossover after the evaluation of the CMR sequence. We use roulette wheel selection [40] to choose the individuals on which crossover and mutation will be applied.…”

Regression Test Case Prioritization Frameworks: Challenges and Future Directions

“…Table I presents the four frameworks that were evaluated for their effectiveness using a weighted average percentage of faults detected (APFD) metric namely F1, F6, F8, and F10. The APFD is a well-known metric developed by Rothermel et al [8] which has since became the most popular metric for evaluating the effectiveness of TCP whereby more than 40% of current studies in the field of TCP employ APFD [31]. Moreover, the calculated values for APFD range from 0 up to 100, as the higher value indicates the better (faster) fault detection rates and can be calculated as [1], [32]:…”