A Multi-Objective Technique to Prioritize Test Cases Based on Latent Semantic Indexing

Islam, Md. Mahfuzul; Marchetto, Alessandro; Susi, Angelo; Scanniello, Giuseppe

doi:10.1109/csmr.2012.13

Cited by 26 publications

(41 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other Approaches. Several other techniques based on leveraging dynamic program information have been proposed, but do not fit into any of the classifications enumerated above [25,51,41]. Islam et al presented an approach that recovers traceability links between system requirements and test cases using (IR) techniques, and dynamic information such as execution cost and code coverage, to prioritize test cases [25].…”

Section: Dynamic Tcp Techniquesmentioning

confidence: 99%

A large-scale empirical comparison of static and dynamic test case prioritization techniques

Luo

Moran

Poshyvanyk

2016

Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering

View full text Add to dashboard Cite

The large body of existing research in Test Case Prioritization (TCP) techniques, can be broadly classified into two categories: dynamic techniques (that rely on run-time execution information) and static techniques (that operate directly on source and test code). Absent from this current body of work is a comprehensive study aimed at understanding and evaluating the static approaches and comparing them to dynamic approaches on a large set of projects.In this work, we perform the first extensive study aimed at empirically evaluating four static TCP techniques comparing them with state-of-research dynamic TCP techniques at different test-case granularities (e.g., method and classlevel) in terms of effectiveness, efficiency and similarity of faults detected. This study was performed on 30 real-word Java programs encompassing 431 KLoC. In terms of effectiveness, we find that the static call-graph-based technique outperforms the other static techniques at test-class level, but the topic-model-based technique performs better at testmethod level. In terms of efficiency, the static call-graphbased technique is also the most efficient when compared to other static techniques. When examining the similarity of faults detected for the four static techniques compared to the four dynamic ones, we find that on average, the faults uncovered by these two groups of techniques are quite dissimilar, with the top 10% of test cases agreeing on only ≈ 25% -30% of detected faults. This prompts further research into the severity/importance of faults uncovered by these techniques, and into the potential for combining static and dynamic information for more effective approaches.

show abstract

Section: Dynamic Tcp Techniquesmentioning

confidence: 99%

A large-scale empirical comparison of static and dynamic test case prioritization techniques

Luo

Moran

Poshyvanyk

2016

Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering

View full text Add to dashboard Cite

show abstract

“…Several other techniques that utilize dynamic program information have been proposed, but do not fit neatly into our classification system enumerated above [30], [64], [51]. Islam et al presented an approach that reconciles information from traceability links between system requirements and test cases and dynamic information, such as execution cost and code coverage, to prioritize test cases [30]. Nguyen et al have designed an approach that uses IR techniques to recover the traceability links between change descriptions and execution traces for test cases to identify the most relevant test cases for each change description [51].…”

Section: Dynamic Tcp Techniquesmentioning

confidence: 99%

How Do Static and Dynamic Test Case Prioritization Techniques Perform on Modern Software Systems? An Extensive Study on GitHub Projects

Luo

Moran

Zhang³

et al. 2019

IIEEE Trans. Software Eng.

View full text Add to dashboard Cite

Test Case Prioritization (TCP) is an increasingly important regression testing technique for reordering test cases according to a pre-defined goal, particularly as agile practices gain adoption. To better understand these techniques, we perform the first extensive study aimed at empirically evaluating four static TCP techniques, comparing them with state-of-research dynamic TCP techniques across several quality metrics. This study was performed on 58 real-word Java programs encompassing 714 KLoC and results in several notable observations. First, our results across two effectiveness metrics (the Average Percentage of Faults Detected APFD and the cost cognizant APFDc) illustrate that at test-class granularity, these metrics tend to correlate, but this correlation does not hold at test-method granularity. Second, our analysis shows that static techniques can be surprisingly effective, particularly when measured by APFDc. Third, we found that TCP techniques tend to perform better on larger programs, but that program size does not affect comparative performance measures between techniques. Fourth, software evolution does not significantly impact comparative performance results between TCP techniques. Fifth, neither the number nor type of mutants utilized dramatically impact measures of TCP effectiveness under typical experimental settings. Finally, our similarity analysis illustrates that highly prioritized test cases tend to uncover dissimilar faults. and his thesis focused on improving bug reporting for mobile apps through novel applications of program analysis techniques. He has published in several top peerreviewed software engineering venues including: ICSE, ESEC/FSE, IC-SME, ICST, and MSR. He was recently recognized as the second-overall winner among graduate students in the ACM Student Research competition at ESEC/FSE15. Moran is a student member of IEEE and ACM and has served as an external reviewer for ICSE, ICSME, FSE, APSEC, and SCAM. More information available at https://www.kpmoran.com.

show abstract

“…[14,20,30,36]). In this section, we¯rst focus on related work concerning approaches based on IR and/or clustering techniques applied to web applications/ systems and then we discuss approaches that apply these techniques to software engineering.…”

Section: Related Workmentioning

confidence: 99%

Enhancing Navigability in Websites Built Using Web Content Management Systems

Distante

Risi

Scanniello

2014

Int. J. Soft. Eng. Knowl. Eng.

Self Cite

View full text Add to dashboard Cite

Websites built using Web Content Management Systems (WCMSs) usually provide their users with three types of access structures to surf their contents: indexes of categories, breadcrumb trails, and sitemaps. In addition, to¯nd contents of his/her interest, a user can perform more or less advanced full-text searches. In this paper we propose an automatic approach to extend the navigation structure of websites developed using WCMSs with Semantic Navigation Maps (SNMs), a complementary navigation structure that enables linking and navigating contents based on their lexical similarity. The approach uses an information retrieval technique (namely, Latent Semantic Indexing) to identify lexical similarities between textual contents, and a fuzzy clustering algorithm to form groups of similar web pages. For each page of the website, a set of navigation links towards pages showing similar content and a measure of such similarity is provided. The paper presents the approach to generate SNMs, an implementation for the Joomla! open source WCMS, and the results of an empirical evaluation involving two real world websites built using this WCMS.

show abstract

A Multi-Objective Technique to Prioritize Test Cases Based on Latent Semantic Indexing

Cited by 26 publications

References 29 publications

A large-scale empirical comparison of static and dynamic test case prioritization techniques

A large-scale empirical comparison of static and dynamic test case prioritization techniques

How Do Static and Dynamic Test Case Prioritization Techniques Perform on Modern Software Systems? An Extensive Study on GitHub Projects

Enhancing Navigability in Websites Built Using Web Content Management Systems

Contact Info

Product

Resources

About