An empirical comparison of test suite reduction techniques for user-session-based testing of Web applications

Sprenkle, Sara; Sampath, Sreedevi; Gibson, Emily; Pollock, Lori; Souter, Amie L.

doi:10.1109/icsm.2005.18

Cited by 37 publications

(41 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of multiple servers is beneficial in improving the computational time, especially for large complex systems having an enormous pool of test cases (Sprenkle et al, 2005). So, in this situation, the tester can achieve efficient computational time at the cost of extra required servers.…”

Section: Multiple Server-based Tsr Optimizationmentioning

confidence: 99%

A survey on Test Suite Reduction frameworks and tools

Khan

Lee

Ahmad

et al. 2016

International Journal of Information Management

View full text Add to dashboard Cite

Abstract-Software testing is a widely accepted practice that ensures the quality of a System under Test (SUT). However, the gradual increase of the test suite size demands high portion of testing budget and time. Test Suite Reduction (TSR) is considered a potential approach to deal with the test suite size problem. Moreover, a complete automation support is highly recommended for software testing to adequately meet the challenges of a resource constrained testing environment. Several TSR frameworks and tools have been proposed to efficiently address the test-suite size problem. The main objective of the paper is to comprehensively review the state-of-the-art TSR frameworks to highlights their strengths and weaknesses. Furthermore, the paper focuses on devising a detailed thematic taxonomy to classify existing literature that helps in understanding the underlying issues and proof of concept. Moreover, the paper investigates critical aspects and related features of TSR frameworks and tools based on a set of defined parameters. We also rigorously elaborated various testing domains and approaches followed by the extant TSR frameworks. The results reveal that majority of TSR frameworks focused on randomized unit testing, and a considerable number of frameworks lacks in supporting multi-objective optimization problems. Moreover, there is no generalized framework, effective for testing applications developed in any programming domain. Conversely, Integer Linear Programming (ILP) based TSR frameworks provide an optimal solution for multi-objective optimization problems and improve execution time by running multiple ILP in parallel. The study concludes with new insights and provides an unbiased view of the state-of-the-art TSR frameworks. Finally, we present potential research issues for further investigation to anticipate efficient TSR frameworks.

show abstract

Section: Multiple Server-based Tsr Optimizationmentioning

confidence: 99%

A survey on Test Suite Reduction frameworks and tools

Khan

Lee

Ahmad

et al. 2016

International Journal of Information Management

View full text Add to dashboard Cite

show abstract

“…The faults were equally distributed among the applications and were seeded according to the methodology of Sprenkle et al [31]. One hundred and fifty user sessions were then collected from volunteers asked to interact with each application in a typical manner.…”

Section: Reduction -Experimental Setupmentioning

confidence: 99%

“…We chose to implement various user-session test suite reduction strategies explored by Sprenkle et al [31]: retestall, Harrold-Gupta-Soffa, and Concept. The retest-all strategy does not reduce the size of the test suite and serves as a baseline for fault detection.…”

Section: Reduction -Experimental Setupmentioning

confidence: 99%

“…We followed the experimental setup in [31], taking a test case to be user session composed of URLs in a specific order, and its requirements to be the respective URLs each user session exercises. Because URLs frequently contain form data as name-value pairs, we follow Sprenkle et al [28,31] by examining the URLs independent of these values. For example, http://example.com/order.php?sku=12&id=11…”

Section: Reduction -Experimental Setupmentioning

confidence: 99%

“…Our last point provides developer guidance towards choosing an optimal testing approach when performing automated testing. This paper examines the trade offs between various test suite reduction methodologies [31] in terms of the consumer-perceived fault severities revealed by each approach.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Addressing High Severity Faults in Web Application Testing

Dobolyi

Weimer

2010

Software Engineering

View full text Add to dashboard Cite

Extreme resource constraints in web application development environments often lead to minimal formal testing. This lack of testing compounds the problem of low consumer retention. In this paper, we analyze an existing study of the consumer-perceived severities of 400 realworld web application faults. We provide concrete guidelines to increase the perceived return-on-investment of testing. We show that even coarse-grained, automated test cases can detect high severity faults. Developers can also mitigate consumer perceptions of fault severity by presenting faults using specific idioms that minimize disruptions to application interaction. Finally, we examine the trade offs between various user-session-based test suite reduction approaches for web applications and the severity of uncovered faults. Overall, we show that even modest testing approaches are able to provide significant predicted gains in consumer satisfaction by focusing on flagging and preventing high severity faults.

show abstract