Evaluating a Test Automation Decision Support Tool

Baral, Kesina; Mohod, Rasika; Flamm, Jennifer; Goldrich, Seth; Ammann, Paul

doi:10.1109/icstw.2019.00034

Cited by 3 publications

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[97][98][99] Automation is also used as decision support system to support go and no go decision for production code promotions. 100,101 Automation effectiveness is measured by the number of defects found and quality of software under test. 102,103 Automated suite optimization helps in reduction of tests to minimize effort and time and results in overall quality for the software under test.…”

Section: Review Of Literaturementioning

confidence: 99%

A survey on software test automation return on investment, in organizations predominantly from Bengaluru, India

Reanzi

Thangaiah

2021

International Journal of Engineering Business Management

View full text Add to dashboard Cite

Software industry has adopted automated testing widely. The most common method adopted is graphical user interface test automation for the functional scenarios to reduce manual testing and increase the repeatability. Reducing execution time and redundancy to achieve quality “go/no go decisions” provides rational for the executive management to allocate funds to adopt automation and invest in the setup including people, process, and tools to achieve faster time to market. There are a variety of practices engaged by testers, like frameworks, tools, methods, procedures, models, and technologies to achieve automation. Nonetheless, the actual effectiveness in terms of return on investment (ROI) is not known, though there are various formulas to calculate ROI of test automation. The factors that determine the ROI are maturity of test automation, purpose, or intent, picking right tests for automation, knowledge of the tester to derive test coverage, domain expertise, defining right metrics like defects found by automation runs, cost versus reduction of time, labor versus quality of scripts, repeatability, and results. These factors form the base of the questions designed for the survey. The paper presents a survey and analysis to understand the ROI of test automation from industry test professionals from both product and services organizations.

show abstract