GUI Test Script Repair in Regression Testing

Abstract

Abstract-UI testing is a process of testing a software application or functionality of GUI. It is defined as an interface between user and software which provides an easy way to interact with the system. GUI plays an important role in software engineering. GUI-based application requires that a test case consists of sequences of user actions/events to be executed. Selenium is an open-source tool for testing GUI Application by executing test cases whether the GUI Application is working properly or not. In this, we present test script repair technique to repair test cases. Test script repair technique uses reverse engineering process for creating the test script. Test script repair consists of three stages; they are Ripping, Mapping and Repairing. In ripping stage, there are two relationships for representing event interaction of GUI Application. During ripping we know the location of each widget. In mapping stage,original GUI events are mapped to an event-flow graph (EFG). In repairing stage, Event flow graph uses repairing transformations and human input to modified script to repair the test cases, and synthesizes a new "repaired" test script. During this process, test script repair uses GUI objects for yielding a final test script that can be executed using selenium tool to validate the GUI Application. An experiment using selenium tool to test, test cases suggests that it is effective in that unusable test scripts are repaired. Annotations significantly reduced the human cost to repair test cases.

A systematic literature review of test breakage prevention and repair techniques

“…There is a need for controlled experiments and industry case studies to compare the effectiveness of the proposed test repair and breakage prevention approaches. [22] An Extensible Heuristic-Based Framework for GUI Test Case Maintenance S3 Gao et al [51] Analyzing Refactorings' Impact on Regression Test Cases S4 Xu et al [20] Using Genetic Algorithms to Repair JUnit Test Cases S5 Pinto et al [52] Understanding Myths and Realities of Test-suite Evolution S6 Mirzaaghaei et al [53] Supporting Test Suite Evolution through Test Case Adaptation S7 Huang et al [54] Repairing GUI test suites using a genetic algorithm S8 Cunha and Maria Ana Casal [55] Automatic maintenance of test scripts S9 Li et al [56] ATOM: Automatic Maintenance of GUI Test Scripts for Evolving Mobile Applications S10 Zhang et al [57] Automatically repairing broken workflows for evolving GUI applications S11 Atif Memon [58] Automatically repairing event sequence-based GUI test suites for regression testing S12 Mirzaaghaei et al [59] Automatically repairing test cases for evolving method declarations S13 Rapos et al [60] Examining the co-evolution relationship between Simulink Models and their test cases S14 Priya et al [61] GUI Test Script Repair in Regression Testing S15 Gove et al [62] Identifying infeasible GUI test cases using support vector machines and induced grammars S16 Grechanik et al [63] Maintaining and evolving GUI-directed test scripts S17 Yang et al [64] Specification-Based Test Repair Using a Lightweight Formal Method S18 Gao et al [6] SITAR: GUI Test Script Repair S19 Mirzaaghaei et al [65] TestCareAssistant: Automatic Repair of Test Case Compilation Errors S20 Hammoudi et al [66] WATERFALL: an incremental approach for repairing recordreplay tests of web applications S21 Choudhary et al [7] WATER: Web Application TEst Repair S22 Atif Memon and Mary Lou Regression testing of GUIs…”