Event-based modelling, analysis and testing of user interactions: approach and case study

Belli, Fevzi; Budnik, Christof J.; White, Lee

doi:10.1002/stvr.335

Cited by 83 publications

(86 citation statements)

References 40 publications

(52 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For exemplifying modeling, model-based testing, and model mutation, we interpret the nodes of a DG as events and arcs as sequences of events leading to event sequence graphs (ESG) [3]. Generally, an event represents an externally observable phenomenon, such as an environmental or a user stimulus, or a system response punctuating different stages of the system activity of an SUC, which is assumed to be deterministic.…”

Section: Event Sequence Graphsmentioning

confidence: 99%

See 1 more Smart Citation

Model-based mutation testing—Approach and case studies

Belli

Budnik

Hollmann³

et al. 2016

Science of Computer Programming

Self Cite

View full text Add to dashboard Cite

This paper rigorously introduces the concept of model-based mutation testing (MBMT) and positions it in the landscape of mutation testing. Two elementary mutation operators, insertion and omission, are exemplarily applied to a hierarchy of graph-based models of increasing expressive power including directed graphs, event sequence graphs, finite-state machines and statecharts. Test cases generated based on the mutated models (mutants) are used to determine not only whether each mutant can be killed but also whether there are any faults in the corresponding system under consideration (SUC) developed based on the original model. Novelties of our approach are: (1) evaluation of the fault detection capability (in terms of revealing faults in the SUC) of test sets generated based on the mutated models, and (2) superseding of the great variety of existing mutation operators by iterations and combinations of the two proposed elementary operators. Three case studies were conducted on industrial and commercial real-life systems to demonstrate the feasibility of using the proposed MBMT approach in detecting faults in SUC, and to analyze its characteristic features. Our experimental data suggest that test sets generated based on the mutated models created by insertion operators are more effective in revealing faults in SUC than those generated by omission operators. Worth noting is that test sets following the MBMT approach were able to detect faults in the systems that were tested by manufacturers and independent testing organizations before they were released.

show abstract

Section: Event Sequence Graphsmentioning

confidence: 99%

“…The paper uses them to introduce notions, especially mutation operators, syntactically. (ii) Event sequence graphs (ESG) interpret nodes as events and arcs as sequences of events [3]. (iii) Finite-state machines (FSM) interpret nodes as states, whereas arcs labeled by events symbolizing state transitions.…”

Section: Introductionmentioning

confidence: 99%

Model-based mutation testing—Approach and case studies

Belli

Budnik

Hollmann³

et al. 2016

Science of Computer Programming

Self Cite

View full text Add to dashboard Cite

show abstract

“…Very few works [17][18][19][20] have been reported to show the generation of test cases using events. The role of events in testing is found in the area of GUI testing.…”

Section: Comparisons With Related Bodies Of Workmentioning

confidence: 99%

“…Combined with customized Event-Space Exploration Strategies (ESESs), the proposed event-flow model is used to quickly generate a large number of GUI test cases, which are effective in detecting GUI faults. Event-based notions and tools are also used to generate and select test cases systematically and introduce a holistic view of fault modeling [20]. A new GUI automation test model is presented in [19] that is based on an event-flow graph model to generate test cases in the daily smoke test and to create test cases in a deep regression test.…”

Section: Comparisons With Related Bodies Of Workmentioning

confidence: 99%

See 1 more Smart Citation

A Novel Approach for Deriving Test Scenarios and Test Cases from Events

Singh¹,

Sabharwal²,

Gupta³

2012

Journal of Information Processing Systems

View full text Add to dashboard Cite

Abstract-Safety critical systems, real time systems, and event-based systems have a complex set of events and their own interdependency, which makes them difficult to test ma Safety critic Safety critical systems, real time systems, and event-based systems have a complex set of events and their own interdependency, which makes them difficult to test manually. In order to cut down on costs, save time, and increase reliability, the model based testing approach is the best solution. Such an approach does not require applications or codes prior to generating test cases, so it leads to the early detection of faults, which helps in reducing the development time. Several model-based testing approaches have used different UML models but very few works have been reported to show the generation of test cases that use events. Test cases that use events are an apt choice for these types of systems. However, these works have considered events that happen at a user interface level in a system while other events that happen in a system are not considered. Such works have limited applications in testing the GUI of a system. In this paper, a novel model-based testing approach is presented using business events, state events, and control events that have been captured directly from requirement specifications. The proposed approach documents events in event templates and then builds an event-flow model and a fault model for a system. Test coverage criterion and an algorithm are designed using these models to generate event sequence based test scenarios and test cases. Unlike other event based approaches, our approach is able to detect the proposed faults in a system. A prototype tool is developed to automate and evaluate the applicability of the entire process. Results have shown that the proposed approach and supportive tool is able to successfully derive test scenarios and test cases from the requirement specifications of safety critical systems, real time systems, and event based systems

show abstract

A holistic approach to model‐based testing of Web service compositions

et al. 2012

Self Cite

View full text Add to dashboard Cite

The behavior of composed Web services depends on the results of the invoked services; unexpected behavior of one of the invoked services can threat the correct execution of an entire composition. This paper proposes an event-based approach to black-box testing of Web service compositions based on event sequence graphs, which are extended by facilities to deal not only with service behavior under regular circumstances (i.e., where cooperating services are working as expected) but also with their behavior in undesirable situations (i.e., where cooperating services are not working as expected). Furthermore, the approach can be used independently of artifacts (e.g., Business Process Execution Language) or type of composition (orchestration/choreography). A large case study, based on a commercial Web application, demonstrates the feasibility of the approach and analyzes its characteristics. Test generation and execution are supported by dedicated tools. Especially, the use of an enterprise service bus for test execution is noteworthy and differs from other approaches. The results of the case study encourage to suggest that the new approach has the power to detect faults systematically, performing properly even with complex and large compositions.To assure the delivery of high quality and robust service-oriented applications, SOA testing has received much attention [4]. In this context, WSC testing plays an important role [5][6][7][8][9][10][11] because the behavior of the composite services now depends not only on the WSC itself but also on the integrated services, complicating the testing process. The WSC can present complex communications among the integrated services in which missing or unexpected messages can lead to a failure. Furthermore, the composition may fail because of undesirable behavior of partner services, such as corrupted messages, unavailable servers, and long timeouts.A common problem in testing any kind of application is to automatically generate meaningful test cases. The strategy of using models for test case generation is known as model-based testing (MBT). In MBT, a tester uses his or her knowledge of a given system under consideration (SUC) § to develop a model for generating test cases. MBT can be applied in initial development phases because the modeling and test generation do not require an executable system. The appropriate application of MBT in software projects brings several benefits, such as high fault detection rate, reduced cost and time for testing, requirement evolution, and high level of automation (see, e.g., a detailed evaluation of MBT in [12]).Test models are more productive when specific features of the system can be described using an appropriate modeling technique. Event-based models have been used to support verification and testing [13][14][15] because events are essential for many different classes of systems, for example, Web applications or embedded systems. Event sequence graphs (ESGs), originally introduced for testing graphical user interfaces [14], were also used t...

show abstract

Event-based modelling, analysis and testing of user interactions: approach and case study

Cited by 83 publications

References 40 publications

Model-based mutation testing—Approach and case studies

Model-based mutation testing—Approach and case studies

A Novel Approach for Deriving Test Scenarios and Test Cases from Events

A holistic approach to model‐based testing of Web service compositions

Contact Info

Product

Resources

About