With the growing complexity of computer-based systems, their graphical user interfaces have also become more complex. Accordingly, the test and analysis process becomes more tedious and costly. This paper introduces a holistic view of fault modelling that is carried out as a complementary step to system modelling, enabling a scalability of the test process, and providing considerable potential for automation. Event-based notions and tools are used to generate and select test cases systematically. The elements of the approach are illustrated and validated by a case study. This paper does not claim to introduce a novel theoretic approach; rather, it makes use of graph-theoretic results for a practical and simple, but nevertheless powerful, view of modelling, analysis and testing of graphical user interfaces. 4 F. BELLI, C. J. BUDNIK AND L. WHITE User Interaction Management System that can be independent of the application, graphics package, etc.[1]. The present paper will focus on the user interface (UI), especially on specification and validation aspects of the system behaviour and its collaboration with the user. Today UIs are usually implemented graphically; this paper will concentrate on graphical user interfaces (GUIs); UI and GUI will be used interchangeably.The design part of the UI development needs a good understanding of the user and his/her needs, while the implementation part requires familiarity with the technical equipment, e.g. programming platform, language, etc. [2,3]. Testing requires both a good understanding of user requirements, and familiarity with the technical equipment. This paper is about UI testing; more precisely, testing of the software that implements the UI. To some extent, analysis aspects will also be covered as testing and analysis usually belong together. Apart from GUI testing, the approach can be deployed for usercentred testing and analysis of any human-computer system including reactive systems, e.g. Internet applications, vending machines, CD players, etc. [4].When observing an interactive human-machine system, depending on the expectations of the user concerning the system behaviour, a distinction is to be made between desirable and undesirable situations, or events. The set of desirable events defines the system properties. Any deviation from the expected behaviour amounts to an undesirable situation. Alongside the desirable system behaviour, for a holistic approach, it is necessary to also consider the undesirable behaviour of the system as a complementary view.Based on previous work by Belli [4] and by White et al. [5], this paper introduces a holistic view of fault modelling that requires an additional, complementary step to system modelling. Thus, both the desirable and undesirable behaviour of the system is specified at the same level of design granularity. In other words, intended and unintended usage scenarios will be generated to check both that system behaviour is in compliance with the user's expectations and that faults are handled properly. This is one of the im...
The behavior of composed Web services depends on the results of the invoked services; unexpected behavior of one of the invoked services can threat the correct execution of an entire composition. This paper proposes an event-based approach to black-box testing of Web service compositions based on event sequence graphs, which are extended by facilities to deal not only with service behavior under regular circumstances (i.e., where cooperating services are working as expected) but also with their behavior in undesirable situations (i.e., where cooperating services are not working as expected). Furthermore, the approach can be used independently of artifacts (e.g., Business Process Execution Language) or type of composition (orchestration/choreography). A large case study, based on a commercial Web application, demonstrates the feasibility of the approach and analyzes its characteristics. Test generation and execution are supported by dedicated tools. Especially, the use of an enterprise service bus for test execution is noteworthy and differs from other approaches. The results of the case study encourage to suggest that the new approach has the power to detect faults systematically, performing properly even with complex and large compositions.To assure the delivery of high quality and robust service-oriented applications, SOA testing has received much attention [4]. In this context, WSC testing plays an important role [5][6][7][8][9][10][11] because the behavior of the composite services now depends not only on the WSC itself but also on the integrated services, complicating the testing process. The WSC can present complex communications among the integrated services in which missing or unexpected messages can lead to a failure. Furthermore, the composition may fail because of undesirable behavior of partner services, such as corrupted messages, unavailable servers, and long timeouts.A common problem in testing any kind of application is to automatically generate meaningful test cases. The strategy of using models for test case generation is known as model-based testing (MBT). In MBT, a tester uses his or her knowledge of a given system under consideration (SUC) § to develop a model for generating test cases. MBT can be applied in initial development phases because the modeling and test generation do not require an executable system. The appropriate application of MBT in software projects brings several benefits, such as high fault detection rate, reduced cost and time for testing, requirement evolution, and high level of automation (see, e.g., a detailed evaluation of MBT in [12]).Test models are more productive when specific features of the system can be described using an appropriate modeling technique. Event-based models have been used to support verification and testing [13][14][15] because events are essential for many different classes of systems, for example, Web applications or embedded systems. Event sequence graphs (ESGs), originally introduced for testing graphical user interfaces [14], were also used t...
This paper rigorously introduces the concept of model-based mutation testing (MBMT) and positions it in the landscape of mutation testing. Two elementary mutation operators, insertion and omission, are exemplarily applied to a hierarchy of graph-based models of increasing expressive power including directed graphs, event sequence graphs, finite-state machines and statecharts. Test cases generated based on the mutated models (mutants) are used to determine not only whether each mutant can be killed but also whether there are any faults in the corresponding system under consideration (SUC) developed based on the original model. Novelties of our approach are: (1) evaluation of the fault detection capability (in terms of revealing faults in the SUC) of test sets generated based on the mutated models, and (2) superseding of the great variety of existing mutation operators by iterations and combinations of the two proposed elementary operators. Three case studies were conducted on industrial and commercial real-life systems to demonstrate the feasibility of using the proposed MBMT approach in detecting faults in SUC, and to analyze its characteristic features. Our experimental data suggest that test sets generated based on the mutated models created by insertion operators are more effective in revealing faults in SUC than those generated by omission operators. Worth noting is that test sets following the MBMT approach were able to detect faults in the systems that were tested by manufacturers and independent testing organizations before they were released.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.