Tapir: Automation Support of Exploratory Testing Using Model Reconstruction of the System Under Test

Abstract

For a considerable number of software projects, the creation of effective test cases is hindered by design documentation that is either lacking, incomplete or obsolete. The exploratory testing approach can serve as a sound method in such situations. However, the efficiency of this testing approach strongly depends on the method, the documentation of explored parts of a system, the organization and distribution of work among individual testers on a team, and the minimization of potential (very probable) duplicities in performed tests. In this paper, we present a framework for replacing and automating a portion of these tasks. A screen-flow-based model of the tested system is incrementally reconstructed during the exploratory testing process by tracking testers' activities. With additional metadata, the model serves for an automated navigation process for a tester. Compared with the exploratory testing approach, which is manually performed in two case studies, the proposed framework allows the testers to explore a greater extent of the tested system and enables greater detection of the defects present in the system. The results show that the time efficiency of the testing process improved with framework support. This efficiency can be increased by team-based navigational strategies that are implemented within the proposed framework, which is documented by another case study presented in this paper.

A Testing Tool for IoT Systems Operating with Limited Network Connectivity

“…From a conceptual viewpoint, the dynamic nature of the problem of possible limited network connectivity during SUT operation might point future research directions towards adding more agility to the approach as well. In this sense, dynamic construction of the SUT model and its subsequent combination with model-based test case generation, as successfully tried with web-based software systems [5,7,4], might be a perspective method as well in the IoT systems. Such an approach has to be examined further.…”

PatrIoT: IoT Automated Interoperability and Integration Testing Framework

“…We are also adding more modules that allow the creation of simulators of various IoT devices. The next prospective direction is adding more capability of the framework for agile testing means, as we successfully tried for web-based systems [19].…”

Discovering Boundary Values of Feature-based Machine Learning Classifiers through Exploratory Datamorphic Testing

“…For example, ARME enables the automatic re nement of system models based on recorded testing activities of test engineers (Gebizli and Sözer, 2016). Tapir supports team collaboration in exploratory testing and reconstruction of system models (Bures et al, 2018). However, as far as we know, there is no work in the literature that automates exploratory strategies as we have done, even though many exploratory strategies have been documented in the literature such as those by Whi aker (2009) and Hendrickson (2013).…”