AutoBlackTest: Automatic Black-Box Testing of Interactive Applications

Mariani, Leonardo; Pezzè, Mauro; Riganelli, Oliviero; Santoro, Mauro

doi:10.1109/icst.2012.88

Cited by 85 publications

(80 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are many researches of model based testing for web applications and GUI applications such as [11], [12] and [13]. Their approach only generate test scenarios without test oracles and cannot treat the web pages which do not appear in models.…”

Section: Related Workmentioning

confidence: 99%

POGen: A Test Code Generator Based on Template Variable Coverage in Gray-Box Integration Testing for Web Applications

Sakamoto

Tomohiro²,

Hamura³

et al. 2013

Fundamental Approaches to Software Engineering

View full text Add to dashboard Cite

Abstract. Web applications are complex; they consist of many subsystems and run on various browsers and platforms. This makes it difficult to conduct adequate integration testing to detect faults in the connections between subsystems or in the specific environments. Therefore, establishing an efficient integration testing method with the proper test adequacy criteria and tools is an important issue.In this paper, we propose a new test coverage called template variable coverage. We also propose a novel technique for generating skeleton test code that includes accessor methods and improves the template variable coverage criterion, using a tool that we developed called POGen. Our experiments show that template variable coverage correlates highly with the capability to detect faults, and that POGen can reduce testing costs.

show abstract

Section: Related Workmentioning

confidence: 99%

POGen: A Test Code Generator Based on Template Variable Coverage in Gray-Box Integration Testing for Web Applications

Sakamoto

Tomohiro²,

Hamura³

et al. 2013

Fundamental Approaches to Software Engineering

View full text Add to dashboard Cite

show abstract

“…Finally, GUI testing techniques [36,34] share with Link the high-level objective of testing an application using the GUI. However, while Link specifically addresses the generation of test inputs, these techniques focus on the generation of test sequences relying on predefined data-sets as test data.…”

Section: Related Workmentioning

confidence: 99%

“…The data obtained for the car domain witness a good performance of Link also when the used knowledge base is not well suitable for that domain. Most of the techniques to automatically generate system test cases, such as GUITAR [36] and AutoBlackTest [34], focus on generating event sequences that use user-defined inputs and are not designed to generate semantically meaningful test inputs for complex forms. The only techniques that consider semantic information are the ones proposed by Bozkurt and Harman, McMinn et al and Shahbaz et al [17,35,42], but unfortunately no prototype tools were publicly available at the time of writing.…”

Section: Quality Of Modelsmentioning

confidence: 99%

“…Generating test cases automatically may largely reduce the effort required to generate test cases. Unfortunately, so far research in automatic generation of system-level test cases has focused mostly on deriving test sequences, with approaches based on models [36,37], learning [34], search-based algorithms [29], and reuse [28,24]. These strategies do not tackle the problem of generating realistic and coherent test inputs, and can hardly cope with applications that extensively exploit the semantic of the input data.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Link: exploiting the web of data to generate test inputs

Mariani

Pezzè

Riganelli

et al. 2014

Proceedings of the 2014 International Symposium on Software Testing and Analysis

Self Cite

View full text Add to dashboard Cite

Applications that process complex data, such as maps, personal data, book information, travel data, etc., are becoming extremely common. Testing such applications is hard, because they require realistic and coherent test inputs that are expensive to generate manually and difficult to synthesize automatically. So far the research on test case generation techniques has focused mostly on generating test sequences and synthetic test inputs, and has payed little attention to the generation of complex test inputs.This paper presents Link, a technique to automatically generate test cases for applications that process complex data. The novel idea of Link is to exploit the Web of Data to generate test data that match the semantics of the related fields, and satisfy the semantic constraints that arise among interrelated fields. Link automatically analyzes the GUI of the application under test, generates a model of the required inputs, queries DBPedia to extract the data that can be used in the tests, and uses the extracted data to generate complex system test inputs.The experimental results show that Link can generate realistic and coherent test inputs that can exercise behaviors difficult to exercise with currently available techniques.

show abstract

“…Test case generation for graphical user interfaces (GUIs) is an active research area [3,8,18,31,34]. Test cases are represented as sequences of events that encode corresponding user interactions with the GUI.…”

Section: Introductionmentioning

confidence: 99%

Reducing GUI test suites via program slicing

Arlt

Podelski

Wehrle

2014

Proceedings of the 2014 International Symposium on Software Testing and Analysis

View full text Add to dashboard Cite

A crucial problem in GUI testing is the identification of accurate event sequences that encode corresponding user interactions with the GUI. Ultimately, event sequences should be both feasible (i. e., executable on the GUI) and relevant (i. e., cover as much of the code as possible). So far, most work on GUI testing focused on approaches to generate feasible event sequences. In addition, based on event dependency analyses, a recently proposed static analysis approach systematically aims at selecting both relevant and feasible event sequences. However, statically analyzing event dependencies can cause the generation of a huge number of event sequences, leading to unmanageable GUI test suites that are not executable within reasonable time.In this paper we propose a refined static analysis approach based on program slicing. On the theoretical side, our approach identifies and eliminates redundant event sequences in GUI test suites. Redundant event sequences have the property that they are guaranteed to not affect the test effectiveness. On the practical side, we have implemented a slicing-based test suite reduction algorithm that approximatively identifies redundant event sequences. Our experiments on six open source GUI applications show that our reduction algorithm significantly reduces the size of GUI test suites. As a result, the overall execution time could significantly be reduced without losing test effectiveness.

show abstract

AutoBlackTest: Automatic Black-Box Testing of Interactive Applications

Cited by 85 publications

References 23 publications

POGen: A Test Code Generator Based on Template Variable Coverage in Gray-Box Integration Testing for Web Applications

POGen: A Test Code Generator Based on Template Variable Coverage in Gray-Box Integration Testing for Web Applications

Link: exploiting the web of data to generate test inputs

Reducing GUI test suites via program slicing

Contact Info

Product

Resources

About