ElasTest — An open source project for testing distributed applications with failure injection

Gortázar, Francisco; Gallego, Micael; García, Boni; Carella, Giuseppe; Pauls, Michael; Gheorghe-Pop, Ilie-Daniel

doi:10.1109/nfv-sdn.2017.8169851

Cited by 12 publications

(4 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In order to be able to collect all the information related to the application run, we have used the ElasTest tool Gortazár et al (2017Gortazár et al ( ), (2018; Bertolino et al (2018) which allowed the authors to execute tests, capture the logs and the videos, and produce the log comparisons. ElasTest provided as well the browser logs that would have been difficult to obtain without modifying the test cases.…”

Section: Dataset Contentsmentioning

confidence: 99%

A dataset of regressions in web applications detected by end-to-end tests

et al. 2021

Self Cite

View full text Add to dashboard Cite

End-to-end tests present many challenges in the industry. The long-running times of these tests make it unsuitable to apply research work on test case prioritization or test case selection, for instance, on them, as most works on these two problems are based on datasets of unit tests. These ones are fast to run, and time is not usually a considered criterion. This is because there is no dataset of end-to-end tests, due to the infrastructure needs for running this kind of tests, the complexity of the setup and the lack of proper characterization of the faults and their fixes. Therefore, running end-to-end tests for any research work is hard and time-consuming, and the availability of a dataset containing regression bugs, documentation and logs for these tests might foster the usage of end-to-end tests in research works. This paper presents a) a dataset for this kind of tests, including six well-documented manually injected regression bugs and their corresponding fixes in three web applications built using Java and the Spring framework; b) tools for easing the execution of these tests no matter the infrastructure; and c) a comparative study with two well-known datasets of unit tests. The comparative study shows that there are important differences between end-to-end and unit tests, such as their execution time and the amount of resources they consume, which are much higher in the end-to-end tests. End-to-end testing deserves some attention from researchers. Our dataset is a first effort toward easing the usage of end-to-end tests in research works.

show abstract

Section: Dataset Contentsmentioning

confidence: 99%

A dataset of regressions in web applications detected by end-to-end tests

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Regarding orchestration languages (not strictly related to testing), we can find different approaches. First, we could use TOSCA 4 (Topology and Orchestration Specification for Cloud Applications). TOSCA is an OASIS (Organization for the Advancement of Structured Information Standards) language to describe a topology of cloud based web services, their components, relationships, and the processes that manage them.…”

Section: Orchestration Languagesmentioning

confidence: 99%

“…This contribution is materialized through a number of novel concepts that include: i) the formalization of the test cases that can be interconnected for creating the topology; ii) the creation of an orchestration notation enabling testers to specify explicitly (i.e., edges and nodes) how the orchestration takes place; and iii) the creation of an engine interpreting that notation for orchestrating tests. All these contributions are being proposed and developed in the context of an European Union funded project called ElasTest [4]. In this project, we are creating a cloud platform designed for helping developers to test large software testing.…”

Section: Introductionmentioning

confidence: 99%

A Proposal to Orchestrate Test Cases

García

Lonetti

Gallego

et al. 2018

2018 11th International Conference on the Quality of Information and Communications Technology (QUATIC)

Self Cite

View full text Add to dashboard Cite

This paper presents the concept of test orchestration, understood as a novel way to select, order, and execute in parallel a group of tests. Our view of test orchestration can be seen as a process in which different test cases are organized, assembled and executed following a topology that determines how their executions coordinate. We distinguish two types of orchestrations techniques: i) verdict-driven, which organizes tests using their outcome (i.e., passed or failed) to drive the workflow; and ii) data-driven, in which test data (input) and test outcomes (output) are handled within the graph. Both approaches are being implemented in the project ElasTest, an open source platform aimed to simplify the end-to-end test process of large software systems.

show abstract

“…While a preliminary overview of the project objectives has been given in [4], the project is still ongoing and this demonstration has two aims: we show here for the first time a complete release of ElasTest in action while testing a multimedia e-learning application, and we invite software engineering researchers and practitioners to join the ElasTest community of users and developers to contribute to its next releases. • all interacting components, and • all involved infrastructures and tools (possibly including different variants and versions)…”

Section: Introductionmentioning

confidence: 99%

When the testing gets tough, the tough get ElasTest

Bertolino

Calabrò

Angelis

et al. 2018

Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Self Cite

View full text Add to dashboard Cite

We present ElasTest, an open-source generic and extensible platform supporting end-to-end testing of large complex cloud systems, including web, mobile, network and WebRTC applications. ElasTest is developed following a fully transparent and open agile process around which a community of developers, contributors and users is collected. We demonstrate ElasTest in action by testing the FullTeaching application: the video is available from http://elastest.io/videos/icse2018-demo . CCS CONCEPTS• Software and its engineering → Software testing and debugging; Software notations and tools; • Computer systems organization → Cloud computing;

show abstract

ElasTest — An open source project for testing distributed applications with failure injection

Cited by 12 publications

References 0 publications

A dataset of regressions in web applications detected by end-to-end tests

A dataset of regressions in web applications detected by end-to-end tests

A Proposal to Orchestrate Test Cases

When the testing gets tough, the tough get ElasTest

Contact Info

Product

Resources

About