Skyfire: Model-Based Testing with Cucumber

Li, Nan; Escalona, Anthony; Kamal, Tariq

doi:10.1109/icst.2016.41

Cited by 20 publications

(17 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…We also investigate if Model-Based Testing [56][57][58][59][60][61][62] help reduce the cost of test over documentation through automatic test generation. In [10], a Model-Based Testing (MBT) tool, skyfire is presented and can easily be used to generate effective UAT test scenarios from UML state machine diagrams. In [63], another Model-based Testing tool, MISTA is implemented to generate Integration and System Test Automation using robot framework, other languages like java and c, etc.…”

Section: Model-based Testing To Automate Test Generationmentioning

confidence: 99%

“…Finally, readability makes auto generation of test automation simple and easy by hiding coding implementation details under textual description. For example, in [10], skyfire is developed to generate cucumber test cases from UML state machine diagram automatically. Test scenarios in natural language are generated, which is easier than the automatic generation of test cases in pure code because code implementation details (like variable definitions, method signatures, etc.)…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Cost Study of Test Automation Over Documentation for Microservices

Shan¹,

Reyna²,

Xu³

et al. 2018

dtcse

View full text Add to dashboard Cite

There are many development test frameworks targeted specifically for developers; e.g. Pytest [1], TestNG [2]. Additionally, there is a culture around developers where code is often preferred over documentation, e.g, Cucumber [3], Robot [4]. we define the category of test automations which provides readability as Test Over Documentation, and identify the common characteristics of it. Readability in the tests has many benefits, like helping improve code quality, however, adding readability to the test code affects the original structure of the test code, adding more cost to test development if the test code is poorly developed. Test automation is expensive, test over documentation can be even more expensive. The cost problem of building and maintaining test automation is one of the biggest problems in the arena of test automation [5], thus it is the same for Test Over Documentation. Test Over Documentation has many subcategories, each add readability to the tests in a different way, thus the cost is different. In this paper, we study the cost problem of Test Over Documentation, evaluate the cost of each subcategory for testing Microservices [6], hoping to give the testers some reference for tooling selection. Additionally, we propose a new design pattern named Element Pattern to help write Test Over Documentation with minimum cost and best readability. We also investigate if automatic test generation using model based testing [7] can help reduce cost. The experiment results compare different Test Over Documentation approaches against our proposed benchmark metrics.

show abstract

Section: Model-based Testing To Automate Test Generationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Cost Study of Test Automation Over Documentation for Microservices

Shan¹,

Reyna²,

Xu³

et al. 2018

dtcse

View full text Add to dashboard Cite

show abstract

“…No entanto, no BDD, algumas questões relacionadas à comunicação podem ficar em aberto (Li et al, 2016). Não existe um processo bem definido para a descrição de comportamento, não é possível julgar se a descrição do comportamento realmente descreve por completo aquilo que é desejado.…”

Section: Definição Do Problemaunclassified

“…Com o objetivo de gerar cenários de uso que explorem de forma abrangente os requisitos e que gerem testes de aceitação que garantam uma boa cobertura de código, Li et al (2016) propõem o uso de práticas do Teste Baseado em Modelo para uma geração automática de cenário e apresentam o Skyfire, uma ferramenta voltada para o BDD onde as cenários de uso são gerados a partir de diagramas UML de estados. O cenário gerado representa um caminho possível dentro do diagrama de estados e está escrita em Gherkin para que possa ser utilizada no Cucumber.…”

Section: Ferramenta De Suporte Ao Bddunclassified

See 1 more Smart Citation

Geração Automática De Exemplos De Uso a Partir Da Descrição Textual De Casos De Uso

SANTOS¹

View full text Add to dashboard Cite

This master's dissertation presents a solution for the automatic generation of examples of use from the textual description of use cases. Use cases describe specifications in a sufficiently formal way that is enough to automatically generate usage examples. A generated example is a text in a natural language which is the paraphrase of one possible manner to use the software, extracted from the use case and applied to a real context where actors are converted into fictitious personas and attributes are valued according to the business rules specified in the use case. The proposed format to present the example aims to allow clients to read, to understand and to judge whether the expressed behavior is in fact what he wants. With this approach, it is expected that the customer himself can approve the specifications and when defects are found, so the specification can quickly be corrected and reflected in the examples. At the same time, the formalized specification in the form of a use case will help developers create solutions that are by construction closer to the correct one when compared to conventional textual specifications.

show abstract

On transforming model‐based tests into code: A systematic literature review

Ferrari,

Durelli,

Andler

et al. 2023

Software Testing Verif & Rel

View full text Add to dashboard Cite

SummaryModel‐based test design is increasingly being applied in practice and studied in research. Model‐based testing (MBT) exploits abstract models of the software behaviour to generate abstract tests, which are then transformed into concrete tests ready to run on the code. Given that abstract tests are designed to cover models but are run on code (after transformation), the effectiveness of MBT is dependent on whether model coverage also ensures coverage of key functional code. In this article, we investigate how MBT approaches generate tests from model specifications and how the coverage of tests designed strictly based on the model translates to code coverage. We used snowballing to conduct a systematic literature review. We started with three primary studies, which we refer to as the initial seeds. At the end of our search iterations, we analysed 30 studies that helped answer our research questions. More specifically, this article characterizes how test sets generated at the model level are mapped and applied to the source code level, discusses how tests are generated from the model specifications, analyses how the test coverage of models relates to the test coverage of the code when the same test set is executed and identifies the technologies and software development tasks that are on focus in the selected studies. Finally, we identify common characteristics and limitations that impact the research and practice of MBT: (i) some studies did not fully describe how tools transform abstract tests into concrete tests, (ii) some studies overlooked the computational cost of model‐based approaches and (iii) some studies found evidence that bears out a robust correlation between decision coverage at the model level and branch coverage at the code level. We also noted that most primary studies omitted essential details about the experiments.

show abstract

Skyfire: Model-Based Testing with Cucumber

Cited by 20 publications

References 5 publications

Cost Study of Test Automation Over Documentation for Microservices

Cost Study of Test Automation Over Documentation for Microservices

Geração Automática De Exemplos De Uso a Partir Da Descrição Textual De Casos De Uso

On transforming model‐based tests into code: A systematic literature review

Contact Info

Product

Resources

About