Automated testing of DSL implementations—experiences from building mbeddr

Ratiu, Daniel; Voelter, Markus; Pavletic, Domenik

doi:10.1007/s11219-017-9390-6

Cited by 7 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mutation-based testing Diverse model generation plays a key role in testing model transformations code generators and complete development environments [40]. Mutation-based approaches [3,16,37] take existing artifacts (model transformations) and make random changes on them by applying mutation rules.…”

Section: Related Workmentioning

confidence: 99%

Diversity of graph models and graph generators in mutation testing

Semeráth

Farkas

Bergmann

et al. 2019

Int J Softw Tools Technol Transfer

View full text Add to dashboard Cite

When custom modeling tools are used for designing complex safety-critical systems (e.g., critical cyber-physical systems), the tools themselves need to be validated by systematic testing to prevent tool-specific bugs reaching the system. Testing of such modeling tools relies upon an automatically generated set of models as a test suite. While many software testing practices recommend that this test suite should be diverse, model diversity has not been studied systematically for graph models. In the paper, we propose different diversity metrics for models by generalizing and exploiting neighborhood and predicate shapes as abstraction. We evaluate such shape-based diversity metrics using various distance functions in the context of mutation testing of graph constraints and access policies for two separate industrial DSLs. Furthermore, we evaluate the quality (i.e., bug detection capability) of different (random and consistent) model generation techniques for mutation testing purposes.

show abstract

Section: Related Workmentioning

confidence: 99%

Diversity of graph models and graph generators in mutation testing

Semeráth

Farkas

Bergmann

et al. 2019

Int J Softw Tools Technol Transfer

View full text Add to dashboard Cite

show abstract

“…Diverse model generation plays a key role in testing model transformations code generators and complete developement environments [25]. Mutation-based approaches [1,11,22] take existing models and make random changes on them by applying mutation rules.…”

Section: Related Workmentioning

confidence: 99%

Iterative Generation of Diverse Models for Testing Specifications of DSL Tools

Semeráth

Varró

2018

Fundamental Approaches to Software Engineering

View full text Add to dashboard Cite

The validation of modeling tools of custom domain-specific languages (DSLs) frequently relies upon an automatically generated set of models as a test suite. While many software testing approaches recommend that this test suite should be diverse, model diversity has not been studied systematically for graph models. In the paper, we propose diversity metrics for models by exploiting neighborhood shapes as abstraction. Furthermore, we propose an iterative model generation technique to synthesize a diverse set of models where each model is taken from a different equivalence class as defined by neighborhood shapes. We evaluate our diversity metrics in the context of mutation testing for an industrial DSL and compare our model generation technique with the popular model generator Alloy.

show abstract