Automatic Test Generation for Model-Based Code Generators

Zelenov, Sergey; Silakov, Denis; Petrenko, Alexander K.; Conrad, Mirko; Fey, Ines

doi:10.1109/isola.2006.70

Cited by 7 publications

(4 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Most of the previous work on code generator testing focuses on checking the correct functional behaviour of generated code .Most of these research efforts rely on the comparison of the model execution to the generated code execution. This is known in the software testing community as equivalence, comparative or back‐to‐back testing approach .…”

Section: Related Workmentioning

confidence: 99%

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Boussaa

Barais

Sunyé

et al. 2019

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARY Generative software development has paved the way for the creation of multiple code generators that serve as a basis for automatically generating code to different software and hardware platforms. In this context, the software quality becomes highly correlated to the quality of code generators used during software development. Eventual failures may result in a loss of confidence for the developers, who will unlikely continue to use these generators. It is then crucial to verify the correct behaviour of code generators in order to preserve software quality and reliability. In this paper, we leverage the metamorphic testing approach to automatically detect inconsistencies in code generators via so‐called “metamorphic relations”. We define the metamorphic relation (i.e., test oracle) as a comparison between the variations of performance and resource usage of test suites running on different versions of generated code. We rely on statistical methods to find the threshold value from which an unexpected variation is detected. We evaluate our approach by testing a family of code generators with respect to resource usage and performance metrics for five different target software platforms. The experimental results show that our approach is able to detect, among 95 executed test suites, 11 performance and 15 memory usage inconsistencies.

show abstract

Section: Related Workmentioning

confidence: 99%

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Boussaa

Barais

Sunyé

et al. 2019

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…Up to now, the models are mainly used for simulation and code generation [90]. In the automotive domain MBT approaches have been introduced [91] [92]. The applicability in production automation needs to be analyzed.…”

Section: Test Sequence Generation From Models Used Within Developmentmentioning

confidence: 99%

Review of Model-Based Testing Approaches in Production Automation and Adjacent Domains—Current Challenges and Research Gaps

Rösch

Ulewicz

Provost

et al. 2015

JSEA

View full text Add to dashboard Cite

As production automation systems have been and are becoming more and more complex, the task of quality assurance is increasingly challenging. Model-based testing is a research field addressing this challenge and many approaches have been suggested for different applications. The goal of this paper is to review these approaches regarding their suitability for the domain of production automation in order to identify current trends and research gaps. The different approaches are classified and clustered according to their main focus which is either testing and test case generation from some form of model automatons, test case generation from models used within the development process of production automation systems, test case generation from fault models or test case selection and regression testing.

show abstract

“…A production code generation tool chain including Real-Time Workshop Embedded Coder and a Texas Instruments C compiler successfully passed the resulting Automotive Code Validation Suite (AVS), a test suite to validate the quality and robustness of the code generator, compiler, linker tool chain [20,43,44]. Underlying concepts on test suites for code generators are laid out for example in [22,23,25,26,29,45]. The interplay between model and code coverage has been examined analytically by [1] and statistically by [3].…”

Section: Related Workmentioning

confidence: 99%

Testing-based translation validation of generated code in the context of IEC 61508

Conrad

2009

Form Methods Syst Des

Self Cite

View full text Add to dashboard Cite

Production code generation with Model-Based Design has successfully replaced manual coding across various industries and application domains. Furthermore, code generated from executable graphical models is increasingly being deployed in high-integrity embedded applications.To validate the model-to-code translation process, generated software components and its precursory stages (i.e. models) should be subjected to an appropriate combination of quality assurance measures. For high-integrity applications, compliance with safety standards such as IEC 61508 needs to be demonstrated as well.On principle, translation validation of generated code could be carried out in the same manner as for manually written code. However, this would not leverage the advantages of Model-Based Design and w.r.t. process efficiency this would leave something to be desired. Therefore, engineering methods and tools for effective and efficient translation validation of generated code are highly desirable. As a step towards this goal, a workflow for verification and validation of models and generated code will be proposed and as far as possible mapped onto the objectives of IEC 61508-3. A cornerstone of this workflow is testing for numerical equivalence between models and generated code.

show abstract

Automatic Test Generation for Model-Based Code Generators

Cited by 7 publications

References 4 publications

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Review of Model-Based Testing Approaches in Production Automation and Adjacent Domains—Current Challenges and Research Gaps

Testing-based translation validation of generated code in the context of IEC 61508

Contact Info

Product

Resources

About