Automatic test case generation for structural testing of function block diagrams

Wu, Yichen; Fan, Chin-Feng

doi:10.1016/j.infsof.2014.04.016

Cited by 18 publications

(10 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Testing software written in 1131-3 languages relies on both functional testing (i.e., tests are derived from requirements) and structural testing (i.e., tests are derived from the structure FPCCTestGen (Wu and Fan (2014)) FBD Data-Flow Coverage 2014 of the code in order to ensure some type of coverage). Functional testing and structural testing are complementary to each other and both are mandated and recommended to be applied to safety critical software John and Tiegelkamp (2010).…”

Section: Discussionmentioning

confidence: 99%

Programming languages popularity and implications to testing programmable logic controllers

Enoiu

2015

Preprint

View full text Add to dashboard Cite

The popularity of domain-specific programming languages has implications on how we test software in these domain industries. For example for programmable logic controllers five standard languages were defined and used in practice. Detailed data on popularity of these languages should show some implications on what languages to target when testing. We suggest that massive new data sources resulting from programmers may offer a new perspective on how we test domain-specific languages. By analyzing Google query volumes for search terms related to programmable logic controllers languages, we find patterns that may be interpreted as signs of actual usage in practice. Comparing with the current testing approaches proposed by researchers our results illustrate both potentials and threats on what is needed in reality when testing programmable logic controllers.

show abstract

Section: Discussionmentioning

confidence: 99%

Programming languages popularity and implications to testing programmable logic controllers

Enoiu

2015

Preprint

View full text Add to dashboard Cite

show abstract

“…However, for domain specific languages used in embedded software development, contributions have been more sparse. For IEC 61131-3 software, a few automated test generation approaches [30,18,28] have been proposed in the last couple of years, but currently there is a lack of tool support. In our previous work, we developed an automated test input generation approach and tool named CompleteTest [8], which automatically produces test suites for a given coverage criterion and an IEC 61131-3 program written using the FBD language.…”

Section: Automated Test Generation For Plc Embedded Softwarementioning

confidence: 99%

Mutation-Based Test Generation for PLC Embedded Software Using Model Checking

Enoiu

Sundmark

Čaušević

et al. 2016

Testing Software and Systems

View full text Add to dashboard Cite

Testing is an important activity in engineering of industrial embedded software. In certain application domains (e.g., railway industry) engineering software is certified according to safety standards that require extensive software testing procedures to be applied for the development of reliable systems. Mutation analysis is a technique for creating faulty versions of a software for the purpose of examining the fault detection ability of a test suite. Mutation analysis has been used for evaluating existing test suites, but also for generating test suites that detect injected faults (i.e., mutation testing). To support developers in software testing, we propose a technique for producing test cases using an automated test generation approach that operates using mutation testing for software written in IEC 61131-3 language, a programming standard for safety-critical embedded software, commonly used for Programmable Logic Controllers (PLCs). This approach uses the Uppaal model checker and is based on a combined model that contains all the mutants and the original program. We applied this approach in a tool for testing industrial PLC programs and evaluated it in terms of cost and fault detection. For realistic validation we collected industrial experimental evidence on how mutation testing compares with manual testing as well as automated decision-coverage adequate test generation. In the evaluation, we used manually seeded faults provided by four industrial engineers. The results show that even if mutation-based test generation achieves better fault detection than automated decision coverage-based test generation, these mutation-adequate test suites are not better at detecting faults than manual test suites. However, the mutation-based test suites are significantly less costly to create, in terms of testing time, than manually created test suites. Our results suggest that the fault detection scores could be improved by considering some new and improved mutation operators (e.g., Feedback Loop Insertion Operator (FIO)) for PLC programs as well as higher-order mutations.

show abstract

“…Transition path coverage, Full predicate coverage and Boundary-testing coverage. R Hametner et al [17] has been translated the UML state chart diagram to FBD. The test cases are generated from UML state chart instants of FBD.…”

Section: Overview Of Specification Diagrams a Behavioural Diagrmentioning

confidence: 99%

A study on functional specification based test case generation for real-time systems

P¹,

M²

2016

IJET

View full text Add to dashboard Cite

Abstract-This paper aims to explicate the method for test case generation in real-time systems. In software engineering, software design phase has the diagrammatic way to understand the real-time systems. The process of software testing to identify the defects and uncovered error as much as possible. Testing the real-time systems has more difficult process because the real-time system programs are adjacent to the hardware device. In this real -time system controls an environment by receiving data, processing and returning the processed data. These systems are simulation process with timing constraint so effective path coverage criteria are required. The testing may be poorly implemented which shows in a low-quality software or more time and cost wastage. A test case plays an important role in software testing. The applicable test cases have been used for generation of test scenarios and test data for realtime systems. This survey puts forward a discussion of research approaches and techniques based on functional specification i.e. behavioural diagram based test cases and structural diagram based test cases. This paper has been classifying the various intermediate approaches that are used to generate a test case for real -time systems notwithstanding discuss the test coverage criteria and major issues applicable to these approaches.Keyword-Real -time system, Model based test case generation, Embedded system I. INTRODUCTION In the real-time digital world, the software has played an important role in our society. We are increasingly dependent on software because the software to run perfectly in our day to day lives. Real-time software needs perfect testing during the software development phase. The software can be tested either automatically or manually. A traditional testing method based on hand work is low efficiency and carried out more time and cost. Automated software testing are consumes more than 50% of the costs that are associated with the software development. Automated software testing can bring us a lot of advantages, which make it easier to find bugs. The automated testing is fully based on test cases. Over the past years, the test case generation approaches have faced many trials to produce efficient automated test cases [1]. The research community presented many approaches to generate the test cases from the functional specification. The design specification allows trimming the error in the early stage of software development. The real-time systems to be coupled with behavioural and structural specifications. An embedded system generally uses microprocessors and integrated circuits that contain many functions. Most of the embedded systems designed for life or safety critical system. The effective path coverage is required in the development process. The execution of embedded real-time system with an object-oriented program is expressed to represent a dynamic view of behaviour and structural in Unified Modelling Language (UML) and some of the structural specification in the Functional block diagram (F...

show abstract

Automatic test case generation for structural testing of function block diagrams

Cited by 18 publications

References 11 publications

Programming languages popularity and implications to testing programmable logic controllers

Programming languages popularity and implications to testing programmable logic controllers

Mutation-Based Test Generation for PLC Embedded Software Using Model Checking

A study on functional specification based test case generation for real-time systems

Contact Info

Product

Resources

About