Automated test case generation approach for PLC control software exception handling using fault injection

Kormann, Benjamin; Vogel‐Heuser, Birgit

doi:10.1109/iecon.2011.6119280

Cited by 29 publications

(9 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As model‐driven development is popular in the industrial automation domain , several model‐based test case generation approaches for PLC programs have been proposed . Enoiu et al proposed model‐based test suite generation for FBD programs.…”

Section: Related Workmentioning

confidence: 99%

“…Silva et al generated timed automata models from FBD programs to test whether the execution traces of the implementation conform to the traces of the specification model, using the UPPAAL TRON tool. Kormann and Vogel‐Heuser proposed an automated test case generation approach for PLC control software exception handling using fault injection . Their primary goal was not to generate test cases that achieve specific coverage criteria.…”

Section: Related Workmentioning

confidence: 99%

“…All model‐driven techniques share the common aspect that they generate test cases from models with respect to specific goals such as coverage achievement and test requirements. Unlike other approaches , the proposed technique works directly on FBD programs without relying on intermediate models (e.g., UML, timed automata, or special Petri net dialect models). In addition to intuitive and straightforward coverage analysis, this work provides thorough analysis of the fault‐detection effectiveness of generated test suites, whereas none of the aforementioned studies do.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Automated test case generation for FBD programs implementing reactor protection system software

Jee

Shin

Cha

et al. 2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

Automated and effective testing for function block diagram (FBD) programs has become an important issue, as FBD is increasingly used in implementing safety-critical systems. This work describes an automated test case generation technique for FBD programs and its associated tool-FBDTester. Given an FBD program and desired test coverage criteria, FBDTester generates test requirements and invokes the Satisfiability Modulo Theories solver iteratively to derive a set of test cases. An industrial case study using reactor protection system software shows that the automatically generated test suites detected at least 82% of the known faults, whereas manually generated test cases only detected approximately 35%. Mutation analysis revealed that the automatically generated test suites substantially outperformed manually generated ones. Although test sequence generation requires some manual effort in the current FBDTester, it is apparent that the proposed approach significantly improves the efficiency and the reliability of FBD testing. AUTOMATED TEST CASE GENERATION FOR FBD PROGRAMS 609 A real-world industrial case study was conducted using trip (shutdown) modules of the bistable processor (BP) of reactor protection systems developed in the Korea Nuclear Instrumentation and Control System R&D Center project. Test cases were manually generated by FBD testing professionals, taking nearly three man-months to generate test cases for the BP system. In the case study, test cases automatically generated by the FBDTester are compared with respect to fault detection capability using real faults detected in development. In addition, mutation analysis was also performed to compare effectiveness against a large number of artificial errors (i.e., mutants).The manually generated test cases only detected approximately 35% of the faults revealed in the preliminary version of the BP systems. The application of other techniques (e.g., model checking) detected the rest. Using the FBDTester, however, at least 82% of known faults in various modules were detected. In mutation analysis, the FBDTester also outperformed the manually generated test cases in almost all configurations. It is highly expected that the proposed approach could improve the efficiency and the reliability of FBD testing significantly.This paper is organized as follows. Section 2 explains FBD test coverage criteria as background for the study and Section 3 presents a literature survey of the most relevant research. A test case generation technique and an automated tool for FBD programs are described in Section 4. Section 5 reports the results of the KNICS BP case study and presents an evaluation of the proposed approach. The paper is concluded in Section 6.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Automated test case generation for FBD programs implementing reactor protection system software

Jee

Shin

Cha

et al. 2014

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…This modeling allows a more detailed analysis and optimization of the structure of relations [1 1]. More recent work also takes software and electronics in addition to the mechanical components into account [12,13,14,15,16].…”

Section: State-of-the-artmentioning

confidence: 99%

Engineering of automated manufacturing systems with mechatronic objects

Weyrich

Klein

2012

IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society

View full text Add to dashboard Cite

Engineering of automated manufacturing systems req uires a lot of effort and therefore creates a bottleneck. In this paper we present a methodology of designing the concept of systems based on mechatronic objects. The methodology proposed enables the identification of objects, which take mechatronic aspects into consideration. This means we are able to create a holistic concept design of the mechanics, electrics and electronics and software. The approach of identifying mechatronic objects is novel because the overall blueprint of the system can be optimized across the various disciplines. The methodology is demonstrated based on an example of special machinery systems, whereby the functional evaluation of the concept is discussed throughout the detail-engineering phase.

show abstract

“…This approach is also suitable for emulating component failures but it is focused on the simulation environment and not developed in order to meet PLC platform requirements (R1 ). In a previous work of this research group a model-implemented FI approach for plant automation has been implemented using a UML state chart simulation environment (Kormann and Vogel-Heuser (2011)). The FI depends on reaching a predefined state of the simulation, and thus a softwareimplemented FI is not possible (R1 ).…”

Section: Fi In Reactive Systemsmentioning

confidence: 99%

Model-based testing of PLC software: test of plants' reliability by using fault injection on component level

Rösch

Tikhonov

Schütz

et al. 2014

IFAC Proceedings Volumes

Self Cite

View full text Add to dashboard Cite

Automated test case generation approach for PLC control software exception handling using fault injection

Cited by 29 publications

References 9 publications

Automated test case generation for FBD programs implementing reactor protection system software

Automated test case generation for FBD programs implementing reactor protection system software

Engineering of automated manufacturing systems with mechatronic objects

Model-based testing of PLC software: test of plants' reliability by using fault injection on component level

Contact Info

Product

Resources

About