SAGA Toolbox: Interactive Testing of Guarded Assertions

Flemström, Daniel; Gustafsson, Thomas; Kobetski, Avenir

doi:10.1109/icst.2017.59

Cited by 3 publications

(4 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A lot of existing research has been devoted to automated testing, such as automatic generation of test cases, test scripts, etc from NL requirements or restricted requirements [11] [12] [13] [14]. However, none of these tasks can guarantee correct results, and some require manual addition of files or manual intervention to get the correct results.…”

Section: Related Workmentioning

confidence: 99%

EARS2TF: A Tool for Automated Planning Test from Semi-formalized Requirements

Liu¹,

Li²,

Li³

2022

Proceedings of the 34th International Conference on Software Engineering and Knowledge Engineering

View full text Add to dashboard Cite

Software testing is critical to the integrity of the software implementation. The test engineers must design tests under the premise of ensuring the conformance of software system with respect to stakeholder requirements. Generally, requirements documents are large and requirements specifications are represented by NL(natural language) which can be error-prone, so test plans tend to consume more time and effort. In this paper, we propose a tool, EARS2TF, which supports test framework generation from NL requirements specifications. Requirements specifications are represented by a requirements template EARS (Easy Approach to Requirements Syntax), which is easy to use and capable of representing stakeholder requirements with less ambiguity. To save testing costs, we provide a technique and tool that allows requirements to be written, edited, and checked for conformance to existing requirements and EARS syntax, while allowing test engineers to test directly without validating the requirements specification. A demo video of this tool is available at https://youtu.be/fmk4xSRh40k.

show abstract

Section: Related Workmentioning

confidence: 99%

EARS2TF: A Tool for Automated Planning Test from Semi-formalized Requirements

Liu¹,

Li²,

Li³

2022

Proceedings of the 34th International Conference on Software Engineering and Knowledge Engineering

View full text Add to dashboard Cite

show abstract

“…The SAGA approach [14] is used to express such guarded assertions. The SAGA approach is supported by a tool chain consisting of an interactive test case editor as well as a description language (i.e., the T-EARS language).…”

Section: Guarded Assertions T-ears and The Saga Tool Chainmentioning

confidence: 99%

“…Another approach is to start from the point of the domain knowledge of the tester, trying to simplify the specification language itself so it can be used by the average tester. While many such attempts use a graphical representation of the language [11], the SAGA 1 [14] approach instead offers interactive visual feedback while writing the test cases with a minimal textual specification language. The approach starts close to the domain knowledge of the test engineers with the goal of allowing the testers (and the requirements engineers) to think of the system as they are used to, without the burden of mastering temporal logic languages.…”

Section: Introductionmentioning

confidence: 99%

“…A more general in-depth review of passive testing methods can be found in [15]. In previous work on the SAGA approach, interviews with practitioners [16] have shown that passive testing using guarded assertions [14], [17], [18] seems to contribute to small tests, preferably one test per requirement, which should facilitate both alignment as well as traceability.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

From Natural Language Requirements to Passive Test Cases Using Guarded Assertions

Flemström¹,

Eduard²,

Wasif³

et al. 2018

2018 IEEE International Conference on Software Quality, Reliability and Security (QRS)

View full text Add to dashboard Cite

In large-scale embedded system development, requirements are often expressed in natural language. Translating these requirements to executable test cases, while keeping the test cases and requirements aligned, is a challenging task. While such a transformation typically requires extensive domain knowledge, we show that a systematic process in combination with passive testing would facilitate the translation as well as linking the requirements to tests. Passive testing approaches observe the behavior of the system and test their correctness without interfering with the normal behavior. We use a specific approach to passive testing: guarded assertions (G/A). This paper presents a method for transforming system requirements expressed in natural language into G/As. We further present a proof of concept evaluation, performed at Bombardier Transportation Sweden AB, in which we show how the process would be used, together with practical advice of the reasoning behind the translation steps.

show abstract