A Metric for Measuring Test Input Generation Effectiveness of Test Generation Methods for Boolean Expressions

Ufuktepe, Deniz Kavzak; Ufuktepe, Ekincan; Ayav, Tolga

doi:10.1109/uyms54260.2021.9659647

Cited by 1 publication

(2 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It was therefore omitted by this case study. Other useful metrics, such as minimized test suite impact (MTSI) (Equation ()) and test effectiveness (TE), were recently used by Ufuktepe et al 40 . for mutant analysis in the Boolean‐expression‐based approach.…”

Section: Related Workmentioning

confidence: 99%

“…It was therefore omitted by this case study. Other useful metrics, such as minimized test suite impact (MTSI) (Equation ( 4)) and test effectiveness (TE), were recently used by Ufuktepe et al 40 for mutant analysis in the Boolean-expression-based approach. All of these metrics can be used for determining the quality of the generated or minimized test case suites and evaluating the reliability of the system under test.…”

Section: Cause-effect Graphsmentioning

confidence: 99%

See 1 more Smart Citation

Usage of cause‐effect graphs for reliability analysis of an embedded IoT alarm software system

Cogo,

Karabegović

et al. 2024

Quality & Reliability Eng

View full text Add to dashboard Cite

Software is a part of most complex systems used for different purposes in today's world. The reliability of these systems must be verified before putting them to use, because their malfunction may lead to catastrophic failure, the loss of human lives, or huge costs. Software reliability can be verified by performing black‐box testing, without knowledge of the complex internal structure of these systems. In this work, an embedded IoT alarm system for detection of intruders and potential robbery is proposed. It is composed of three subsystems: embedded IoT, web‐server, and mobile phone subsystems. Cause‐effect graphing technique was applied for generating three types of black‐box test suites, by using the forward‐propagation and two different minimization algorithms. These test suites were used for black‐box testing the system, which was performed after injecting a maximum of 12 faults into the system in 100 iterations. The resulting software quality and reliability metrics showed that the forward‐propagation algorithm always achieves maximum fault detection rate (FDR), and this algorithm should be used when the highest demand for reliability must be met. The optimized minimization should only be used in cases where testing is very expensive, because it did not find faults in all testing iterations. The basic optimization retained high FDR, while reducing the impact of the minimized test suite and achieved a significant increase of test effect coverage values.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Cause-effect Graphsmentioning

confidence: 99%