Self-Metamorphic-Testing Components

Beydeda, Sami

doi:10.1109/compsac.2006.161

Cited by 23 publications

(13 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Beydeda [114] proposed a self-testing method for commercial off-the-shelf components using metamorphic testing. In this method, components are augmented with self-testing functionality including test case generation, execution and evaluation.…”

Section: Componentsmentioning

confidence: 99%

A Survey on Metamorphic Testing

Segura

Fraser

Sánchez

et al. 2016

IIEEE Trans. Software Eng.

400

230

View full text Add to dashboard Cite

Abstract-A test oracle determines whether a test execution reveals a fault, often by comparing the observed program output to the expected output. This is not always practical, for example when a program's input-output relation is complex and difficult to capture formally. Metamorphic testing provides an alternative, where correctness is not determined by checking an individual concrete output, but by applying a transformation to a test input and observing how the program output "morphs" into a different one as a result. Since the introduction of such metamorphic relations in 1998, many contributions on metamorphic testing have been made, and the technique has seen successful applications in a variety of domains, ranging from web services to computer graphics. This article provides a comprehensive survey on metamorphic testing: It summarises the research results and application areas, and analyses common practice in empirical studies of metamorphic testing as well as the main open challenges.

show abstract

Section: Componentsmentioning

confidence: 99%

A Survey on Metamorphic Testing

Segura

Fraser

Sánchez

et al. 2016

IIEEE Trans. Software Eng.

400

230

View full text Add to dashboard Cite

show abstract

“…A metamorphic service is a service that calls the relevant services of the application and checks the metamorphic relations. Beydeda [6] proposed a method to enable self-testability of components using metamorphic testing. Murphy et al [40] presented an extension to the Java Modeling Language (JML) and a tool able to process it.…”

Section: Related Workmentioning

confidence: 99%

Automated metamorphic testing on the analyses of feature models

Segura¹,

Hierons²,

Benavides³

et al. 2011

Information and Software Technology

View full text Add to dashboard Cite

Copyright © 2010 Elsevier B.V. All rights reserved.Context: A feature model (FM) represents the valid combinations of features in a domain. The automated extraction of information from FMs is a complex task that involves numerous analysis operations, techniques and tools. Current testing methods in this context are manual and rely on the ability of the tester to decide whether the output of an analysis is correct. However, this is acknowledged to be time-consuming, error-prone and in most cases infeasible due to the combinatorial complexity of the analyses, this is known as the oracle problem.Objective: In this paper, we propose using metamorphic testing to automate the generation of test data for feature model analysis tools overcoming the oracle problem. An automated test data generator is presented and evaluated to show the feasibility of our approach.Method: We present a set of relations (so-called metamorphic relations) between input FMs and the set of products they represent. Based on these relations and given a FM and its known set of products, a set of neighbouring FMs together with their corresponding set of products are automatically generated and used for testing multiple analyses. Complex FMs representing millions of products can be efficiently created by applying this process iteratively.Results: Our evaluation results using mutation testing and real faults reveal that most faults can be automatically detected within a few seconds. Two defects were found in FaMa and another two in SPLOT, two real tools for the automated analysis of feature models. Also, we show how our generator outperforms a related manual suite for the automated analysis of feature models and how this suite can be used to guide the automated generation of test cases obtaining important gains in efficiency.Conclusion: Our results show that the application of metamorphic testing in the domain of automated analysis of feature models is efficient and effective in detecting most faults in a few seconds without the need for a human oracle.This work has been partially supported by the European Commission(FEDER)and Spanish Government under CICYT project SETI(TIN2009-07366)and the Andalusian Government project ISABEL(TIC-2533)

show abstract

“…Beydeda [36] proposed to use metamorphic testing as a means to improve the testability of program components. Wu [37] observed that follow-up test cases can be initial test cases of the next round, and thus, proposes to apply MT iteratively to utilize metamorphic relations more economically.…”

Section: Related Workmentioning

confidence: 99%

Experimental Study to Compare the Use of Metamorphic Testing and Assertion Checking

Zhang¹,

Chan²,

Tse³

et al. 2009

Journal of Software

View full text Add to dashboard Cite

A test oracle in software testing is a mechanism for checking whether the program under test behaves correctly for any execution. In some practical situations, oracles can be unavailable or too expensive to apply.Metamorphic testing (MT) was proposed to alleviate this problem so that software can be delivered under the time-to-market pressure. However, the effectiveness of MT has not been studied adequately. This paper conducts a controlled experiment to investigate the cost effectiveness of using MT. The fault detection capability and time cost of MT are compared with the standard assertion checking method. Our results show that MT has potentials to detect more faults than the assertion checking method. The experimental results also show a trade-off between the two testing methods: MT can be less efficient but more effective, and can be defined at a coarser level of granularity th an the assertion checking method.

show abstract

Self-Metamorphic-Testing Components

Cited by 23 publications

References 11 publications

A Survey on Metamorphic Testing

A Survey on Metamorphic Testing

Automated metamorphic testing on the analyses of feature models

Experimental Study to Compare the Use of Metamorphic Testing and Assertion Checking

Contact Info

Product

Resources

About