Bringing white-box testing to Service Oriented Architectures through a Service Oriented Approach

Bartolini, Cesare; Bertolino, Antonia; Elbaum, Sebastian; Marchetti, Eda

doi:10.1016/j.jss.2010.10.024

Cited by 34 publications

(36 citation statements)

References 23 publications

(33 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Bartolini et al [4] extracted state machine data based on messages from opaque web services. It appears that their model can be integrated with our strategy.…”

Section: Related Workmentioning

confidence: 99%

A Subsumption Hierarchy of Test Case Prioritization for Composite Services

Mei

Cai

Jia

et al. 2015

IEEE Trans. Serv. Comput.

View full text Add to dashboard Cite

Abstract-Many composite workflow services utilize non-imperative XML technologies such as WSDL, XPath, XML schema, and XML messages. Regression testing should assure the services against regression faults that appear in both the workflows and these artifacts. In this paper, we propose a refinement-oriented level-exploration strategy and a multilevel coverage model that captures progressively the coverage of different types of artifacts by the test cases. We show that by using them, the test case prioritization techniques initialized on top of existing greedy-based test case prioritization strategy form a subsumption hierarchy such that a technique can produce more test suite permutations than a technique that subsumes it. Our experimental study of a model instance shows that a technique generally achieves a higher fault detection rate than a subsumed technique, which validates that the proposed hierarchy and model have the potential to improve the cost-effectiveness of test case prioritization techniques.

show abstract

“…Bartolini et al [4] extracted state machine data based on messages from opaque web services. It appears that their model can be integrated with our strategy.…”

Section: Related Workmentioning

confidence: 99%

A Subsumption Hierarchy of Test Case Prioritization for Composite Services

Mei

Cai

Jia

et al. 2015

IEEE Trans. Serv. Comput.

View full text Add to dashboard Cite

show abstract

“…Testing of web services composition has been investigated in [39,40]. The work presented in [41] uses the Category Partition methodology in order to define test cases for web services. However, this work focuses on non-transactional web services.…”

Section: Related Workmentioning

confidence: 99%

Multi-dimensional criteria for testing web services transactions

Casado¹,

Younas²,

Tuya³

2013

Journal of Computer and System Sciences

View full text Add to dashboard Cite

Web services (WS) transactions are important in order to reliably compose distributed and autonomous services into composite web services and to ensure that their execution is consistent and correct. But such transactions are generally complex and they require longer processing time, and manipulate critical data. Thus various techniques have been developed in order to perform quality assessment of WS transactions in terms of response time efficiency, failure recovery and throughput. This paper focuses on the testing aspect of WS transactions -a key issue that has not been examined in the literature. Accordingly it proposes multi-dimensional criteria for testing the WS transactions. The proposed criteria have the potential to capture the behaviour of WS transactions and to analyze and classify the possible (failure) situations that effect the execution of such transactions. These criteria are used to generate various test cases and to provide (WS transactions) tester with flexibility of adjusting the method in terms of test efforts and effectiveness. The proposed criteria have been designed, implemented and evaluated through a case study and a number of experiments have been performed. The evaluation shows that these criteria have the capability to effectively generate test cases for testing WS transactions as well as enable tester to decide on the trade-off between test efforts and the quality.

show abstract

“…Their focus is not on the testing of such third-party web services. Bartolini et al (2009Bartolini et al ( , 2010 propose a framework to collect and report the coverage statistics achieved by a test on a service. We focus on using the information captured in messages to guide the testing process.…”

Section: Related Workmentioning

confidence: 99%

XML-manipulating test case prioritization for XML-manipulating services

Mei

Chan

Tse

et al. 2011

Journal of Systems and Software

View full text Add to dashboard Cite

A B S T R A C TA web service may evolve autonomously, making peer web services in the same service composition uncertain as to whether the evolved behaviors are compatible with its original collaborative agreement. Although peer services may wish to conduct regression testing to verify the agreed collaboration, the source code of the former service may be inaccessible to them. Owing to the black-box nature of peer services, traditional code-based approaches to regression testing are inapplicable. In addition, traditional techniques assume that a regression test suite for verifying a web service is available. The location to store a regression test suite is also a problem. On the other hand, we note that the rich interface specifications of a web service provide peer services with a means to formulate black-box testing strategies. In this paper, we provide a strategy for black-box service-oriented testing. We also formulate new test case prioritization strategies using tags embedded in XML messages to reorder regression test cases, and reveal how the test cases use the interface specifications of web services. We experimentally evaluate the effectiveness of these black-box strategies in revealing regression faults in modified WS-BPEL programs. The results show that the new techniques can have a high chance of outperforming random ordering. Moreover, our experiment shows that prioritizing test cases based on WSDL tag coverage can achieve a smaller variance than that based on the number of tags in XML messages in regression test cases, even though their overall fault detection rates are similar.

show abstract

Bringing white-box testing to Service Oriented Architectures through a Service Oriented Approach

Cited by 34 publications

References 23 publications

A Subsumption Hierarchy of Test Case Prioritization for Composite Services

A Subsumption Hierarchy of Test Case Prioritization for Composite Services

Multi-dimensional criteria for testing web services transactions

XML-manipulating test case prioritization for XML-manipulating services

Contact Info

Product

Resources

About