Introducing service-oriented coverage testing

Abstract

Testing of service-oriented systems is challenged by loose coupling and high dynamism, which are the founding characteristics of this emerging paradigm. Traditional test approaches needs to be revised for such systems, and in particular white-box techniques cannot be applied because services only grant black-box access. We introduce here a novel methodology, called SOCT (service-oriented coverage testing), that adapts the notion of coverage testing to the service-oriented domain, by exploiting the very features of service technology. In SOCT, both the probes inserted into the instrumented service code, and the retrieval of coveragerelated information are themselves implemented as pure service invocations. A TCov service is published that makes available these coverage-related services through a WSDL interface. This simple idea elegantly enables the usage of practical test adequacy criteria also to service-oriented applications. In this paper a realization of SOCT is exemplified for coverage testing of BPEL orchestrations, and is illustrated on the case study of the Virtual Scientific Bookstore.

Whitening SOA testing

“…We briefly introduced SOCT in our previous work [3]. In here we further motivate the problem, define the approach, implement an instance of it, and illustrate its application in a preliminary case study.…”

Bringing white-box testing to Service Oriented Architectures through a Service Oriented Approach

“…The very idea of SOCT has been proposed for the first time in Bartolini et al (2008a), and elaborated in a conceptual approach in Bartolini et al (2009). This paper extends on the latter work by revising the approach's associated definitions together with its potential applications, providing more detailed explanations of the interactions among the stakeholders, describing a full implemented instance of it, and performing a completely new assessment of its usefulness and performance through a case study.…”

Estabelecimento de uma arquitetura de referência orientada a serviços para ferramentas de teste de software

“…Em virtude disso, ferramentas de teste oferecidas na forma de serviços web já podem ser encontradas (Bartolini et al, 2008;Eler et al, 2010Eler et al, , 2009. Além disso, pode ser encontrado, inclusive, um registro de serviços projetado especificamente para a publicação e descoberta de serviços relacionados ao teste de software (Gondim, 2010).…”

“…Os trabalhos pertencentes a esse grupo de fontes de informação são apresentados na Tabela 4.1. Bartolini et al (2008) propõem uma ferramenta, denominada TCov, destinada ao teste estrutural de serviços web. Tal ferramenta, disponível como serviço, faz uso de uma abordagem de análise de cobertura dos testes denominada SOCT (Service-Oriented Coverage Testing).…”

“…Além da instrumentação manual, o cliente ou integrador deve coletar manualmente os dados obtidos das chamadas ao serviço ou implementar uma ferramenta para realizar tal coleta. Apesar de oferecer informações sobre o funcionamento de uma ferramenta de teste disponível como serviço, não foram discutidos no trabalho de Bartolini et al (2008) detalhes sobre a arquitetura da ferramenta proposta.…”