Data-Grey-BoxWeb Services in Data-Centric Environments

Habich, Dirk; Preissler, Steffen; Lehner, Wolfgang; Richly, Sebastian; Aßmann, Uwe; Grasselt, Mike; Maier, Albert

doi:10.1109/icws.2007.69

Cited by 22 publications

(28 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Since the cloud can offer high amount of storage and processing, this broker can handle much more data than proxies and triggers. In [1,11], a shared data storage is proposed for sharing the intermediate data between the component services. A clear advantage of the above approaches is that the proposed middle layer, that brokers the data-flow on behalf of the orchestrator, relieves the orchestrator from sending and receiving the intermediate data.…”

Section: Related Workmentioning

confidence: 99%

Direct data transfer between SOAP web services in orchestration

Subramanian

Sztromwasser

Petersen

et al. 2012

Proceedings of the 14th International Conference on Information Integration and Web-Based Applications &Amp; Services

View full text Add to dashboard Cite

In scientific data analysis, workflows are used to integrate and coordinate resources such as databases and tools. Workflows are normally executed by an orchestrator that invokes component services and mediates data transport between them. Scientific data are frequently large, and brokering large data increases the load on the orchestrator and reduces workflow performance. To remedy this problem, we demonstrate how plain SOAP web services can be tailored to support direct service-to-service data transport, thus allowing the orchestrator to delegate the data-flow. We formally define a data-flow delegation message, develop an XML schema for it, and analyze performance improvement of data-flow delegation empirically in comparison with the regular orchestration using an example bioinformatics workflow.

show abstract

Section: Related Workmentioning

confidence: 99%

Direct data transfer between SOAP web services in orchestration

Subramanian

Sztromwasser

Petersen

et al. 2012

Proceedings of the 14th International Conference on Information Integration and Web-Based Applications &Amp; Services

View full text Add to dashboard Cite

show abstract

“…Data-Grey-Box Web Services proposed in [10] is an extension to the SOAP Web Services standard that includes a middle-layer between services and service consumers. The middle-layer is responsible for storing and moving the data using specialized tools, opposed to the original standard where the data-exchange is direct and using SOAP messages.…”

Section: Related Workmentioning

confidence: 99%

“…The great advantage of having data structured in XML, parsed and loaded into memory on arrival, becomes the problem of SOAP as the data size grows. The capability of handling large-scale data with SOAP Web Services has been a concern in context of scientifc applications [8][9][10]. Improving the efficiency of SOAP Web Services and workflows is important for ensuring their wider endorsement in bioinformatics.…”

Section: Introductionmentioning

confidence: 99%

Data partitioning enables the use of standard SOAP Web Services in genome-scale workflows

Sztromwasser

Petersen

Puntervoll

2011

Journal of Integrative Bioinformatics

View full text Add to dashboard Cite

SummaryBiological databases and computational biology tools are provided by research groups around the world, and made accessible on the Web. Combining these resources is a common practice in bioinformatics, but integration of heterogeneous and often distributed tools and datasets can be challenging. To date, this challenge has been commonly addressed in a pragmatic way, by tedious and error-prone scripting. Recently however a more reliable technique has been identified and proposed as the platform that would tie together bioinformatics resources, namely Web Services. In the last decade the Web Services have spread wide in bioinformatics, and earned the title of recommended technology. However, in the era of high-throughput experimentation, a major concern regarding Web Services is their ability to handle large-scale data traffic. We propose a stream-like communication pattern for standard SOAP Web Services, that enables efficient flow of large data traffic between a workflow orchestrator and Web Services. We evaluated the data-partitioning strategy by comparing it with typical communication patterns on an example pipeline for genomic sequence annotation. The results show that data-partitioning lowers resource demands of services and increases their throughput, which in consequence allows to execute in-silico experiments on genome-scale, using standard SOAP Web Services and workflows. As a proof-of-principle we annotated an RNA-seq dataset using a plain BPEL workflow engine.

show abstract

“…Some introduce SOA-aware dataflow to optimize the management of data-incentive services in cloud [5][6]. There are also some researches on modeling, verification and discovery of data-intensive Web service [7][8][9][10][11][12][13]. However, all the researches mentioned above do not concern the parallel technology in service composition.…”

Section: Introductionmentioning

confidence: 99%