Robust Runtime Optimization of Data Transfer in Queries over Web Services

Gounaris, Anastasios; Yfoulis, Christos; Sakellariou, Rizos; Dikaiakos, Marios D.

doi:10.1109/icde.2008.4497468

Cited by 26 publications

(16 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this way, the computation and the communication costs overlap resulting in decreased query total response time. Note that mitigating the impact of high data transmission in service based systems is an ongoing activity already yielding significant results (see [14,15,35]) from which our unifying architectural proposal can benefit.…”

Section: Query Plan Generationmentioning

confidence: 99%

“…First, the service oriented architecture and the SOAP-based communication protocol incur a high overhead when large data sets are transmitted. This drawback has been partly ameliorated through the development of adaptive techniques [14,15] that continuously track the optimum size of data chunks. Second, as users typically do not have enough information about the semantics of the data in the autonomous, third-party resources to which they are provided access, they find it difficult to formulate semantically correct queries that combine data from multiple sources.…”

Section: Motivation and Contributionsmentioning

confidence: 99%

See 1 more Smart Citation

A service-oriented system for distributed data querying and integration on Grids

Comito

Gounaris

Sakellariou

et al. 2009

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

a b s t r a c tData Grids rely on the coordinated sharing of and interaction across multiple autonomous database management systems. They provide transparent access to heterogeneous and autonomous data resources stored on Grid nodes. Data sharing tools for Grids must include both distributed query processing and data integration functionality. This paper presents the implementation of a data sharing system that (i) is tailored to data Grids, (ii) supports well established and widely spread relational DBMSs, and (iii) adopts a hybrid architecture by relying on a peer model for query reformulation to retrieve semantically equivalent expressions, and on a wrapper-mediator integration model for accessing and querying distributed data sources. The system builds upon the infrastructure provided by the OGSA-DQP distributed query processor and the XMAP query reformulation algorithm. The paper discusses the implementation methodology, and presents empirical evaluation results.

show abstract

Section: Query Plan Generationmentioning

confidence: 99%

Section: Motivation and Contributionsmentioning

confidence: 99%

A service-oriented system for distributed data querying and integration on Grids

Comito

Gounaris

Sakellariou

et al. 2009

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…This is a part of the general rewriting algorithm (Algorithm 1, lines [13][14]. There are additional rewriting rules for Fork, Savepoint and Reply operators, which we omitted here because they are straight-forward.…”

Section: Algorithm 1 Process Plan Vectorizationmentioning

confidence: 99%

“…There, request documents are divided into chunks, and services are called for every single chunk [13]. An automatic chunk-size computation using the extremum-control approach was addressed in [14]. On the process level, pipeline scheduling was incorporated in [15] into a general workflow model to show the valuable benefit of pipelining in business processes.…”

Section: Related Workmentioning

confidence: 99%

Vectorizing Instance-Based Integration Processes

Böehm

Habich²,

Preissler³

et al. 2009

Enterprise Information Systems

View full text Add to dashboard Cite

Abstract. The inefficiency of integration processes-as an abstraction of workflow-based integration tasks-is often reasoned by low resource utilization and significant waiting times for external systems. Due to the increasing use of integration processes within IT infrastructures, the throughput optimization has high influence on the overall performance of such an infrastructure. In the area of computational engineering, low resource utilization is addressed with vectorization techniques. In this paper, we introduce the concept of vectorization in the context of integration processes in order to achieve a higher degree of parallelism. Here, transactional behavior and serialized execution must be ensured. In conclusion of our evaluation, the message throughput can be significantly increased.

show abstract

“…The service-wrapped database receives the query and prepares the results. Typically, the results are not sent in a single message, but are split into chunks [10,3]. More specifically, in Step 2a, the client asks for the next chunk of the results specifying the exact chunk size (measured in number of tuples) as a parameter.…”

Section: Introductionmentioning

confidence: 99%

Adaptive memory-aware chunk sizing techniques for data-intensive queries over web services

Theodouli

Gounaris

2013

Proceedings of the 28th Annual ACM Symposium on Applied Computing

Self Cite

View full text Add to dashboard Cite

Modern applications of Web Services (WSs) that involve the processing of large amounts of data tend to transmit data in chunks. Several performance control techniques have been proposed to dynamically select the appropriate chunk size with a view to minimize the communication cost. However, when the data consumer is slower than the data producer, the consumer applications may suffer from memory shortage if high volumes of data arrive in the incoming buffers. To this end, we propose a specific approach to coupling performance control with congestion control features, in order to consider both performance and memory overflow issues in an integrated manner. The performance results with real data show that we can combine these controllers effectively and efficiently, so that no memory overflow occurs at the expense of negligible performance degradation.

show abstract

Robust Runtime Optimization of Data Transfer in Queries over Web Services

Cited by 26 publications

References 16 publications

A service-oriented system for distributed data querying and integration on Grids

A service-oriented system for distributed data querying and integration on Grids

Vectorizing Instance-Based Integration Processes

Adaptive memory-aware chunk sizing techniques for data-intensive queries over web services

Contact Info

Product

Resources

About