Brokering Multi-grid Workflows in the P-GRADE Portal

Kertész, Attila; Sipos, Gergely; Kacsuk, Péter

doi:10.1007/978-3-540-72337-0_14

Cited by 15 publications

(14 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This supports the use of an ORE-bundling approach. P-GRADE [25] is designed to work using Webstart and has a custom integration within its portal, which can enable the creation, execution and monitoring of workflows. However, it provides no means to expose and share workflows with users of other workflow engines.…”

Section: Background and Related Workmentioning

confidence: 99%

Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

Rogers

Harvey²,

Truong-Huu³

et al. 2013

J Grid Computing

View full text Add to dashboard Cite

In this paper, we leverage the previous work on the SHIWA bundling format and expand on this specification in order to facilitate workflow execution within a multi-workflow environment. We introduce a scalable and robust execution pool environment that supports workflows consisting of sub-workflows built upon a multitude of different workflow engines and environments, and also provide a common workflow representation for seamless connectivity through serialization to workflow bundles. We also present a meta-workflow scenario based upon this system.Workflow bundles employ the lightweight Open Archives Initiative Object Reuse and Exchange (ORE) Web-based standard, to provide a common format for representing and sharing workflows and the associated metadata required for their execution. This generalized bundling approach is already available within five workflow engines and has proven a useful environment for interworkflow experimentation.The execution pool facilitates federated access to multiple distributed computing infrastructures supported by the underlying workflow engines subscribed to the pool. Workflow bundles are exposed using the eXtensible Messaging and Presence Protocol (XMPP), which provides the necessary commu- nication backbone to enable multiple workflow engine agents to asynchronously publish and subscribe to bundles in meta-workflow pipelines.We present experiments showing the scalability and robustness of the pool execution approach with results showing that overheads remain controlled for up to 150 workflow agents, and that agent failures have very limited impact. We then demonstrate the applicability of our architecture by describing how a Java-based music analysis workflow can be distributed within such a multiworkflow environment consisting of the Triana and MOTEUR workflow engines.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

Rogers

Harvey²,

Truong-Huu³

et al. 2013

J Grid Computing

View full text Add to dashboard Cite

show abstract

“…• Broker: It interacts with virtual or physical resources, and in case the required service needs to be deployed it interacts directly with the Automatic Service Deployer (ADS) [13].…”

Section: Sla-based Layered Cloud Infrastructuresmentioning

confidence: 99%

“…Table II shows the implementation choices for the layered Cloud architecture and the possible reactive actions each layer can perform. We use Meta Negotiator [4], Meta Broker [12], GTBroker [13] and Automatic Service Deployer [10] components, which have already been used and evaluated to build an SLA-based resource virtualization environment for on-demand service provision [11].…”

Section: Sla-based Layered Cloud Infrastructuresmentioning

confidence: 99%

LAYSI: A Layered Approach for SLA-Violation Propagation in Self-Manageable Cloud Infrastructures

Brandić

Emeakaroha

Maurer

et al. 2010

2010 IEEE 34th Annual Computer Software and Applications Conference Workshops

View full text Add to dashboard Cite

Abstract-Cloud computing represents a promising computing paradigm where computing resources have to be allocated to software for their execution. Self-manageable Cloud infrastructures are required to achieve that level of flexibility on one hand, and to comply to users' requirements specified by means of Service Level Agreements (SLAs) on the other. Such infrastructures should automatically respond to changing component, workload, and environmental conditions minimizing user interactions with the system and preventing violations of agreed SLAs. However, identification of sources responsible for the possible SLA violation and the decision about the reactive actions necessary to prevent SLA violation is far from trivial. First, in this paper we present a novel approach for mapping low-level resource metrics to SLA parameters necessary for the identification of failure sources. Second, we devise a layered Cloud architecture for the bottom-up propagation of failures to the layer, which can react to sensed SLA violation threats. Moreover, we present a communication model for the propagation of SLA violation threats to the appropriate layer of the Cloud infrastructure, which includes negotiators, brokers, and automatic service deployer.

show abstract

“…Within the framework of the European CoreGrid project a meta-broker concept has been introduced to solve Grid interoperation and interoperability at job submission level [42]. This solution is also based on JSDL but can also interoperate with Grids using various non-standard job submission languages [43]. The two largest UK-based production Grids, the UK National Grid Service (NGS) [9] and the GridPP (UK Computing for Partical Physics) [10] have recently analyzed different aspects of middleware level interoperation proposing short and long term solutions [12].…”

Section: Workflow Level Interoperationmentioning

confidence: 99%

Workflow Level Interoperation of Grid Data Resources

Kiss

Kacsuk

Terstyánszky

et al. 2008

2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID)

View full text Add to dashboard Cite

Abstract-The lack of widely accepted standards and the use of different middleware solutions divide today's Grid resources into non-interoperable production Grid islands. On the other hand, more and more experiments require such a large number of resources that the interoperation of existing production Grids becomes inevitable. This paper, based on the current results of grid interoperation studies, defines generic requirements towards the workflow level interoperation of grid solutions. It concentrates on intra-workflow interoperation of grid data resources, as one of the key areas of generic interoperation, and describes through an example how existing tools can be extended to achieve the required level of interoperation.

show abstract

Brokering Multi-grid Workflows in the P-GRADE Portal

Cited by 15 publications

References 13 publications

Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

LAYSI: A Layered Approach for SLA-Violation Propagation in Self-Manageable Cloud Infrastructures

Workflow Level Interoperation of Grid Data Resources

Contact Info

Product

Resources

About