Toward a framework for preparing and executing adaptive grid programs

Kennedy, Ken; Mazina, M.; Mellor-Crummey, John; Cooper, Keith D.; Torczon, Linda; Berman, Fran; Chien, Andrew A.; Dail, Holly; Sievert, Otto; Angulo, Dave; Foster, Ian; Aydt, Ruth; Reed, Dan

doi:10.1109/ipdps.2002.1016570

Cited by 79 publications

(38 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mandal et. al [17] propose a heuristic strategy using performance model based in-advance scheduling for optimal load-balancing on grid resources using the GrADS infrastructure [14]. Blythe et.…”

Section: Related Workmentioning

confidence: 99%

Deadline-sensitive workflow orchestration without explicit resource control

Ramakrishnan

Chase

Gannon

et al. 2011

Journal of Parallel and Distributed Computing

View full text Add to dashboard Cite

Deadline-sensitive workflows require careful coordination of user constraints with resource availability. Current distributed resource access models provide varying degrees of resource control: from limited or none in grid batch systems to explicit in cloud systems. Additionally applications experience variability due to competing user loads, performance variations, failures, etc. These variations impact the quality of service(QoS) that goes unaccounted for in planning strategies. In this paper we propose Workflow ORchestrator for Distributed Systems (WORDS ) architecture based on a least common denominator resource model that abstracts the differences and captures the QoS properties provided by grid and cloud systems. We investigate algorithms for effective orchestration (i.e., resource procurement and task mapping) for deadline sensitive workflows atop the resource abstraction provided in WORDS . Our evaluation compares orchestration methodologies over TeraGrid and Amazon EC2 systems. Experimental results show that WORDS enables effective orchestration possible at reasonable costs on batch queue grid and cloud systems with or without explicit resource control.

show abstract

Section: Related Workmentioning

confidence: 99%

Deadline-sensitive workflow orchestration without explicit resource control

Ramakrishnan

Chase

Gannon

et al. 2011

Journal of Parallel and Distributed Computing

View full text Add to dashboard Cite

show abstract

“…Workflow scheduling has largely focused on heuristic techniques using performance models to qualitatively select resources and map tasks to the resources that have good performance [12]. Few scheduling algorithms take into account reliability of the grid resources.…”

Section: Related Workmentioning

confidence: 99%

Combined Fault Tolerance and Scheduling Techniques for Workflow Applications on Computational Grids

Yang

Mandal

Koelbel

et al. 2009

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid

View full text Add to dashboard Cite

More and more complex scientific workflows are now executed on computational grids. In addition to the challenges of managing and scheduling these workflows, additional reliability challenges arise because of the unreliable nature of large-scale grid infrastructure. Fault tolerance mechanisms like over-provisioning and checkpoint-recovery are used in current grid application management systems to address these reliability challenges. In this work, we propose new approaches that combine these fault tolerance techniques with existing workflow scheduling algorithms. We present a study on the effectiveness of the combined approaches by analyzing their impact on the reliability of workflow execution, workflow performance and resource usage under different reliability models, failure prediction accuracies and workflow application types.

show abstract

“…In Grid and cluster computing, there is a large body of research work on runtime platforms for supporting program adaptation at the level of middleware or runtime platforms [4,5,6,7]. However, as their objective is to implement middleware support for adaptation between the application and the underlying execution layer, these efforts focus on resource management towards efficient utilization of the environment, such as load-balancing and scheduling of application tasks, where coarse-grained strategies based on resource constraints or external operating parameters are employed.…”

Section: Related Workmentioning

confidence: 99%

“…The approaches to support program adaptation include: languages and compilers for specifying adaptation strategies [1,2,3] and runtime platforms or middleware for adaptive execution [4,5,6,7]. These efforts are primarily centered around resource management to achieve efficient utilization of the environment, such as adaptive load-balancing and scheduling of application tasks, to match resource constraints or dynamic operating conditions of the environment.…”

Section: Introductionmentioning

confidence: 99%

Modular, Fine-Grained Adaptation of Parallel Programs

Kang

Selvarasu

Ramakrishnan

et al. 2009

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. We present a modular approach to realizing fine-grained adaptation of program behavior in a parallel environment. Using a compositional framework based on function call interception and manipulation, the adaptive logic to monitor internal program states and control the behavior of program modules is written and managed as a separate code, thus supporting centralized design of complex adaptation strategies for adapting to dynamic changes within an application. By 'catching' the functions that execute in synchronization across the parallel environment and inserting the adaptive logic operations at the intercepted control points, the proposed method provides a convenient way of synchronous adaptation without disturbing the parallel execution and communication structure already established in the original program. Applying our method to a CFD (computational fluid dynamics) simulation program to implement example adaptation scenarios, we demonstrate how effectively applications can change their behavior through fine-grained control.

show abstract

Toward a framework for preparing and executing adaptive grid programs

Abstract: This paper describes the program execution framework being developed by the Grid Application Development Software (GrADS) Project.

Cited by 79 publications

References 10 publications

Deadline-sensitive workflow orchestration without explicit resource control

Deadline-sensitive workflow orchestration without explicit resource control

Combined Fault Tolerance and Scheduling Techniques for Workflow Applications on Computational Grids

Modular, Fine-Grained Adaptation of Parallel Programs

Contact Info

Product

Resources

About