Efficient hierarchical self-scheduling for MPI applications executing in computational Grids

Abstract

The execution of distributed applications on the grid is already a reality. As both the number of applications grow and grids scale, efficient utilization of the available but shared heterogeneous resources will be essential. The EasyGrid middleware is a hierarchically distributed Application Management System embedded into MPI applications to facilitate their efficient execution in computational grids. The overhead of employing a distinct AMS to make each application system aware does however bring at least two benefits. First, the (scheduling) policies adopted can be tailored to the specific needs of each application leading to improved performance. Second, distributing the management effort amongst the applications themselves makes grid management more scalable. This paper describes a low intrusion implementation of a hybrid scheduling strategy designed to cope with the dynamic behaviour of grid environments. Using application-specific scheduling policies, near-optimal runtimes highlight the advantages of self-scheduling when executing one or more system aware applications on a grid.

Designing parallel loop self-scheduling schemes using the hybrid MPI and OpenMP programming model for multi-core grid systems

“…The EasyGrid middleware is a hierarchically distributed Application Management System (AMS) which is embedded automatically into a user's parallel MPI application without modifications to the original code by a scheduling portal [2]. Each EasyGrid AMS is a three-level hierarchical management system for application-specific self-scheduling and distinct scheduling policies can be used at each level, even within the same level.…”

“…Chronopoulos et al proposed a distributed self-scheduling algorithm which takes CPU computation powers as weights that scale the size of iterations each computer is assigned to compute [2,3]. Their method can be used to improve the performance of various self-scheduling algorithms.…”

Three-layer control policy for grid resource management

“…It is based on multiple-queue management with respect to both a super scheduling scheme for distributing jobs to overall nodes and a local scheduling scheme for assigning jobs within a node. Cristina Boeres et al (2005) present EasyGrid middleware which is a hierarchically distributed application management system embedded into MPI applications to facilitate their efficient execution in computational grids. Abawajy and Dandamudi (2003) propose an on-line dynamic scheduling policy that manages multiple job streams across both single and multiple cluster computing systems with the objectives of improving the mean response time and system utilization.…”