EMPEROR: An OGSA Grid Meta-Scheduler Based on Dynamic Resource Predictions

Abstract

Scheduling constitutes an integral feature of Grid computing infrastructures, being also a key to realizing several of the Grid promises. In particular, scheduling can maximize the resources available to end users, accelerate the execution of jobs, while also supporting scalable and autonomic management of the resources comprising a Grid. Grid scheduling functionality hinges on middleware components called meta-schedulers, which undertake to automatically distribute jobs across the dispersed heterogeneous resources of a Grid. In this paper we present the design and implementation of a Grid meta-scheduler, which we call EMPEROR. EMPEROR provides a framework for implementing scheduling algorithms based on performance criteria. In implementing a particular instantiation of this framework, we have devised models for predicting host load and memory resources, and accordingly for estimating the running time of a task. These models hinge on time series analysis techniques and take into account results of the cluster computing literature. Apart from incorporating these models, EMPEROR provides fully fledged Grid scheduling functionality, which complies with OGSA standards as the later are reflected in the Globus toolkit. Specifically, EMPEROR interfaces to Globus middleware services (i.e., GSI, MDS, GRAM) towards discovering resources, implementing the scheduling algorithm and ultimately submitting jobs to local scheduling systems. By and large, EMPEROR is one of the few standards based meta-schedulers making use of dynamic scheduling information.

Towards the Scheduling of Multiple Workflows on Computational Grids

“…The task scheduling has been studied in homogeneous systems [23,32,37,50]. With the development of heterogeneous systems and the Grid, it has been necessary to consider the heterogeneity in processing power and bandwidth [1,4,8,16,19,31,38,44,48].…”

Strategies for Rescheduling Tightly-Coupled Parallel Applications in Multi-Cluster Grids

“…The current work can be integrated into Grid meta-schedulers complying with the Grid standards [16,[21][22][23][24]. Emperor [24] is a OGSA metascheduler that integrates models for predicting resource characteristics, scheduling algorithm that uses these measures for deriving a schedule, and a job submitting mechanism for spawning the application on the schedule.…”

“…Emperor [24] is a OGSA metascheduler that integrates models for predicting resource characteristics, scheduling algorithm that uses these measures for deriving a schedule, and a job submitting mechanism for spawning the application on the schedule. They use AR and ARIMA methods for resource load predictions, the MDS, GRIS, GIIS, and GASS mechanisms of Globus toolkit [25] for information retrieval, resource discovery and file staging, and job execution time predictions in their scheduling algorithm.…”

HECTOR: Enabling Microarray Experiments over the Hellenic Grid Infrastructure

“…• It can alleviate the high cost of computing resources required to support microarray experiments [7,8]: Researchers can leverage the computing power, the immense storage resources, as well as the quality of service provided by Grid computing infrastructures [28,29]. • It can enable access to distributed resources (i.e.…”