Ganga: A tool for computational-task management and easy access to Grid resources

Abstract

In this paper, we present the computational task-management tool Ganga, which allows for the specification, submission, bookkeeping and post-processing of computational tasks on a wide set of distributed resources. Ganga has been developed to solve a problem increasingly common in scientific projects, which is that researchers must regularly switch between different processing systems, each with its own command set, to complete their computational tasks. Ganga provides a homogeneous environment for processing data on heterogeneous resources. We give examples from High Energy Physics, demonstrating how an analysis can be developed on a local system and then transparently moved to a Grid system for processing of all available data. Ganga has an API that can be used via an interactive interface, in scripts, or through a GUI. Specific knowledge about types of tasks or computational resources is provided at run-time through a plugin system, making new developments easy to integrate. We give an overview of the Ganga architecture, give examples of current use, and demonstrate how Ganga can be used in many different areas of science.

Mathematical Modeling of Distributed Image Processing Algorithms

“…Other approaches that share the same experience regard the GANGA [17] and Diane (Distributed Analysis Environment) [18] tools. Grid process configuration and monitoring is based on the GANGA tool, while the execution scheduling and task submission is related to the Diane application III.…”

Using Grid Computing for Constructing Ternary Covering Arrays

“…The submission of pilot jobs is based on the master-worker architecture and supported by the DIANE (DIANE, 2011) + Ganga (Moscicki et al, 2009) tools. When the processing begins a master process (a server) is started locally, which will provide tasks to the worker nodes until all the tasks have been completed, being then dismissed.…”

Calibration of SWAT Hydrological Models in a Distributed Environment Using the gSWAT Application

“…GANGA [9] offers a flexible programming interface and facilitates the accessibility to Grid infrastructures. DIANE (DIstributes ANalysis Environment) [10] provides an efficient usage of Grid infrastructures and it is based on the master-slave paradigm.…”