InstantGrid: A Framework for On-Demand Grid Point Construction

Abstract

This paper proposes the InstantGrid framework for on-demand construction of grid points. The framework comprises the following components: (1) a centralized model of software management using an application-centric software grouping scheme; (2) proactive configuration of grid middleware, which shortens the time in composing and switching between execution environments; (3) performance optimization techniques using I/O caching and discriminative file sharing mechanisms; and (4) an in-memory execution mode that enables a machine to participate in grid without affecting the OS/data stored in the permanent storage. Compared with traditional approaches, this new framework is designed to substantially simplify software management in grid systems, and is capable to instantly turn any computer (be it a cluster node or a desktop PC) into a grid-ready platform with the desired execution environment. The advanced features also facilitate ad-hoc formation of grid platforms in computers having idle resources. We describe a reference implementation of InstantGrid for constructing Linux-based grid points. Experimental results demonstrate that a 256-node grid point with commodity grid middleware can be constructed in 5 minutes from scratch.