The XtreemFS architecture—a case for object‐based file systems in Grids

Abstract

SUMMARYIn today's Grids, files are usually managed by Grid data management systems that are superimposed on existing file and storage systems. In this paper, we analyze this predominant approach and argue that object-based file systems can be an alternative when adapted to the characteristics of a Grid environment. We describe how we are solving the challenge of extending the object-based storage architecture for the Grid in XtreemFS, an object-based file system for federated infrastructures.

Maintaining a Science Gateway - Lessons Learned from MoSGrid

“…XtreemFS is a distributed data management system [20]. It is integrated with MoSGrid in a frictionless way as previously described [1].…”

Overcoming data locality: An in-memory runtime file system with symmetrical data distribution

“…Traditional parallel or distributed file systems such as GPFS [3], PVFS [4], Lustre [9], GlusterFS [10], XtreemFS [11], and Ceph [12] are generally deployed statically on (a subset of) the nodes of a cluster/supercomputer. Such storage systems provide consistency, durability and fault-tolerance.…”

BlobSeer: Next-generation data management for large scale infrastructures

“…A very large distributed storage space is thus made available to applications that usually use file storage, with no need for modifications. This approach has been taken by a few projects like GFarm [34], GridNFS [13], GPFS [29], XtreemFS [14], etc. Implementing transparent access at a global scale naturally leads however to a number of challenges related to scalability and performance, as the file system is put under pressure by a very large number of concurrent accesses.…”