Design and Implementation of a Middleware for Data Storage in Opportunistic Grids

Camargo, Raphael Y. de; Kon, Fábio

doi:10.1109/ccgrid.2007.37

Cited by 9 publications

(11 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…InteGrade implements a distributed data repository called OppStore (de Camargo & Kon, 2007). It is used for storing the application's input and output files and checkpointing data.…”

Section: Integrade Stable Storagementioning

confidence: 99%

Efficient Parallel Application Execution on Opportunistic Desktop Grids

Silva¹,

Kon²,

Batista³

et al. 2012

Grid Computing - Technology and Applications, Widespread Coverage and New Horizons

Self Cite

View full text Add to dashboard Cite

“…InteGrade implements a distributed data repository called OppStore (de Camargo & Kon, 2007). It is used for storing the application's input and output files and checkpointing data.…”

Section: Integrade Stable Storagementioning

confidence: 99%

Efficient Parallel Application Execution on Opportunistic Desktop Grids

Silva¹,

Kon²,

Batista³

et al. 2012

Grid Computing - Technology and Applications, Widespread Coverage and New Horizons

Self Cite

View full text Add to dashboard Cite

“…To deal with those files, we developed a distributed data repository called OppStore (Camargo and Kon , 2007). Access to this distributed repository is performed through a library called access broker, which interacts with OppStore.…”

Section: Managing Application Datamentioning

confidence: 99%

“…We also performed experimental evaluations (Camargo and Kon , 2007) that showed that the time required to store and retrieve files in OppStore is mostly dependent on the bandwidth of cluster connections. The broker downloads the file fragments in parallel and, since the number of available fragments is normally larger than the number of required fragments for file reconstruction, the broker can choose the fragments located in the clusters with the fastest connections.…”

Section: Managing Application Datamentioning

confidence: 99%

Application execution management on the InteGrade opportunistic grid middleware

Silva

Kon

Goldman

et al. 2010

Journal of Parallel and Distributed Computing

Self Cite

View full text Add to dashboard Cite

The InteGrade project is a multi-university effort to build a novel grid computing middleware based on the opportunistic use of resources belonging to user workstations. The InteGrade middleware currently enables the execution of sequential, bag-of-tasks, and parallel applications that follow the BSP or MPI programming models.This article presents the lessons learned over the last five years of InteGrade development and describes the achieved solutions concerning the support for robust application execution. The contributions cover the related fields of application scheduling, execution management, and fault tolerance. We present our solutions, describing their implementation principles and evaluation through the analysis of several experimental results.

show abstract

“…OppStore [4] organizes the machines in the same fashion, allowing its deployment over existing grid middlewares. We consider that each cluster has a management machine, where we instantiate the CDRM (Cluster Data Repository Manager ), the module responsible for manages the machines within the same cluster.…”

Section: Oppstorementioning

confidence: 99%

“…Several classes of parallel applications manipulate large amounts of data and need a data storage and management infrastructure. OppStore [4] is a middleware that allows the storage of application data using the unused disk space of non-dedicated machines in the context of opportunistic grids.…”

Section: Introductionmentioning

confidence: 99%

Efficient maintenance of distributed data in highly dynamic opportunistic grids

Camargo

Filho

Kon

2009

Proceedings of the 2009 ACM Symposium on Applied Computing

Self Cite

View full text Add to dashboard Cite

Opportunistic grids are a class of computational grids that can leverage the idle processing and storage capacity of shared workstations in laboratories, companies, and universities to perform useful computation. OppStore is a middleware that allows using the free disk space of machines from an opportunistic grid for the distributed storage of application data.But when machines depart from the grid, it is necessary to reconstruct the fragments that were stored in that machines. Depending on the amount of stored data and the rate of machine departures, the generated traffic may make the distributed storage of data infeasible. In this work we present and evaluate a fragment recovery mechanism that makes viable to achieve redundancy and large data scale in a dynamic environment.

show abstract

Design and Implementation of a Middleware for Data Storage in Opportunistic Grids

Abstract: Abstract

Cited by 9 publications

References 19 publications

Efficient Parallel Application Execution on Opportunistic Desktop Grids

Efficient Parallel Application Execution on Opportunistic Desktop Grids

Application execution management on the InteGrade opportunistic grid middleware

Efficient maintenance of distributed data in highly dynamic opportunistic grids

Contact Info

Product

Resources

About