DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure

Candela, Leonardo; Akal, Fuat; Avancini, Henri; Castelli, Donatella; Fusco, L.; Guidetti, Veronica; Langguth, Christoph; Manzi, Andrea; Pagano, Pasquale; Schuldt, Heiko; Simi, Maria; Springmann, Michael; Voicu, Laura Cristiana

doi:10.1007/s00799-007-0023-8

Cited by 27 publications

(9 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At the same time, environmental reports that include satellite images of the region observed, their descriptions (in the form of XML documents) and image interpretations [4] are periodically generated and/or updated at several sites. In order to improve availability, copies of data are maintained at different sites.…”

Section: Example Application: Earth Observationmentioning

confidence: 99%

“…A data object can be represented at the base level as a file stored on the local file system, a database relation, or partition of a relation on the local database management system (similar to the model presented in [4]). Coming back to the example in Figure 3, the image associated to document B will be stored on the file system, while metadata associated to the image and a pointer to the location of the file will be stored in the database (similar to IBM DataLinks 1 which allows storing large files in the file system in order to take advantage of file-system capabilities, while at the same time coordinating the management and access to these files and their contents with associated data stored in a relational database management system).…”

Section: Re:gridit Physical Layermentioning

confidence: 99%

See 1 more Smart Citation

Replicated data management in the grid

Voicu

Schuldt

Breitbart

et al. 2009

Proceedings of the 1st ACM Workshop on Data Grids for eScience

Self Cite

View full text Add to dashboard Cite

Grid environments more and more target novel domains such as eScience, eHealth or digital libraries that feature a variety of data-intensive applications. Consequently, issues related to data management in Grids are becoming increasingly important. In terms of data management, the Grid allows keeping a large number of replicas of data objects, possibly with different versions or levels of freshness, to allow for a high degree of availability, reliability and performance so as to best meet the needs of users and applications. At the same time, the seamless integration of replication management into the Grid while taking into account its special characteristics, needs to be done without any central component for managing data or metadata. In this paper, we report on the ongoing Re:GRIDiT project which aims at addressing all the above requirements. Re:GRIDiT distinguishes between potentially many updateable and read-only replicas which can be distributed across a Grid environment. First, Re:GRIDiT provides new protocols for the correct synchronization of concurrent updates to different updateable replicas and their subsequent propagation in a completely distributed way. Second, Re:GRIDiT takes into account the semantics of the data which is managed in the Grid: mutable data can be subject to updates; immutable data, in turn, cannot be changed once created, but may be subject to version control. Third, Re:GRIDiT will be dynamic in a way that according to the current load, new replicas (updateable or read-only) can be created or removed on demand. Fourth, Re:GRIDiT will provide read-only transactions the full flexibility to specify the freshness (for mutable data) or version number (for immutable data) -which is particularly useful * This work has been partly supported by the Hasler Foundation within the project COSA (Compiling Service-oriented Architectures).

show abstract

Section: Example Application: Earth Observationmentioning

confidence: 99%

Section: Re:gridit Physical Layermentioning

confidence: 99%

Replicated data management in the grid

Voicu

Schuldt

Breitbart

et al. 2009

Proceedings of the 1st ACM Workshop on Data Grids for eScience

Self Cite

View full text Add to dashboard Cite

show abstract

“…DILIGENT [1] is a digital library infrastructure based on grid technologies and distributed resources. This infrastructure provides diverse digital content services by using distributed computing, storage, and application resources.…”

Section: Related Workmentioning

confidence: 99%

“…Some researchers [1,2,3,4] proposed several grid computing-based digital content management systems. But, existing systems are unsuitable for the current digital content environment in which user requirements are very detailed and complex.…”

Section: Introductionmentioning

confidence: 99%

Semantic Web-Based Digital Content Management in Grid Computing

Jang

Noh

Lee

2008

2008 IEEE International Workshop on Semantic Computing and Applications

View full text Add to dashboard Cite

Grid computing has been noticed as a solution for digital content management. But, existing grid computing-based digital content management systems cannot meet complex and detailed requirements of a grid user due to the simple search mechanism base on few keywords. Therefore, this paper constructs a digital content ontology that represents digital content information. And, this paper proposes a semantic webbased digital content management system. In the system, a semantic web agent analyzes user requirements and infers a proper digital content from the digital content ontology. And, the system selects a grid resource with the cheapest and fastest data service among grid resources which can provide the inferred digital content. Digital content data is transferred from the selected grid resource to the grid user through a local grid resource agent.

show abstract

“…According to [12], by the year 2010 the earth observation data archives around the world will grow to around 9.000 Tbytes and by the year 2014 to around 14.000 Tbytes. In many applications, Data Grids not only maintain raw data produced by instruments, but need to take into account also reports derived out of these raw data and image interpretations that are periodically generated and potentially concurrently updated by scientists at several sites [5]. Similar to Cloud-based systems, a high degree of availability of data can only be achieved by means of replication across different nodes in the Grid.…”

Section: Introductionmentioning

confidence: 99%

How replicated data management in the cloud can benefit from a data grid protocol

Voicu

Schuldt

2009

Proceedings of the First International Workshop on Cloud Data Management

Self Cite

View full text Add to dashboard Cite

Cloud computing has recently received considerable attention both in industry and academia. Due to the great success of the first generation of Cloud-based services, providers have to deal with larger and larger volumes of data. Quality of service agreements with customers require data to be replicated across data centers in order to guarantee a high degree of availability. In this context, Cloud Data Management has to address several challenges, especially when replicated data are concurrently updated at different sites or when the system workload and the resources requested by clients change dynamically. Mostly independent from recent developments in Cloud Data Management, Data Grids have undergone a transition from pure file management with readonly access to more powerful systems. In our recent work, we have developed the Re:GRIDiT protocol for managing data in the Grid which provides concurrent access to replicated data at different sites without any global component and supports the dynamic deployment of replicas. Since it is independent from the underlying Grid middleware, it can be seamlessly transferred to other environments like the Cloud. In this paper, we compare Data Management in the Grid and the Cloud, briefly introduce the Re:GRIDiT protocol and show its applicability for Cloud Data Management.

show abstract

DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure

Cited by 27 publications

References 22 publications

Replicated data management in the grid

Replicated data management in the grid

Semantic Web-Based Digital Content Management in Grid Computing

How replicated data management in the cloud can benefit from a data grid protocol

Contact Info

Product

Resources

About