Uniform and Efficient Access to Data in Organizationally Distributed Environments

Dutka, Łukasz; Słota, Renata; Wrzeszcz, Michał; Król, Dariusz; Kitowski, Jacek

doi:10.1007/978-3-319-10894-0_13

Cited by 9 publications

(5 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…VeilFS is a system that attempts to unify access to files stored at heterogeneous data storage systems that belong to geographically distributed organizations [7]. This approach is designed to only use local storage.…”

Section: Related Workmentioning

confidence: 99%

“…The selection of the storage resources takes into account the performance of the resource gathered from previous transfers (step 6). Finally, the worker relays the data to the user (step 7,8).…”

Section: System Architecture and Its Compo-nentmentioning

confidence: 99%

“…All files were replicated on all available storage and to reduce the load on the storage backend, caches were used on each LOBCDER worker. For producing concurrent requests, we used the Tsung benchmark tool 7 which is able to simulate a large amount of users. Tests are composed of four separate experiments using 128, 256, 512 and 1024 users requesting the same file simultaneously.…”

Section: Scalability Analysismentioning

confidence: 99%

See 2 more Smart Citations

Distributed Data Management Service for VPH Applications

Koulouzis

Belloum

Bubak

et al. 2016

IEEE Internet Comput.

View full text Add to dashboard Cite

Abstract-For many medical applications it is challenging to transparently access large datasets, often hosted across different domains on heterogeneous infrastructures. Homogenizing the infrastructure to simplify data access is unrealistic, therefore, it is important to elaborate a distributed storage which doesn't introduce added complexity. The main objective of this research is to investigate a solution that flexibly federates data on clouds or grids without any changes to the existing infrastructure and to be able to scale with the increasing data demand. Unlike existing approaches, ours isnt bound to a specific technology and doesn't require from administrators, users or application developers additional effort to federate and use the storage infrastructure. The elaborated system is implemented on the VPH-Share infostructure. As an example, we present a cardiac anatomy analysis workflow which uses the proposed solution to support a novel diagnostic method to characterize the shape of the heart.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: System Architecture and Its Compo-nentmentioning

confidence: 99%

Section: Scalability Analysismentioning

confidence: 99%

See 1 more Smart Citation

Distributed Data Management Service for VPH Applications

Koulouzis

Belloum

Bubak

et al. 2016

IEEE Internet Comput.

View full text Add to dashboard Cite

show abstract

“…Storage systems based on files are convenient for cluster administrators -a PFS compatible with POSIX could be mounted in Unix/Linux as a regular file system and accessed remotely when operating on files before and after computations. Modern solutions, like VeilFS [4] or OneData [20,23], are even able to hide various storage systems located in different locations behind a common interface. Another advantage of using an PFS is its integration with libraries helpful in application development.…”

Section: Introductionmentioning

confidence: 99%

Using Redis Supported by Nvram in HPC Applications

Malinowski

2017

csci

View full text Add to dashboard Cite

Nowadays, the efficiency of storage systems is a bottleneck in many modern HPC clusters. High performance in the traditional approach -processing using files -is often difficult to obtain because of a model's complexity and its read/write patterns. An alternative approach is to apply a key-value database, which usually has low latency and scales well. On the other hand, many key-value stores suffer from a limitation of memory capacity and vulnerability to serious failures, which is caused by processing in RAM. Moreover, some research suggests that scientific data models are not applicable to the storage structures of key-value databases. In this paper, the author proposes a resolution to the above-mentioned issues by replacing RAM with NVRAM. A practical example is based on Redis NoSQL. The article also contains three domain-specific APIs that show the idea behind transforming from an HPC data model to Redis structures as well as two micro-benchmarks results.

show abstract

“…Another requirement were the fact that existing applications are providing functionalities in an isolated mode [6,7]. Also it was hard to share data and functionality offered by different application in an efficient and unified ways [8]. In other hand, literatures shows that some business had merged but the reality is that they merge with the aim of cutting redundancies and lowering the cost of services they offer.…”

Section: Introductionmentioning

confidence: 99%

An Overview of Existing Frameworks for Integrating Fragmented Information Systems

Ramadhani¹,

Sam²,

Kalegele³

2016

IJIST

View full text Add to dashboard Cite

Literatures show that there are several structured integration frameworks which emerged with the aim of facilitating application integration. But weakness and strength of these frameworks are not known. This paper aimed at reviewing these frameworks with the focus on identifying their weakness and strength. To accomplish this, recommended comparison factors were identified and used to compare these frameworks. Findings shows that most of these structure frameworks are custom based on their motives. They focus on integrating applications from different sectors within an organization for the purpose of eliminating communication inefficiencies. There is no framework which guides application's integrators on goals of integrations, outcomes of integration, outputs of integration and skills which will be required for types of applications expected to be integrated. The study recommended further study on integration framework especial on designing unstructured framework which will support and guide application's integrators with consideration on consumer's surrounding environment.

show abstract

Uniform and Efficient Access to Data in Organizationally Distributed Environments

Cited by 9 publications

References 5 publications

Distributed Data Management Service for VPH Applications

Distributed Data Management Service for VPH Applications

Using Redis Supported by Nvram in HPC Applications

An Overview of Existing Frameworks for Integrating Fragmented Information Systems

Contact Info

Product

Resources

About