Data Resilience in the dCache Storage System

Rossi, Albert; Adeyemi, F.; Ashish, A.; Behrmann, Gerd; Fuhrmann, Patrick; Litvintsev, D.; Millar, Paul; Mkrtchyan, T.; Mohiuddin, A.; Sahakyan, Marina; Starek, Jürgen; Yasar, S.

doi:10.1088/1742-6596/898/6/062024

Cited by 2 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To address those requirements the Resilience [8] subsystem of dCache, which is responsible for data durability, is evolving into QoS Engine. A significant amount of Resilience's architecture needed to be refactored in order to be placed on top of the already implemented functionality.…”

Section: Quality Of Servicementioning

confidence: 99%

dCache: Inter-disciplinary storage system

et al. 2021

View full text Add to dashboard Cite

The dCache project provides open-source software deployed internationally to satisfy ever more demanding storage requirements. Its multifaceted approach provides an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters and long term data persistence on a tertiary storage. Though it was originally developed for the HEP experiments, today it is used by various scientific communities, including astrophysics, biomed, life science, which have their specific requirements. In this paper we describe some of the new requirements as well as demonstrate how dCache developers are addressing them.

show abstract

Section: Quality Of Servicementioning

confidence: 99%

dCache: Inter-disciplinary storage system

et al. 2021

View full text Add to dashboard Cite

show abstract

“…"Resilience" [henceforward referred to in capitals without quotation marks] is a dCache subsystem that achieves data durability by maintaining permanent disk replicas independently of the presence of a back-end or tertiary storage system [4]. As implemented, Resilience relies on a partitioning of storage in such a way that files, pools and pool groups are either "resilient" or not, with the service only being responsible for handling the former.…”

Section: The Dcache Resilience Service As Qos Servicementioning

confidence: 99%

dCache: from Resilience to Quality of Service

Rossi

Chitrapu

Garonne³

et al. 2021

EPJ Web Conf.

View full text Add to dashboard Cite

A major goal of future dCache development will be to allow users to define file Quality of Service (QoS) in a more flexible way than currently available. This will mean implementing what might be called a QoS rule engine responsible for registering and managing time-bound QoS transitions for files or storage units. In anticipation of this extension to existing dCache capabilities, the Resilience service, which maintains on-disk replica state, needs to undergo both structural modification and generalization. This paper describes ongoing work to transform Resilience into the new architecture which will eventually support a more broadly defined file QoS.

show abstract

Data Resilience in the dCache Storage System

Cited by 2 publications

References 0 publications

dCache: Inter-disciplinary storage system

dCache: Inter-disciplinary storage system

dCache: from Resilience to Quality of Service

Contact Info

Product

Resources

About