Cooperative Recovery of Distributed Storage Systems from Multiple Losses with Network Coding

Hu, Yuchong; Xu, Yinlong; Wang, Xiaozhao; Zhan, Cheng; Li, Pei

doi:10.1109/jsac.2010.100216

Cited by 126 publications

(105 citation statements)

References 8 publications

Supporting

Mentioning

104

Contrasting

Order By: Relevance

“…On top of regenerating codes, several studies (e.g., [29], [34], [55], [56]) address cooperative recovery for multiple failures. Their idea is to have new nodes exchange reconstructed data to minimize the overall repair traffic.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds

Chen

Lee

et al. 2014

IEEE Trans. Comput.

Self Cite

View full text Add to dashboard Cite

Abstract-To provide fault tolerance for cloud storage, recent studies propose to stripe data across multiple cloud vendors. However, if a cloud suffers from a permanent failure and loses all its data, we need to repair the lost data with the help of the other surviving clouds to preserve data redundancy. We present a proxy-based storage system for fault-tolerant multiple-cloud storage called NCCloud, which achieves cost-effective repair for a permanent single-cloud failure. NCCloud is built on top of a network-coding-based storage scheme called the functional minimum-storage regenerating (FMSR) codes, which maintain the same fault tolerance and data redundancy as in traditional erasure codes (e.g., RAID-6), but use less repair traffic and hence incur less monetary cost due to data transfer. One key design feature of our FMSR codes is that we relax the encoding requirement of storage nodes during repair, while preserving the benefits of network coding in repair. We implement a proof-of-concept prototype of NCCloud and deploy it atop both local and commercial clouds. We validate that FMSR codes provide significant monetary cost savings in repair over RAID-6 codes, while having comparable response time performance in normal cloud storage operations such as upload/download.

show abstract

Section: Related Workmentioning

confidence: 99%

“…Regenerating codes have been extensively studied in the theoretical context (e.g., [14], [16], [29], [34], [41], [50], [51], [55]- [57]). However, the practical performance of regenerating codes remains uncertain.…”

Section: Introductionmentioning

confidence: 99%

NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds

Chen

Lee

et al. 2014

IEEE Trans. Comput.

Self Cite

View full text Add to dashboard Cite

show abstract

“…The closest related works are on the repair problem, providing mechanisms for preserving the level of redundancy when one or more nodes fail or leave the system [25]. To this end, different symmetric and asymmetric network and erasure coding mechanisms have been proposed [26], [22], [27] that either rebuild a node with the same functionality as the failed node (functional repair) from the surviving nodes [22], [27], or reconstruct an exact copy of the failed node (exact repair) [28]. In [22], the notion of regenerating codes has been introduced to decrease the repair bandwidth by allowing a new node to communicate functions of the stored data from the surviving nodes.…”

Section: Related Workmentioning

confidence: 99%

“…In [22], the notion of regenerating codes has been introduced to decrease the repair bandwidth by allowing a new node to communicate functions of the stored data from the surviving nodes. Similarly, in [27], another solution for multiple node failures in a distributed storage system has been proposed. This solution is based on a mutually cooperative recovery (MCR) mechanism and it has been shown that this mechanism matches the lower bound maintenance bandwidth.…”

Section: Related Workmentioning

confidence: 99%

An update model for network coding in cloud storage systems

Zakerinasab¹,

Wang²

2012

2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton)

View full text Add to dashboard Cite

Abstract-The fast emerging cloud services have received a tremendous amount of attention in both industry and academia. Storage services such as Dropbox and iCloud enabled us to share files among multiple users or devices. Providing the benefits of network coding in distributed systems such as Peerto-Peer file sharing and multimedia streaming, researchers have also been trying to apply network coding in storage systems. Existing works have been focusing on mechanisms for preserving the level of redundancy when one or more nodes fail or leave the system. However, file updates, the most frequent operations performed on files, pose challenges in maintaining coded information in the system up to date. In other words, any change in the file will impact all coded blocks in the system, so all traces of the file must be completely replaced. This becomes costly since recomputing coded blocks is very CPU intensive and replacing all the coded blocks consumes an excessive amount of bandwidth. To the best of our knowledge, there has been no work addressing this update problem. To this end, we propose a Differential Update Model (DUM) that will update coded blocks by delivering only the changes in the file. We also present our objective view of the model through a complete analysis on computational complexity and bandwidth saving and simulated experiments.

show abstract

“…It makes data available closer to the user in distributed system [6]. The types of distributed storage system are Redundant Array of Independent Disks (RAID), Centralized RAID, Network Attached Storage (NAS) and Storage Area Network (SAN).…”

Section: Distributed Storage Systemmentioning

confidence: 99%

Accessing the Data Security Model in Distributed System

Agarwal¹,

Agarwal²

2012

IJAIS

View full text Add to dashboard Cite

This research deals with the comparative study of distributed system and client/server computer system, placing a special emphasis is on security system. The researches describe the data security in these systems by describing them; examine their issues, challenges and presenting the adequate solutions. We have selected four type of distributed system and included a report on the basis of authorization, authentication, encryption, access control.

show abstract

Cooperative Recovery of Distributed Storage Systems from Multiple Losses with Network Coding

Cited by 126 publications

References 8 publications

NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds

NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds

An update model for network coding in cloud storage systems

Accessing the Data Security Model in Distributed System

Contact Info

Product

Resources

About