Capacity of clustered distributed storage

Sohn, Jy-yong; Choi, Byung-Hee; Yoon, Sang Youl; Moon, Jaekyun

doi:10.1109/icc.2017.7997392

Cited by 23 publications

(114 citation statements)

References 11 publications

Supporting

Mentioning

113

Contrasting

Order By: Relevance

“…Obviously, the k newcomers {x ti } k i=1 correspond to a repair sequence of k original nodes called selected nodes. As analyzed in [22,24], the min-cut in the HC-DSS model is obtained by cutting {x ti } k i=1 one by one in the topological ordering as…”

Section: Main Definitionsmentioning

confidence: 99%

“…In [17,24], the authors proposed algorithms for the cluster DSS model corresponding to the above two steps under the assumption that the newcomer connects to all the alive nodes, namely, d = n − 1. However, this assumption cannot be used to analyse the cases with multiple node failures, which is also frequent in realistic storage systems [20,32].…”

Section: Heterogeneous Vertical Order Algorithm and Horizontal Selectmentioning

confidence: 99%

“…. , 0) and N sep = 0, the algorithms for the cluster DSS model in [17,24] are retrieved from Algorithms 1 and 2. Similarly, if N sep = 1 and v = (j, 0, .…”

Section: Heterogeneous Vertical Order Algorithm and Horizontal Selectmentioning

confidence: 99%

“…In [21,23], the authors considered the two-rack model and analyzed the storage and repair bandwidth tradeoff. Sohn et al [17,24] formulated the tradeoff bound theoretically for the multiple cluster DSS model, and the newcomer would download data from all the alive nodes in the repair procedure.…”

Section: Introductionmentioning

confidence: 99%

“…In [22], we investigated the cluster DSS model when the number of help nodes varied, which is different with the constraints in [17,24]. In heterogeneous storage systems, such as peer-to-peer (P2P) networks, sensor networks, hybrid cloud storage systems and content delivery networks [25][26][27], separate nodes are also prevalent.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Storage and repair bandwidth tradeoff for heterogeneous cluster distributed storage systems

Wang

Luo

Shum

2020

Sci. China Inf. Sci.

View full text Add to dashboard Cite

The storage and repair bandwidth tradeoff is an important issue in distributed storage systems (DSSs) where large scale data are stored in multiple nodes with erasure coding to ensure reliability. There are lots of studies on the DSS model with multiple clusters where the repair bandwidths from intra-cluster and cross-cluster nodes are differentiated to improve repair efficiency based on the realistic network topological structures. At the same time, separate nodes are also prevalent due to the variety of practical networks, but the work on the cluster DSS model with multiple separate nodes is insufficient, which is a main motivation of this paper. We formulate the tradeoff bound between storage repair bandwidth for a heterogeneous DSS model consisting of clusters and separate nodes by analyzing the min-cuts of heterogeneous information flow graphs corresponding to the orders of failed nodes. Additionally, the tradeoff bounds are investigated in multiple aspects when the repair bandwidth constraints and the amount of separate nodes vary, respectively. Moreover, a class of regenerating codes are illustrated to achieve the tradeoff in the heterogeneous cases.

show abstract

Section: Main Definitionsmentioning

confidence: 99%

Section: Heterogeneous Vertical Order Algorithm and Horizontal Selectmentioning

confidence: 99%

“…. , 0) and N sep = 0, the algorithms for the cluster DSS model in [17,24] are retrieved from Algorithms 1 and 2. Similarly, if N sep = 1 and v = (j, 0, .…”

Section: Heterogeneous Vertical Order Algorithm and Horizontal Selectmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Storage and repair bandwidth tradeoff for heterogeneous cluster distributed storage systems

Wang

Luo

Shum

2020

Sci. China Inf. Sci.

View full text Add to dashboard Cite

show abstract

Storage and repair bandwidth tradeoff for distributed storage systems with clusters and separate nodes

Wang

Luo

2018

Sci. China Inf. Sci.

View full text Add to dashboard Cite

In distributed storage systems (DSSs), the optimal tradeoff between node storage and repair bandwidth is an important issue for designing distributed coding strategies to ensure large scale data reliability. The capacity of DSSs is obtained as a function of node storage and repair bandwidth parameters, characterizing the tradeoff. There are lots of works on DSSs with clusters (racks) where the repair bandwidths from intra-cluster and cross-cluster are differentiated. However, separate nodes are also prevalent in the realistic DSSs, but the works on DSSs with clusters and separate nodes (CSN-DSSs) are insufficient. In this paper, we formulate the capacity of CSN-DSSs with one separate node for the first time where the bandwidth to repair a separate node is of cross-cluster. Consequently, the optimal tradeoff between node storage and repair bandwidth are derived and compared with cluster DSSs. A regenerating code instance is constructed based on the tradeoff. Furthermore, the influence of adding a separate node is analyzed and formulated theoretically. We prove that when each cluster contains R nodes and any k nodes suffice to recover the original file (MDS property), adding an extra separate node will keep the capacity if R|k, and reduce the capacity otherwise.

show abstract

Global multi-scale grid integer coding and spatial indexing: A novel approach for big earth observation data

Lei

Tong

Zhang

et al. 2020

ISPRS Journal of Photogrammetry and Remote Sensing

View full text Add to dashboard Cite

Capacity of clustered distributed storage

Cited by 23 publications

References 11 publications

Storage and repair bandwidth tradeoff for heterogeneous cluster distributed storage systems

Storage and repair bandwidth tradeoff for heterogeneous cluster distributed storage systems

Storage and repair bandwidth tradeoff for distributed storage systems with clusters and separate nodes

Global multi-scale grid integer coding and spatial indexing: A novel approach for big earth observation data

Contact Info

Product

Resources

About