The Quick Migration of File Servers

Matsuzawa, Keiichi; Hayasaka, Mitsuo; Shinagawa, Takahiro

doi:10.1145/3211890.3211894

Cited by 8 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The transfer of process data between the source computing element and the serving element and the element is done at once. In the case of the serving computing element and the destination computing element, it is done peer-to-peer and as a function of time Matsuzawa, K., Hayasaka, M., & Shinagawa, T., 2018, June).…”

Section: 𝐹𝐹(𝑙𝑙𝑙𝑙𝑙𝑙ℎ𝑖𝑖𝑖𝑖𝑖𝑖)mentioning

confidence: 99%

A Mechanism for Using the Flushing Process Migration Mechanism in Distributed Exascale Systems

Gholamrezaie¹,

Feyziyev²

2022

AzJHPC

View full text Add to dashboard Cite

The effect of dynamic and interactive events on the function of the elements that make up the computing system manager causes the time required to run the user program to increase or the operation of these elements to change. These changes either increase the execution time of the scientific program or make the system incapable of executing the program. Computational processes on the migration process and vector algebras try to analyze and enable the Flushing process migration mechanism in support of distributed Exascale systems despite dynamic and interactive events. This paper investigates the Flushing process migration management mechanism in distributed Exascale systems, the effects of dynamic and interactive occurrences in the computational system, and the impact of dynamic and interactive events on the system.

show abstract

Section: 𝐹𝐹(𝑙𝑙𝑙𝑙𝑙𝑙ℎ𝑖𝑖𝑖𝑖𝑖𝑖)mentioning

confidence: 99%

A Mechanism for Using the Flushing Process Migration Mechanism in Distributed Exascale Systems

Gholamrezaie¹,

Feyziyev²

2022

AzJHPC

View full text Add to dashboard Cite

show abstract

“…Each storage node in the cluster can independently perform deduplication work [3,4]. Deduplication clusters can meet increasing data backup needs [5]. Since 2010, the international academic community has focused on deduplication clusters [6][7][8] and applied many popular data routing strategies to deduplication clusters.…”

Section: Introductionmentioning

confidence: 99%

Research on Multifeature Data Routing Strategy in Deduplication

BianGenqing

ShaoBilin

et al. 2020

Scientific Programming

View full text Add to dashboard Cite

Deduplication is a popular data reduction technology in storage systems which has significant advantages, such as finding and eliminating duplicate data, reducing data storage capacity required, increasing resource utilization, and saving storage costs. The file features are a key factor that is used to calculate the similarity between files, but the similarity calculated by the single feature has some limitations especially for the similar files. The storage node feature reflects the load condition of the node, which is the key factor to be considered in the data routing. This paper introduces a multifeature data routing strategy (DRMF). The routing strategy is made based on the features of the cluster, including routing communication, file similarity calculation, and the determination of the target node. The mutual information exchange is achieved by routing communication, routing servers, and storage nodes. The storage node calculates the similarity between the files stored, and then the file is routed according to the information provided by the routing server. The routing server determines the target node of the route according to the similar results and the node load features. The system prototype is designed and implemented; also, we develop a system to process the feature of cluster and determine the specific parameters of various features of experiments. In the end, we simulate the multifeature data routing and single-feature data routing, respectively, and compare the deduplication rate and data slope between the two strategies. The experimental results show that the proposed data routing strategy using multiple features can improve the deduplication rate of the cluster and maintain a lower data skew rate compared with the single-feature-based routing strategy MCS; DRMF can improve the deduplication rate of the cluster and maintain a lower data skew rate.

show abstract

“…Maddodietal proposed data deduplication technology and analysed database applications, which try to reduce database storage consumption or process transactions online. For granularity, deduplication is applied at the sub-file or the entire file level [3][4][5][6], which improves the impact of space storage and performance trade-off evaluation issues. More fine-grained deduplication creates more space storage opportunities and causes a significant performance impact.…”

Section: Introductionmentioning

confidence: 99%

Data Deduplication Technology for Cloud Storage

Bian

Shao

et al. 2020

Teh. vjesn.

View full text Add to dashboard Cite

With the explosive growth of information data, the data storage system has stepped into the cloud storage era. Although the core of the cloud storage system is distributed file system in solving the problem of mass data storage, a large number of duplicate data exist in all storage system. File systems are designed to control how files are stored and retrieved. Fewer studies focus on the cloud file system deduplication technologies at the application level, especially for the Hadoop distributed file system. In this paper, we design a file deduplication framework on Hadoop distributed file system for cloud application developer. Proposed RFD-HDFS and FD-HDFS two data deduplication solutions process data deduplication online, which improves storage space utilisation and reduces the redundancy. In the end of the paper, we test the disk utilisation and the file upload performance on RFD-HDFS and FD-HDFS, and compare HDFS with the disk utilisation of two system frameworks. The results show that the two-system framework not only implements data deduplication function but also effectively reduces the disk utilisation of duplicate files. So, the proposed framework can indeed reduce the storage space by eliminating redundant HDFS file.

show abstract

The Quick Migration of File Servers

Cited by 8 publications

References 10 publications

A Mechanism for Using the Flushing Process Migration Mechanism in Distributed Exascale Systems

A Mechanism for Using the Flushing Process Migration Mechanism in Distributed Exascale Systems

Research on Multifeature Data Routing Strategy in Deduplication

Data Deduplication Technology for Cloud Storage

Contact Info

Product

Resources

About