Design and Implementation of a Metadata Management Scheme for Large Distributed File Systems

Abstract

SUMMARYMost large-scale distributed file systems decouple a metadata operation from read and write operations for a file. In the distributed file systems, a certain server named a metadata server (MDS) is responsible for maintaining the metadata information of the file systems. In this paper, we propose a new metadata management scheme in order to provide the high metadata throughput and scalability for a cluster of MDSs. First, we derive a new metadata distribution technique. Then, we present a load balancing technique based on the distribution technique. Several experiments show that our scheme outperforms existing metadata management scheme in terms of scalability and load balancing. key words: distributed file system (DFS), metadata server (MDS)

Implementation of a Software-Defined Storage Service with Heterogeneous Storage Technologies

“…Ceph [7]- [9] is a software storage platform designed to present object, block, and file storage from a single distributed computer cluster. Ceph is a distributed storage designed to provide excellent performance, reliability and scalability.…”