Efficient storage utilization using erasure codes in OpenStack cloud

Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services

“…Erasure Coding (EC) is a static redundancy strategy that offers similar levels of fault tolerance as replication, but with less storage space. This technique is used in Hadoop 3.0 [19] and Open Stack Swift [20]. Dynamic replication methods [21], [22] allows to adjust configurations on-the-fly during the storage service life cycle, based usually on monitoring data.…”

“…The main advantages of our proposal with respect to the related work are: i) It allows the creation of policies for providing cloud storage solution with data availability that improves storage utilization and performance of the information sharing for CDS services based on virtual machines and containers; ii) Most of the related work have been tested in simulated scenarios, while our methodology was tested in a prototype of a semantic CDS service for an organizational scenario; iii) To the best of our knowledge, this work would be the first approach that provides an integrated load balancing, availability and reliability scheme based on the classification of users and content (topics) activity, which dynamically adapt the replication factor and distribution of contents in a semantic CDS service to improve the trade-off between I/O performance and cloud storage consumption; and iv) A complementary simulator and emulator based on our methodology is available to evaluate state-of-the-art availability policies and load balancing methods at different scales. Some aspects that were not considered in our proposal and are available in the related work are: i) The use of synchronization techniques on the end-user side that can potentially improve user experience [32], [34]; and ii) The use of Erasure Coding (EC) techniques to provide data confidentiality and improve storage consumption [19], [20], [35].…”