Efficient Erasure-Coded Data Update and Recovery Based on Machine Learning and I/O Mitigation

Su, Xiaosong; Wei, Bing; Wu, Yalan; Wu, Jigang

doi:10.1109/hpcc-dss-smartcity-dependsys57074.2022.00180

Cited by 1 publication

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…PLR designates additional space next to parity chunks, incoming parity deltas can be sequentially stored on the space, thus alleviating disk seeks. Nevertheless, the reserved space drastically escalates the storage overhead [12]. Also, the potential to reduce the read amount of parity deltas in recovery by leveraging the shareability of parity delta is inadequately exploited in PLR, resulting in slow recovery speed.…”

Section: Introductionmentioning

confidence: 99%

Cognitive Update and Fast Recovery Using Machine Learning and Parity Delta Shareability for Erasure-Coded Storage Systems

Wei,

Shi,

et al. 2024

Preprint

View full text Add to dashboard Cite

Erasure-coded systems require simultaneous updating of data chunks and parity chunks, thereby leading to high input/output (I/O) overhead. Following these updates, the most recent data and parity deltas are dispersed randomly in the log, which results in prolonged recovery time. This study introduces a novel approach named MPLR, which is specifically designed to expedite erasure-coded data updating and recovery. MPLR uses machine learning to categorize files into non-read-only and read-only classes, and then performs updates based on these classifications. For non-read-only files, MPLR applies in-place updates for data chunks and log-based updates for parity chunks, while setting aside disk space adjacent to the parity chunk to minimize disk seeks. For read-only files, MPLR likewise employs a mixture of in-place data updates and log-based parity updates, although without reserving space next to parity chunks. In regard to data recovery, MPLR enhances speed by accessing the parity delta stored in the allocated disk space. To further boost recovery acceleration, MPLR reads the parity delta in parallel and reduces the volume of parity delta leveraging the shareable aspects of the parity delta. Experimental results confirm the efficiency of MPLR in significantly improving update and recovery performances, compared to the state-of-the-art approaches.

show abstract

Section: Introductionmentioning

confidence: 99%