Restoration and content analysis of ancient manuscripts via color space based segmentation

Abstract

Ancient manuscripts are a rich source of history and civilization. Unfortunately, these documents are often affected by different age and storage related degradation which impinge on their readability and information contents. In this paper, we propose a document restoration method that removes the unwanted interfering degradation patterns from color ancient manuscripts. We exploit different color spaces to highlight the spectral differences in various layers of information usually present in these documents. At each image pixel, the spectral representations of all color spaces are stacked to form a feature vector. PCA is applied to the whole data cube to eliminate correlation of the color planes and enhance separation among the patterns. The reduced data cube, along with the pixel spatial information, is used to perform a pixel based segmentation, where each cluster represents a class of pixels that share similar color properties in the decorrelated color spaces. The interfering, unwanted classes can thus be removed by inpainting their pixels with the background texture. Assuming Gaussian distributions for the various classes, a Gaussian Mixture Model (GMM) is estimated through the Expectation Maximization (EM) algorithm from the data, and then used to find appropriate labels for each pixel. In order to preserve the original appearance of the document and reproduce the background texture, the detected degraded pixels are replaced based on Gaussian conditional simulation, according to the surrounding context. Experiments are shown on manuscripts affected by different kinds of degradations, including manuscripts from the DIBCO 2018 and 2019 publicaly available dataset. We observe that the use of a few PCA dominant components accelerates the clustering process and provides a more accurate segmentation.

Removal of Color-Document Image Show-Through Based on Self-Supervised Learning

“…He et al [11] proposed a novel DL-based document-enhancement-and-binarization model (DeepOtsu), utilizing iterative refinement and superposition to achieve visually pleasing results. Hanif et al [12] proposed a document-restoration method aimed at eliminating unwanted interfering degradation patterns from ancient manuscripts containing color.…”

The Urgency of Digitizing Ancient Indonesian Manuscripts in Libraries: A Literature Review

“…Indonesian ancient manuscripts, known for their cultural and linguistic diversity, represent an invaluable intellectual treasure (Dinesh et al, 2023;Hanif et al, 2023). These texts provide a window to the past, offering profound insights into Indonesia's cultural evolution (Sunarno & Rachman, 2023), history (Dinasheva et al, 2022), religion (Shamakhay et al, 2019), and science (Schettino et al, 2023).…”