Detection of Blotch and Scratch in Video Based on Video Decomposition

Abstract

In old video restoration, automatic detection of common defects, e.g., scratches and blotches, has always been emphasized. While prior thoughts mainly focus on detecting blotches and linear, vertical scratches separately, this paper contributes to a more generalized and challenging issue: simultaneous detection of blotches and complex scratches in video, with much less knowledge of them. We investigate the characteristics of blotches and scratches in space and time domain, and propose a novel detection method based on two main steps: cartoontexture decomposition in the space domain and content-defect separation in the time domain. We then formulate it into convex optimization problems and develop corresponding algorithms. The experiment results demonstrate that the proposed method is of high detection accuracy, verifying the effectiveness of our detection via a video decomposition method.

Advancing Image Understanding in Poor Visibility Environments: A Collective Benchmark Study

“…There are numerous algorithms aiming to enhance visibility of the degraded imagery, such as image and video denoising/inpainting [75][76][77][78][79], deblurring [80,81,162? ?…”

Learning Defects in Old Movies from Manually Assisted Restoration

“…To detect blotch and line scratches, [25] experimented a detection method based on cartoon-texture decomposition in the space domain and content-defect separation in the time domain. The distinction between defect or not was handled temporally, using matrix decomposition in a low-rank matrix in addition to a sparse matrix representing the defects.…”

U-Finger: Multi-Scale Dilated Convolutional Network for Fingerprint Image Denoising and Inpainting

“…Convolutional neural networks (CNNs) [20] have brought unprecedented success in many computer vision tasks, including some recent works addressing fingerprint extraction and analysis [1,2]. On the other hand, fingerprint restoration and enhancement have been traditionally studied using classical example-based and regression methods [3,4,5,8] [6,10,11,17,18], the recent ECCV 2018 ChaLearn competition 3 has started to motivate researchers to develop deep learning algorithms that can restore fingerprint images that contain artifacts such as noise, scratches [7,9], etc. to improve the performance of subsequent operations like fingerprint verification that are typically applied to such images.…”