Quality Assessment of Sharpened Images: Challenges, Methodology, and Objective Metrics

Abstract

Most of the effort in image quality assessment (QA) has been so far dedicated to the degradation of the image. However, there are also many algorithms in the image processing chain that can enhance the quality of an input image. These include procedures for contrast enhancement, deblurring, sharpening, up-sampling, denoising, transfer function compensation, etc. In this work, possible strategies for the quality assessment of sharpened images are investigated. This task is not trivial because the sharpening techniques can increase the perceived quality, as well as introduce artifacts leading to the quality drop (over-sharpening). Here, the framework specifically adapted for the quality assessment of sharpened images and objective metrics comparison in this context is introduced. However, the framework can be adopted in other quality assessment areas as well. The problem of selecting the correct procedure for subjective evaluation was addressed and a subjective test on blurred, sharpened, and over-sharpened images was performed in order to demonstrate the use of the framework. The obtained ground-truth data were used for testing the suitability of state-ofthe- art objective quality metrics for the assessment of sharpened images. The comparison was performed by novel procedure using ROC analyses which is found more appropriate for the task than standard methods. Furthermore, seven possible augmentations of the no-reference S3 metric adapted for sharpened images are proposed. The performance of the metric is significantly improved and also superior over the rest of the tested quality criteria with respect to the subjective data.

Tackling Problems of Marker-Based Augmented Reality Under Water

“…The last filter used is a debluring filter (or unsharp mask filter [26]), which emphasizes high frequencies in input image by subtracting its low frequencies from itself as shown below:…”

Underwater augmented reality for improving the diving experience in submerged archaeological sites

“…The front camera of the device, which is sealed in a waterproof housing, records images of surrounding objects, and improves them in real-time to increase their contrast. The system also allowed the diver to change between methods that improve images, namely CLAHE [Pizer et al 1987], debluring [Krasula et al 2017], white balancing [Limare et al 2011], and white balancing that is adapted to underwater sea environment [Čejka et al 2018]. Then, the AR system detects squared planar markers in these images using the standard computer vision libraries ArUco [Garrido-Jurado et al 2014], which is available as a part of OpenCV library, and computes the relative position of the user (which is in essence the camera of the device) to each marker.…”

Detecting Square Markers in Underwater Environments

“…At each pixel, it computes a histogram of its surroundings, rearranges it to avoid unnatural changes in contrast, and equalizes it to obtain new intensity. Deblur [51] (also known as deblurring or the unsharp mask filter) stresses edges by removing low frequencies from the original image, which can be described by the following equation:…”