The Spatial Resolution Enhancement for a Thermogram Enabled by Controlled Subpixel Movements

Abstract

The measurement accuracy and reliability of thermography is largely limited by a relatively low spatial resolution of the thermal imager. Using a high-end camera to achieve high spatial resolution can be costly or infeasible due to a high sample rate required. Furthermore, the system miniaturisation becomes an inevitable trend with the continuous development of Internet of Things and their suitability to in-situ inspection scenarios. However, a miniaturised sensor usually suffers a low spatial resolution. Addressing this challenge, the paper reports a novel Spatial Resolution Enhancement for a Thermogram (SRE4T) system to significantly improve the spatial resolution without upgrading the sensor. A high-resolution thermal image is reconstructed by fusing a sequence of lowresolution images with sub-pixel movements. To achieve the best image quality, instead of benefiting from natural movements of existing studies, this paper proposes to use a high-resolution xy translation stage to produce a sequence of controlled sub-pixel movements. The performance of the proposed system was tested on both high-end and low-end thermal imagers. Both visual and quantitative results successfully demonstrated the considerable improvement of the quality of thermal images (up to 30.5% improvement of peak signal to noise ratio). This technique allows improving the measurement accuracy of thermography inspection without upgrading sensors. It also has the potential to be applied on other imaging systems.

A Review and Analysis of Automatic Optical Inspection and Quality Monitoring Methods in Electronics Industry

“…The three vectors are then sent for classification algorithm to classify the defects. Despite the effectiveness of thermography to detect certain types of defects, this method has relatively low spatial resolution (typically 640 × 480 pixels), which makes it not suitable for small defects detection that requires high resolution [340]. Jiang et al in [238] proposed statistical models to identify Mura defects in TFT-LCD in addition to their sizes and locations.…”

Deep Learning Based Super Resolution and Classification Applications for Neonatal Thermal Images

“…Content loss is created from the combination of VGG loss and MSE loss value and is calculated using a pre-trained 19layer network (VGG19). Here, VGG loss is used to ensure that the improvement in visual quality can be perceived by people, while MSE loss is used to observe the visual improvement in PSNR and SSIM values [23].…”

Compressive Sensing Based Active Imaging System Using Programable Coded Mask and a Photodiode

“…According to Nyquist criteria, the sampling frequency should be greater than twice the highest spatial frequency present in the optical image to accurately preserve the spatial resolution in the resulting digital image [7], [8]. As the spatial resolution increases, the cost of the camera also increases accordingly [9]. CS comes here as a rescuer [10], [11], which has emerged as an alternative to the traditional method for efficiently acquiring and reconstructing a signal [12], [13], [14], [15].…”