Multi-Sensor Fusion of Infrared and Electro-Optic Signals for High Resolution Night Images

Abstract

Electro-optic (EO) image sensors exhibit the properties of high resolution and low noise level at daytime, but they do not work in dark environments. Infrared (IR) image sensors exhibit poor resolution and cannot separate objects with similar temperature. Therefore, we propose a novel framework of IR image enhancement based on the information (e.g., edge) from EO images, which improves the resolution of IR images and helps us distinguish objects at night. Our framework superimposing/blending the edges of the EO image onto the corresponding transformed IR image improves their resolution. In this framework, we adopt the theoretical point spread function (PSF) proposed by Hardie et al. for the IR image, which has the modulation transfer function (MTF) of a uniform detector array and the incoherent optical transfer function (OTF) of diffraction-limited optics. In addition, we design an inverse filter for the proposed PSF and use it for the IR image transformation. The framework requires four main steps: (1) inverse filter-based IR image transformation; (2) EO image edge detection; (3) registration; and (4) blending/superimposing of the obtained image pair. Simulation results show both blended and superimposed IR images, and demonstrate that blended IR images have better quality over the superimposed images. Additionally, based on the same steps, simulation result shows a blended IR image of better quality when only the original IR image is available.

A Study into the Effects of Factors Influencing an Underwater, Single-Pixel Imaging System’s Performance

“…As the material's own reflectivity decreases, the system's ability to reconstruct the target is continuously reduced; that is, the contrast and replication rate of the system are gradually attenuated at a certain stripe spatial frequency. Considering that the coherence of light in computational imaging has less effect on imaging quality [47], the degree of modulation of the object space information by the system may correspond to an MTF value of the system at the frequency [48]:…”

DMD Mask Construction to Suppress Blocky Structural Artifacts for Medium Wave Infrared Focal Plane Array-Based Compressive Imaging

“…Unfortunately, the MWIR sensors in the imaging systems are typically of low-resolution [3]. In order to improve performance of target recognition and surveillance, MWIR sensors of high-resolution are desired, but they are usually greater than tens of thousands dollars [4]. Hence, in spite of the immense application potential, high-resolution MWIR sensors are beyond the reach of scholars and researchers in some research fields which could get the most benefit from the high-resolution MWIR sensors.…”

Multisensor Fusion of Landsat Images for High‐Resolution Thermal Infrared Images Using Sparse Representations

“…Many researchers in the field of image processing have developed efficient image fusion algorithms such as the expectation maximization (EM), discrete wavelet transform (DWT), and Laplacian pyramid [8,9] methods. Much literature focuses on presenting techniques of integrating IR and visible image information for enhanced visual quality.…”