Two-branch crisscross network for realistic and accurate image super-resolution

Yang, Qirui; Liu, Yihao; Yang, Jingyu

doi:10.1016/j.displa.2023.102549

Cited by 5 publications

(1 citation statement)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The low-frequency components affect the image base content, such as contrast, contour, and structure, while the high-frequency components affect the image details. For this reason, the high-frequency and low-frequency components of the image are processed separately to achieve excellent reconstruction results in many image enhancement methods [ 18 , 19 , 20 , 21 ]. Similarly, contrast and noise are difficult to be handled separately when degrading images in the spatial domain, which may make degradation from HR to LR more challenging.…”

Section: Introductionmentioning

confidence: 99%

Frequency-Aware Degradation Modeling for Real-World Thermal Image Super-Resolution

Qu,

Chen,

et al. 2024

Entropy

View full text Add to dashboard Cite

The supervised super-resolution (SR) methods based on simple degradation assumptions (e.g., bicubic downsampling) have unsatisfactory generalization ability on real-world thermal images. To enhance the SR effect of real-world sceneries, we introduce an unsupervised SR framework for thermal images, incorporating degradation modeling and corresponding SR. Inspired by the physical prior that high frequency affects details and low frequency affects thermal contrast, we propose a frequency-aware degradation model, named TFADGAN. The model achieves image quality migration between thermal detectors of different resolutions by degrading different frequency components of the image from high-resolution (HR) to low-resolution (LR). Specifically, by adversarial learning with unpaired LR thermal images, the complex degradation processes of HR thermal images at low and high frequencies are modeled separately. Benefiting from the thermal characteristics mined from real-world images, the degraded images generated by TFADGAN are similar to LR thermal ones in terms of detail and contrast. Then, the SR model is trained based on the pseudo-paired data consisting of degraded images and HR images. Extensive experimental results demonstrate that the degraded images generated by TFADGAN provide reliable alternatives to real-world LR thermal images. In real-world thermal image experiments, the proposed SR framework can improve the peak signal-to-noise ratio (PSNR) and structural similarity degree (SSIM) by 1.28 dB and 0.02, respectively.

show abstract