Infrared and visible image fusion based on oversampled graph filter banks

Song, Chunyan; Gao, Xueying; Qiao, Yulong; Zhang, Kaige

doi:10.1117/1.jei.29.2.023016

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The methods of IVIF can generally be categorized as traditional and deep learning based 5 , 6 . Traditional methods, such as sparse representation 7 – 9 and multi-scale transform, 10 – 12 typically rely on manual feature extraction and exhibit limited generalization capabilities. Deep learning based methods 13 – 17 have gradually overcome these limitations, and they demonstrate greater universality and reliability.…”

Section: Introductionmentioning

confidence: 99%

MCFusion: infrared and visible image fusion based multiscale receptive field and cross-modal enhanced attention mechanism

Jiang,

Wang,

Kong

et al. 2024

J. Electron. Imag.

View full text Add to dashboard Cite

Infrared and visible image fusion aims to generate a more comprehensive image for improving measurement and analysis accuracy. Existing Swin Transformer based methods effectively extract features from medium-large scale receptive fields. However, these methods ignore the complementary role of features extracted from the small receptive field, resulting in the loss of essential fine information. To this end, we propose MCFusion, a dual-branch framework based on a multiscale receptive field and cross-modal enhanced attention mechanism. MCFusion is composed of an attention-guided coarse branch (AGCB) and a fine branch (FineB). First, AGCB and FineB are designed to extract distinct yet complementary features from medium-large and small receptive fields, respectively. Second, a cross-modal enhanced attention mechanism is designed to enhance shared features across different modalities. Third, a loss function fully considering contrast, texture, and illumination intensity is proposed to generate fused images. The test results demonstrate that MCFusion is superior to other state-of-the-art methods and can notably enhance the detection and recognition of targets.

show abstract