Aim:
To deal with the drawbacks of the traditional medical image fusion methods, such
as the low preservation ability of the details, the loss of edge information, and the image distortion,
as well as the huge need for the training data for deep learning, a new multi-modal medical image
fusion method based on the VGG19 model and the non-subsampled contourlet transform (NSCT)
is proposed, whose overall objective is to simultaneously make the full use of the advantages of the
NSCT and the VGG19 model.
Methodology:
Firstly, the source images are decomposed into the high-pass and low-pass subbands by NSCT, respectively. Then, the weighted average fusion rule is implemented to produce
the fused low-pass sub-band coefficients, while an extractor based on the pre-trained VGG19
model is constructed to obtain the fused high-pass subband coefficients.
Result and Discussion:
Finally, the fusion results are reconstructed by the inversion transform of
the NSCT on the fused coefficients. To prove the effectiveness and the accuracy, experiments on
three types of medical datasets are implemented.
Conclusion:
By comparing seven famous fusion methods, both of the subjective and objective
evaluations demonstrate that the proposed method can effectively avoid the loss of detailed feature
information, capture more medical information from the source images, and integrate them into the
fused images.