Mixed-UNet: Refined class activation mapping for weakly-supervised semantic segmentation with multi-scale inference

Abstract

Deep learning techniques have shown great potential in medical image processing, particularly through accurate and reliable image segmentation on magnetic resonance imaging (MRI) scans or computed tomography (CT) scans, which allow the localization and diagnosis of lesions. However, training these segmentation models requires a large number of manually annotated pixel-level labels, which are time-consuming and labor-intensive, in contrast to image-level labels that are easier to obtain. It is imperative to resolve this problem through weakly-supervised semantic segmentation models using image-level labels as supervision since it can significantly reduce human annotation efforts. Most of the advanced solutions exploit class activation mapping (CAM). However, the original CAMs rarely capture the precise boundaries of lesions. In this study, we propose the strategy of multi-scale inference to refine CAMs by reducing the detail loss in single-scale reasoning. For segmentation, we develop a novel model named Mixed-UNet, which has two parallel branches in the decoding phase. The results can be obtained after fusing the extracted features from two branches. We evaluate the designed Mixed-UNet against several prevalent deep learning-based segmentation approaches on our dataset collected from the local hospital and public datasets. The validation results demonstrate that our model surpasses available methods under the same supervision level in the segmentation of various lesions from brain imaging.

HAFREE: A heatmap-based anchor-free detector for apple defects

“…Secondly, weakly supervised approaches may incur additional computational costs due to the use of complex architectures for learning the relationship between features and locations 32 or the generation of multiple heatmaps at different scales for accurate object localization 33 . Lastly, some weakly supervised approaches may involve a two-stage process that relies on pre-trained models for initial localization, potentially limiting the model's ability to directly learn from the heatmaps used for refinement.…”

Universal protection against SARS-CoV-2 viruses by multivalent mRNA vaccine in mice

“…Moreover, CH.1.1 and CA.3.1, two Omicron variants identified before EG.5.1, exhibit nearly complete escape of neutralization from bivalent booster [19]. Although deep learning and machine learning have been applied to predicting the antigenic evolution of SARS-CoV-2, an effective universal SARS-CoV-2 vaccine providing protection against the newest strains is urgently needed, and the protection efficiency of the vaccines on the market should be reassessed against new virus variants [20][21][22][23].…”