Mixed-UNet: Refined class activation mapping for weakly-supervised semantic segmentation with multi-scale inference

Abstract

Deep learning techniques have shown great potential in medical image processing, particularly through accurate and reliable image segmentation on magnetic resonance imaging (MRI) scans or computed tomography (CT) scans, which allow the localization and diagnosis of lesions. However, training these segmentation models requires a large number of manually annotated pixel-level labels, which are time-consuming and labor-intensive, in contrast to image-level labels that are easier to obtain. It is imperative to resolve this problem through weakly-supervised semantic segmentation models using image-level labels as supervision since it can significantly reduce human annotation efforts. Most of the advanced solutions exploit class activation mapping (CAM). However, the original CAMs rarely capture the precise boundaries of lesions. In this study, we propose the strategy of multi-scale inference to refine CAMs by reducing the detail loss in single-scale reasoning. For segmentation, we develop a novel model named Mixed-UNet, which has two parallel branches in the decoding phase. The results can be obtained after fusing the extracted features from two branches. We evaluate the designed Mixed-UNet against several prevalent deep learning-based segmentation approaches on our dataset collected from the local hospital and public datasets. The validation results demonstrate that our model surpasses available methods under the same supervision level in the segmentation of various lesions from brain imaging.

HAFREE: A heatmap-based anchor-free detector for apple defects

“…Secondly, weakly supervised approaches may incur additional computational costs due to the use of complex architectures for learning the relationship between features and locations 32 or the generation of multiple heatmaps at different scales for accurate object localization 33 . Lastly, some weakly supervised approaches may involve a two-stage process that relies on pre-trained models for initial localization, potentially limiting the model's ability to directly learn from the heatmaps used for refinement.…”

Object detection for caries or pit and fissure sealing requirement in children's first permanent molars

“…Deep learning models have been adopted for medical diagnosis in a variety of clinical dental settings. [11][12][13] Deep convolutional neural networks have been employed to analyze periapical radiographs and near-infrared transillumination images for dental caries detection and diagnosis, showing promise in enhancing the speed and accuracy of caries detection and supporting dental practitioners' diagnoses. [14][15][16] The Mask R-CNN detects and classifies dental caries on occlusal surfaces across the entire 7-class on an intraoral camera image data set.…”

“…Neural networks have demonstrated remarkable performance in breast disease detection, skin cancer classification diagnosis, and diabetic retinopathy detection with accuracies approaching those of clinical experts, which can greatly alleviate the work pressure of clinicians. Deep learning models have been adopted for medical diagnosis in a variety of clinical dental settings 11–13 . Deep convolutional neural networks have been employed to analyze periapical radiographs and near‐infrared transillumination images for dental caries detection and diagnosis, showing promise in enhancing the speed and accuracy of caries detection and supporting dental practitioners' diagnoses 14–16 .…”

Universal protection against SARS-CoV-2 viruses by multivalent mRNA vaccine in mice

“…Moreover, CH.1.1 and CA.3.1, two Omicron variants identified before EG.5.1, exhibit nearly complete escape of neutralization from bivalent booster [19]. Although deep learning and machine learning have been applied to predicting the antigenic evolution of SARS-CoV-2, an effective universal SARS-CoV-2 vaccine providing protection against the newest strains is urgently needed, and the protection efficiency of the vaccines on the market should be reassessed against new virus variants [20][21][22][23].…”