A Novel GBM Saliency Detection Model Using Multi-Channel MRI

Abstract

The automatic computerized detection of regions of interest (ROI) is an important step in the process of medical image processing and analysis. The reasons are many, and include an increasing amount of available medical imaging data, existence of inter-observer and inter-scanner variability, and to improve the accuracy in automatic detection in order to assist doctors in diagnosing faster and on time. A novel algorithm, based on visual saliency, is developed here for the identification of tumor regions from MR images of the brain. The GBM saliency detection model is designed by taking cue from the concept of visual saliency in natural scenes. A visually salient region is typically rare in an image, and contains highly discriminating information, with attention getting immediately focused upon it. Although color is typically considered as the most important feature in a bottom-up saliency detection model, we circumvent this issue in the inherently gray scale MR framework. We develop a novel pseudo-coloring scheme, based on the three MRI sequences, viz. FLAIR, T2 and T1C (contrast enhanced with Gadolinium). A bottom-up strategy, based on a new pseudo-color distance and spatial distance between image patches, is defined for highlighting the salient regions in the image. This multi-channel representation of the image and saliency detection model help in automatically and quickly isolating the tumor region, for subsequent delineation, as is necessary in medical diagnosis. The effectiveness of the proposed model is evaluated on MRI of 80 subjects from the BRATS database in terms of the saliency map values. Using ground truth of the tumor regions for both high- and low- grade gliomas, the results are compared with four highly referred saliency detection models from literature. In all cases the AUC scores from the ROC analysis are found to be more than 0.999 ± 0.001 over different tumor grades, sizes and positions.

Application of Models based on Human Vision in Medical Image Processing: A Review Article

“…Saliency maps built up based on bottom-up visual attention strategy. Comparison between their saliency detection algorithms with four other popular saliency models had shown that in all cases the AUC scores were more than 0.999±0.001 [14].…”

Radiogenomics: bridging imaging and genomics

“…Various approaches have been proposed to shed light on this black box. Saliency mapping has gained attention in AI research, where the impact of each individual pixel on the prediction is measured and "areas of importance" for the prediction of the neural network are visualized [207]. This effectively generates a heat-map highlighting where in the image the model bases its prediction.…”

Feature of Interest‐Based Direct Volume Rendering Using Contextual Saliency‐Driven Ray Profile Analysis

“…Research in saliency by the computer vision research community has shown promising accuracy in object (feature) detection for medical images and scientific data [MTY*11, BMSH16, AKB*17]. These medical and scientific images tend to have salient object composition, that is differentiation between the foreground and background objects, for example, the lungs, heart, abdominal organs and bony skeleton are the foreground and empty space is the background.…”