A feature transfer enabled multi-task deep learning model on medical imaging

Abstract

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages-saving computing time and resources and improving robustness against overfitting.However, existing multi-task deep models start with each task as an individual task and integrate parallelly conducted tasks at the end of the architecture with one cost function. Such architecture fails to take advantage of the combined power of the features from each individual task at an early stage of the training. In this research, we propose a new architecture, FT-MTL-Net, an MTL enabled by feature transferring. Traditional transfer learning deals with the same or similar task from different data sources (a.k.a. domain). The underlying assumption is that the knowledge gained from source domains may help the learning task on the target domain. Our proposed FT-MTL-Net utilizes the different tasks from the same domain. Considering features from the tasks are different views of the domain, the combined feature maps can be well exploited using knowledge from multiple views to enhance the generalizability. To evaluate the validity of the proposed approach, FT-MTL-Net is compared with models from literature including 8 classification models, 4 detection models and 3 segmentation models using a public full field digital mammogram dataset for breast cancer diagnosis. Experimental results show that the proposed FT-MTL-Net outperforms the competing models in classification and detection and has comparable results in segmentation.

Stacked-autoencoder-based model for COVID-19 diagnosis on CT images

“…In recent years, deep learning technology has achieved promising results in the automatic analysis of multimodal medical images to complete radiological tasks [18][19][20]. Deep convolutional neural networks are a powerful deep learning architecture, which has been widely applied to image classification, pattern recognition, and other fields [21].…”

FCOD: Fast COVID-19 Detector based on deep learning techniques

“…In several medical fields, Artificial intelligence (AI) methods like a deep neural network and machine learning turn to the core of the superior CAD applications. In recent years, deep learning methods have encouraged the results to perform radiological tasks by automated examining multi-modal medical images [ [16] , [17] , [18] ]. Deep learning techniques are one of the robust neural network structures.…”

Deep convolutional neural networks for COVID‐19 automatic diagnosis

“…Deep learning has been investigated in the last decade as an automatic feature extraction and classification tool. It has been widely used on medical images including X‐ray images (Chen et al, 2019 ; Gao, Yoon, Wu, & Chu, 2020 ; Kim et al, 2020 ). Recently, deep convolutional neural networks (DCNNs) have spread widely in the machine learning domain.…”