A novel augmented deep transfer learning for classification of COVID-19 and other thoracic diseases from X-rays

Abstract

Deep learning has provided numerous breakthroughs in natural imaging tasks. However, its successful application to medical images is severely handicapped with the limited amount of annotated training data. Transfer learning is commonly adopted for the medical imaging tasks. However, a large covariant shift between the source domain of natural images and target domain of medical images results in poor transfer learning. Moreover, scarcity of annotated data for the medical imaging tasks causes further problems for effective transfer learning. To address these problems, we develop an augmented ensemble transfer learning technique that leads to significant performance gain over the conventional transfer learning. Our technique uses an ensemble of deep learning models, where the architecture of each network is modified with extra layers to account for dimensionality change between the images of source and target data domains. Moreover, the model is hierarchically tuned to the target domain with augmented training data. Along with the network ensemble, we also utilize an ensemble of dictionaries that are based on features extracted from the augmented models. The dictionary ensemble provides an additional performance boost to our method. We first establish the effectiveness of our technique with the challenging ChestXray-14 radiography data set. Our experimental results show more than 50% reduction in the error rate with our method as compared to the baseline transfer learning technique. We then apply our technique to a recent COVID-19 data set for binary and multi-class classification tasks. Our technique achieves 99.49% accuracy for the binary classification, and 99.24% for multi-class classification.

Morphological signatures of actin organization in single cells accurately classify genetic perturbations using CNNs with transfer learning

“…3 below. 32 The learning rate was reduced-a common strategy when using transfer learning 33 -to 0.001. A stochastic gradient descent optimizer was used, and the loss function was set to the cross-entropy loss function.…”

Long future frame prediction using optical flow‐informed deep neural networks for enhancement of robotic teleoperation in high latency environments

“…In recent times ensembling is a popular concept to improve the results for discriminative CNNs, particularly for image classification (Neena & Geetha, 2018), object detection (X. Wang & Gupta, 2015), or medical image segmentation tasks (Altaf et al, 2021; Kavur, Gezer, et al, 2020; Kavur, Kuncheva, et al, 2020; Menze et al, 2014). Ensembling of GANs has also been experimented with for imbalanced image classification (Ermaliuc et al, 2021; Huang et al, 2020).…”

Deep learning based models to study the effect of glaucoma genes on angle dysgenesis in-vivo

“…Deep learning requires an enormous number of annotated training data, which is challenging to obtain in rare disorders 37 , however, transfer learning and augmentation techniques are effective strategies to be used in cases with limited dataset. 38 Transfer learning is a special case in which a CNN based DL model trained on one type of dataset or domain is repurposed on another dataset.…”