Data augmentation using generative adversarial neural networks on brain structural connectivity in multiple sclerosis

Abstract

Background and objective: Machine learning frameworks have demonstrated their potentials in dealing with complex data structures, achieving remarkable results in many areas, including brain imaging. However, a large collection of data is needed to train these models. This is particularly challenging in the biomedical domain since, due to acquisition accessibility, costs and pathology related variability, available datasets are limited and usually imbalanced. To overcome this challenge, generative models can be used to generate new data. Methods: In this study, a framework based on generative adversarial network is proposed to create synthetic structural brain networks in Multiple Sclerosis (MS). The dataset consists of 29 relapsingremitting and 19 secondary-progressive MS patients. T1 and diffusion tensor imaging (DTI) acquisitions were used to obtain the structural brain network for each subject. Evaluation of the quality of newly generated brain networks is performed by (i) analysing their structural properties and (ii) studying their impact on classification performance. Results: We demonstrate that advanced generative models could be directly applied to the structural brain networks. We quantitatively and qualitatively show that newly generated data do not present significant differences compared to the real ones. In addition, augmenting the existing dataset with generated samples leads to an improvement of the classification performance ( 1 81%) with respect to the baseline approach ( 1 66%). Conclusions: Our approach defines a new tool for biomedical application when connectome-based data augmentation is needed, providing a valid alternative to usual image-based data augmentation techniques.

Early Diagnosis of Multiple Sclerosis Using Swept-Source Optical Coherence Tomography and Convolutional Neural Networks Trained with Data Augmentation

“…In medicine, GANs have been used in image synthesis [ 59 ] and radiology applications [ 60 ], or to generate one-dimensional medical signals, such as EEGs [ 61 , 62 ] or ECGs [ 63 ]. Concerning GANs’ applications in diagnosis of MS, papers that can be cited include [ 64 ], in which the number of images is increased to analyze brain structural connectivity, or [ 65 ], in which the authors verify that performing data augmentation on a variety of T1-weighted MRIs improves both tissue and lesion segmentation in MS.…”

Deep Active Learning for Automatic Mitotic Cell Detection on HEp-2 Specimen Medical Images

“…Their MCGAN architecture was designed to conditionally optimize the generated nodules’ position, size, and attenuation to enhance the performance of a cascaded 3D CNN-based object detector. Nonetheless, various other contemporary research suggested using GANs to boost the classification performance of different medical imaging modalities, such as works in [ 52 , 53 , 54 , 55 , 56 ].…”

Role of artificial intelligence in MS clinical practice

“…These studies are examples of how the analysis of big data by ML approaches offers considerable advantages, such as flexibility, scalability and the ability to analyze diverse data, compared with traditional biostatistical methods. Furthermore, in one study several ML models were combined (“ensemble learning”), proving to be more performant than single models to estimate disability in MS ( Barile et al, 2021a ).…”