Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks

Abstract

A magnetic resonance imaging (MRI) exam typically consists of the acquisition of multiple MR pulse sequences, which are required for a reliable diagnosis. With the rise of generative deep learning models, approaches for the synthesis of MR images are developed to either synthesize additional MR contrasts, generate synthetic data, or augment existing data for AI training. While current generative approaches allow only the synthesis of specific sets of MR contrasts, we developed a method to generate synthetic MR images with adjustable image contrast. Therefore, we trained a generative adversarial network (GAN) with a separate auxiliary classifier (AC) network to generate synthetic MR knee images conditioned on various acquisition parameters (repetition time, echo time, and image orientation). The AC determined the repetition time with a mean absolute error (MAE) of 239.6 ms, the echo time with an MAE of 1.6 ms, and the image orientation with an accuracy of 100%. Therefore, it can properly condition the generator network during training. Moreover, in a visual Turing test, two experts mislabeled 40.5% of real and synthetic MR images, demonstrating that the image quality of the generated synthetic and real MR images is comparable. This work can support radiologists and technologists during the parameterization of MR sequences by previewing the yielded MR contrast, can serve as a valuable tool for radiology training, and can be used for customized data generation to support AI training.

Potential Role of Generative Adversarial Networks in Enhancing Brain Tumors

“…This contentious training would result in the generation of realistic images. 31 Historically, the original structure of GANs depended on a random latent vector. It was successful in reproducing the handwritten digits of the MNIST data set.…”

Generative Adversarial Network of Industrial Positron Images on Memory Module

“…Ref. [ 25 ] proposed a solution focused on GAN for the augmentation of training data to improve the quality of MR images. Ref.…”

Advertisement Synthesis Network for Automatic Advertisement Image Synthesis

“…We believe that the two-stage generation protocol used in this paper breaks the paradigm of intrinsic advertisement image synthesis methods and can provide a generic solution idea for similar tasks. Early Generative Adversarial Networks (GANs) [10,11] are capable of sampling and generating high-resolution images, but they are difcult to optimise [12][13][14] and capture the complete distribution of data [15]. In contrast, Variable Autoencoder (VAE) [16] and stream-based models [17,18] are easier to optimise [19][20][21], but the quality of the images they generate will be lower than GAN-based models.…”