Fully automated convolutional neural network-based affine algorithm improves liver registration and lesion co-localization on hepatobiliary phase T1-weighted MR images

Abstract

BackgroundLiver alignment between series/exams is challenged by dynamic morphology or variability in patient positioning or motion. Image registration can improve image interpretation and lesion co-localization. We assessed the performance of a convolutional neural network algorithm to register cross-sectional liver imaging series and compared its performance to manual image registration.MethodsThree hundred fourteen patients, including internal and external datasets, who underwent gadoxetate disodium-enhanced magnetic resonance imaging for clinical care from 2011 to 2018, were retrospectively selected. Automated registration was applied to all 2,663 within-patient series pairs derived from these datasets. Additionally, 100 within-patient series pairs from the internal dataset were independently manually registered by expert readers. Liver overlap, image correlation, and intra-observation distances for manual versus automated registrations were compared using paired t tests. Influence of patient demographics, imaging characteristics, and liver uptake function was evaluated using univariate and multivariate mixed models.ResultsCompared to the manual, automated registration produced significantly lower intra-observation distance (p < 0.001) and higher liver overlap and image correlation (p < 0.001). Intra-exam automated registration achieved 0.88 mean liver overlap and 0.44 mean image correlation for the internal dataset and 0.91 and 0.41, respectively, for the external dataset. For inter-exam registration, mean overlap was 0.81 and image correlation 0.41. Older age, female sex, greater inter-series time interval, differing uptake, and greater voxel size differences independently reduced automated registration performance (p ≤ 0.020).ConclusionA fully automated algorithm accurately registered the liver within and between examinations, yielding better liver and focal observation co-localization compared to manual registration.Electronic supplementary materialThe online version of this article (10.1186/s41747-019-0120-7) contains supplementary material, which is available to authorized users.

The Application and Development of Deep Learning in Radiotherapy: A Systematic Review

“…Research by Jiang et al 32 showed that 4-dimensional computed tomography (CT) deformed image registration of the lung based on CNN had the smallest error compared with various traditional methods, and the registration time was 1.4s. Hasenstab et al 33 evaluated the performance of a CNN algorithm for liver registration in 314 patients, and compared it with manual image registration. The results showed that compared with manual registration, the liver overlap and image correlation for automatic registration were higher.…”

A regularization‐based deep unsupervised model for affine multimodal co‐registration

“…The problem is that the regularizer terms like L2-norm cannot be applied to the affine transformation with such an encrypted set of parameters. Actually, the regularizer can only be applied to the transformation fields as reported by the related works (Hasenstab et al, 2019), (Lee et al, 2019), and (Boveiri et al, 2021).…”

Alternative approach of hepatocellular carcinoma surveillance: abbreviated MRI

“…There is great interest in applying artificial intelligence to improve MRI image quality, image registration, and workflow [73,[82][83][84] all of which are active areas of investigation.…”