A Joint Multitask Learning Model for Cross-sectional and Longitudinal Predictions of Visual Field Using OCT

Abstract

Purpose: We constructed a multitask learning model (latent space linear regression and deep learning [LSLR-DL]) in which the 2 tasks of cross-sectional predictions (using OCT) of visual field (VF; central 10 ) and longitudinal progression predictions of VF (30 ) were performed jointly via sharing the deep learning (DL) component such that information from both tasks was used in an auxiliary manner (The Association for Computing Machinery's Special Interest Group on Knowledge Discovery and Data Mining [SIGKDD] 2021). The purpose of the current study was to investigate the prediction accuracy preparing an independent validation dataset.Design: Cohort study.Participants: Cross-sectional training and testing data sets included the VF (Humphrey Field Analyzer [HFA] 10-2 test) and an OCT measurement (obtained within 6 months) from 591 eyes of 351 healthy people or patients with open-angle glaucoma (OAG) and from 155 eyes of 131 patients with OAG, respectively. Longitudinal training and testing data sets included 7984 VF results (HFA 24-2 test) from 998 eyes of 592 patients with OAG and 1184 VF results (HFA 24-2 test) from 148 eyes of 84 patients with OAG, respectively. Each eye had 8 VF test results (HFA 24-2 test). The OCT sequences within the observation period were used.Methods: Root mean square error (RMSE) was used to evaluate the accuracy of LSLR-DL for the crosssectional prediction of VF (HFA 10-2 test). For the longitudinal prediction, the final (eighth) VF test (HFA 24-2 test) was predicted using a shorter VF series and relevant OCT images, and the RMSE was calculated. For comparison, RMSE values were calculated by applying the DL component (cross-sectional prediction) and the ordinary pointwise linear regression (longitudinal prediction).Main Outcome Measures: Root mean square error in the cross-sectional and longitudinal predictions.Results: Using LSLR-DL, the mean RMSE in the cross-sectional prediction was 6.4 dB and was between 4.4 dB (VF tests 1 and 2) and 3.7 dB (VF tests 1e7) in the longitudinal prediction, indicating that LSLR-DL significantly outperformed other methods.Conclusions: The results of this study indicate that LSLR-DL is useful for both the cross-sectional prediction of VF (HFA 10-2 test) and the longitudinal progression prediction of VF (HFA 24-2 test). Ophthalmology

Outlier-Based Autism Detection Using Longitudinal Structural MRI

“…Future work will focus on these extensions. Another interesting line of exploration would be to utilise multi-task learning for exploiting complementarities in (substantially available) cross-sectional and (sparse) longitudinal data for improving prediction accuracy as in [77]. We will also investigate architectures alternative to SAGAN such as Dense-Attentive GAN [78].…”

Multimodal Deep Learning Model of Predicting Future Visual Field for Glaucoma Patients

“…To manage the time series data, a recurrent neural network (RNN) model was used in [17]. In order to improve the performance, a linear regularization method is introduced to combine both previous VFs and OCT images in the same latent space [14], [18]. Although those recent researchers are able to learn the glaucoma progression.…”

Prediction of Central Visual Field Measures From Macular OCT Volume Scans With Deep Learning

“… 28 , 30 Deep learning (DL) has also been implemented for the prediction of VF measures using structural modalities in glaucoma. 34 – 36 Prior SF models utilized topographical matching of structural and functional data and considered anatomical retinal ganglion cell displacement to further enhance the SF relationship. 16 , 18 , 37 However, given the ability of CNNs to learn patterns within the input data, providing this additional information to the DL network may not be necessary.…”