AimsTo investigate the efficacy of a bi-modality deep convolutional neural network (DCNN) framework to categorise age-related macular degeneration (AMD) and polypoidal choroidal vasculopathy (PCV) from colour fundus images and optical coherence tomography (OCT) images.MethodsA retrospective cross-sectional study was proposed of patients with AMD or PCV who came to Peking Union Medical College Hospital. Diagnoses of all patients were confirmed by two retinal experts based on diagnostic gold standard for AMD and PCV. Patients with concurrent retinal vascular diseases were excluded. Colour fundus images and spectral domain OCT images were taken from dilated eyes of patients and healthy controls, and anonymised. All images were pre-labelled into normal, dry or wet AMD or PCV. ResNet-50 models were used as the backbone and alternate machine learning models including random forest classifiers were constructed for further comparison. For human-machine comparison, the same testing data set was diagnosed by three retinal experts independently. All images from the same participant were presented only within a single partition subset.ResultsOn a test set of 143 fundus and OCT image pairs from 80 eyes (20 eyes per-group), the bi-modal DCNN demonstrated the best performance, with accuracy 87.4%, sensitivity 88.8% and specificity 95.6%, and a perfect agreement with diagnostic gold standard (Cohen’s κ 0.828), exceeds slightly over the best expert (Human1, Cohen’s κ 0.810). For recognising PCV, the model outperformed the best expert as well.ConclusionA bi-modal DCNN for automated classification of AMD and PCV is accurate and promising in the realm of public health.
This paper studies automated categorization of age-related macular degeneration (AMD) given a multi-modal input, which consists of a color fundus image and an optical coherence tomography (OCT) image from a specific eye. Previous work uses a traditional method, comprised of feature extraction and classifier training that cannot be optimized jointly. By contrast, we propose a two-stream convolutional neural network (CNN) that is end-to-end. The CNN's fusion layer is tailored to the need of fusing information from the fundus and OCT streams. For generating more multi-modal training instances, we introduce Loose Pair training, where a fundus image and an OCT image are paired based on class labels rather than eyes. Moreover, for a visual interpretation of how the individual modalities make contributions, we extend the class activation mapping technique to the multi-modal scenario. Experiments on a real-world dataset collected from an outpatient clinic justify the viability of our proposal for multi-modal AMD categorization.
Background/aimsThe aim of this study was to generate and evaluate individualised post-therapeutic optical coherence tomography (OCT) images that could predict the short-term response of antivascular endothelial growth factor therapy for typical neovascular age-related macular degeneration (nAMD) based on pretherapeutic images using generative adversarial network (GAN).MethodsA total of 476 pairs of pretherapeutic and post-therapeutic OCT images of patients with nAMD were included in training set, while 50 pretherapeutic OCT images were included in the tests set retrospectively, and their corresponding post-therapeutic OCT images were used to evaluate the synthetic images. The pix2pixHD method was adopted for image synthesis. Three experiments were performed to evaluate the quality, authenticity and predictive power of the synthetic images by retinal specialists.ResultsWe found that 92% of the synthetic OCT images had sufficient quality for further clinical interpretation. Only about 26%–30% synthetic post-therapeutic images could be accurately identified as synthetic images. The accuracy to predict macular status of wet or dry was 0.85 (95% CI 0.74 to 0.95).ConclusionOur results revealed a great potential of GAN to generate post-therapeutic OCT images with both good quality and high accuracy.
BackgroundBoth inflammation and cerebral white matter injury are closely associated with vascular cognitive impairment (VCI). The aim of this study was to analyze the correlation between peripheral serological markers, white matter injury, and cognitive function in patients with non-disabling ischemic cerebrovascular events (NICE); to identify potential biological markers for the diagnosis and prediction of VCI; and to provide a basis for the early diagnosis and intervention of VCI.MethodsWe collected clinical data, along with demographic and medical history data, from 151 NICE patients. Fasting venous blood samples were collected. Based on the Montreal Cognitive Assessment (MoCA) after admission, we divided the patients into normal cognitive function (NCF) and VCI groups, and then classified them into mild white matter hyperintensity (mWMH) and severe white matter hyperintensity (sWMH) based on Fazekas scores. The differences in serological marker levels were compared between the cognitive function groups and the white matter hyperintensity groups. Binary logistic regression models and receiver operating characteristic curves were used to analyze the diagnostic predictive value of serological markers for VCI in patients with NICE and in the white matter hyperintensity subgroups.ResultsAmong 151 patients with NICE, 95 were male and 56 were female. Lymphocyte count (OR = 0.405, p = 0.010, 95% CI [0.201, 0.806]), red blood cell count (OR = 0.433, p = 0.010, 95% CI [0.228, 0.821]), and hemoglobin level (OR = 0.979, p = 0.046, 95% CI [0.958, 0.999]) were protective factors for cognitive function in patients with NICE. The sWMH group had a higher age, granulocyte/lymphoid ratio (NLR), and neutrophil percentage but a lower MoCA score, hemoglobin level, and lymphocyte count than the mWMH group. In the mWMH group, lymphocyte count (AUC = 0.713, p = 0.003, 95% CI [0.593, 0.833]) had an acceptable predictive value for the diagnosis of VCI, whereas white blood cell count (AUC = 0.672, p = 0.011, 95% CI [0.545, 0.799]), red blood cell count (AUC = 0.665, p = 0.014, 95% CI [0.545, 0.784]), and hemoglobin level (AUC = 0.634, p = 0.047, 95% CI [0.502, 0.765]) had marginal predictive value for the diagnosis of VCI. In the sWMH group, no significant differences were found in serological markers between the NCF and VCI groups.ConclusionLymphocyte count, red blood cell count, and hemoglobin level were independent protective factors for cognitive function in patients with NICE; they can be used as potential biological markers to distinguish VCI in patients with NICE and are applicable to subgroups of patients with mWMH.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.