Deep learning segmentation of endothelial cell images using an active learning paradigm with guided label corrections

Abstract

.PurposeTo create Guided Correction Software for informed manual editing of automatically generated corneal endothelial cell (EC) segmentations and apply it to an active learning paradigm to analyze a diverse set of post-keratoplasty EC images.ApproachAn original U-Net model trained on 130 manually labeled post-Descemet stripping automated endothelial keratoplasty (EK) images was applied to 841 post-Descemet membrane EK images generating “uncorrected” cell border segmentations. Segmentations were then manually edited using the Guided Correction Software to create corrected labels. This dataset was split into 741 training and 100 testing EC images. U-Net and DeepLabV3+ were trained on the EC images and the corresponding uncorrected and corrected labels. Model performance was evaluated in a cell-by-cell analysis. Evaluation metrics included the number of over-segmentations, under-segmentations, correctly identified new cells, and endothelial cell density (ECD).ResultsUtilizing corrected segmentations for training U-Net and DeepLabV3+ improved their performance. The average number of over- and under-segmentations per image was reduced from 23 to 11 with the corrected training set. Predicted ECD values generated by networks trained on the corrected labels were not significantly different than the ground truth counterparts (p=0.02, paired t-test). These models also correctly segmented a larger percentage of newly identified cells. The proposed Guided Correction Software and semi-automated approach reduced the time to accurately segment EC images from 15 to 30 to 5 min, an ∼80% decrease compared to manual editing.ConclusionsGuided Correction Software can efficiently label new training data for improved deep learning performance and generalization between EC datasets.