The present study aimed to conduct a real-time automatic analysis of two important surgical phases, which are continuous curvilinear capsulorrhexis (CCC), nuclear extraction, and three other surgical phases of cataract surgery using artificial intelligence technology. A total of 303 cases of cataract surgery registered in the clinical database of the Ophthalmology Department of Tsukazaki Hospital were used as a dataset. Surgical videos were downsampled to a resolution of 299 × 168 at 1 FPS to image each frame. Next, based on the start and end times of each surgical phase recorded by an ophthalmologist, the obtained images were labeled correctly. Using the data, a neural network model, known as InceptionV3, was developed to identify the given surgical phase for each image. Then, the obtained images were processed in chronological order using the neural network model, where the moving average of the output result of five consecutive images was derived. The class with the maximum output value was defined as the surgical phase. For each surgical phase, the time at which a phase was first identified was defined as the start time, and the time at which a phase was last identified was defined as the end time. The performance was evaluated by finding the mean absolute error between the start and end times of each important phase recorded by the ophthalmologist as well as the start and end times determined by the model. The correct response rate of the cataract surgical phase classification was 90.7% for CCC, 94.5% for nuclear extraction, and 97.9% for other phases, with a mean correct response rate of 96.5%. The errors between each phase’s start and end times recorded by the ophthalmologist and those determined by the neural network model were as follows: CCC’s start and end times, 3.34 seconds and 4.43 seconds, respectively and nuclear extraction’s start and end times, 7.21 seconds and 6.04 seconds, respectively, with a mean of 5.25 seconds. The neural network model used in this study was able to perform the classification of the surgical phase by only referring to the last 5 seconds of video images. Therefore, our method has performed like a real-time classification.
Purpose:
To evaluate the efficacy of deep learning in judging the need for rebubbling after Descemet's endothelial membrane keratoplasty (DMEK).
Methods:
This retrospective study included eyes that underwent rebubbling after DMEK (rebubbling group: RB group) and the same number of eyes that did not require rebubbling (non-RB group), based on medical records. To classify the RB group, randomly selected images from anterior segment optical coherence tomography at postoperative day 5 were evaluated by corneal specialists. The criterion for rebubbling was the condition where graft detachment reached the central 4.0-mm pupil area. We trained nine types of deep neural network structures (VGG16, VGG19, ResNet50, InceptionV3, InceptionResNetV2, Xception, DenseNet121, DenseNet169, and DenseNet201) and built nine models. Using each model, we tested the validation data and evaluated the model.
Results:
This study included 496 images (31 eyes from 24 patients) in the RB group and 496 images (31 eyes from 29 patients) in the non-RB group. Because 16 picture images were obtained from the same point of each eye, a total of 992 images were obtained. The VGG19 model was found to have the highest area under the receiver operating characteristic curve (AUC) of all models. The AUC, sensitivity, and specificity of the VGG19 model were 0.964, 0.967, and 0.915, respectively, whereas those of the best ensemble model were 0.956, 0.913, and 0.921, respectively.
Conclusions:
This automated system that enables the physician to be aware of the requirement of RB might be clinically useful.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.