Development and validation of a deep learning-based approach to predict the Mayo endoscopic score of ulcerative colitis

Abstract

Background: The ulcerative colitis (UC) Mayo endoscopy score is a useful tool for evaluating the severity of UC in patients in clinical practice. Objectives: We aimed to develop and validate a deep learning-based approach to automatically predict the Mayo endoscopic score using UC endoscopic images. Design: A multicenter, diagnostic retrospective study. Methods: We collected 15120 colonoscopy images of 768 UC patients from two hospitals in China and developed a deep model based on a vision transformer named the UC-former. The performance of the UC-former was compared with that of six endoscopists on the internal test set. Furthermore, multicenter validation from three hospitals was also carried out to evaluate UC-former’s generalization performance. Results: On the internal test set, the areas under the curve of Mayo 0, Mayo 1, Mayo 2, and Mayo 3 achieved by the UC-former were 0.998, 0.984, 0.973, and 0.990, respectively. The accuracy (ACC) achieved by the UC-former was 90.8%, which is higher than that achieved by the best senior endoscopist. For three multicenter external validations, the ACC was 82.4%, 85.0%, and 83.6%, respectively. Conclusions: The developed UC-former could achieve high ACC, fidelity, and stability to evaluate the severity of UC, which may provide potential application in clinical practice. Registration: This clinical trial was registered at the ClinicalTrials.gov (trial registration number: NCT05336773)

Deep transfer learning from ordinary to capsule esophagogastroduodenoscopy for image quality controlling

“…Esophagogastroduodenoscopy is the most common examination in the department of gastroenterology, 1 and it can be used to diagnose many digestive tract disorders. 2,3 It produces large quantity of images during the whole examining process, especially for capsule endoscope, 4 automatic capturing mode may produce more pictures than ordinary endoscopy. Plenty of endoscopic images should be analyzed and corresponding reports need to be provided in the real clinical work of gastroenterologists.…”