Artificial intelligence-based diagnosis of standard endoscopic ultrasonography scanning sites in the biliopancreatic system: a multicenter retrospective study

Abstract

Background: There are challenges for beginners to identify standard biliopancreatic system (BPS) anatomical sites on endoscopic ultrasonography (EUS) images. Therefore, we aimed to develop a convolutional neural network (CNN)-based model to identify standard BPS anatomical sites on EUS images. Methods: The standard anatomical structures of the gastric and duodenal regions observed by EUS was divided into 14 sites. We used 6230 EUS images with standard anatomical sites selected from 1812 patients to train the CNN model, and then tested its diagnostic performance both in internal and external validations. Internal validation set tests were performed on 1569 EUS images of 47 patients from 2 centers. Externally validated datasets were retrospectively collected from 16 centers, and finally 131 patients with 85,322 EUS images were included. In the external validation, all EUS images were read by CNN model, beginners, and experts, respectively. The final decision made by the experts was considered as the gold standard, and the diagnostic performance between CNN model and beginners were compared. Results: In the internal test cohort, the accuracy of CNN model was 92.1%-100.0% for 14 standard anatomical sites. In the external test cohort, the sensitivity and specificity of CNN model were 89.45%-99.92% and 93.35%-99.79%, respectively. Compared with beginners, CNN model had higher sensitivity and specificity for 11 sites, and was in good agreement with the experts (Kappa values 0.84-0.97). Conclusions: We developed a CNN-based model to automatically identify standard anatomical sites on EUS images with excellent diagnostic performance, which may serve as a potentially powerful auxiliary tool in future clinical practice.