Construction and validation of an endoscopic ultrasonography-based ultrasomics nomogram for differentiating pancreatic neuroendocrine tumors from pancreatic cancer

Abstract

ObjectivesTo develop and validate various ultrasomics models based on endoscopic ultrasonography (EUS) for retrospective differentiating pancreatic neuroendocrine tumors (PNET) from pancreatic cancer.MethodsA total of 231 patients, comprising 127 with pancreatic cancer and 104 with PNET, were retrospectively enrolled. These patients were randomly divided into either a training or test cohort at a ratio of 7:3. Ultrasomics features were extracted from conventional EUS images, focusing on delineating the region of interest (ROI) for pancreatic lesions. Subsequently, dimensionality reduction of the ultrasomics features was performed by applying the Mann-Whitney test and least absolute shrinkage and selection operator (LASSO) algorithm. Eight machine learning algorithms, namely logistic regression (LR), light gradient boosting machine (LightGBM), multilayer perceptron (MLP), random forest (RF), extra trees, k nearest neighbors (KNN), support vector machine (SVM), and extreme gradient boosting (XGBoost), were employed to train prediction models using nonzero coefficient features. The optimal ultrasomics model was determined using a ROC curve and utilized for subsequent analysis. Clinical-ultrasonic features were assessed using both univariate and multivariate logistic regression. An ultrasomics nomogram model, integrating both ultrasomics and clinical-ultrasonic features, was developed.ResultsA total of 107 EUS-based ultrasomics features were extracted, and 6 features with nonzero coefficients were ultimately retained. Among the eight ultrasomics models based on machine learning algorithms, the RF model exhibited superior performance with an AUC= 0.999 (95% CI 0.9977 - 1.0000) in the training cohort and an AUC= 0.649 (95% CI 0.5215 - 0.7760) in the test cohort. A clinical-ultrasonic model was established and evaluated, yielding an AUC of 0.999 (95% CI 0.9961 - 1.0000) in the training cohort and 0.847 (95% CI 0.7543 - 0.9391) in the test cohort. Subsequently, the ultrasomics nomogram demonstrated a significant improvement in prediction accuracy in the test cohort, as evidenced by an AUC of 0.884 (95% CI 0.8047 - 0.9635) and confirmed by the Delong test. The calibration curve and decision curve analysis (DCA) depicted this ultrasomics nomogram demonstrated superior accuracy. They also yielded the highest net benefit for clinical decision-making compared to alternative models.ConclusionsA novel ultrasomics nomogram was proposed and validated, that integrated clinical-ultrasonic and ultrasomics features obtained through EUS, aiming to accurately and efficiently identify pancreatic cancer and PNET.