Machine Learning Predicts Patients With New-onset Diabetes at Risk of Pancreatic Cancer

Abstract

Background: New-onset diabetes represent a high-risk cohort to screen for pancreatic cancer. Goals: Develop a machine model to predict pancreatic cancer among patients with new-onset diabetes. Study: A retrospective cohort of patients with new-onset diabetes was assembled from multiple health care networks in the United States. An XGBoost machine learning model was designed from a portion of this cohort (the training set) and tested on the remaining part of the cohort (the test set). Shapley values were used to explain the XGBoost’s model features. Model performance was compared with 2 contemporary models designed to predict pancreatic cancer among patients with new-onset diabetes. Results: In the test set, the XGBoost model had an area under the curve of 0.80 (0.76 to 0.85) compared with 0.63 and 0.68 for other models. Using cutoffs based on the Youden index, the sensitivity of the XGBoost model was 75%, the specificity was 70%, the accuracy was 70%, the positive predictive value was 1.2%, and the negative predictive value was >99%. The XGBoost model obtained a positive predictive value of at least 2.5% with a sensitivity of 38%. The XGBoost model was the only model that detected at least 50% of patients with cancer one year after the onset of diabetes. All 3 models had similar features that predicted pancreatic cancer, including older age, weight loss, and the rapid destabilization of glucose homeostasis. Conclusion: Machine learning models isolate a high-risk cohort from those with new-onset diabetes at risk for pancreatic cancer.