A Multimodal Deep Learning Approach to Predicting Systemic Diseases from Oral Conditions

Abstract

Background: It is known that oral diseases such as periodontal (gum) disease are closely linked to various systemic diseases and disorders. Deep learning advances have the potential to make major contributions to healthcare, particularly in the domains that rely on medical imaging. Incorporating non-imaging information based on clinical and laboratory data may allow clinicians to make more comprehensive and accurate decisions. Methods: Here, we developed a multimodal deep learning method to predict systemic diseases and disorders from oral health conditions. A dual-loss autoencoder was used in the first phase to extract periodontal disease-related features from 1188 panoramic radiographs. Then, in the second phase, we fused the image features with the demographic data and clinical information taken from electronic health records (EHR) to predict systemic diseases. We used receiver operation characteristics (ROC) and accuracy to evaluate our model. The model was further validated by an unseen test dataset. Findings: According to our findings, the top three most accurately predicted chapters, in order, are the Chapters III, VI and IX. The results indicated that the proposed model could predict systemic diseases belonging to Chapters III, VI and IX, with AUC values of 0.92 (95% CI, 0.90–94), 0.87 (95% CI, 0.84–89) and 0.78 (95% CI, 0.75–81), respectively. To assess the robustness of the models, we performed the evaluation on the unseen test dataset for these chapters and the results showed an accuracy of 0.88, 0.82 and 0.72 for Chapters III, VI and IX, respectively. Interpretation: The present study shows that the combination of panoramic radiograph and clinical oral features could be considered to train a fusion deep learning model for predicting systemic diseases and disorders.

Revolutionizing Dental Caries Diagnosis through Artificial Intelligence

“…A typical multimodal learning model can deftly merge dental images with patient medical histories and other pertinent data, paving the way for more precise diagnostic outcomes and better forecasts of disease progression. By harnessing this multifaceted data, practitioners can achieve an enriched understanding, thereby enhancing the overall effectiveness of the diagnostic process [32].…”

Improving Pancreatic Cyst Management: Artificial Intelligence-Powered Prediction of Advanced Neoplasms through Endoscopic Ultrasound-Guided Confocal Endomicroscopy

“…Integrative approaches have also been applied to determine prognosis of clear cell renal cell carcinoma and lung adenocarcinoma [65,66]. Additionally, it is well established in the literature that deep learning methods utilizing multiple modalities of input data sources (multimodal) outperform methods with a single source of input data (unimodal) [67][68][69]. Given the promising evidence regarding the success of previous integrative AI algorithms in addressing both clinical and non-clinical challenges, we anticipate that our next step, involving an integrative approach with an ML-powered model, will contribute to optimizing diagnostic accuracy and further enhancing the ability to predict HGD-Ca in branch-duct IPMNs.…”