Rules Extraction, Diagnoses and Prognosis of Diabetes and its Comorbidities using Deep Learning Analytics with Semantics on Big Data

Abstract

Millions of people die because of diabetes each year. Furthermore, most adults living with this condition are juggling with one or more other major health concerns. These related diseases also known as comorbidities, coexist with the primary disease, but also stand as their own specific disease. The challenge that healthcare professionals face is that Diabetes Mellitus (DM) is difficult to differentiate into its six forms. This hinders timely and accurate diagnosis and proper treatment. This paper presents our research in developing a novel Artificial Intelligence (AI) based approach to analyze data of real patients having different comorbidity diseases for interpretation and finding inferences for diagnosis and prognosis of DM and its comorbidities in patients in different scenarios. Details are provided about the data models used, relevant feature sets and their association rule mining, deep learning analytical models developed, and results validation against various accuracy measures. The performance of several big data analytics platforms was validated for the different models for three different sizes of endocrine datasets with varying parameters. The data models were mapped to HL7 FHIR v4 schema that is flexible in adapting to diagnostic models for all diseases. Out of several analytical models evaluated, Louvain Mani-Hierarchical Fold Learning (LMHFL) was found to be the most promising in terms of efficiency and accurate explainable diagnosis through reflective visualizations of associated features.

NER Sequence Embedding of Unified Medical Corpora to Incorporate Semantic Intelligence in Big Data Healthcare Diagnostics

“…We started off with some traditional ML algorithms like; multinomial logistic regression, decision tree, naïve Bayes, ada boost and light gradient boosting machine (Light GBM) as in [40]. Our previous explorations in [40] and [41] showed us some good results using deep learning heuristics. ML algorithms integrated with traditional NLP methods were also experimented with and results were obtained.…”