An interpretable risk prediction model for healthcare with pattern attention

Abstract

Background The availability of massive amount of data enables the possibility of clinical predictive tasks. Deep learning methods have achieved promising performance on the tasks. However, most existing methods suffer from three limitations: (1) There are lots of missing value for real value events, many methods impute the missing value and then train their models based on the imputed values, which may introduce imputation bias. The models’ performance is highly dependent on the imputation accuracy. (2) Lots of existing studies just take Boolean value medical events (e.g. diagnosis code) as inputs, but ignore real value medical events (e.g., lab tests and vital signs), which are more important for acute disease (e.g., sepsis) and mortality prediction. (3) Existing interpretable models can illustrate which medical events are conducive to the output results, but are not able to give contributions of patterns among medical events. Methods In this study, we propose a novel interpretable Pattern Attention model with Value Embedding (PAVE) to predict the risks of certain diseases. PAVE takes the embedding of various medical events, their values and the corresponding occurring time as inputs, leverage self-attention mechanism to attend to meaningful patterns among medical events for risk prediction tasks. Because only the observed values are embedded into vectors, we don’t need to impute the missing values and thus avoids the imputations bias. Moreover, the self-attention mechanism is helpful for the model interpretability, which means the proposed model can output which patterns cause high risks. Results We conduct sepsis onset prediction and mortality prediction experiments on a publicly available dataset MIMIC-III and our proprietary EHR dataset. The experimental results show that PAVE outperforms existing models. Moreover, by analyzing the self-attention weights, our model outputs meaningful medical event patterns related to mortality. Conclusions PAVE learns effective medical event representation by incorporating the values and occurring time, which can improve the risk prediction performance. Moreover, the presented self-attention mechanism can not only capture patients’ health state information, but also output the contributions of various medical event patterns, which pave the way for interpretable clinical risk predictions. Availability The code for this paper is available at: https://github.com/yinchangchang/PAVE.

Research on Multimodal Fusion of Temporal Electronic Medical Records

“…These data encompass information about the patient's condition progression, crucial auxiliary test results, and clinical expert opinions, containing rich temporal information. Furthermore, the timeseries tabular data include multiple measurements of laboratory indicators and vital signs during the hospitalization, serving as the basis for clinical doctors to assess the patient's condition [9,10,41,42]. To fully leverage these valuable data, we devised an innovative multimodal fusion model capable of integrating data from different modalities.…”

“…In the medical domain, research employing multimodal data has exhibited notable diagnostic proficiency, thereby aiding the enhancement of healthcare practices and cost reduction [8,9]. Nevertheless, prior investigations concerning EMRs have often been confined to predictive modeling employing structured tabular data or unstructured clinical notes [10][11][12] alone.…”

Novel Representation Learning Improves Personalizing Blood Test Ranges and Disease Risk Prediction

“…Assessing individuals' future health risks remains a vital but challenging public health task 18 . Many current techniques for assessing future health complications rely on data from multiple time points in order to estimate health risks 5,21,22,23,24 . Despite the utility of such approaches, the need for many visits leads to the exclusion of subjects who do not return for several check-ups, especially those on lower incomes or without adequate access to healthcare 25,26,27 .…”

Sepsis Prediction by Using a Hybrid Metaheuristic Algorithm: A Novel Approach for Optimizing Deep Neural Networks

“…Antibiotic treatment for patients should be undertaken as soon as possible. Several studies in the literature use neural networks to predict sepsis [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 ]. In recent studies, sepsis and sepsis mortality have been predicted using a multilayer perceptron, neural networks with deep learning, Long Short-Term Memory (LSTM), and Recurrent Neural Networks (RNN).…”