Using a machine learning approach to predict mortality in critically ill influenza patients: a cross-sectional retrospective multicentre study in Taiwan

Abstract

ObjectivesCurrent mortality prediction models used in the intensive care unit (ICU) have a limited role for specific diseases such as influenza, and we aimed to establish an explainable machine learning (ML) model for predicting mortality in critically ill influenza patients using a real-world severe influenza data set.Study designA cross-sectional retrospective multicentre study in TaiwanSettingEight medical centres in Taiwan.ParticipantsA total of 336 patients requiring ICU-admission for virology-proven influenza at eight hospitals during an influenza epidemic between October 2015 and March 2016.Primary and secondary outcome measuresWe employed extreme gradient boosting (XGBoost) to establish the prediction model, compared the performance with logistic regression (LR) and random forest (RF), demonstrated the feature importance categorised by clinical domains, and used SHapley Additive exPlanations (SHAP) for visualised interpretation.ResultsThe data set contained 76 features of the 336 patients with severe influenza. The severity was apparently high, as shown by the high Acute Physiology and Chronic Health Evaluation II score (22, 17 to 29) and pneumonia severity index score (118, 88 to 151). XGBoost model (area under the curve (AUC): 0.842; 95% CI 0.749 to 0.928) outperformed RF (AUC: 0.809; 95% CI 0.629 to 0.891) and LR (AUC: 0.701; 95% CI 0.573 to 0.825) for predicting 30-day mortality. To give clinicians an intuitive understanding of feature exploitation, we stratified features by the clinical domain. The cumulative feature importance in the fluid balance domain, ventilation domain, laboratory data domain, demographic and symptom domain, management domain and severity score domain was 0.253, 0.113, 0.177, 0.140, 0.152 and 0.165, respectively. We further used SHAP plots to illustrate associations between features and 30-day mortality in critically ill influenza patients.ConclusionsWe used a real-world data set and applied an ML approach, mainly XGBoost, to establish a practical and explainable mortality prediction model in critically ill influenza patients.

Machine Learning Predicts Prolonged Acute Hypoxemic Respiratory Failure in Pediatric Severe Influenza

“…Our model had low bias with good generalizability and excellent discrimination (AUROC > 0.90). Although we found no direct comparison in the literature for sustained PARDS prediction, the AUROC for ARDS mortality in the literature ranges from 0.60 to 0.84 ( 8 – 13 , 17 , 43 ). Second, because many clinical variables are missing that limit the ability to diagnose PARDS, our study provides a clinically useful definition of AHRF that can be done using the available variables in clinical practice.…”

“…Predictive models have been designed to predict ARDS ( 8 ) or its mortality ( 9 – 13 ). Nearly all published ARDS predictive models used logistic regression (LR), which is fairly easy to understand, but must follows several assumptions and has limited abilities to exploit nonlinear data.…”

“…Nearly all published ARDS predictive models used logistic regression (LR), which is fairly easy to understand, but must follows several assumptions and has limited abilities to exploit nonlinear data. However, more recent machine learning models do not have those restrictions in finding the best pathway to a prespecified outcome and has been shown to be superior to simple LR for some clinical cohorts ( 13 , 14 ) and may help with treatment response interpretation ( 15 , 16 ).…”

An Artificial Intelligence Model for Predicting 1-Year Survival of Bone Metastases in Non-Small-Cell Lung Cancer Patients Based on XGBoost Algorithm

“…Tree-based classifiers, including RF and XGBoost, based on homogeneity, fit the characteristics of the data set for the present study. We speculated that the application of regularization, using Taylor expansion to estimate the loss function, and high flexibility to allow for fine-tuning might enable XGBoost to perform better than RF [34]. Taken together, our findings suggested that the XGBoost approach can reflect the feature importance and set up a mortality prediction model with extreme accuracy.…”

Spanish influenza score: poder predictivo sin renunciar a lo clásico

“…La comparación de los resultados obtenidos por técnicas convencionales con las obtenidas mediante un análisis avanzado con random forest (ML) da fortaleza a los hallazgos, y parece indicar que las nuevas técnicas serán capaces de añadir información a las técnicas de análisis clásico, pero gran parte de la información sustantiva puede lograrse con estas últimas 7 . Eso sí, para que las técnicas de RL tengan consistencia debemos tener registros de calidad y de tamaño muestral suficiente, lo que se ha garantizado en este estudio, a diferencia de otros recientes en los que un tamaño muestral insuficiente potencia la capacidad predictiva del ML sobre la RL 8 .…”