Predicting Mortality in the Surgical Intensive Care Unit Using Artificial Intelligence and Natural Language Processing of Physician Documentation

Abstract

The purpose of this study was to use natural language processing of physician documentation to predict mortality in patients admitted to the surgical intensive care unit (SICU). The Multiparameter Intelligent Monitoring in Intensive Care III database was used to obtain SICU stays with six different severity of illness scores. Natural language processing was performed on the physician notes. Classifiers for predicting mortality were created. One classifier used only the physician notes, one used only the severity of illness scores, and one used the physician notes with severity of injury scores. There were 3838 SICU stays identified during the study period and 5.4 per cent ended with mortality. The classifier trained with physician notes with severity of injury scores performed with the highest area under the curve (0.88 ± 0.05) and accuracy (94.6 ± 1.1%). The most important variable was the Oxford Acute Severity of Illness Score (16.0%). The most important terms were “dilated” (4.3%) and “hemorrhage” (3.7%). This study demonstrates the novel use of artificial intelligence to process physician documentation to predict mortality in the SICU. The classifiers were able to detect the subtle nuances in physician vernacular that predict mortality. These nuances provided improved performance in predicting mortality over physiologic parameters alone.

Future Medical Artificial Intelligence Application Requirements and Expectations of Physicians in German University Hospitals: Web-Based Survey

“…This can be partly explained by the fact that it is a "high-level" term, often not mentioning concrete ML algorithms or models in a clear context. Examples of AI in medicine are AI applications to support diagnostic procedures, predict the course of the disease [13][14][15][16][17], enhance the potential of clinical decision support [18], and support the management of hospital workflows [19,20]. Thereby, AI offers the possibility to support physicians in delivering high-quality medicine and increasing medical care efficiency.…”

AI in the Intensive Care Unit: Up-to-Date Review

“…Utilizing the vast amount of physiologic data produced in the NICU, AI can provide prompt warnings for neonates who are at greatest risk for complications. 34,35 AI applications in the NICU currently have two main components: predicting mortality risk and providing suggestions for duration of appropriate intervention. 36 ANNs generally are used in the NICU to predict infant mortality.…”

Artificial Intelligence in Neuroanesthesiology and Neurocritical Care

“…35 Predictive ML models for patient trajectories 36 and ICU readmission have been developed and have shown higher predictive values than the conventionally used stability and workload index for transfer score or the modified early warning score criteria for early deterioration. 37 Mortality is a common outcome in medical studies, and prediction capabilities related to it have been studied extensively using ML and NLP. Use of NLP enables inclusion of the traditionally difficult-to-use clinical notes.…”