Early warning scores for detecting deterioration in adult hospital patients: systematic review and critical appraisal of methodology

Abstract

ObjectiveTo provide an overview and critical appraisal of early warning scores for adult hospital patients.DesignSystematic review.Data sourcesMedline, CINAHL, PsycInfo, and Embase until June 2019.Eligibility criteria for study selectionStudies describing the development or external validation of an early warning score for adult hospital inpatients.Results13 171 references were screened and 95 articles were included in the review. 11 studies were development only, 23 were development and external validation, and 61 were external validation only. Most early warning scores were developed for use in the United States (n=13/34, 38%) and the United Kingdom (n=10/34, 29%). Death was the most frequent prediction outcome for development studies (n=10/23, 44%) and validation studies (n=66/84, 79%), with different time horizons (the most frequent was 24 hours). The most common predictors were respiratory rate (n=30/34, 88%), heart rate (n=28/34, 83%), oxygen saturation, temperature, and systolic blood pressure (all n=24/34, 71%). Age (n=13/34, 38%) and sex (n=3/34, 9%) were less frequently included. Key details of the analysis populations were often not reported in development studies (n=12/29, 41%) or validation studies (n=33/84, 39%). Small sample sizes and insufficient numbers of event patients were common in model development and external validation studies. Missing data were often discarded, with just one study using multiple imputation. Only nine of the early warning scores that were developed were presented in sufficient detail to allow individualised risk prediction. Internal validation was carried out in 19 studies, but recommended approaches such as bootstrapping or cross validation were rarely used (n=4/19, 22%). Model performance was frequently assessed using discrimination (development n=18/22, 82%; validation n=69/84, 82%), while calibration was seldom assessed (validation n=13/84, 15%). All included studies were rated at high risk of bias.ConclusionsEarly warning scores are widely used prediction models that are often mandated in daily clinical practice to identify early clinical deterioration in hospital patients. However, many early warning scores in clinical use were found to have methodological weaknesses. Early warning scores might not perform as well as expected and therefore they could have a detrimental effect on patient care. Future work should focus on following recommended approaches for developing and evaluating early warning scores, and investigating the impact and safety of using these scores in clinical practice.Systematic review registrationPROSPERO CRD42017053324.

The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise

“…Evidence suggests that f R is an important marker of clinical deterioration for a variety of pathological conditions in both adults [4,[108][109][110] and children [111]. Indeed, f R is a fundamental variable included in the majority of prognostic scores developed for the prediction of different outcomes, including intensive care unit (ICU) admission and mortality [4,109,110]. As such, f R contributes to the computation of the most accurate prognostic scores developed so far, such as the National Early Warning Score (NEWS) and the Modified Early Warning Score (MEWS) [4].…”

“…However, despite the clinical relevance of f R , this vital sign is often under-recorded [29,37,120,121] or not measured accurately [38,59,60,[122][123][124]. This may impair the efficacy of early warning scores [118,120,121], which also suffer from other methodological issues [109,110]. Therefore, it is imperative to improve the accuracy and frequency of f R monitoring throughout the healthcare chain (pre-hospital, hospital, and post-hospital).…”

Prognostic Models for Knee Osteoarthritis: A Protocol for Systematic Review, Critical Appraisal and Meta-Analysis

“…We will develop a data extraction instrument for study data based on several previous systematic reviews of prediction model [51][52][53]. As the reviewers have different levels of experience and knowledge, the items listed will be reviewed and discussed to ensure that all reviewers had clear knowledge of the procedures.…”

Type of Track and Trigger system and incidence of in-hospital cardiac arrest: an observational registry-based study

“…Track and Trigger systems were expected to reduce the incidence of IHCA by identifying deterioration at an earlier stage when there is greater opportunity to intervene and provide timely and appropriate care, be that increased monitoring, clinical review or the revision of decisions around limits of treatment. It is perhaps not surprising that an inconsistent picture of the impact of TTS on IHCA has emerged from studies over the last two decades [6][7][8].…”