Predicting Risk of Hospital Admission in Patients With Suspected COVID-19 in a Community Setting: Protocol for Development and Validation of a Multivariate Risk Prediction Tool

Espinosa-González, Ana Belén; Neves, Ana Luísa; Fiorentino, Francesca; Prociuk, Denys; Ramtale, Sonny Christian; Mi, Emma; Mi, Ella; Macartney, Jack; Anand, Sneha; Sherlock, Julian; Saravanakumar, Kavitha; Mayer, Erik; Lusignan, Simon de; Greenhalgh, Trisha; Delaney, Brendan

doi:10.2196/29072

Cited by 10 publications

(12 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…RECAP is a prospective cohort observational study. Data are remotely collected through a questionnaire form outlined in the original study protocol [ 5 ] for study-specific data, with additional demographic data being collected through routine electronic health record systems run by participating clinical practices.…”

Section: Methodsmentioning

confidence: 99%

“…Assuming that 10% of patients diagnosed with COVID-19 will be admitted to hospital [ 6 ], a 0.05 acceptable difference in apparent and adjusted Cox-Snell R-squared, 0.05 margin of error in estimation of the intercept, a binary outcome based on admission to hospital, and a maximum of 24 predictor parameters [ 5 ], we estimate that the minimum sample size required for new model development is 1317 participants enrolled for the development set [ 7 ].…”

Section: Methodsmentioning

confidence: 99%

“…The RECAP (Remote COVID-19 Assessment in Primary Care) trial (NCT04435041) was designed to develop an early warning tool for patients diagnosed with COVID-19 in primary care settings. The original study protocol [ 5 ] outlines the study rationale and data collection process. This paper describes the process for quantitative development and validation of the RECAP-V1 model.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

An Early Warning Risk Prediction Tool (RECAP-V1) for Patients Diagnosed With COVID-19: Protocol for a Statistical Analysis Plan

Fiorentino¹,

Prociuk²,

Espinosa-González³

et al. 2021

JMIR Res Protoc

Self Cite

View full text Add to dashboard Cite

Background Since the start of the COVID-19 pandemic, efforts have been made to develop early warning risk scores to help clinicians decide which patient is likely to deteriorate and require hospitalization. The RECAP (Remote COVID-19 Assessment in Primary Care) study investigates the predictive risk of hospitalization, deterioration, and death of patients with confirmed COVID-19, based on a set of parameters chosen through a Delphi process performed by clinicians. We aim to use rich data collected remotely through the use of electronic data templates integrated in the electronic health systems of several general practices across the United Kingdom to construct accurate predictive models. The models will be based on preexisting conditions and monitoring data of a patient’s clinical parameters (eg, blood oxygen saturation) to make reliable predictions as to the patient’s risk of hospital admission, deterioration, and death. Objective This statistical analysis plan outlines the statistical methods to build the prediction model to be used in the prioritization of patients in the primary care setting. The statistical analysis plan for the RECAP study includes the development and validation of the RECAP-V1 prediction model as a primary outcome. This prediction model will be adapted as a three-category risk score split into red (high risk), amber (medium risk), and green (low risk) for any patient with suspected COVID-19. The model will predict the risk of deterioration and hospitalization. Methods After the data have been collected, we will assess the degree of missingness and use a combination of traditional data imputation using multiple imputation by chained equations, as well as more novel machine-learning approaches to impute the missing data for the final analysis. For predictive model development, we will use multiple logistic regression analyses to construct the model. We aim to recruit a minimum of 1317 patients for model development and validation. We will then externally validate the model on an independent dataset of 1400 patients. The model will also be applied for multiple different datasets to assess both its performance in different patient groups and its applicability for different methods of data collection. Results As of May 10, 2021, we have recruited 3732 patients. A further 2088 patients have been recruited through the National Health Service Clinical Assessment Service, and approximately 5000 patients have been recruited through the DoctalyHealth platform. Conclusions The methodology for the development of the RECAP-V1 prediction model as well as the risk score will provide clinicians with a statistically robust tool to help prioritize COVID-19 patients. Trial Registration ClinicalTrials.gov NCT04435041; https://clinicaltrials.gov/ct2/show/NCT04435041 International Registered Report Identifier (IRRID) DERR1-10.2196/30083

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An Early Warning Risk Prediction Tool (RECAP-V1) for Patients Diagnosed With COVID-19: Protocol for a Statistical Analysis Plan

Fiorentino¹,

Prociuk²,

Espinosa-González³

et al. 2021

JMIR Res Protoc

Self Cite

View full text Add to dashboard Cite

show abstract

“…The previously published study protocol and statistical analysis plan are summarised below. [11, 12]…”

Section: Methodsmentioning

confidence: 99%

Remote Covid Assessment in Primary Care (RECAP) risk prediction tool: derivation and real-world validation studies

Espinosa-González

Prociuk

Fiorentino

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

Background Accurate assessment of COVID-19 severity in the community is essential for best patient care and efficient use of services and requires a risk prediction score that is COVID-19 specific and adequately validated in a community setting. Following a qualitative phase to identify signs, symptoms and risk factors, we sought to develop and validate two COVID-19-specific risk prediction scores RECAP-GP (without peripheral oxygen saturation (SpO2)) and RECAP-O2 (with SpO2). Methods Prospective cohort study using multivariable logistic regression for model development. Data on signs and symptoms (model predictors) were collected on community-based patients with suspected COVID-19 via primary care electronic health records systems and linked with secondary data on hospital admission (primary outcome) within 28 days of symptom onset. Data sources: RECAP-GP: Oxford-Royal College of General Practitioners Research and Surveillance Centre (RSC) primary care practices (development), Northwest London (NWL) primary care practices, NHS COVID-19 Clinical Assessment Service (CCAS) (validation). RECAP-O2: Doctaly Assist platform (development, and validation in subsequent sample). Estimated sample size was 2,880 per model. Findings Data were available from 8,311 individuals. Observations, such SpO2, were mostly missing in NWL, RSC, and CCAS data; however, SpO2 was available for around 70% of Doctaly patients. In the final predictive models, RECAP-GP included sex, age, degree of breathlessness, temperature symptoms, and presence of hypertension (Area Under the Curve (AUC): 0.802, Validation Negative Predictive Value (NPV) of low risk 98.8%. RECAP-O2 included age, degree of breathlessness, fatigue, and SpO2 at rest (AUC: 0.843), Validation NPV of low risk 99.4%. Interpretation Both RECAP models are a valid tool in the assessment of COVID-19 patients in the community. RECAP-GP can be used initially, without need for observations, to identify patients who require monitoring. If the patient is monitored at home and SpO2 is available, RECAP-O2 is useful to assess the need for further treatment escalation.

show abstract

“…This study was part of the RECAP (Predicting Risk of Hospital Admission in Patients with Suspected COVID-19 in a Community Setting) study sponsored by the Imperial College London [26]. Although primarily a study to develop a risk prediction tool, it also included the creation of an LC phenotype.…”

Section: Ethical Considerationsmentioning

confidence: 99%

Developing a Long COVID Phenotype for Postacute COVID-19 in a National Primary Care Sentinel Cohort: Observational Retrospective Database Analysis

Mayer¹,

Meza-Torres²,

Okusi³

et al. 2022

JMIR Public Health Surveill

Self Cite

View full text Add to dashboard Cite

Background Following COVID-19, up to 40% of people have ongoing health problems, referred to as postacute COVID-19 or long COVID (LC). LC varies from a single persisting symptom to a complex multisystem disease. Research has flagged that this condition is underrecorded in primary care records, and seeks to better define its clinical characteristics and management. Phenotypes provide a standard method for case definition and identification from routine data and are usually machine-processable. An LC phenotype can underpin research into this condition. Objective This study aims to develop a phenotype for LC to inform the epidemiology and future research into this condition. We compared clinical symptoms in people with LC before and after their index infection, recorded from March 1, 2020, to April 1, 2021. We also compared people recorded as having acute infection with those with LC who were hospitalized and those who were not. Methods We used data from the Primary Care Sentinel Cohort (PCSC) of the Oxford Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC) database. This network was recruited to be nationally representative of the English population. We developed an LC phenotype using our established 3-step ontological method: (1) ontological step (defining the reasoning process underpinning the phenotype, (2) coding step (exploring what clinical terms are available, and (3) logical extract model (testing performance). We created a version of this phenotype using Protégé in the ontology web language for BioPortal and using PhenoFlow. Next, we used the phenotype to compare people with LC (1) with regard to their symptoms in the year prior to acquiring COVID-19 and (2) with people with acute COVID-19. We also compared hospitalized people with LC with those not hospitalized. We compared sociodemographic details, comorbidities, and Office of National Statistics–defined LC symptoms between groups. We used descriptive statistics and logistic regression. Results The long-COVID phenotype differentiated people hospitalized with LC from people who were not and where no index infection was identified. The PCSC (N=7.4 million) includes 428,479 patients with acute COVID-19 diagnosis confirmed by a laboratory test and 10,772 patients with clinically diagnosed COVID-19. A total of 7471 (1.74%, 95% CI 1.70-1.78) people were coded as having LC, 1009 (13.5%, 95% CI 12.7-14.3) had a hospital admission related to acute COVID-19, and 6462 (86.5%, 95% CI 85.7-87.3) were not hospitalized, of whom 2728 (42.2%) had no COVID-19 index date recorded. In addition, 1009 (13.5%, 95% CI 12.73-14.28) people with LC were hospitalized compared to 17,993 (4.5%, 95% CI 4.48-4.61; P<.001) with uncomplicated COVID-19. Conclusions Our LC phenotype enables the identification of individuals with the condition in routine data sets, facilitating their comparison with unaffected people through retrospective research. This phenotype and study protocol to explore its face validity contributes to a better understanding of LC.

show abstract

Predicting Risk of Hospital Admission in Patients With Suspected COVID-19 in a Community Setting: Protocol for Development and Validation of a Multivariate Risk Prediction Tool

Cited by 10 publications

References 19 publications

An Early Warning Risk Prediction Tool (RECAP-V1) for Patients Diagnosed With COVID-19: Protocol for a Statistical Analysis Plan

An Early Warning Risk Prediction Tool (RECAP-V1) for Patients Diagnosed With COVID-19: Protocol for a Statistical Analysis Plan

Remote Covid Assessment in Primary Care (RECAP) risk prediction tool: derivation and real-world validation studies

Developing a Long COVID Phenotype for Postacute COVID-19 in a National Primary Care Sentinel Cohort: Observational Retrospective Database Analysis

Contact Info

Product

Resources

About