Thorough validation is pivotal for any prediction model before it can be advocated for use in medical practice. For time-to-event outcomes such as breast cancer recurrence, death from other causes is a competing risk. Model performance measures must account for such competing events. In this article, we present a comprehensive yet accessible overview of performance measures for this competing event setting, including the calculation and interpretation of statistical measures for calibration, discrimination, overall prediction error, and clinical usefulness by decision curve analysis. All methods are illustrated for patients with breast cancer, with publicly available data and R code.
Background Healthcare workers (HCWs), particularly those from ethnic minority groups, have been shown to be at disproportionately higher risk of infection with Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) compared to the general population. However, there is insufficient evidence on how demographic and occupational factors influence infection risk among ethnic minority HCWs. Methods and findings We conducted a cross-sectional analysis using data from the baseline questionnaire of the United Kingdom Research study into Ethnicity and Coronavirus Disease 2019 (COVID-19) Outcomes in Healthcare workers (UK-REACH) cohort study, administered between December 2020 and March 2021. We used logistic regression to examine associations of demographic, household, and occupational risk factors with SARS-CoV-2 infection (defined by polymerase chain reaction (PCR), serology, or suspected COVID-19) in a diverse group of HCWs. The primary exposure of interest was self-reported ethnicity. Among 10,772 HCWs who worked during the first UK national lockdown in March 2020, the median age was 45 (interquartile range [IQR] 35 to 54), 75.1% were female and 29.6% were from ethnic minority groups. A total of 2,496 (23.2%) reported previous SARS-CoV-2 infection. The fully adjusted model contained the following dependent variables: demographic factors (age, sex, ethnicity, migration status, deprivation, religiosity), household factors (living with key workers, shared spaces in accommodation, number of people in household), health factors (presence/absence of diabetes or immunosuppression, smoking history, shielding status, SARS-CoV-2 vaccination status), the extent of social mixing outside of the household, and occupational factors (job role, the area in which a participant worked, use of public transport to work, exposure to confirmed suspected COVID-19 patients, personal protective equipment [PPE] access, aerosol generating procedure exposure, night shift pattern, and the UK region of workplace). After adjustment, demographic and household factors associated with increased odds of infection included younger age, living with other key workers, and higher religiosity. Important occupational risk factors associated with increased odds of infection included attending to a higher number of COVID-19 positive patients (aOR 2.59, 95% CI 2.11 to 3.18 for ≥21 patients per week versus none), working in a nursing or midwifery role (1.30, 1.11 to 1.53, compared to doctors), reporting a lack of access to PPE (1.29, 1.17 to 1.43), and working in an ambulance (2.00, 1.56 to 2.58) or hospital inpatient setting (1.55, 1.38 to 1.75). Those who worked in intensive care units were less likely to have been infected (0.76, 0.64 to 0.92) than those who did not. Black HCWs were more likely to have been infected than their White colleagues, an effect which attenuated after adjustment for other known risk factors. This study is limited by self-selection bias and the cross sectional nature of the study means we cannot infer the direction of causality. Conclusions We identified key sociodemographic and occupational risk factors associated with SARS-CoV-2 infection among UK HCWs, and have determined factors that might contribute to a disproportionate odds of infection in HCWs from Black ethnic groups. These findings demonstrate the importance of social and occupational factors in driving ethnic disparities in COVID-19 outcomes, and should inform policies, including targeted vaccination strategies and risk assessments aimed at protecting HCWs in future waves of the COVID-19 pandemic. Trial registration The study was prospectively registered at ISRCTN (reference number: ISRCTN11811602).
In the general HF population, T2D stratified by glycemic control and drug treatments showed differential risk associations. Routine measures of dynamic diabetes status provide important prognostic indication of poor outcomes in HF.
Background External validation of prognostic models is necessary to assess the accuracy and generalizability of the model to new patients. If models are validated in a setting in which competing events occur, these competing risks should be accounted for when comparing predicted risks to observed outcomes. Methods We discuss existing measures of calibration and discrimination that incorporate competing events for time-to-event models. These methods are illustrated using a clinical-data example concerning the prediction of kidney failure in a population with advanced chronic kidney disease (CKD), using the guideline-recommended Kidney Failure Risk Equation (KFRE). The KFRE was developed using Cox regression in a diverse population of CKD patients and has been proposed for use in patients with advanced CKD in whom death is a frequent competing event. Results When validating the 5-year KFRE with methods that account for competing events, it becomes apparent that the 5-year KFRE considerably overestimates the real-world risk of kidney failure. The absolute overestimation was 10%age points on average and 29%age points in older high-risk patients. Conclusions It is crucial that competing events are accounted for during external validation to provide a more reliable assessment the performance of a model in clinical settings in which competing risks occur.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.