ObjectiveReports of efficacy, effectiveness and harms of COVID-19 vaccines have not used key indicators from evidence-based medicine (EBM) that can inform policies about vaccine distribution. This study aims to clarify EBM indicators that consider baseline risks when assessing vaccines’ benefits versus harms: absolute risk reduction (ARR) and number needed to be vaccinated (NNV), versus absolute risk of the intervention (ARI) and number needed to harm (NNH).MethodsWe used a multimethod approach, including a scoping review of the literature; calculation of risk reductions and harms from data concerning five major vaccines; analysis of risk reductions in population subgroups with varying baseline risks; and comparisons with prior vaccines.FindingsThe scoping review showed few reports regarding ARR, NNV, ARI and NNH; comparisons of benefits versus harms using these EBM methods; or analyses of varying baseline risks. Calculated ARRs for symptomatic infection and hospitalisation were approximately 1% and 0.1%, respectively, as compared with relative risk reduction of 50%–95% and 58%–100%. NNV to prevent one symptomatic infection and one hospitalisation was in the range of 80–500 and 500–4000. Based on available data, ARI and NNH as measures of harm were difficult to calculate, and the balance between benefits and harms using EBM measures remained uncertain. The effectiveness of COVID-19 vaccines as measured by ARR and NNV was substantially higher in population subgroups with high versus low baseline risks.ConclusionsPriorities for vaccine distribution should target subpopulations with higher baseline risks. Similar analyses using ARR/NNV and ARI/NNH would strengthen evaluations of vaccines’ benefits versus harms. An EBM perspective on vaccine distribution that emphasises baseline risks becomes especially important as the world’s population continues to face major barriers to vaccine access—sometimes termed ‘vaccine apartheid’.
OBJECTIVETo clarify efficacy, effectiveness, and harm of available vaccines for COVID-19, using measures in evidence-based medicine (EBM) that, in addition to relative risk reduction, consider absolute risk reduction and variations in baseline risks.DESIGNSystematic review of studies that have considered impacts of vaccines in relation to baseline risks. Calculation of risk reduction and harms from published data in two random controlled trials and one population-based implementation study. Analysis of risk reductions in geographical areas with varying baseline risks. Comparison of results concerning COVID-19 vaccine and selected prior vaccines.SETTINGRandom controlled trials of Pfizer and Moderna vaccines in multiple countries; population-based study using Pfizer vaccine in Israel. Counties with varying baseline risks in the United States; states with varying baseline risks in India.PARTICIPANTS43,448 and 30,420 subjects in the random controlled trials; 1,198,236 subjects in the population-based study.INTERVENTIONSMulti-site random controlled trials of vaccine efficacy; population-based administration of vaccine with determination of effectiveness by comparison of vaccinated and unvaccinated subjects.MAIN OUTCOME MEASURESRelative risk reduction (RRR), absolute risk reduction (ARR), number needed to be vaccinated to prevent one symptomatic infection (NNV), absolute risk of the intervention (ARI), and number needed to harm (NNH).RESULTSA systematic review of literature in medicine and public health showed very few reports regarding ARR, NNV, ARI, and NNH; use of these indicators to compare benefits versus harms; or analysis of these EBM indicators in the context of varying baseline risks. From data in the two random controlled trials and one population-based study, calculated ARR was approximately 1 percent (as compared to RRR of 50 to 95 percent), and NNV was in the range of 100 to 500. In comparisons of ARR and NNV versus ARI and NNH, benefits and harms were not markedly different. From a sensitivity analysis of ARR and NNV in population groups with varying baseline risks, the effectiveness of vaccines as measured by ARR and NNV was substantially higher in regions with high as compared to low baseline risks. The ARR for COVID-19 vaccines was somewhat smaller and the NNV somewhat larger than achieved by some vaccines to prevent influenza and smallpox.CONCLUSIONThe efficacy and effectiveness of major COVID-19 vaccines, as measured by RRR, are impressive. As measured by ARR and NNV, which take into account variation in baseline risks, the effectiveness of the vaccines is substantially higher in areas with higher baseline risks. This finding can contribute to educational efforts, informed consent procedures, and policy making about priorities for vaccine distribution, especially under conditions of access barriers linked to poverty and inequality.WHAT IS ALREADY KNOWN ON THIS TOPICMajor COVID-19 vaccines so far have shown impressive efficacy in random controlled trials and effectiveness in population-based studies. To determine efficacy and effectiveness, these studies have used relative risk reduction (RRR), which shows the difference in event rate between those receiving and not receiving a vaccine. Reports of efficacy and effectiveness have not yet clarified other key indicators from evidence-based medicine (EBM) that consider variations baseline risks. Such indicators include measures of benefits such as absolute risk reduction (ARR) and number needed to be vaccinated (NNV), as well as measures of harm such as absolute risk of the intervention (ARI) and number needed to harm (NNH).WHAT THIS STUDY ADDSFor COVID-19 vaccines, calculated ARR is somewhat lower and NNV somewhat higher than for certain prior vaccines such as those for influenza and smallpox. Indicators of harm for COVID-19 vaccines, as measured by ARI and NNH, appear to be in the same order of magnitude as indicators of benefit such as ARR and NNV. The effectiveness of COVID-19 vaccines, as measured by ARR and NNV, is substantially higher in geographical areas with high baseline risk, compared to areas with low baseline risk.These findings can assist in informed consent procedures, educational efforts, and priority setting in policies about distribution of vaccines, especially in the context of access barriers related to poverty and inequality.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.