Background The COVID-19 pandemic has driven demand for forecasts to guide policy and planning. Previous research has suggested that combining forecasts from multiple models into a single "ensemble" forecast can increase the robustness of forecasts. Here we evaluate the real-time application of an open, collaborative ensemble to forecast deaths attributable to COVID-19 in the U.S. Methods Beginning on April 13, 2020, we collected and combined one- to four-week ahead forecasts of cumulative deaths for U.S. jurisdictions in standardized, probabilistic formats to generate real-time, publicly available ensemble forecasts. We evaluated the point prediction accuracy and calibration of these forecasts compared to reported deaths. Results Analysis of 2,512 ensemble forecasts made April 27 to July 20 with outcomes observed in the weeks ending May 23 through July 25, 2020 revealed precise short-term forecasts, with accuracy deteriorating at longer prediction horizons of up to four weeks. At all prediction horizons, the prediction intervals were well calibrated with 92-96% of observations falling within the rounded 95% prediction intervals. Conclusions This analysis demonstrates that real-time, publicly available ensemble forecasts issued in April-July 2020 provided robust short-term predictions of reported COVID-19 deaths in the United States. With the ongoing need for forecasts of impacts and resource needs for the COVID-19 response, the results underscore the importance of combining multiple probabilistic models and assessing forecast skill at different prediction horizons. Careful development, assessment, and communication of ensemble forecasts can provide reliable insight to public health decision makers.

BackgroundLarge Phase III trials across Asia and Latin America have recently demonstrated the efficacy of a recombinant, live-attenuated dengue vaccine (Dengvaxia) over the first 25 mo following vaccination. Subsequent data collected in the longer-term follow-up phase, however, have raised concerns about a potential increase in hospitalization risk of subsequent dengue infections, in particular among young, dengue-naïve vaccinees. We here report predictions from eight independent modelling groups on the long-term safety, public health impact, and cost-effectiveness of routine vaccination with Dengvaxia in a range of transmission settings, as characterised by seroprevalence levels among 9-y-olds (SP9). These predictions were conducted for the World Health Organization to inform their recommendations on optimal use of this vaccine.Methods and FindingsThe models adopted, with small variations, a parsimonious vaccine mode of action that was able to reproduce quantitative features of the observed trial data. The adopted mode of action assumed that vaccination, similarly to natural infection, induces transient, heterologous protection and, further, establishes a long-lasting immunogenic memory, which determines disease severity of subsequent infections. The default vaccination policy considered was routine vaccination of 9-y-old children in a three-dose schedule at 80% coverage. The outcomes examined were the impact of vaccination on infections, symptomatic dengue, hospitalised dengue, deaths, and cost-effectiveness over a 30-y postvaccination period. Case definitions were chosen in accordance with the Phase III trials.All models predicted that in settings with moderate to high dengue endemicity (SP9 ≥ 50%), the default vaccination policy would reduce the burden of dengue disease for the population by 6%–25% (all simulations: –3%–34%) and in high-transmission settings (SP9 ≥ 70%) by 13%–25% (all simulations: 10%– 34%). These endemicity levels are representative of the participating sites in both Phase III trials. In contrast, in settings with low transmission intensity (SP9 ≤ 30%), the models predicted that vaccination could lead to a substantial increase in hospitalisation because of dengue. Modelling reduced vaccine coverage or the addition of catch-up campaigns showed that the impact of vaccination scaled approximately linearly with the number of people vaccinated. In assessing the optimal age of vaccination, we found that targeting older children could increase the net benefit of vaccination in settings with moderate transmission intensity (SP9 = 50%). Overall, vaccination was predicted to be potentially cost-effective in most endemic settings if priced competitively.The results are based on the assumption that the vaccine acts similarly to natural infection. This assumption is consistent with the available trial results but cannot be directly validated in the absence of additional data. Furthermore, uncertainties remain regarding the level of protection provided against disease versus infection and the rate at whi...

Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes.

After the Zika virus (ZIKV) epidemic in the Americas in 2016, both Zika and dengue incidence declined to record lows in many countries in 2017–2018, but in 2019 dengue resurged in Brazil, causing ~2.1 million cases. In this study we use epidemiological, climatological and genomic data to investigate dengue dynamics in recent years in Brazil. First, we estimate dengue virus force of infection (FOI) and model mosquito-borne transmission suitability since the early 2000s. Our estimates reveal that DENV transmission was low in 2017–2018, despite conditions being suitable for viral spread. Our study also shows a marked decline in dengue susceptibility between 2002 and 2019, which could explain the synchronous decline of dengue in the country, partially as a result of protective immunity from prior ZIKV and/or DENV infections. Furthermore, we performed phylogeographic analyses using 69 newly sequenced genomes of dengue virus serotype 1 and 2 from Brazil, and found that the outbreaks in 2018–2019 were caused by local DENV lineages that persisted for 5–10 years, circulating cryptically before and after the Zika epidemic. We hypothesize that DENV lineages may circulate at low transmission levels for many years, until local conditions are suitable for higher transmission, when they cause major outbreaks.

Prophylactic vaccination is a powerful tool for reducing the burden of infectious diseases, due to a combination of direct protection of vaccinees and indirect protection of others via herd immunity. Computational models play an important role in devising strategies for vaccination by making projections of its impacts on public health. Such projections are subject to uncertainty about numerous factors, however. For example, many vaccine efficacy trials focus on measuring protection against disease rather than protection against infection, leaving the extent of breakthrough infections (i.e., disease ameliorated but infection unimpeded) among vaccinees unknown. Our goal in this study was to quantify the extent to which uncertainty about breakthrough infections results in uncertainty about vaccination impact, with a focus on vaccines for dengue. To realistically account for the many forms of heterogeneity in dengue virus (DENV) transmission, which could have implications for the dynamics of indirect protection, we used a stochastic, agent-based model for DENV transmission informed by more than a decade of empirical studies in the city of Iquitos, Peru. Following 20 years of routine vaccination of nine-year-old children at 80% coverage, projections of the proportion of disease episodes averted varied by a factor of 1.76 (95% CI: 1.54–2.06) across the range of uncertainty about breakthrough infections. This was equivalent to the range of vaccination impact projected across a range of uncertainty about vaccine efficacy of 0.268 (95% CI: 0.210–0.329). Until uncertainty about breakthrough infections can be addressed empirically, our results demonstrate the importance of accounting for it in models of vaccination impact.