Using simulation modeling to inform intervention and implementation selection in a rapid stakeholder-engaged hybrid effectiveness-implementation randomized trial

Abstract

Background Implementation research generally assumes established evidence-based practices and prior piloting of implementation strategies, which may not be feasible during a public health emergency. We describe the use of a simulation model of the effectiveness of COVID-19 mitigation strategies to inform a stakeholder-engaged process of rapidly designing a tailored intervention and implementation strategy for individuals with serious mental illness (SMI) and intellectual/developmental disabilities (ID/DD) in group homes in a hybrid effectiveness-implementation randomized trial. Methods We used a validated dynamic microsimulation model of COVID-19 transmission and disease in late 2020/early 2021 to determine the most effective strategies to mitigate infections among Massachusetts group home staff and residents. Model inputs were informed by data from stakeholders, public records, and published literature. We assessed different prevention strategies, iterated over time with input from multidisciplinary stakeholders and pandemic evolution, including varying symptom screening, testing frequency, isolation, contact-time, use of personal protective equipment, and vaccination. Model outcomes included new infections in group home residents, new infections in group home staff, and resident hospital days. Sensitivity analyses were performed to account for parameter uncertainty. Results of the simulations informed a stakeholder-engaged process to select components of a tailored best practice intervention and implementation strategy. Results The largest projected decrease in infections was with initial vaccination, with minimal benefit for additional routine testing. The initial level of actual vaccination in the group homes was estimated to reduce resident infections by 72.4% and staff infections by 55.9% over the 90-day time horizon. Increasing resident and staff vaccination uptake to a target goal of 90% further decreased resident infections by 45.2% and staff infections by 51.3%. Subsequent simulated removal of masking led to a 6.5% increase in infections among residents and 3.2% among staff. The simulation model results were presented to multidisciplinary stakeholders and policymakers to inform the “Tailored Best Practice” package for the hybrid effectiveness-implementation trial. Conclusions Vaccination and decreasing vaccine hesitancy among staff were predicted to have the greatest impact in mitigating COVID-19 risk in vulnerable populations of group home residents and staff. Simulation modeling was effective in rapidly informing the selection of the prevention and implementation strategy in a hybrid effectiveness-implementation trial. Future implementation may benefit from this approach when rapid deployment is necessary in the absence of data on tailored interventions. Trial registration ClinicalTrials.gov NCT04726371