The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review

Abstract

BackgroundDigital interventions have been effective in improving numerous health outcomes and health behaviors; furthermore, they are increasingly being used in different health care areas, including self-management of long-term conditions, mental health, and health promotion. The full potential of digital interventions is hindered by a lack of user engagement. There is an urgent need to develop effective strategies that can promote users’ engagement with digital interventions. One potential method is the use of technology-based reminders or prompts.ObjectiveTo evaluate the effectiveness of technology-based strategies for promoting engagement with digital interventions.MethodsCochrane Collaboration guidelines on systematic review methodology were followed. The search strategy was executed across 7 electronic databases: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Web of Science, the Education Resources Information Center (ERIC), PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). Databases were searched from inception to September 13, 2013, with no language or publication type restrictions, using three concepts: randomized controlled trials, digital interventions, and engagement. Gray literature and reference lists of included studies were also searched. Titles and abstracts were independently screened by 2 authors, then the full texts of potentially eligible papers were obtained and double-screened. Data from eligible papers were extracted by one author and checked for accuracy by another author. Bias was assessed using the Cochrane risk of bias assessment tool. Narrative synthesis was performed on all included studies and, where appropriate, data were pooled using meta-analysis. All findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.ResultsA total of 14 studies were included in the review with 8774 participants. Of the 14 studies, 9 had sufficient data to be included in the meta-analyses. The meta-analyses suggested that technology-based strategies can potentially promote engagement compared to no strategy for dichotomous outcomes (relative risk [RR] 1.27, 95% CI 1.01-1.60, I2=71%), but due to considerable heterogeneity and the small sample sizes in most studies, this result should be treated with caution. No studies reported adverse or economic outcomes. Only one study with a small sample size compared different characteristics; the study found that strategies promoting new digital intervention content and those sent to users shortly after they started using the digital intervention were more likely to engage users.ConclusionsOverall, studies reported borderline positive effects of technology-based strategies on engagement compared to no strategy. However, the results have to be interpreted with caution. More research is needed to replicate findings and understand which characteristics of the strategies are effective in promoting engagement and how cost-effective they are.

Design of a randomized controlled trial of Internet-based cognitive behavioral therapy for treatment-induced menopausal symptoms in breast cancer survivors

“…Under such conditions, compliance rates are similar to those found in face-to face therapy [60]. There is also evidence that compliance in self-management interventions can be further increased by the use of reminders [65–67]. …”

The Men’s Safer Sex project: intervention development and feasibility randomised controlled trial of an interactive digital intervention to increase condom use in men

“…84 We placed the intervention in clinic waiting rooms to take advantage of the waiting time that is common in drop-in sexual health clinics; however, this depended on flow of patients into the clinic. One-third of the intervention group did not see the Men's Safer Sex intervention website, which may have been a result of lack of available time.…”

Improving Adherence to Smoking Cessation Treatment: Smoking Outcomes in a Web-based Randomized Trial

“…Our study builds on work by Strecher (23), McClure (20, 24), and others (25, 26) that has focused on the role of engagement in promoting abstinence. The first strategy in this trial was a theory-driven social network (SN) approach to increase the proportion of individuals that participate in an existing online social network for cessation.…”