Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial

Abstract

Background Drink Less is a behavior change app that aims to help users in the general adult population reduce hazardous and harmful alcohol consumption. The app includes a daily push notification, delivered at 11 am, asking users to “Please complete your mood and drinking diaries.” Previous analysis of Drink Less engagement data suggests the current notification strongly influences how users engage with the app in the subsequent hour. To exploit a potential increase of vulnerability of excess drinking and opportunity to engage with the app in the evenings, we changed the delivery time from 11 am to 8 pm. We now aim to further optimise the content and sequence of notifications, testing 30 new evidence-informed notifications targeting the user’s perceived usefulness of the app. Objective The primary objective is to assess whether sending a notification at 8 pm increases behavioral engagement (opening the app) in the subsequent hour. Secondary objectives include comparing the effect of the new bank of messages with the standard message and effect moderation over time. We also aim to more generally understand the role notifications have on the overall duration, depth, and frequency of engagement with Drink Less over the first 30 days after download. Methods This is a protocol for a micro-randomized trial with two additional parallel arms. Inclusion criteria are Drink Less users who (1) consent to participate in the trial; (2) self-report a baseline Alcohol Use Disorders Identification Test score of 8 or above; (3) reside in the United Kingdom; (4) age ≥18 years and; (5) report interest in drinking less alcohol. In the micro-randomized trial, participants will be randomized daily at 8 pm to receive no notification, a notification with text from the new message bank, or the standard message. The primary outcome is the time-varying, binary outcome of “Did the user open the app in the hour from 8 pm to 9 pm?”. The primary analysis will estimate the marginal relative risk for the notifications using an estimator developed for micro-randomized trials with binary outcomes. Participants randomized to the parallel arms will receive no notifications (Secondary Arm A), or the standard notification delivered daily at 11 am (Secondary Arm B) over 30 days, allowing the comparison of overall engagement between different notification delivery strategies. Results Approval was granted by the University College of London’s Departmental Research Ethics Committee (CEHP/2016/556) on October 11, 2019, and The London School of Hygiene and Tropical Medicine Interventions Research Ethics Committee (17929) on November 27, 2019. Recruitment began on January 2, 2020, and is ongoing. Conclusions Understanding how push notifications may impact engagement with a behavior change app can lead to further improvements in engagement, and ultimately help users reduce their alcohol consumption. This understanding may also be generalizable to other apps that target a variety of behavior changes. International Registered Report Identifier (IRRID) DERR1-10.2196/18690

Engagement With a Behavior Change App for Alcohol Reduction: Data Visualization for Longitudinal Observational Study

“…It is now our priority to understand the causal effect of the notification on engagement and to consider further optimizing the push notification policy to contextual circumstances of individuals over time to inform the development of a just-in-time adaptive intervention. The MRT aims to inform the development of decision rules to tailor the notification policy to individuals over time, with details found in our protocol [ 65 ].…”

Optimizing a Just-in-Time Adaptive Intervention to Improve Dietary Adherence in Behavioral Obesity Treatment: Protocol for a Microrandomized Trial

“…This project will be the first known implementation of an MRT protocol to optimize a JITAI on the proximal outcome of eating behavior. Across the field of health behavior change, MRTs remain novel; there are several MRTs in the process of optimizing JITAIs in the areas of physical activity [ 85 , 86 ], smoking cessation [ 87 , 88 ], stress management [ 88 ], mood [ 86 ], medication adherence [ 89 ], and substance use [ 90 , 91 ]. A recently completed MRT to increase self-monitoring in a commercial wellness app for lifestyle behaviors found that sending prompts with tailored suggestions (vs tailored feedback) significantly increased the odds of self-monitoring and that the frequency of engagement with the app moderated this effect (eg, as frequency of self-monitoring increased and sending prompts with suggestions reduced the odds of engagement) [ 92 ].…”

The impact of celebrity influence and national media coverage on users of an alcohol reduction app: a natural experiment

“…It is also unclear whether a different message (e.g. to engage with all the app’s available features) may lead to increased time spent or screens viewed – this is currently explored in a different study, specifically designed to optimise the push notifications in Drink Less [ 24 ].…”