Engagement, Satisfaction, and Mental Health Outcomes Across Different Residential Subgroup Users of a Digital Mental Health Relational Agent: Exploratory Single-Arm Study (Preprint)

Abstract

BACKGROUND Mental illness is a pervasive worldwide public health issue. Residentially vulnerable populations such as those living in rural, medically underserved, or mental health provider shortage areas face unique access barriers to mental health care. Despite the growth of digital mental health interventions utilizing relational agent technology, little is known about their use patterns, efficacy, and favorability in residentially vulnerable populations. OBJECTIVE To explore differences in application (app) utilization, therapeutic alliance, mental health outcomes, and satisfaction across residential subgroups (metropolitan/nonmetropolitan/rural, medically underserved area (MUA) (yes/no), and mental health provider shortage areas (MHPSA) (yes/no) among users of a smartphone-based, digital mental health intervention, Woebot Life (WB-LIFE). WB-LIFE was designed to help users better understand and manage their moods and features a relational agent, Woebot, that converses through text-based messages. METHODS This exploratory study examined data from 255 adults enrolled in an 8-week, single-arm trial of WB-LIFE. Analyses compared levels of app utilization and therapeutic alliance Total scores as well as subscales Goal, Task, and Bond, mental health outcomes (depressive and anxiety symptoms, stress, resilience, burnout), and program satisfaction across residential subgroups. RESULTS Few study participants resided in non-metropolitan (n=25, 10%) or rural (n=3, 1%) areas, precluding estimates across this variable. Despite a largely metropolitan sample, nearly 39% (n=99) resided in an MUA and 55% (n=141) in an MHPSA. There were no significant differences in app utilization or satisfaction by MUA or MHPSA status. There also were no differences in depression, anxiety, stress, resilience or burnout, with the exception of MUA participants having higher baseline depressive symptoms among those starting in the moderate range or higher (Patient Health Questionnaire-8 item ([PHQ-8]≥10) than non-MUA participants (mean=16.50 versus 14.41, respectively, p=0.01). Although working alliance scores did not differ by MHPSA status, those who resided in an MUA had higher Goal (t=2.21, p=0.03), Bond (t=1.94, p=0.05) and Total therapeutic alliance scores at Day 3 (t=2.15, p=0.03), and higher Goal scores at Week 8 (t=2.28, p=0.02) as compared to those not living in an MUA. CONCLUSIONS Despite the study not recruiting many participants from rural or nonmetropolitan populations, sizable proportions resided in an MUA or an MHPSA. Analyses revealed few differences in app utilization, therapeutic alliance, mental health outcomes (including baseline levels), or satisfaction across MUA or MHPSA status over the 8-week study. Findings suggest that vulnerable residential populations may benefit from using digital agent-guided cognitive behavioral therapy.