Digital interventions in mental health: evidence syntheses and economic modelling

Abstract

Background Economic evaluations provide evidence on whether or not digital interventions offer value for money, based on their costs and outcomes relative to the costs and outcomes of alternatives. Objectives (1) Evaluate and summarise published economic studies about digital interventions across different technologies, therapies, comparators and mental health conditions; (2) synthesise clinical evidence about digital interventions for an exemplar mental health condition; (3) construct an economic model for the same exemplar mental health condition using the previously synthesised clinical evidence; and (4) consult with stakeholders about how they understand and assess the value of digital interventions. Methods We completed four work packages: (1) a systematic review and quality assessment of economic studies about digital interventions; (2) a systematic review and network meta-analysis of randomised controlled trials on digital interventions for generalised anxiety disorder; (3) an economic model and value-of-information analysis on digital interventions for generalised anxiety disorder; and (4) a series of knowledge exchange face-to-face and digital seminars with stakeholders. Results In work package 1, we reviewed 76 economic evaluations: 11 economic models and 65 within-trial analyses. Although the results of the studies are not directly comparable because they used different methods, the overall picture suggests that digital interventions are likely to be cost-effective, compared with no intervention and non-therapeutic controls, whereas the value of digital interventions compared with face-to-face therapy or printed manuals is unclear. In work package 2, we carried out two network meta-analyses of 20 randomised controlled trials of digital interventions for generalised anxiety disorder with a total of 2350 participants. The results were used to inform our economic model, but when considered on their own they were inconclusive because of the very wide confidence intervals. In work package 3, our decision-analytic model found that digital interventions for generalised anxiety disorder were associated with lower net monetary benefit than medication and face-to-face therapy, but greater net monetary benefit than non-therapeutic controls and no intervention. Value for money was driven by clinical outcomes rather than by intervention costs, and a value-of-information analysis suggested that uncertainty in the treatment effect had the greatest value (£12.9B). In work package 4, stakeholders identified several areas of benefits and costs of digital interventions that are important to them, including safety, sustainability and reducing waiting times. Four factors may influence their decisions to use digital interventions, other than costs and outcomes: increasing patient choice, reaching underserved populations, enabling continuous care and accepting the ‘inevitability of going digital’. Limitations There was substantial uncertainty around effect estimates of digital interventions compared with alternatives. This uncertainty was driven by the small number of studies informing most comparisons, the small samples in some of these studies and the studies’ high risk of bias. Conclusions Digital interventions may offer good value for money as an alternative to ‘doing nothing’ or ‘doing something non-therapeutic’ (e.g. monitoring or having a general discussion), but their added value compared with medication, face-to-face therapy and printed manuals is uncertain. Clinical outcomes rather than intervention costs drive ‘value for money’. Future work There is a need to develop digital interventions that are more effective, rather than just cheaper, than their alternatives. Study registration This study is registered as PROSPERO CRD42018105837. Funding This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 1. See the NIHR Journals Library website for further project information.

Digital mental health: challenges and next steps

“…We are aware of some limitations in our approach, which is a narrative rather than a systematic review of the literature and was reached by expert consensus. We did not address some important approaches that have been tested in digital mental health, such as mobile apps, internet-based interventions (including internet-based cognitive therapy and internet-based self-help interventions) and virtual reality 37 ; however, we aim to cover these in future projects. In addition, while the consensus development panel enabled international and multidisciplinary expert discussion, we are aware that we were not able to include patient and public representation, and rather than using a separate panel—given the novelty and the complexity of the field—we used the whole expert group for consensus.…”

Psychological Outcomes and Mechanisms of Mindfulness-Based Training for Generalised Anxiety Disorder: A Systematic Review and Meta-Analysis

“…While RCTs concerning anxiety treatment have historically been treatment framework- or program-specific, further technique- and mechanism-specific research may be most valuable to fully comprehend how second and third wave therapeutic approaches can be adequately integrated and delivered to both those experiencing clinical and sub-clinical levels of GAD symptoms. This is important as research and clinical practice looks towards more individually tailored and accessible programs to treat anxiety symptoms (Gega et al, 2022 ).…”

Artificial Intelligence, Digital Health Research, and the Clinical Nurse Specialist

“…These include using digital resources to identify, recruit, and retain subjects for clinical trials; creating and testing unique nursing interventions that can be presented digitally aimed at promoting health or managing chronic health problems; and collecting data that previously would have been expensive and/or difficult to obtain. 1,2,4 Identification, Recruitment, and Retention in the Digital Age Finding, recruiting, and retaining subjects for a clinical study are critical to the validity of the study findings. It is estimated that more than 40% of clinical trials have insufficient samples because of recruitment and retention issues.…”

“…Digital technology has many uses in healthcare, but there are 3 specific ways in which digital technology can be used to advance nursing research agendas. These include using digital resources to identify, recruit, and retain subjects for clinical trials; creating and testing unique nursing interventions that can be presented digitally aimed at promoting health or managing chronic health problems; and collecting data that previously would have been expensive and/or difficult to obtain 1,2,4 …”