Online digital mental health communities can contribute to users’ mental health positively and negatively. Yet the measurement of outcomes and impact relating to digital mental health communities is difficult to capture. In this paper we demonstrate the development of an online experience measure for a specific children and young people’s community inside a digital mental health service. The development is informed by three phases: (i) item reduction through Estimate-Talk-Estimate modified Delphi methods, (ii) user testing with participatory action research and (iii) a pilot within the digital service community to explore its use. Rounds of experts talks help to reduce the items. User experience workshops helped to inform the usability and appearance, wording, and purpose of the measure. Finally, the pilot results highlight completion rates, difference in scores for age and community roles and a preference to ‘relate to others’; as a mechanism of support. Outcomes frequently selected in the measure show the importance of certain aspects of the community, such as safety, connection, and non-judgment previously highlighted in the literature. Self-reported helpfulness scales like this one could be used as indicators of meaningful engagement within the community and its content but further research is required to ascertain its acceptability and validity. Phased approaches involving stakeholders and participatory action research enhances the development of digitally enabled measurement tools.
The adoption of digital health technologies accelerated during Covid-19, with concerns over the equity of access due to digital exclusion. Using data from a text-based online mental health service for children and young people we explore the impact of the pandemic on service access and presenting concerns and whether differences were observed by sociodemographic characteristics in terms of access (gender, ethnicity and deprivation). We used interrupted time-series models to assess whether there was a change in the level and rate of service use during the Covid-19 pandemic (April 2020-April 2021) compared to pre-pandemic trends (June 2019-March 2020). Routinely collected data from 61221 service users were extracted for observation, those represented half of the service population as only those with consent to share their data were used. The majority of users identified as female (74%) and White (80%), with an age range between 13 and 20 years of age,. There was evidence of a sudden increase (13%) in service access at the start of the pandemic (RR 1.13 95% CI 1.02, 1.25), followed by a reduced rate (from 25% to 21%) of engagement during the pandemic compared to pre-pandemic trends (RR 0.97 95% CI 0.95,0.98). There was a sudden increase in almost all presenting issues apart from physical complaints. There was evidence of a step increase in the number of contacts for Black/African/Caribbean/Black British (38% increase; 95% CI: 1%-90%) and White ethnic groups (14% increase; 95% CI: 2%-27%) ), the sudden increase in service use at the start of the pandemic for the most (58% increase; 95% CI: 1%-247%) and least (47% increase; 95% CI: 6%-204%) deprived areas. During the pandemic, contact rates decreased, and referral sources change at the start. Findings on access and service activity align with other studies observing reduced service utilisation. The lack of differences in deprivation levels and ethnicity at lockdown suggests exploring equity of access to the anonymous service. The study provides unique insights into changes in digital mental health use during Covid-19 in the UK.
The adoption of digital health technologies accelerated during Covid-19, with concerns over the equity of access due to digital exclusion. Using data from a text-based online mental health service for children and young people we explore the impact of the pandemic on service access and presenting concerns and whether differences were observed by sociodemographic characteristics in terms of access (gender, ethnicity and deprivation). We used interrupted time-series models to assess whether there was a change in the level and rate of service use during the Covid-19 pandemic (April 2020-April 2021) compared to pre-pandemic trends (June 2019-March 2020). Routinely collected data from 61221 service users were extracted for observation, those represented half of the service population as only those with consent to share their data were used. The majority of users identified as female (74%) and White (80%), with an age range between 13 and 20 years of age,. There was evidence of a sudden increase (13%) in service access at the start of the pandemic (RR 1.13 95% CI 1.02, 1.25), followed by a reduced rate (from 25% to 21%) of engagement during the pandemic compared to pre-pandemic trends (RR 0.97 95% CI 0.95,0.98). There was a sudden increase in almost all presenting issues apart from physical complaints. There was evidence of a step increase in the number of contacts for Black/African/Caribbean/Black British (38% increase; 95% CI: 1%-90%) and White ethnic groups (14% increase; 95% CI: 2%-27%) ), sudden increase in service use at the start of the pandemic for the most (58% increase; 95% CI: 1%-247%) and least (47% increase; 95% CI: 6%-204%) deprived areas. During the pandemic, contact rates decreased, and referral sources change at the start. Findings on access and service activity align with other studies observing reduced service utilization. The lack of differences in deprivation levels and ethnicity at lockdown suggests exploring equity of access to the anonymous service. The study provides unique insights into changes in digital mental health use during Covid-19 in the UK.
Online digital mental health communities can contribute to users' mental health positively and negatively. Yet the measurement of experience, outcomes and impact mechanisms relating to digital mental health communities is difficult to capture. In this paper we demonstrate the development of an online experience measure for a specific children and young people's community forum inside a digital mental health service. The development of the Peer Online Community Experience Measure (POCEM) is informed by a multi-phased design: (i) item reduction through Estimate-Talk-Estimate modified Delphi methods, (ii) user testing with think-aloud protocols and (iii) a pilot study within the digital service community to explore observational data within the platform. Experts in the field were consulted to help reduce the items in the pool and to check their theoretical coherence. User testing workshops helped to inform the usability appearance, wording, and purpose of the measure. Finally, the pilot results highlight completion rates, differences in scores for age and roles and “relate to others”, as the most frequent domain mechanism of support for this community. Outcomes frequently selected show the importance of certain aspects of the community, such as safety, connection, and non-judgment previously highlighted in the literature. Experience measures like this one could be used as indicators of active therapeutic engagement within the forum community and its content but further research is required to ascertain its acceptability and validity. Multi-phased approaches involving stakeholders and user-centred design activities enhances the development of digitally enabled measurement tools.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.