A Mixed-Methods Evaluation of Usability and Acceptability of Web-Based Relapse Prevention and Self-Monitoring Program: Secondary Analysis of a Pilot Randomized Controlled Trial

Abstract

This secondary analysis of a pilot randomized controlled trial assessed the usability and acceptability of a web-based relapse prevention and self-monitoring program, which was newly developed for Japanese drug users. We analyzed quantitative and qualitative data using a mixed-method approach among 43 study participants. We assessed the usability of the programs using the Web Usability Scale (WUS) and satisfaction and acceptance using the Client Satisfaction Questionnaire 8-item version (CSQ-8). We also collected qualitative feedback using semi-structured open-ended questions. The results of WUS indicated that the usability of the programs was sufficient. According to the CSQ-8 results, the self-monitoring program had less satisfaction, while the web-based relapse prevention program met satisfaction. Some possible improvements for a future version of the web-based programs were suggested based on participants' feedback.

A digital Norwegian version of the client satisfaction questionnaire 8: factor validity and internal reliability in outpatient mental health care

“…The CSQ-8 has been used in studies examining the quality of inpatient forensic services, community and substance abuse services, inpatient services, and outpatient clinical settings [5]. In addition, the CSQ has been used to assess patient satisfaction across various populations, including both voluntary and involuntary admitted patients [13], as well as pre-therapy educational interventions [11,14], teletherapy [15], and follow-up interventions [16]. Finally, a slightly modified version has been used to evaluate web-based treatments [17].…”