Development and assessment of the usability of a web-based referral to treatment tool for persons with substance use disorders

Abstract

Background Hospitalized people with unhealthy substance use should be referred to treatment. Although inpatient referral resources are often available, clinicians report that outpatient referral networks are not well-established. The purpose of this manuscript is to describe the development and usability testing of a web-based Referral to Treatment Tool (RTT © 2020 Trustees of Indiana University, all rights reserved) designed to identify treatment centers for people with unhealthy substance use. Results The RTT was conceptualized, developed, and then populated with public use and local survey data of treatment centers from 14 market ZIP codes of hospitals participating in an SBIRT implementation study. The tool underwent initial heuristic testing, followed by usability testing at three hospitals within a large healthcare system in the Midwest region of the United States. Administrative (n = 6) and provider (n = 12) users of the RTT completed a list of tasks and provided feedback through Think-Aloud Tests, the System Usability Scale, and in-person interviews. Patients (n = 4) assessed multiple versions of a take-home printout of referral sites that met their specifications and completed in-person interviews to provide feedback. Each administrative task was completed in less than 3 min, and providers took an average of 4 min and 3 s to identify appropriate referral sites for a patient and print a referral list for the patient. The mean System Usability Scale score (M = 77.22, SD = 15.57, p = 0.03) was significantly higher than the passable score of 70, indicating favorable perceptions of the usability of the RTT. Administrative and provider users felt that the RTT was useful and easy to use, but the settings and search features could be refined. Patients indicated that the printouts contained useful information and that it was helpful to include multiple referral sites on the printout. Conclusion The web-based referral tool has the potential to facilitate voluntary outpatient referral to treatment for patients with unhealthy substance use. The RTT can be customized for a variety of health care settings and patient needs. Additional revisions based on usability testing results are needed to prepare for a broader multi-site clinical evaluation. Trial Registration Not applicable.

A Veteran-Centric Web-Based Decision Aid for Lung Cancer Screening: Usability Analysis (Preprint)

“…We used both quantitative and qualitative methods for usability testing. The SUS and the EUCS scales have been widely used and well-validated to assess interventions in the domains of ease of use and usefulness [28,29,[31][32][33][34][35][36]. The SUS is a 10-item scale developed for the assessment of a broad range of products; scores (ranging from 0=low usability to 100=high usability) correspond to the following adjective descriptors: worst imaginable, awful, poor, okay, good, excellent, and best imaginable [27,37].…”