Background Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on health care utilization. Digital technologies that improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials—the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials. Objective This study will use the iterative convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. Using this methodology, we will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. This study protocol will provide a blueprint for future usability studies of mobile health solutions. Methods We will collect qualitative and quantitative data from 20-30 participants aged 18 years and older for 4 months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 standard and the system usability scale, providing a usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles. Results This study received approval from the Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) on June 4, 2020. At manuscript submission, study recruitment was on-going, with data collection to be completed and results published in 2021. Conclusions This study will provide evidence concerning mobile health DART system usability and acceptance determining system improvements required to support user adoption and minimize suboptimal system usability as a potential confounder within subsequent noninferiority clinical trials. Success should produce a safe effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This deliberately rigorous approach to mobile health innovation could be used as a guide for other developers of similar apps. International Registered Report Identifier (IRRID) DERR1-10.2196/27205
Background Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing demand for health care use. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are rarely tested with sufficient rigor in clinical trials, which is the gold standard for clinical proof of safety and efficacy. We have developed a new musculoskeletal digital assessment routing tool (DART) that allows users to self-assess and be directed to the right care. DART requires validation in a real-world setting before implementation. Objective This pilot study aims to assess the feasibility of a future trial by exploring the key aspects of trial methodology, assessing the procedures, and collecting exploratory data to inform the design of a definitive randomized crossover noninferiority trial to assess DART safety and effectiveness. Methods We will collect data from 76 adults with a musculoskeletal condition presenting to general practitioners within a National Health Service (NHS) in England. Participants will complete both a DART assessment and a physiotherapist-led triage, with the order determined by randomization. The primary analysis will involve an absolute agreement intraclass correlation (A,1) estimate with 95% CI between DART and the clinician for assessment outcomes signposting to condition management pathways. Data will be collected to allow the analysis of participant recruitment and retention, randomization, allocation concealment, blinding, data collection process, and bias. In addition, the impact of trial burden and potential barriers to intervention delivery will be considered. The DART user satisfaction will be measured using the system usability scale. Results A UK NHS ethics submission was done during June 2021 and is pending approval; recruitment will commence in early 2022, with data collection anticipated to last for 3 months. The results will be reported in a follow-up paper in 2022. Conclusions This study will inform the design of a randomized controlled crossover noninferiority study that will provide evidence concerning mobile health DART system clinical signposting in an NHS setting before real-world implementation. Success should produce evidence of a safe, effective system with good usability, potentially facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This rigorous approach to mobile health system testing could be used as a guide for other developers of similar applications. Trial Registration ClinicalTrials.gov NCT04904029; http://clinicaltrials.gov/ct2/show/NCT04904029 International Registered Report Identifier (IRRID) PRR1-10.2196/31541
BACKGROUND Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on healthcare utilization. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are often inadequately developed and poorly adopted. Further, they are rarely tested with sufficient rigor in clinical trials, the gold standard for clinical proof of efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires usability testing in preparation for clinical trials. OBJECTIVE This study will use the iterative-convergent mixed methods design to assess and mitigate all serious usability issues to optimize user experience and adoption. This will provide justifiable confidence to progress to full-scale randomized controlled trials when DART is integrated into clinical management pathways. METHODS We will collect qualitative and quantitative data from between 20-30 participants aged 18 and over four months. The exact number of participants recruited will be dependent on the number of iterative cycles required to reach the study end points. Building on previous internal testing and stakeholder involvement, quantitative data collection is defined by the constructs within the ISO 9241-210-2019 Standard and the System Usability Scale (SUS), providing a benchmark usability score for DART. Guided by the participant responses to quantitative questioning, the researcher will focus the qualitative data collection on specific usability problems. These will then be graded to provide the rationale for further DART system improvements throughout the iterative cycles. RESULTS This study received approval from Queen Mary University of London Ethics of Research Committee (QMREC2018/48/048) in June 2020. At manuscript submission, the first round of individual interviews has been completed, with data collection to be completed and results published in 2021. CONCLUSIONS This study will provide evidence concerning mHealth DART system usability and acceptance determining system improvements required to support user adoption and minimize sub-optimal system usability as a potential confounder within subsequent non-inferiority clinical trials. This deliberately rigorous approach to mHealth innovation could be used as a guide for other developers of similar applications. Success should produce a safe, effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services.
BACKGROUND Musculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing burden on healthcare utilization. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are rarely tested with sufficient rigor in clinical trials, the gold standard for clinical proof of safety and efficacy. We have developed a new musculoskeletal Digital Assessment Routing Tool (DART) that allows users to self-assess and be directed to the right care. DART requires validation in a real-world setting prior to implementation. OBJECTIVE This pilot study will assess the feasibility of a future trial by exploring key aspects of trial methodology, assess the procedures and collect exploratory data to inform the design of a definitive, randomized, crossover, non-inferiority trial to assess DART safety and effectiveness. METHODS We will collect data from 76 adult participants presenting to an NHS England GP practice with a musculoskeletal condition. Participants will complete both a DART assessment and a physiotherapist-led triage with the order determined by randomization. The primary analysis will involve an absolute agreement ICC (A,1) estimate with 95% confidence intervals between DART and the clinician for assessment outcomes sign-posting to condition management pathways. Data will be collected to allow analysis of participant recruitment and retention, randomization, allocation concealment, blinding, data collection process and bias. In addition, the impact of trial burden and potential barriers to intervention delivery will be considered. DART user satisfaction will be measured using the System Usability Scale. RESULTS A UK NHS ethics submission will be submitted during June 2021 and pending approval, recruitment will commence during August 2021 with data collection anticipated to last for 3 months. Results will be reported in a follow-up paper later in 2021. CONCLUSIONS This study will inform the design of a randomized controlled crossover non-inferiority study that will provide evidence concerning mHealth DART system clinical sign posting in an NHS setting prior to real-world implementation. Success should produce evidence of a safe, effective system with excellent usability, facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This rigorous approach to mHealth system testing could be used as a guide for other developers of similar applications. CLINICALTRIAL This trial is registered with Clinical Trials number NCT04904029
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.