How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

Abstract

Background Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms—such as provider knowledge, skills, and attitudes—is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services. Methods A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge). Results There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage. Conclusions Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices. Trial registration ClinicalTrials.gov NCT05041517. Retrospectively registered on 10 September 2021.

Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis

“…Both groups reported similar data collection rates using the MFS, and higher rates of measure collection compared to rates of providing feedback or using MFS data to inform changes to treatment course. Previous MBC studies show similar trends: using data and adjusting treatment based on data is often the most difficult practice to change in implementation [ 47 , 76 – 78 ]. Yet, even adjusting for agency, Higher MFS participants reported significantly higher rates of providing feedback based on the MFS, compared to the Lower MFS participants.…”

Strategies for implementing the interRAI home care frailty scale with home-delivered meal clients

“…In addition to appointing specific staff members to be responsible for tool administration and adjusting electronic documentation systems, staff should have access to initial training as well as ongoing consultations to confirm procedures for administration, documentation, and interpretation of results. The combination of training and follow-up consultations has been previously found effective for supporting the uptake of evidence-based interventions and assessments ( 53 , 54 ), particularly in the community setting. Lastly, of the available data our partner agency's staff collected from clients beyond May 2021, we identified that clients had unmet needs, especially in the domains of function and mobility, that could not be addressed through home-delivered meal services alone.…”

Social work, mental health and substance use: a scoping review

“…Recommending more training appears to be a simple solution. However, implementation research points to the complex challenges and lack of success in practice change with this approach (Evans et al , 2022; Lyon et al , 2022; Lyon et al , 2011). It is well known that transforming systems and processes is needed to change practice.…”