Evaluating training of screening, brief intervention, and referral to treatment (SBIRT) for substance use: Reliability of the MD3 SBIRT Coding Scale.

Abstract

Screening, brief intervention, and referral to treatment (SBIRT) has become an empirically supported and widely implemented approach in primary and specialty care for addressing substance misuse. Accordingly, training of providers in SBIRT has increased exponentially in recent years. However, the quality and fidelity of training programs and subsequent interventions are largely unknown because of the lack of SBIRT-specific evaluation tools. The purpose of this study was to create a coding scale to assess quality and fidelity of SBIRT interactions addressing alcohol, tobacco, illicit drugs, and prescription medication misuse. The scale was developed to evaluate performance in an SBIRT residency training program. Scale development was based on training protocol and competencies with consultation from Motivational Interviewing coding experts. Trained medical residents practiced SBIRT with standardized patients during 10- to 15-min videotaped interactions. This study included 25 tapes from the Family Medicine program coded by 3 unique coder pairs with varying levels of coding experience. Interrater reliability was assessed for overall scale components and individual items via intraclass correlation coefficients. Coder pair-specific reliability was also assessed. Interrater reliability was excellent overall for the scale components (>.85) and nearly all items. Reliability was higher for more experienced coders, though still adequate for the trained coder pair. Descriptive data demonstrated a broad range of adherence and skills. Subscale correlations supported concurrent and discriminant validity. Data provide evidence that the MD3 SBIRT Coding Scale is a psychometrically reliable coding system for evaluating SBIRT interactions and can be used to evaluate implementation skills for fidelity, training, assessment, and research. Recommendations for refinement and further testing of the measure are discussed. (PsycINFO Database Record

SBIRT-A: Adapting SBIRT to Maximize Developmental Fit for Adolescents in Primary Care

“…Moving forward, the proposed SBIRT-A adaptations will require more detailed specification, manualization, and training materials to facilitate systematic application across PC clinics (e.g., DiClemente, Crouch, Norwood, Delahanty, & Welsh, 2015). In particular, the validation of caregiver screening measures and the development of software programs for implementing the S and preventive BI components, including algorithms for determining the appropriate BI based on a given profile of adolescent- and caregiver-reported risk factors, are critical next-steps for the dissemination and implementation of SBIRT-A.…”

Online Versus In-Person Screening, Brief Intervention, and Referral to Treatment Training in Pediatrics Residents

“…Tapes were coded using the MarylanD MD's Making a Difference (MD3) SBIRT coding scale, 17 adapted for use with adolescent patients and used to evaluate 16 SBIRT-adherent (''desirable'') behaviors, 7 SBIRT-nonadherent (''undesirable'') behaviors, and 2 global skills (T A B L E 1).…”

“Focusing” in Motivational Interviewing: development of a training tool for practitioners

“…Six measures included items that assess skilfulness in establishing focus, that is, as an upfront process of agreeing a change target. Establishing focus was assessed as agenda mapping [35][36][37] or raising the subject [38,39]. A more recently developed measure included focusing as a process of guiding patients toward a change target [40].…”