This column focuses on use of learning collaboratives by the Center for Practice Innovations to help programs implement the evidence-based individual placement and support model of supported employment in New York State. These learning collaboratives use fidelity and performance indicator data to drive the development of program-specific individualized quality improvement plans. As of 2014, 59 (69%) of 86 eligible programs have joined the initiative. Programs are achieving employment outcomes for consumers on par with national benchmarks, along with improved fidelity.

Objective Fidelity assessments help ensure evidence-based practices are implemented properly. While typically conducted by independent raters, some programs have implemented self- assessments due to resource constraints. Self-assessments were compared to independent assessments within programs implementing Individual Placement and Support (IPS) supported employment. Methods Eleven community-based outpatient programs in New York State completed both self and independent assessments. ICCs and paired t-tests were used to compare independent and self-rated assessments. Results Mean scores are within the range of “fair fidelity” to IPS. Mean self (91.7) and independent (92.9) scores were not significantly different from one another. However, significant differences were found among individual items in this small sample. Conclusions and Implications for Practice Self-assessments may be valid for examining a program’s overall functioning, and useful when resource constraints prevent independent assessment. Independent assessors may be able to identify nuances, particularly among individual assessment items, that can identify areas for program improvement.

Higher-fidelity implementation of the IPS model, as self-assessed by program sites, was associated with higher employment rates, which were sustained over time.

No abstract