Interactive Participatory Audit and Feedback (IPAF): Theory-based development and multi-site implementation outcomes with specialty clinic staff

Abstract

Background: Theory-based implementation strategies, such as audit and feedback (A&F), can improve adoption of evidence-based practices. However, few strategies have been developed and tested to meet the needs of specialty clinics. In particular, frontline staff can execute CVD risk-reduction protocols, but A&F strategies to support them have not been well examined. The objective of this paper is to develop a novel A&F strategy, Interactive Participatory A&F (IPAF), and evaluate as an implementation strategy to support specialty clinic staff. Methods: We developed IPAF by combining theories to inform staff goals (Self-Regulation Theory) and address their psychological needs for relatedness, autonomy, and confidence (Self-Determination Theory). We facilitated IPAF fidelity by developing a theory-based facilitation tool: a semi-structured worksheet to guide flexible discussion of target behaviors, perceived barriers, goals, and action plans. We evaluated IPAF in the context of eight quasi-experimental implementations in specialty clinics across two health systems. Following a Hybrid Type 2 effectiveness-implementation design, we reported intervention outcomes for CVD risk-reduction elsewhere. This paper reports implementation outcomes associated with IPAF, focusing on feasibility, acceptability, fidelity, and adoption. We evaluated implementation outcomes using mixed-methods data including Electronic Health Records (EHR) data, team records, IPAF worksheets, and staff questionnaire responses. Results: Eighteen staff participated in 99 monthly, individual, synchronous (face-to-face or by phone) IPAF sessions during the first six months of implementation. Subsequently, we provided over 375 monthly feedback emails. Feasibility data revealed high staff attendance (90-93%) and engagement in IPAF sessions. Staff rated questionnaire items about acceptability of IPAF highly. IPAF records and staff responses demonstrated fidelity of delivery and receipt of IPAF. Adoption of target behaviors increased significantly (all P-values < 0.05) and was maintained for over 24 months. Conclusions: We developed and evaluated an interactive participatory A&F strategy to improve implementation of evidence-based interventions. The IPAF toolkit combines two complementary theories: Self-Regulation Theory and Self-Determination Theory. Findings support feasibility, acceptability, and fidelity of IPAF, and staff adoption and maintenance of target behaviors. By evaluating multi-site implementation outcomes in specialty clinics with frontline staff, we have extended prior research on clinic protocols and A&F beyond primary care settings and providers.