Periodic reflections: a method of guided discussions for documenting implementation phenomena

Abstract

BackgroundEthnography has been proposed as a valuable method for understanding how implementation occurs within dynamic healthcare contexts, yet this method can be time-intensive and challenging to operationalize in pragmatic implementation. The current study describes an ethnographically-informed method of guided discussions developed for use by a multi-project national implementation program.MethodsThe EMPOWER QUERI is conducting three projects to implement innovative care models in VA women’s health for high-priority health concerns – prediabetes, cardiovascular risk, and mental health – utilizing the Replicating Effective Programs (REP) implementation strategy enhanced with stakeholder engagement and complexity science. Drawing on tenets of ethnographic research, we developed a lightly-structured method of guided “periodic reflections” to aid in documenting implementation phenomena over time. Reflections are completed as 30–60 min telephone discussions with implementation team members at monthly or bi-monthly intervals, led by a member of the implementation core. Discussion notes are coded to reflect key domains of interest and emergent themes, and can be analyzed singly or in triangulation with other qualitative and quantitative assessments to inform evaluation and implementation activities.ResultsThirty structured reflections were completed across the three projects during a 15-month period spanning pre-implementation, implementation, and sustainment activities. Reflections provide detailed, near-real-time information on projects’ dynamic implementation context, including characteristics of implementation settings and changes in the local or national environment, adaptations to the intervention and implementation plan, and implementation team sensemaking and learning. Reflections also provide an opportunity for implementation teams to engage in recurring reflection and problem-solving.ConclusionsTo implement new, complex interventions into dynamic organizations, we must better understand the implementation process as it unfolds in real time. Ethnography is well suited to this task, but few approaches exist to aid in integrating ethnographic insights into implementation research. Periodic reflections show potential as a straightforward and low-burden method for documenting events across the life cycle of an implementation effort.They offer an effective means for capturing information on context, unfolding process and sensemaking, unexpected events, and diverse viewpoints, illustrating their value for use as part of an ethnographically-minded implementation approach.Trial registrationThe two implementation research studies described in this article have been registered as required: Facilitating Cardiovascular Risk Screening and Risk Reduction in Women Veterans (NCT02991534); and Implementation of Tailored Collaborative Care for Women Veterans (NCT02950961).

Unintended consequences: a qualitative study exploring the impact of collecting implementation process data with phone interviews on implementation activities

“…In nursing and social work research, reflexivity has been used to create transparency and improve research quality [ 49 – 51 ]. Reflexive discussions among implementation researchers may also help with understanding and accounting for the unintended consequences of their data collection methods [ 24 ]. In implementation science, it may be difficult to engage study participants in data collection without incurring such consequences; critical self-reflection among researchers may yield greater transparency.…”

Leveraging emergency department visits to connect older adults at risk for malnutrition and food insecurity to community resources: design and protocol development for the BRIDGE study

“…In addition, we will continue to gather stakeholder perspectives throughout the implementation to determine if the intervention is feasible and sustainable, guided by CFIR [23]. Periodic reflections with the ED and AAA staff champions or key implementers will be used to understand implementation phenomena, including unplanned adaptations and real-time barriers or facilitators [32]. Qualitative data will be collected and analyzed in a similar approach as in phase 1.…”

Protocol for a process evaluation of Family Planning Elevated: a statewide initiative to improve contraceptive access in Utah (USA)

“…The meeting notes will be organised into the codes derived from Finley et al's article on periodic reflections as a tool for process evaluations. 44 Monthly interviews with a member of the FPE staff will also follow the template of these periodic reflections. The clustered codes from the field notes and FPE staff interview for each month will be combined into a monthly process evaluation report along with the summaries of the month's implementation activities and the revised logframe for that month.…”