Process evaluation for complex interventions in health services research: analysing context, text trajectories and disruptions

Abstract

BackgroundProcess evaluations assess the implementation and sustainability of complex healthcare interventions within clinical trials, with well-established theoretical models available for evaluating intervention delivery within specific contexts. However, there is a need to translate conceptualisations of context into analytical tools which enable the dynamic relationship between context and intervention implementation to be captured and understood.MethodsIn this paper I propose an alternative approach to the design, implementation and analysis of process evaluations for complex health interventions through a consideration of trial protocols as textual documents, distributed and enacted at multiple contextual levels. As an example, I conduct retrospective analysis of a sample of field notes and transcripts collected during the ESTEEM study - a cluster randomised controlled trial of primary care telephone triage. I draw on theoretical perspectives associated with Linguistic Ethnography to examine the delivery of ESTEEM through staff orientation to different texts. In doing so I consider what can be learned from examining the flow and enactment of protocols for notions of implementation and theoretical fidelity (i.e. intervention delivered as intended and whether congruent with the intervention theory).ResultsImplementation of the triage intervention required staff to integrate essential elements of the protocol within everyday practice, seen through the adoption and use of different texts that were distributed across staff and within specific events. Staff were observed deploying texts in diverse ways (e.g. reinterpreting scripts, deviating from standard operating procedures, difficulty completing decision support software), providing numerous instances of disruption to maintaining intervention fidelity. Such observations exposed tensions between different contextual features in which the trial was implemented, offering theoretical explanations for the main trial findings.ConclusionsThe value of following how trial protocols produce new texts is that we can observe the flow of ‘the intervention as intended’ across a series of events which are enacted to meet specific demands of intervention delivery. Such observations are not solely premised on identifying routines or practices of implementation, but where ‘protocols as intended’ breaks down. In doing so, I discuss whether it is here where we might expose the ‘active ingredients’ of interventions in action.Electronic supplementary materialThe online version of this article (doi:10.1186/s12913-016-1651-8) contains supplementary material, which is available to authorized users.

Addressing the quality and scope of paediatric primary care in South Africa: Evaluating contextual impacts of the introduction of the Practical Approach to Care Kit for children (PACK Child)

“…Linguistic ethnography provides theoretical and methodological tools for analysing how the meaning of talk, text and objects shift over time and space. We have previously adapted this approach [32] to facilitate detailed investigation of complex healthcare interventions across macro, meso-and microcontextual levels, drawing on Bronfenbrenner's socio-ecological model of behaviour, which conceptualises individual action as a response to socially structured processes and characteristics, organised across a layered system of relationships [33].…”

Strengthening the quality and scope of paediatric primary care in South Africa: Evaluating contextual impacts of the introduction of the Practical Approach to Care Kit for children (PACK Child)

“…Linguistic ethnography provides theoretical and methodological tools for analysing how the meaning of talk, text and objects shift over time and space. We have previously adapted this approach [33] to facilitate detailed investigation of complex healthcare interventions across macro-, meso-and microcontextual levels, drawing on Bronfenbrenner's socio-ecological model of behaviour [34].…”

“…Polar questions [42] are questions that are either interrogative or declarative and are designed to prefer either a "yes" or "no" response. In the process of clinical assessment, clinicians' use of polar questions have also been shown to frequently prefer no problem answers [33,43]. For example, "And she is weeing ok?"…”

Interpersonal Counselling for Adolescent Depression Delivered by Youth Mental Health Workers Without Core Professional Training: A Feasibility Randomised Controlled Trialstudy Protocol

“…A linguistic ethnographic methodology (37,38) will be employed to analyse how relationships, roles and moments of intervention delivery are organised within the contexts of delivery. This will be achieved by: 1) setting out macro, meso and micro contextual features relevant to implementation within each provider; 2)…”