Access to primary care for socio-economically disadvantaged older people in rural areas: exploring realist theory using structural equation modelling in a linked dataset

Abstract

BackgroundRealist approaches seek to answer questions such as ‘how?’, ‘why?’, ‘for whom?’, ‘in what circumstances?’ and ‘to what extent?’ interventions ‘work’ using context-mechanism-outcome (CMO) configurations. Quantitative methods are not well-established in realist approaches, but structural equation modelling (SEM) may be useful to explore CMO configurations. Our aim was to assess the feasibility and appropriateness of SEM to explore CMO configurations and, if appropriate, make recommendations based on our access to primary care research. Our specific objectives were to map variables from two large population datasets to CMO configurations from our realist review looking at access to primary care, generate latent variables where needed, and use SEM to quantitatively test the CMO configurations.MethodsA linked dataset was created by merging individual patient data from the English Longitudinal Study of Ageing and practice data from the GP Patient Survey. Patients registered in rural practices and who were in the highest deprivation tertile were included. Three latent variables were defined using confirmatory factor analysis. SEM was used to explore the nine full CMOs. All models were estimated using robust maximum likelihoods and accounted for clustering at practice level. Ordinal variables were treated as continuous to ensure convergence.ResultsWe successfully explored our CMO configurations, but analysis was limited because of data availability. Two hundred seventy-six participants were included. We found a statistically significant direct (context to outcome) or indirect effect (context to outcome via mechanism) for two of nine CMOs. The strongest association was between ‘ease of getting through to the surgery’ and ‘being able to get an appointment’ with an indirect mediated effect through convenience (proportion of the indirect effect of the total was 21%). Healthcare experience was not directly associated with getting an appointment, but there was a statistically significant indirect effect through convenience (53% mediated effect). Model fit indices showed adequate fit.ConclusionsSEM allowed quantification of CMO configurations and could complement other qualitative and quantitative techniques in realist evaluations to support inferences about strengths of relationships. Future research exploring CMO configurations with SEM should aim to collect, preferably continuous, primary data.Electronic supplementary materialThe online version of this article (10.1186/s12874-018-0514-x) contains supplementary material, which is available to authorized users.

How and how well do workplace assessments work? Using contextual variations in a theory-based evaluation with a largeN

“…When activated, these mechanisms are theoretically consistent with a soft form of regulation that places a main responsibility for the conduct of WPAs on the workplace and its people, even if we concede they may be imprecise representations of multiple, 'real' underlying mechanisms (Ford et al, 2018;Pawson and Tilley, 1997). If the list above represents the most likely mechanisms that help convert a WPA into action, the lack of signs of such mechanisms will constitute a threat to belief in the effectiveness of WPAs.…”

“…Although large-N studies, variance-based approaches and quantitative methods are less established in realist evaluation, with Ravn (2019) and Ford et al (2018) as noteworthy exceptions, this article argues that exactly these approaches provide findings that are useful in evaluative argumentation (Valovirta, 2002) in situations where a control group is absent.…”

Testing mechanisms in large-N realistic evaluations

“…The dominance of qualitative approaches in the field of realistic evaluation (and theory-based evaluation in general) has been the starting point of several recent methodological papers promoting a more quantitative turn in realistic evaluation and in theory-based evaluation (e.g. Ford et al, 2018; Giffoni et al, 2018; Hawkins, 2016). The methods promoted include ‘The Bayesian Network Approach’ (Giffoni et al, 2018), ‘Process Tracing and Bayesian updating’ (Befani and Stedman-Bryce, 2017) and ‘Structural Equation Modelling’ (Ford et al, 2018).…”

“…Ford et al, 2018; Giffoni et al, 2018; Hawkins, 2016). The methods promoted include ‘The Bayesian Network Approach’ (Giffoni et al, 2018), ‘Process Tracing and Bayesian updating’ (Befani and Stedman-Bryce, 2017) and ‘Structural Equation Modelling’ (Ford et al, 2018). These approaches are, however, quite advanced and not readily applicable for evaluators with only rudimentary statistical training.…”

Improving primary care Access in Context and Theory (I-ACT trial): a theory-informed randomised cluster feasibility trial using a realist perspective

“…Second, we undertook a qualitative study of older people and health professionals, identifying barriers to access, such as engaged telephone lines, availability of appointments, interactions with receptionists and transport [14]. Finally, we looked at the usefulness of structural equation modelling to explore realist theory in the English Longitudinal Study of Ageing [15]. Based on these studies, we identified the booking system and transport for those without car access as important issues suitable for intervention.…”