In spite of their widespread use in policy making in the UK and elsewhere, there is a relatively sparse literature specifically devoted to policy pilots. Recent research on policy piloting has focused on the role of pilots in making policy work in accordance with national agendas. Taking this as a point of departure, the present paper develops the notion of pilots doing policy work. It does this by situating piloting within established theories of policy formulation and implementation, and illustrating using an empirical case. Our case is drawn from a qualitative policy ethnography of a local government pilot programme aiming to extend access to healthcare services. Our case explores the collective entrepreneurship of regional policy makers together with local pilot volunteers. We argue that pilots work to mobilise and manage the ambiguity and conflict associated with particular policy goals, and in their structure and design, shape action towards particular outcomes. We conclude with a discussion of the generative but managed role which piloting affords to local implementers.
Background and aim The NHS collects a large number of data on patient experience, but there are concerns that it does not use this information to improve care. This study explored whether or not and how front-line staff use patient experience data for service improvement. Methods Phase 1 – secondary analysis of existing national survey data, and a new survey of NHS trust patient experience leads. Phase 2 – case studies in six medical wards using ethnographic observations and interviews. A baseline and a follow-up patient experience survey were conducted on each ward, supplemented by in-depth interviews. Following an initial learning community to discuss approaches to learning from and improving patient experience, teams developed and implemented their own interventions. Emerging findings from the ethnographic research were shared formatively. Phase 3 – dissemination, including an online guide for NHS staff. Key findings Phase 1 – an analysis of staff and inpatient survey results for all 153 acute trusts in England was undertaken, and 57 completed surveys were obtained from patient experience leads. The most commonly cited barrier to using patient experience data was a lack of staff time to examine the data (75%), followed by cost (35%), lack of staff interest/support (21%) and too many data (21%). Trusts were grouped in a matrix of high, medium and low performance across several indices to inform case study selection. Phase 2 – in every site, staff undertook quality improvement projects using a range of data sources. The number and scale of these varied, as did the extent to which they drew directly on patient experience data, and the extent of involvement of patients. Before-and-after surveys of patient experience showed little statistically significant change. Making sense of patient experience ‘data’ Staff were engaged in a process of sense-making from a range of formal and informal sources of intelligence. Survey data remain the most commonly recognised and used form of data. ‘Soft’ intelligence, such as patient stories, informal comments and daily ward experiences of staff, patients and family, also fed into staff’s improvement plans, but they and the wider organisation may not recognise these as ‘data’. Staff may lack confidence in using them for improvement. Staff could not always point to a specific source of patient experience ‘data’ that led to a particular project, and sometimes reported acting on what they felt they already knew needed changing. Staff experience as a route to improving patient experience Some sites focused on staff motivation and experience on the assumption that this would improve patient experience through indirect cultural and attitudinal change, and by making staff feel empowered and supported. Staff participants identified several potential interlinked mechanisms: (1) motivated staff provide better care, (2) staff who feel taken seriously are more likely to be motivated, (3) involvement in quality improvement is itself motivating and (4) improving patient experience can directly improve staff experience. ‘Team-based capital’ in NHS settings We propose ‘team-based capital’ in NHS settings as a key mechanism between the contexts in our case studies and observed outcomes. ‘Capital’ is the extent to which staff command varied practical, organisational and social resources that enable them to set agendas, drive process and implement change. These include not just material or economic resources, but also status, time, space, relational networks and influence. Teams involving a range of clinical and non-clinical staff from multiple disciplines and levels of seniority could assemble a greater range of capital; progress was generally greater when the team included individuals from the patient experience office. Phase 3 – an online guide for NHS staff was produced in collaboration with The Point of Care Foundation. Limitations This was an ethnographic study of how and why NHS front-line staff do or do not use patient experience data for quality improvement. It was not designed to demonstrate whether particular types of patient experience data or quality improvement approaches are more effective than others. Future research Developing and testing interventions focused specifically on staff but with patient experience as the outcome, with a health economics component. Studies focusing on the effect of team composition and diversity on the impact and scope of patient-centred quality improvement. Research into using unstructured feedback and soft intelligence. Funding The National Institute for Health Research Health Services and Delivery Research programme.
Objectives Improving patient experience is widely regarded as a key component of health care quality. However, while a considerable amount of data are collected about patient experience, there are concerns this information is not always used to improve care. This study explored whether and how frontline staff use patient experience data for service improvement. Methods We conducted a year-long ethnographic case study evaluation, including 299 hours of observations and 95 interviews, of how frontline staff in six medical wards at different hospital sites in the United Kingdom used patient experience data for improvement. Results In every site, staff undertook quality improvement projects using a range of data sources. Teams of health care practitioners and ancillary staff engaged collectively in a process of sense-making using formal and informal sources of patient experience data. While survey data were popular, ‘soft’ intelligence – such as patients’ stories, informal comments and observations – also informed staff’s improvement plans, without always being recognized as data. Teams with staff from different professional backgrounds and grades tended to make more progress than less diverse teams, being able to draw on a wider net of practical, organizational and social resources, support and skills, which we describe as team-based capital. Conclusions Organizational recognition, or rejection, of specific forms of patient experience intelligence as ‘data’ affects whether staff feel the data are actionable. Teams combining a diverse range of staff generated higher levels of ‘team-based capital’ for quality improvement than those adopting a single disciplinary approach. This may be a key mechanism for achieving person-centred improvement in health care.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.