BackgroundPatient feedback is considered integral to quality improvement and professional development. However, while popular across the educational continuum, evidence to support its efficacy in facilitating positive behaviour change in a postgraduate setting remains unclear. This review therefore aims to explore the evidence that supports, or refutes, the impact of patient feedback on the medical performance of qualified doctors.MethodsElectronic databases PubMed, EMBASE, Medline and PsycINFO were systematically searched for studies assessing the impact of patient feedback on medical performance published in the English language between 2006-2016. Impact was defined as a measured change in behaviour using Barr’s (2000) adaptation of Kirkpatrick’s four level evaluation model. Papers were quality appraised, thematically analysed and synthesised using a narrative approach.ResultsFrom 1,269 initial studies, 20 articles were included (qualitative (n=8); observational (n=6); systematic review (n=3); mixed methodology (n=1); randomised control trial (n=1); and longitudinal (n=1) design). One article identified change at an organisational level (Kirkpatrick level 4); six reported a measured change in behaviour (Kirkpatrick level 3b); 12 identified self-reported change or intention to change (Kirkpatrick level 3a), and one identified knowledge or skill acquisition (Kirkpatrick level 2). No study identified a change at the highest level, an improvement in the health and wellbeing of patients. The main factors found to influence the impact of patient feedback were: specificity; perceived credibility; congruence with physician self-perceptions and performance expectations; presence of facilitation and reflection; and inclusion of narrative comments. The quality of feedback facilitation and local professional cultures also appeared integral to positive behaviour change.ConclusionPatient feedback can have an impact on medical performance. However, actionable change is influenced by several contextual factors and cannot simply be guaranteed. Patient feedback is likely to be more influential if it is specific, collected through credible methods and contains narrative information. Data obtained should be fed back in a way that facilitates reflective discussion and encourages the formulation of actionable behaviour change. A supportive cultural understanding of patient feedback and its intended purpose is also essential for its effective use.Electronic supplementary materialThe online version of this article (10.1186/s12909-018-1277-0) contains supplementary material, which is available to authorized users.

This paper reports on a quasi-experiment in which quantitative methods (QM) are embedded within a substantive sociology module. Through measuring student attitudes before and after the intervention alongside control group comparisons, we illustrate the impact that embedding has on the student experience. Our findings are complex and even contradictory. Whilst the experimental group were less likely to be distrustful of statistics and appreciate how QM inform social research, they were also less confident about their statistical abilities, suggesting that through ‘doing’ quantitative sociology the experimental group are exposed to the intricacies of method and their optimism about their own abilities is challenged. We conclude that embedding QM in a single substantive module is not a ‘magic bullet’ and that a wider programme of content and assessment diversification across the curriculum is preferential.

Introduction:The importance of meaningfully involving patients and the public in digital health innovation is widely acknowledged, but often poorly understood. This review, therefore, sought to explore how patients and the public are involved in digital health innovation and to identify factors that support and inhibit meaningful patient and public involvement (PPI) in digital health innovation, implementation and evaluation.Methods: Searches were undertaken from 2010 to July 2020 in the electronic databases MEDLINE, EMBASE, PsycINFO, CINAHL, Scopus and ACM Digital Library. Grey literature searches were also undertaken using the Patient Experience Library database and Google Scholar.Results: Of the 10,540 articles identified, 433 were included. The majority of included articles were published in the United States, United Kingdom, Canada and Australia, with representation from 42 countries highlighting the international relevance of PPI in digital health. 112 topic areas where PPI had reportedly taken place were identified. Areas most often described included cancer (n = 50), mental health (n = 43), diabetes (n = 26) and long-term conditions (n = 19). Interestingly, over 133 terms were used to describe PPI; few were explicitly defined. Patients were often most involved in the final, passive stages of an innovation journey, for example, usability testing, where the ability to proactively influence change was severely limited. Common barriers to achieving meaningful PPI included data privacy and security concerns, not involving patients early enough and lack of trust.Suggested enablers were often designed to counteract such challenges.

Entry into higher education (HE) is recognised as a challenging time for undergraduates as they negotiate the norms and practices of new academic communities and foster relationships with peers and academics. Given the significance of this time period, our University has piloted a new four-week module that immerses students in their discipline and provides them with the academic skills and networks to support them through this period and beyond. Here we report a comprehensive evaluation examining academic and student experience of this immersive module. We explore its impact on essential aspects of the transition experience e.g. social integration, academic literacies and the sense of preparation for HE. Whilst this new approach did have positive impacts on students' sense of integration, questions were raised around the extent to which it matched or even raised expectations, and the extent to which this prepared students for the rest of their studies.

Evidence for the validity of MSF has, across a number of domains, been well established. However, the size and quality of the existing evidence remains variable. To determine the extent to which MSF is considered a valid instrument to assess medical performance, future research is required to determine the following: (1) how best to design and deliver MSF assessments that address the identified limitations of existing tools and (2) how to ensure that involvement within MSF supports positive changes in practice. Such research is integral if MSF is to continue to inform medical performance and subsequent improvements in the quality and safety of patient care.

ObjectivesTo explore if consumer interest in digital health products (DHPs), changed following the COVID-19 pandemic and the lockdown measures that ensued.DesignRetrospective time-series analysis of web-based internet searches for DHPs in the UK, split over two periods, pre-COVID-19 lockdown (January 2019–23 March 2020) and post-COVID-19 lockdown (24 March 2020–31 December 2020).SettingThe UK.ParticipantsMembers of the UK general population using health-app libraries provided by the Organisation for the Review of Care and Health Applications.Primary and secondary outcome measuresThe primary outcome was volume of searches for DHPs. Secondary outcomes considered search volumes for 25 different therapeutic areas. Outcomes were assessed for significance using a two-stage Poisson test.ResultsThere were 126 640 searches for DHPs over the study period. Searches for DHPs increased by 343% from 2446 per month prior to COVID-19 lockdown measures being introduced to 8996 per month in the period following the first COVID-19 lockdown in the UK. In total, 23/25 (92%) of condition areas experienced a significant increase in searches for DHPs, with the greatest increases occurring in the first 2 months following lockdown. Musculoskeletal conditions (2.036%), allergy (1.253%) and healthy living DHPs (1.051%) experienced the greatest increases in searches compared with pre-lockdown. Increased search volumes for DHPs were sustained in the 9 months following the introduction of lockdown measures, with 21/25 (84%) of condition areas experiencing monthly search volumes at least 50% greater than pre-lockdown levels.ConclusionsThe COVID-19 pandemic has profoundly disrupted the routine delivery of healthcare, making face-to-face interaction difficult, and contributing to unmet clinical needs. This study has demonstrated significant increases in internet searches for DHPs by members of the UK population since COVID-19, signifying an increased interest in this potential therapeutic medium. Future research should clarify whether this increased interest has resulted in increased acceptance and utilisation of these technologies also.

Background Video consultations (VCs) were rapidly implemented in response to COVID-19 despite modest progress before. Objective We aim to explore staff and patient experiences with VCs implemented during COVID-19 and use feedback insights to support quality improvement and service development. Methods Secondary data analysis was conducted on 955 patient and 521 staff responses (from 4234 consultations; 955/4234, 22.6% and 521/4234, 12.3%, respectively) routinely collected following a VC between June and July 2020 in a rural, older adult, and outpatient care setting at a National Health Service Trust. Responses were summarized using descriptive statistics and inductive thematic analysis and presented to Trust stakeholders. Results Most patients (890/955, 93.2%) reported having good (210/955, 22%) or very good (680/955, 71.2%) experience with VCs and felt listened to and understood (904/955, 94.7%). Most patients accessed their VC alone (806/955, 84.4%) except for those aged ≥71 years (23/58, 40%), with ease of joining VCs negatively associated with age (P<.001). Despite more difficulties joining, older adults were most likely to be satisfied with the technology (46/58, 79%). Patients and staff generally felt that patients’ needs had been met (860/955, 90.1% and 453/521, 86.9%, respectively), although staff appeared to overestimate patient dissatisfaction with VC outcomes (P=.02). Patients (848/955, 88.8%) and staff (419/521, 80.5%) felt able to communicate everything they wanted, although patients were significantly more positive than staff (P<.001). Patient satisfaction with communication was positively associated with technical performance satisfaction (P<.001). Most staff members (466/521, 89.4%) reported positive (185/521, 35.5%) or very positive (281/521, 53.9%) experiences with joining and managing VCs. Staff reported reductions in carbon footprint (380/521, 72.9%) and time (373/521, 71.6%). Most patients (880/955, 92.1%) would choose VCs again. We identified three themes in responses: barriers, including technological difficulties, patient information, and suitability concerns; potential benefits, including reduced stress, enhanced accessibility, cost, and time savings; and suggested improvements, including trial calls, turning music off, photo uploads, expanding written character limit, supporting other internet browsers, and shared online screens. This routine feedback, including evidence to suggest that patients were more satisfied than clinicians had anticipated, was presented to relevant Trust stakeholders, allowing for improved processes and supporting the development of a business case to inform the Trust decision on continuing VCs beyond COVID-19 restrictions. Conclusions The findings highlight the importance of regularly reviewing and responding to routine feedback following digital service implementation. The feedback helped the Trust improve the VC service, challenge clinician-held assumptions about patient experience, and inform future use of VCs. It has focused improvement efforts on patient information; technological improvements such as blurred backgrounds and interactive whiteboards; and responding to the needs of patients with dementia, communication or cognitive impairment, or lack of appropriate technology. These findings have implications for other health care providers.

IntroductionDiabetes mellitus (DM) is a leading cause of morbidity and mortality worldwide. At the same time, digital health technologies (DHTs), which include mobile health apps (mHealth) have been rapidly gaining popularity in the self-management of chronic diseases, particularly following the COVID-19 pandemic. However, while a great variety of DM-specific mHealth apps exist on the market, the evidence supporting their clinical effectiveness is still limited.MethodsA systematic review was performed. A systematic search was conducted in a major electronic database to identify randomized controlled trials (RCTs) of mHealth interventions in DM published between June 2010 and June 2020. The studies were categorized by the type of DM and impact of DM-specific mHealth apps on the management of glycated haemoglobin (HbA1c) was analysed.ResultsIn total, 25 studies comprising 3,360 patients were included. The methodological quality of included trials was mixed. Overall, participants diagnosed with T1DM, T2DM and Prediabetes all demonstrated greater improvements in HbA1c as a result of using a DHT compared with those who experienced usual care. The analysis revealed an overall improvement in HbA1c compared with usual care, with a mean difference of –0.56% for T1DM, –0.90% for T2DM and –0.26% for Prediabetes.ConclusionDM-specific mHealth apps may reduce HbA1c levels in patients with T1DM, T2DM and Prediabetes. The review highlights a need for further research on the wider clinical effectiveness of diabetes-specific mHealth specifically within T1DM and Prediabetes. These should include measures which go beyond HbA1c, capturing outcomes including short-term glycemic variability or hypoglycemic events.