Development and Validation of a Trustworthy Multisource Feedback Instrument to Support Nurse Appraisals

Crossley, James

doi:10.1002/chp.21273

Cited by 6 publications

(6 citation statements)

References 13 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Multisource feedback (MSF) is widely used as a quality improvement strategy in healthcare, based on the assumption that performance feedback from more than one source, such as self, colleagues or patients would prompt healthcare professionals to modify their clinical practice [1][2][3][4][5]. Leading medical regulators, including Medical Councils in the UK and Australia, and College professional bodies have incorporated MSF into the performance review cycle for doctors [5].…”

Section: Introductionmentioning

confidence: 99%

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students

et al. 2020

View full text Add to dashboard Cite

Background: The use of feedback has been integral to medical student learning, but rigorous evidence to evaluate its education effect is limited, especially in the role of patient feedback in clinical teaching and practice improvement. The aim of the Patient Teaching Associate (PTA) Feedback Study was to evaluate whether additional written consumer feedback on patient satisfaction improved consultation skills among medical students and whether multisource feedback (MSF) improved student performance. Methods: In this single site, double-blinded randomised controlled trial, 71 eligible medical students from two universities in their first clinical year were allocated to intervention or control and followed up for one semester. They participated in five simulated student-led consultations in a teaching clinic with patient volunteers living with chronic illness. Students in the intervention group received additional written feedback on patient satisfaction combined with guided self-reflection. The control group received usual immediate formative multisource feedback from tutors, patients and peers. Student characteristics, baseline patient-rated satisfaction scores and tutor-rated consultation skills were measured. Results: Follow-up assessments were complete in 70 students attending the MSF program. At the final consultation episodes, both groups improved patient-rated rapport (P = 0.002), tutor-rated patient-centeredness and tutor-rated overall consultation skills (P = 0.01). The intervention group showed significantly better tutor-rated patientcenteredness (P = 0.003) comparing with the control group. Distress relief, communication comfort, rapport reported by patients and tutor-rated clinical skills did not differ significantly between the two groups. Conclusions: The innovative multisource feedback program effectively improved consultation skills in medical students. Structured written consumer feedback combined with guided student reflection further improved patientcentred practice and effectively enhanced the benefit of an MSF model. This strategy might provide a valuable adjunct to communication skills education for medical students.

show abstract

Section: Introductionmentioning

confidence: 99%

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students

et al. 2020

View full text Add to dashboard Cite

show abstract

“…This can lead to instances where the reliability coefficient is spuriously inflated (De Champlain et al 2016). Other studies correctly employed generalizability theory as a broader framework to not only assess the reliability of MSF ratings but also to quantify the impact of various sources of measurement error (Wright et al 2012;Archer et al 2005;Campbell et al 2008Campbell et al ,2010Crossley 2015;Garra et al 2011;Moonen-van Loon et al 2015;Violato et al 2008). Largely, these studies suggest that 8-14 raters and about 25 patients should be used in any MSF assessment to meet an "acceptable" (e.g.…”

Section: Psychometric Evidencementioning

confidence: 99%

A review of multi-source feedback focusing on psychometrics, pitfalls and some possible solutions

2021

View full text Add to dashboard Cite

With the re-emergence of competency-based frameworks in professional education, multisource feedback (MSF) has become a common method for assessing various competencies, including communication, professionalism, and aspects of teambased performance. A wide variety of publications over the past 50 years or more in the business and health literature would seem to support the use of MSF at least for quality improvement (QI) purposes. However, our own experience with using MSF in physicians has been quite mixed, with some physicians embracing the experience and making improvements and others the complete opposite. We decided to review the existing literature on MSF to try to identify key aspects of successful MSF programs. This paper presents a structured critique of the literature on the use of MSF in physician populations. The findings were surprising as key assumptions around the validity and reliability of MSF were not consistently met, key lessons from earlier research were not carried over to present day programs and perhaps most concerning was a lack of evidence for MSF producing meaningful sustained behavior change. From these findings we suggest some key areas of potential improvement in MSF programs.

show abstract

“…The data demonstrate that providing an appropriate environment for the evaluative interview, with satisfactory air conditioning and access only to those involved, would be paramount to carry out the evaluations. In a contemporary perspective of evaluation, its concept and application are inserted in complex and dynamic circumstances that permeate the nurses' routine, highlighting the role of the evaluator and the evaluated, the methods used, the expected results, the proposed objectives and the feedbacks to be provided (14) . Therefore, conducting the evaluative interview in a suitable place demonstrates consideration to the collaborator.…”

Section: It Is Usually the Nurses On Duty Who Do The Assessment And Smentioning

confidence: 99%

“…Encouraging meetings that deal with evaluation with all those involved in the process is essential to achieve the objectives of the assessment. Therefore, discussing the assessment helps the parties involved align organizational and personal goals and explore the strengths and weaknesses of each employee's and team's performance, thereby developing important skills in the professional practice (14) .…”

Section: We Do Not Hold Meetings or Conversation Circles Specificallymentioning

confidence: 99%

Gestão por competências: preparo do processo avaliativo pelos enfermeiros de uma unidade de internação

Foppa

Dall'Agnol

Medeiros

2018

Rev. Gaúcha Enferm.

View full text Add to dashboard Cite

Resumo OBJETIVO Compreender como ocorre o preparo do processo avaliativo dos técnicos e auxiliares de enfermagem pelos enfermeiros de uma unidade de internação clínica adulto, na perspectiva da gestão por competências. MÉTODO Estudo descritivo, qualitativo, desenvolvido com 13 enfermeiros de um hospital universitário. Os dados coletados entre maio e junho de 2017, por meio de entrevistas semiestruturadas, foram submetidos à análise de conteúdo temática. RESULTADOS Emergiram duas categorias: gestão por competências, um novo modelo de avaliação; e, processo avaliativo, uma trajetória a ser discutida. CONCLUSÃO O planejamento da avaliação ao longo do ano por meio de reuniões periódicas sobre a temática é importante para o preparo do processo avaliativo. Além disso, o conhecimento prévio dos percalços avaliativos subsidia o enfermeiro na organização da avaliação.

show abstract

Development and Validation of a Trustworthy Multisource Feedback Instrument to Support Nurse Appraisals

Abstract: This is the first contemporary psychometric evaluation of an MSF instrument for nurses. MSF appears to be as valid and reliable as an assessment method to inform appraisal in nurses as it is in other health professional groups.

Cited by 6 publications

References 13 publications

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students

A review of multi-source feedback focusing on psychometrics, pitfalls and some possible solutions

Gestão por competências: preparo do processo avaliativo pelos enfermeiros de uma unidade de internação

Contact Info

Product

Resources

About