Resident Self-Other Assessor Agreement

Abstract

To review the literature on selfassessment in the context of resident performance and to determine the correlation between self-assessment across competencies in high-and low-performing residents and assessments performed by raters from a variety of professional roles (peers, nurses, and faculty).Design: Retrospective analysis of prospectively collected anonymous self-assessment and multiprofessional (360) performance assessments by competency and overall.Setting: University-based academic general surgical program.Participants: Sixty-two residents rotating in general surgery.Main Outcome Measures: Mean difference for each self-assessment dyad (self-peer, self-nurse, and selfattending physician) by resident performance quartile, adjusted for measurement error, correlation coefficients, and summed differences across all competencies.Results: Irrespective of self-other dyad, residents asked to rate their global performance overestimated their skills. Residents in the upper quartile underestimated their specific skills while those in the lowest-performing quartile overestimated their abilities when compared with faculty, peers, and especially nurse raters. Moreover, overestimation was greatest in competencies related to interpersonal skills, communication, teamwork, and professionalism.Conclusions: Rater, level of performance, and the competency being assessed all influence the comparison of the resident's self-assessment and those of other raters. Self-assessment of competencies related to behavior may be inaccurate when compared with raters from various professions. Residents in the lowest-performing quartile are least able to identify their weakness. These data have important implications for residents, program directors, and the public and suggest that strategies that help the lowest-performing residents recognize areas in need of improvement are needed.

Comparison of the medical students’ perceived self-efficacy and the evaluation of the observers and patients

“…The differences were, however, driven by only 2 of 12 items. The results indicate that by using self-efficacy scores, the students do not overestimate their skills, while such was the case in studies in which a self-assessment tool was used in comparison with external scores [24], and in other OSCE scenarios in which the communication of the students was scored by simulated patients [8]. …”

General Surgery Resident Case Logs: Do They Accurately Reflect Resident Experience?

“…[14][15][16][17][18] Factors associated with gender, generation, learning style, and personality may influence the way residents recall their role in a case. [19][20][21][22][23][24] Minter et al 19 demonstrated that female general surgery residents tend to report experiences different from those of their male counterparts during training.…”

Resident Surgeons Underrate Their Laparoscopic Skills and Comfort Level When Compared With the Rating by Attending Surgeons

“…1–4 Accurate identification of technical strengths and deficiencies allows the surgeon to actively work toward improvement and track their progression. To facilitate this improvement, it is important that attending surgeons (attendings) and residents are in agreement regarding resident surgical skills and comfort level.…”