How Do Physicians Assess Their Family Physician Colleagues' Performance? Creating a Rubric to Inform Assessment and Feedback

Abstract

The CPSNS has used the assessment rubric to create an online resource to inform medical colleague assessment and enhance the usefulness of their NSPAR scores. Further research will be required to determine its impact.

Evaluating Nonphysician Staff Members' Self-Perceived Ability to Provide Multisource Evaluations of Residents

“…Physicians use multiple sources of information, such as patient medical records, direct contact, patient feedback, and written or verbal communication to assess their colleagues. 15 Nonphysician staff members have less access to these multiple sources of information, and therefore must base their assessments on direct observations and interactions. This lack of external sources of information heightens the importance of focusing multisource questions on resident behaviors that can be directly observed by staff members.…”

“…[17][18][19][20][21] Raters must understand their role in multisource feedback and the goals of the behavior they are evaluating. 7,15,22 Think-aloud interviews by Mazor et al 19 revealed that raters frequently base their evaluations on general impressions rather than directly observed behaviors, and they had different interpretations of the desired behaviors they were rating. 15,23 Although training has been shown to improve faculty ability to give feedback, nonphysician staff members who participate in multisource feedback rarely receive comparable training.…”

“…7,15,22 Think-aloud interviews by Mazor et al 19 revealed that raters frequently base their evaluations on general impressions rather than directly observed behaviors, and they had different interpretations of the desired behaviors they were rating. 15,23 Although training has been shown to improve faculty ability to give feedback, nonphysician staff members who participate in multisource feedback rarely receive comparable training. 24 Our findings add to the knowledge about competencies that nonphysician staff members feel competent and comfortable in evaluating.…”

Is the Research on Continuing Education of Health Professionals Underutilized?

“…Consider this fairly typical issue of JCEHP. In it, you will find a randomized controlled trial of an intervention, 2 a focus group study exploring how physicians evaluate their peers, 3 a position paper by a professional association identifying principles for physician reentry programs, 4 and another that weaves theory and research into an argument that CME professionals should be trained to facilitate interaction between health care practitioners as a means of facilitating practice improvement. 5 Some of these articles were labeled "Original Research" when decisions were made about what section of JCEHP they would appear in, but I will freely admit these choices inevitably require some editorial judgment calls.…”

Multisource Feedback: Can It Meet Criteria for Good Assessment?

“…The studies have examined changes that physicians made or intended to make in their practices and the focus of changes made that related to PAR feedback. 2,6,13,[17][18][19][20][21][22][23][24] It is also clear from the extensive focus groups and interviews conducted in Nova Scotia that use of the data to make changes was influenced by the perceived credibility of data, fairness of process, specificity of the data to inform the physician about what to do to improve scores, the characteristics of feedback (positive or negative), initial reactions to the feedback, the perceived need for change, beliefs about change, and ability to effect change (self-efficacy). [18][19][20][21][22][23] Physician improvement in scores over a 5-year period has also been examined for physicians who repeated the assessment.…”