An Objective Structured Clinical Examination to Assess Pharmacy Resident Performance

Abstract

Objective: The objective was to utilize an Objective Structured Clinical Examination (OSCE) for assessment of pharmacy residents.
 Innovation: Post-graduate year 1 (PGY1) and post-graduate year 2 (PGY2) pharmacy residents completing multiple, local residency programs were invited to participate in an OSCE. A total of eight PGY1 residents and one PGY2 resident completed the OSCE. American Society of Health-System Pharmacists (ASHP) residency program goals were aligned for each case, which were originally developed for a fourth-year pharmacy student OSCE. Station design included outpatient and inpatient settings with patient and physician interactions. Median communication and clinical skills scores were evaluated.
 Critical Analysis: The OSCE allows for assessment of all residents on common scenarios. Pharmacy residents met competency requirements and demonstrated excellent communication skills. The OSCE was able to evaluate both physician-pharmacist communication and patient-pharmacist communication. Baseline performance related to the ASHP goals and objectives was not completed; however, the OSCE could highlight resident strengths and weaknesses in communication and clinical skills. The OSCE could simulate independent practice, may reduce bias, and could provide an evaluation of the resident by a patient. However, the OSCE incurs higher resource utilization, specifically monetary and time, than other assessment methods.
 Next Steps: The pilot study results provide a beginning for further study of OSCEs for pharmacy residents. Further study should include surveying the residency directors about use of the OSCE, a comparison of performance between the OSCE and preceptor evaluations of residents on ASHP goals and objectives, and an evaluation of OSCE implementation at different time points within the residency.
 Conflict of Interest
 We declare no conflicts of interest or financial interests that the authors or members of their immediate families have in any product or service discussed in the manuscript, including grants (pending or received), employment, gifts, stock holdings or options, honoraria, consultancies, expert testimony, patents and royalties
 
 Type: Note

Competency Assessment Tool and Faculty Assessors for Competency-based Pharmacy Education: A Preliminary Study of Its Applications and Advantages

“…This study identified the usefulness and limitations of applying a competency assessment tool and faculty assessors in the development of CBE. The study results showed that the competency assessment tool can identify the students' level of competency and allows assessors to identify the strengths and weaknesses of students' competencies, 6,[13][14] and develop instructional materials based on the assessment scores to improve the students' graduation competencies. In the test, students demonstrated excellent competency in the field of collecting patient information and providing drug information while maintaining eye contact; however, they showed poor competency in the field of identifying errors, solving problems, and providing effective regimens.…”

“…[8][9][10][11] Among the assessment tools, Harden's objective structured clinical assessment (OSCE) was known as the gold standard for competency assessment in Europe and North America in the late 20th century. [12][13][14] It included a combination of standardized virtual patients and multi-station examination, and this combination made the OSCE a reliable and useful assessment tool. 8) As a result, OSCE has become widely used in North American medical schools; hence, it is easy for faculty members to set competency goals, design a curriculum, and assess the competency, and the students have become familiar with the OSCE performance.…”

A Simulation-Based Workshop to Improve Dermatologists’ Communication Skills: A Pilot for Continuing Medical Education

“…This OSCE format could also be utilized for competency assessment for trainee coaching and assessment [ 28 ]. This curriculum may also be expanded to address additional continuing medical educational needs such as interprofessional communication skills, including giving and receiving feedback.…”