Assessment of emergency medicine residents: a systematic review

Abstract

Background: Competency-based medical education is becoming the new standard for residency programs, including Emergency Medicine (EM). To inform programmatic restructuring, guide resources and identify gaps in publication, we reviewed the published literature on types and frequency of resident assessment.Methods: We searched MEDLINE, EMBASE, PsycInfo and ERIC from Jan 2005 - June 2014. MeSH terms included “assessment,” “residency,” and “emergency medicine.” We included studies on EM residents reporting either of two primary outcomes: 1) assessment type and 2) assessment frequency per resident. Two reviewers screened abstracts, reviewed full text studies, and abstracted data. Reporting of assessment-related costs was a secondary outcome.Results: The search returned 879 articles; 137 articles were full-text reviewed; 73 met inclusion criteria. Half of the studies (54.8%) were pilot projects and one-quarter (26.0%) described fully implemented assessment tools/programs. Assessment tools (n=111) comprised 12 categories, most commonly: simulation-based assessments (28.8%), written exams (28.8%), and direct observation (26.0%). Median assessment frequency (n=39 studies) was twice per month/rotation (range: daily to once in residency). No studies thoroughly reported costs.Conclusion: EM resident assessment commonly uses simulation or direct observation, done once-per-rotation. Implemented assessment systems and assessment-associated costs are poorly reported. Moving forward, routine publication will facilitate transitioning to competency-based medical education.

Clinical Improvement Interventions for Residents and Practicing Physicians: A Scoping Review of Coaching and Mentoring for Practice Improvement

“…When the current state of the literature on coaching and mentoring is considered, most published studies report satisfaction‐based outcomes. There is a great opportunity for emergency medicine to enter into this field, since our field is one which allows for direct observation and assessment quite readily (at least in the GME setting) . Future work must go beyond descriptive studies and move to designs that evaluate the acquisition of a skill set.…”

Emergency medicine residency programs: the changing face of graduate medical education

“…Competency-based medical education became the new standard for all residency programs. 9 - 11 Programs moved away from classic didactic lectures to include more self-directed learning opportunities with experiential learning aids in the development of critical, cognitive and scholarly skills. 1 , 8 , 12 In addition, EM has quickly and efficiently implemented the use of social media and online resources, e.g., Twitter, Facebook, blogs, podcasts, live sessions etc.…”

Clinical Cadavers as a Simulation Resource for Procedural Learning

“…Simulation is taking on a rapidly growing role that is predicted to increase significantly with the implementation of competency‐based medical education (CBME) . The translational evidence supporting simulation for procedural learning is certainly not overwhelmingly positive; however, its role is indisputable where traditional experiences are either inadequate or unavailable .…”