Building a System of Competency-Based Assessment

Young, John Q.

doi:10.1007/978-3-031-00836-8_17

Cited by 1 publication

(13 citation statements)

References 142 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…• data from multiple sources (e.g. multi-source feedback), 15,22,32,36,38,58 including trusted frontline assessors, 15,32,37 ad hoc (e.g. hallway conversations and anecdotal) reports, 21,35 resident self-assessment, 54 and patients and other non-physicians 26,33 ; and…”

Section: Demi-regularity #3: E/ccc Members (C) Must Possess Sufficien...mentioning

confidence: 99%

“…• contextual information about the data, including rotations, assessor, assessor type, case complexity and higher acuity settings 15,21,25,27,30,31,35,53,55,58,59 :…”

Section: Demi-regularity #3: E/ccc Members (C) Must Possess Sufficien...mentioning

confidence: 99%

“…21,25,55,64 While varied worldviews are expected, it is important that E/CCC members hold worldviews that include valuing the collective in their work. 6,21,24,54 3.8.3 | Faculty development specific to entrustment Faculty development can enable E/CCC entrustment decision making, 24,46,49,58,62 beginning with a shared mental model for the concept of entrustment 32,60 or progression, 58 as well as a model for decision making used within the group. 64 If the committee is using EPAs, a common mental model for what development looks like for those EPAs is important.…”

Section: Meeting Frequencymentioning

confidence: 99%

“…PhD), patients, trainees and representatives from other training programmes. 47,49,58,62,66 Administrative support can help facilitate E/CCC decision making. 47 Committees should also include direct supervisors of trainees.…”

Section: Committee Structurementioning

confidence: 99%

“…63 Processes for arriving at consensus should be defined, 22,23,36,[62][63][64] including plans for decision making and conflict resolution between people 22,23,25,64 and data. 25 Multiple papers in the corpus noted the benefit of completing pre-reviews of trainees before E/CCC meetings 51,54,58,62 and being prepared for meetings. 63 Time, energy, space, workload, trainees to review and engagement are important factors during E/CCC work.…”

Section: Review Processesmentioning

confidence: 99%

See 4 more Smart Citations

A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees

Schumacher,

Michelson,

Winn

et al. 2023

Medical Education

View full text Add to dashboard Cite

IntroductionThe real‐world mechanisms underlying prospective entrustment decision making (PEDM) by entrustment or clinical competency committees (E/CCCs) are poorly understood. To advance understanding in this area, the authors conducted a realist synthesis of the published literature to address the following research question: In E/CCC efforts to make defensible prospective entrustment decisions (PEDs), what works, for whom, under what circumstances and why?MethodsRealist work seeks to understand the contexts (C), mechanisms (M) and outcomes (O) that explain how and why things work (or do not). In the authors' study, contexts included individual E/CCC members, E/CCC structures and processes, and training programmes. The outcome (i.e. desired outcome) was a PED. Mechanisms were a substantial focus of the analysis and informed the core findings. To define a final corpus of 52 included papers, the authors searched four databases, screened all results from those searches and performed a full‐text review of a subset of screened papers. Data extraction focused on developing context–mechanism–outcome configurations from the papers, which were used to create a theory for how PEDM leads to PEDs.ResultsPEDM is often driven by default (non‐deliberate) decision making rather than a deliberate process of deciding whether a trainee should be entrusted or not. When defaulting, some E/CCCs find red flags that sometimes lead to being more deliberate with decision making. E/CCCs that seek to be deliberate describe PEDM that can be effortful (when data are insufficient or incongruent) or effortless (when data are robust and tell a congruent story about a trainee). Both information about trainee trustworthiness and the sufficiency of data about trainee performance influence PEDM. Several moderators influence what is considered to be sufficient data, how trustworthiness data are viewed and how PEDM is carried out. These include perceived consequences and associated risks, E/CCC member trust propensity, E/CCC member personal knowledge of and experience with trainees and E/CCC structures and processes.DiscussionPEDM is rarely deliberate but should be. Data about trainee trustworthiness are foundational to making PEDs. Bias, equity and fairness are nearly absent from the papers in this synthesis, and future efforts must seek to advance understanding and practice regarding the roles of bias, equity and fairness in PEDM.

show abstract

Section: Demi-regularity #3: E/ccc Members (C) Must Possess Sufficien...mentioning

confidence: 99%

“…• contextual information about the data, including rotations, assessor, assessor type, case complexity and higher acuity settings 15,21,25,27,30,31,35,53,55,58,59 :…”

Section: Demi-regularity #3: E/ccc Members (C) Must Possess Sufficien...mentioning

confidence: 99%

Section: Meeting Frequencymentioning

confidence: 99%

Section: Committee Structurementioning

confidence: 99%

Section: Review Processesmentioning

confidence: 99%

See 3 more Smart Citations

A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees

Schumacher,

Michelson,

Winn

et al. 2023

Medical Education

View full text Add to dashboard Cite

show abstract

Building a System of Competency-Based Assessment

Cited by 1 publication

References 142 publications

A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees

A realist synthesis of prospective entrustment decision making by entrustment or clinical competency committees

Contact Info

Product

Resources

About