The hidden curriculum and limitations of situational judgement tests for selection

Wang, Xuyi Mimi; Leung, Vincent

doi:10.1111/medu.14264

Cited by 2 publications

(2 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Overall, the AUC values of ≤ 0.5, 0.6 -0.7, 0.7 -0.8, 0.8 -0.9, and 0.9 -1 indicated no, poor, acceptable, excellent, and outstanding accuracy in selecting candidates, respectively (21). Ethical approval for this study was obtained from the OMSB Institutional Research and Ethics Committee.…”

Section: Methodsmentioning

confidence: 99%

Performance Prediction of the Family Medicine Applicants of Oman Medical Specialty Board in Multiple Mini-interviews Using the International Foundations of Medicine Exam and Situational Judgment Test

Hadhrami

Jaafar²,

Farsi³

et al. 2022

J Med Edu

View full text Add to dashboard Cite

Background: Entry into postgraduate medical training programs should be based on valid selection measures predictive of training performance. A situational judgment test (SJT) is often used during the residency selection process to measure knowledge and behavioral attributes. Objectives: This study aimed to test the validity of the International Foundations of Medicine (IFOM) examination and an SJT for predicting performance during multiple mini-interviews (MMI) of the applicants for a family medicine residency program in Oman. Methods: This retrospective cross-sectional study was conducted at Oman Medical Specialty Board (OMSB) during the application process for the academic year 2021. Data were collected from 80 applicants to the OMSB Family Medicine Residency Program. Before participating in the MMI panels, all applicants underwent pre-interview tests (comprising the IFOM examination and SJT). Multiple regression analysis was performed to determine the predictors of the MMI score. Results: A total of 67 applicants completed the entire selection process cycle and were included in the study. The SJT score was a significant predictor of the MMI score (r = 0.367; P = 0.002), whereas the IFOM score was not a significant predictor (r = 0.105; P = 0.396). Conclusions: This study supports using SJT as an additional selection measure alongside the MMI panel for entry to OMSB residency training.

show abstract

Section: Methodsmentioning

confidence: 99%

Performance Prediction of the Family Medicine Applicants of Oman Medical Specialty Board in Multiple Mini-interviews Using the International Foundations of Medicine Exam and Situational Judgment Test

Hadhrami

Jaafar²,

Farsi³

et al. 2022

J Med Edu

View full text Add to dashboard Cite

show abstract

“…45,46 Further disconnect may occur with the loss of nuance inherent to condensing complex dilemmas into scenarios with "best" and "worst" response options. 47 Finally, SJTs can shed light on expected behaviors, but they do not necessarily promote professional identity formation in and of themselves; as a result, high scores on an SJT do not necessarily mean that underlying values and beliefs have been internalized.…”

Section: Disadvantages Limitations and Other Considerationsmentioning

confidence: 99%

Situational judgment tests: An introduction for clinician educators

Reed

Smith

Robinson

et al. 2021

J Am Coll Clin Pharm

View full text Add to dashboard Cite

Although numerous tools exist to assess the clinical knowledge and skills of learners as they progress throughout the health professions curriculum, the measurement of professional attitudes, and behaviors (eg, empathy, integrity, teamwork) remains a challenge for educators. Situational judgment tests (SJTs) are a methodology for assessing how an individual's underlying knowledge, skills, traits, and other attributes are expressed when making decisions about job-related scenarios. Studies have shown that SJTs can be a valuable predictor of future job performance among health professionals and recent research suggests that they may also be useful for the development of professional attitudes and behaviors. The primary advantage of SJTs is that they permit an assessment of these complex constructs among large groups of test-takers, making them an appealing alternative or supplement to more resourceintensive methods, such as situational interviews or objective structured clinical examinations. However, SJT development is a complex process and requires a set of knowledge and skills that may be unfamiliar to many clinician educators (eg, job analysis, assessments of validity, and reliability). The purpose of this review is to provide readers with an introduction to SJTs, including an overview of research to support their use, considerations regarding their content and development, and implications for practice and education.

show abstract

The hidden curriculum and limitations of situational judgement tests for selection

Abstract: If situational judgment tests define who enters the health professions, we must be cautious and transparent in their use to avoid unintentional creation of a detrimental hidden curriculum.

Cited by 2 publications

References 24 publications

Performance Prediction of the Family Medicine Applicants of Oman Medical Specialty Board in Multiple Mini-interviews Using the International Foundations of Medicine Exam and Situational Judgment Test

Performance Prediction of the Family Medicine Applicants of Oman Medical Specialty Board in Multiple Mini-interviews Using the International Foundations of Medicine Exam and Situational Judgment Test

Situational judgment tests: An introduction for clinician educators

Contact Info

Product

Resources

About