Predicting American Board of Emergency Medicine Qualifying Examination Passage Using United States Medical Licensing Examination Step Scores

Caffery, Terrell; Fredette, Jenna; Musso, Mandi W.; Jones, Glenn N.

doi:10.31486/toj.17.0101

Cited by 10 publications

(11 citation statements)

References 10 publications

(9 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We received one unpublished manuscript 23 and one in press (now published) manuscript 22 from these queries. In total, we included 15 published articles, [8][9][10][11][12][13][14][15][16][17][18][19][20][21][22] one unpublished manuscript, 23 and 11 abstracts [24][25][26][27][28][29][30][31][32][33][34] (Figure 1).…”

Section: Resultsmentioning

confidence: 99%

“…The authors of these studies defined success by the following: in-training examination (ITE) performance, 13,18,19,25,[27][28][29][30]34 passage of the American Board of Emergency Medicine (ABEM) Qualifying Examination (QE) 11,22,29 or American Osteopathic Board of Emergency Medicine (AOEBM) written examination 14,31 average ACGME core competencybased Likert-scale faculty evaluation scores, 8,10,21,26 or a graduation rank order list (GROL). 12,15,16,19,20,23,27,32,33 A GROL is a ranked list of graduates, as determined by a vote of faculty or program leaders, upon or after graduation, made specifically for the purposes of the study.…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Which Applicant Factors Predict Success in Emergency Medicine Training Programs? A Scoping Review

Yang

Saadat

Murphy

et al. 2020

AEM Education and Training

View full text Add to dashboard Cite

Background: Program directors (PDs) in emergency medicine (EM) receive an abundance of applications for very few residency training spots. It is unclear which selection strategies will yield the most successful residents. Many authors have attempted to determine which items in an applicant's file predict future performance in EM. Objectives:The purpose of this scoping review is to examine the breadth of evidence related to the predictive value of selection factors for performance in EM residency. Methods:The authors systematically searched four databases and websites for peer-reviewed and gray literature related to EM admissions published between 1992 and February 2019. Two reviewers screened titles and abstracts for articles that met the inclusion criteria, according to the scoping review study protocol. The authors included studies if they specifically examined selection factors and whether those factors predicted performance in EM residency training in the United States.Results: After screening 23,243 records, the authors selected 60 for full review. From these, the authors selected 15 published manuscripts, one unpublished manuscript, and 11 abstracts for inclusion in the review. These studies examined the United States Medical Licensing Examination (USMLE), Standardized Letters of Evaluation, Medical Student Performance Evaluation, medical school attended, clerkship grades, membership in honor societies, and other less common factors and their association with future EM residency training performance. Conclusions:The USMLE was the most common factor studied. It unreliably predicts clinical performance, but more reliably predicts performance on licensing examinations. All other factors were less commonly studied and, similar to the USMLE, yielded mixed results.S electing residents for a graduate medical education (GME) training program is a difficult task. The average emergency medicine (EM) program receives 940 applications for 11 first postgraduate year (PGY-1) positions. 1 Programs typically rank 12.8 applicants per PGY-1 position, 1,2 investing considerable time and resources in the screening, reviewing, and interviewing of medical student applicants.When deciding where an applicant should fall on a program's rank list, a program director (PD) may consider many factors in their decision, such as clerkship grades, United States Medical Licensing Examination

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Which Applicant Factors Predict Success in Emergency Medicine Training Programs? A Scoping Review

Yang

Saadat

Murphy

et al. 2020

AEM Education and Training

View full text Add to dashboard Cite

show abstract

“…While not part of our primary objective, we found that while Grit‐S scores did not correlate with the need for remediation, the need for remediation did predict success on the ITE, which would be expected as many residents undergo remediation for low ITE scores. Additionally, USMLE Step 2 CK (Clinical Knowledge) scores have been shown to predict passage of the ABEM Qualifying Examination on the first attempt . We did not collect data regarding residents’ USMLE scores in this study so it is possible that there may have been a correlation between grit and Step 2 CK scores that was not assessed in this study.…”

Section: Discussionmentioning

confidence: 97%

The Correlation Between Emergency Medicine Residents’ Grit and Achievement

Olson

Williamson

Hartman

et al. 2019

AEM Education and Training

View full text Add to dashboard Cite

Background: Early identification of emergency medicine (EM) residents who struggle with educational attainment is difficult. In-training examination (ITE) scores predict success on the American Board of Emergency Medicine (ABEM) Qualifying Examination; however, results are not available until late in the academic year. The noncognitive trait "grit," defined as "perseverance and passion for long-term goals," predicts achievement in high school graduation rates, undergraduate GPA, and gross anatomy. Grit-S is a validated eight-question scale scored 1 to 5; the average of responses represents a person's grit. Our objective was to determine the correlation between EM resident Grit-S scores and achievement, as measured by MCAT percentiles, ITE scores, and remediation rates. Study Design and Methods:This was a 1-year prospective, multicenter trial involving ten EM residencies from 2017 to 2018. Subjects were PGY-1 to -4 EM residents. Grit-S scores, MCAT percentile, remediation rates, ITE scores, and the ITE score's prediction of passing the ABEM Qualifying Examination were collected. Correlation coefficients were computed to assess the relationship between residents' grit and achievement.Results: A total 385 of 434 (88.7%) residents participated who completed the Grit-S as part of a larger study.The mean Grit-S score was 3.62. Grit positively correlated with the predicted likelihood of passing the ABEM Qualifying Examination (r = 0.134, n = 382, p = 0.025). There was no correlation between grit and remediation (r = À0.04, n = 378, p = 0.46) or grit and MCAT percentiles (r =À 0.08, n = 262, p = 0.22). Conclusions:The positive correlation between Grit-S scores and percent likelihood of passing the ABEM Qualifying Examination demonstrates grit's potential to assist residency leadership in early identification of residents who may attain a lower ITE score.

show abstract

“…The medical education community recognizes that performance on USMLE Step 1 evaluates medical knowledge and predicts performance on other standardized tests, such as in-training and certification examinations. [5][6][7][8][9][10] However, there are few data to suggest that USMLE Step 1 and 2 scores predict performance across other critical competency domains, such as patient care, communication, and professionalism. [11][12][13][14] The Association of American Medical Colleges, American Medical Association, Educational Commission for Foreign Medical Graduates, Federation of State Medical Boards, and National Board of Medical Examiners convened a multistakeholder Invitational Conference on USMLE Scoring (InCUS) in March 2019 to address issues concerning USMLE score reporting, primary and secondary uses, and the transition from undergraduate medical education to graduate medical education (GME).…”

Section: Introductionmentioning

confidence: 99%

Are USMLE Scores Valid Measures for Chief Resident Selection?

Cohen

Goldstein

Schroedl

et al. 2020

Journal of Graduate Medical Education

View full text Add to dashboard Cite

Background The US Medical Licensing Examination (USMLE) Step 1 and Step 2 scores are often used to inform a variety of secondary medical career decisions, such as residency selection, despite the lack of validity evidence supporting their use in these contexts. Objective We compared USMLE scores between non–chief residents (non-CRs) and chief residents (CRs), selected based on performance during training, at a US academic medical center that sponsors a variety of graduate medical education programs. Methods This was a retrospective cohort study of residents' USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores from 2015 to 2019. The authors used archived data to compare USMLE Step 1 and Step 2 CK scores between non-CR residents in each of the eligible programs and their CRs during the 5-year study period. Results Sixteen programs enrolled a total of 1264 non-CRs and 210 CRs over the study period. There were no significant differences overall between non-CRs' and CRs' average USMLE Step 1 (239.95 ± 14.40 versus 241.50 ± 14.29; P = .15) or Step 2 (250.51 ± 14.02 versus 251.67 ± 14.82; P = .28) scores. Conclusions There was no link between USMLE Step 1 and Step 2 CK scores and CR selection across multiple clinical specialties over a 5-year period. Reliance on USMLE Step 1 and 2 scores to predict success in residency as measured by CR selection is not recommended.

show abstract

Predicting American Board of Emergency Medicine Qualifying Examination Passage Using United States Medical Licensing Examination Step Scores

Cited by 10 publications

References 10 publications

Which Applicant Factors Predict Success in Emergency Medicine Training Programs? A Scoping Review

Which Applicant Factors Predict Success in Emergency Medicine Training Programs? A Scoping Review

The Correlation Between Emergency Medicine Residents’ Grit and Achievement

Are USMLE Scores Valid Measures for Chief Resident Selection?

Contact Info

Product

Resources

About