Predicting Performance on the American Board of Surgery Qualifying and Certifying Examinations

Virgilio, Christian de; Yaghoubian, Arezou; Kaji, Amy H.; Collins, J. Craig; Deveney, Karen E.; Dolich, Matthew; Easter, David W.; Hines, Oscar J.; Katz, Steven J.; Liu, Terrence; Mahmoud, Ahmed; Melcher, Marc L.; Parks, Steven N.; Reeves, Mark E.; Salim, Ali; Scherer, Lynette A.; Takanishi, Danny; Waxman, Kenneth

doi:10.1001/archsurg.2010.177

Cited by 167 publications

(110 citation statements)

References 8 publications

(12 reference statements)

Supporting

Mentioning

103

Contrasting

Unclassified

Order By: Relevance

“…Factors such as sex, age at the time of training, and international medical school training have had varied effects on examination performance. [8][9][10][11][12][13] Graduates from larger training programs tended to have better Results controlled for in-training examination score and yearspecific anomalies using a standard fixed-effects model. *Results for first-time test takers certification performance in pediatrics, ophthalmology, and general surgery.…”

Section: Discussionmentioning

confidence: 99%

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Marco

Counselman

Korte

et al. 2014

Academic Emergency Medicine

View full text Add to dashboard Cite

Objectives: The initial step in certification by the American Board of Emergency Medicine (ABEM) requires passing a multiple-choice-question qualifying examination. The qualifying examination is typically taken in the first year after residency training. This study was undertaken to determine if a delay in taking the qualifying examination is associated with poorer performance. The authors also examined the relationship between in-training examination scores and qualifying examination scores.Methods: This was a pooled time-series cross-section study. Primary measurements were initial qualifying examination scores, the timing of the qualifying examination, and in-training examination scores. The three groups, based on qualifying examination timing, were immediate, 1-year delay, and ≥2-year delay. In-training examination scores were analyzed to determine the relationship between intrinsic ability, examination timing, and qualifying examination scores. For analysis, a generic pooled ordinary least-squares dummy variable model with robust standard errors was used. A pre hoc level of significance was determined to be a < 0.01.Results: There were 16,353 qualifying examination test administrations between 2000 and 2012. Intraining examination scores were positively correlated with qualifying examination scores (p < 0.001). The group pass rates were 98.9% immediate, 95.6% 1-year delay, and 86.6% ≥2-year delay. After controlling for in-training examination scores, delay taking the qualifying examination of 1 year was associated with a decrease in score of -0.6 (p = 0.003). A delay in taking the qualifying examination ≥2 years was associated with a decrease in score of -2.5 points (p < 0.001).

show abstract

Section: Discussionmentioning

confidence: 99%

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Marco

Counselman

Korte

et al. 2014

Academic Emergency Medicine

View full text Add to dashboard Cite

show abstract

“…6,[8][9][10][11][12][13][14][15][17][18][19][20][21][22][23][24][25] The results from our study also indicate that predictors such as those ITEs that test knowledge gained over the first two years of anesthesiology training can be used as predictors of passing the ABA Part 1 examination. However, we did not find either the PGY-0 ITE (administered at the beginning of the intern year) or the CB ITE (administered at the beginning of the CA-1/first anesthesiology residency year) to be particularly good predictors of passing the ABA Part 1 examination.…”

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 85%

“…28 Studies in other specialties have also demonstrated that USMLE scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] In 1986, Warrick and Crumrine 32 actually found a negative correlation between the National Board of Medical Examiners (NBME) Part 1 examination, which the USMLE Step 1 examination has replaced, and the ABA-ASA ITE. In that study, higher scores on the NBME Part 1 examination were associated with lower ABA-ASA ITE scores.…”

Section: Table 2 Stepwise Regression Analyses Predictors From Ites Bmentioning

confidence: 99%

“…Studies in other specialties have largely demonstrated that USMLE Step 1 and Step 2 scores were positive predictors of specialty board certification. 4,[6][7][8][9][10][11][12][13][14][15][16][17] However, one study involving ophthalmology residents failed to find a correlation between USMLE Step 1 and the ophthalmology specialty board examination. 18 Quantitative academic assessments of resident performance are typically collected during the course of residency.…”

Section: Introductionmentioning

confidence: 99%

“…Several studies in multiple other medical specialties have shown that annual American Board of Medical Specialties (ABMS) In-Training Examinations (ITEs) are good predictors of performance on the specialty board certification examination. 6,[8][9][10][11][12][13][14][15][17][18][19][20][21][22][23][24][25] ITEs occur yearly during residency training and are typically mandatory except during extenuating circumstances such as illness or a leave of absence. This relationship between ITEs and board certification has been demonstrated in anesthesiology as well.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Predictors of success on the written anesthesiology board certification examination

et al. 2012

View full text Add to dashboard Cite

Objectives: To determine whether information available prior to and during anesthesia residency training can predict American Board of Anesthesiology (ABA) Part 1 (Written) performance and help identify anesthesia residents at risk for failure. Methods: Retrospective analysis of 97 anesthesiology residents' academic files at a single Midwestern residency program. ABA Part 1 score was used as the dependent variable. Categorical demographic predictor variables included gender, under-represented minority status, and type of medical degree. Quantitative academic predictor variables included first-attempt scores on United States Medical Licensing Examination (USMLE) Steps 1 and 2, annual ABA In-Training Exam (ITE) scores, and biannual Basic Science Examination (BSE) scores. Predictors that correlated significantly with the dependent variable were entered into stepwise linear regression analyses. Results:In our analyses, only the USMLE Step 2 score was a significant pre-residency predictor (B=0.169; SE=0.031, p<0.001). Scores on ITEs were significant predictors at every time point. In the final regression model using all available measures during residency, the most recent ITE (B = 0.627; SE=0.090; p<0.001) and BSE (B=0.096; SE = 0.047; p=0.046) scores were significant predictors. The model accounted for 52% of the variance in the outcome variable, with 50% of the variance explained by ITE score alone. The model had a specificity of 0.83 and a sensitivity of 0.82 for predicting passing the ABA Part 1 exam. Conclusions: First-attempt scores on the USMLE Step 2 examination and the CA-2 ITE are moderately strong predictors of anesthesiology board examination performance, and may help target residents who are at risk of failing.

show abstract

Reading Habits of General Surgery Residents and Association With American Board of Surgery In-Training Examination Performance

Kim

Kaji

et al. 2015

JAMA Surg

Self Cite

View full text Add to dashboard Cite

show abstract

Predicting Performance on the American Board of Surgery Qualifying and Certifying Examinations

Cited by 167 publications

References 8 publications

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

Predictors of success on the written anesthesiology board certification examination

Reading Habits of General Surgery Residents and Association With American Board of Surgery In-Training Examination Performance

Contact Info

Product

Resources

About