A time-efficient web-based teaching tool to improve medical knowledge and decrease ABIM failure rate in select residents

Drake, Sean; Qureshi, Waqas; Morse, W. I.; Baker-Genaw, Kimberly

doi:10.3402/meo.v20.29221

Cited by 11 publications

(12 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some of the remediation plans include enrolling in board review courses, attending conferences, or self-study courses, however, their efficacy in helping residents pass the ABIM-CE is unclear [29]. Although there are reports of improved ABIM-CE results with a directed reading program and individual education plan, although literature regarding the efficacy of these strategies is limited [30,31]. At our program, we identified residents with scores < 35 percentile in the PGY3 ITE exam, and encouraged them to enroll in board review courses or use one of the available Question bank's which yielded a 100% ABIM-CE pass rate over the past few couple of years.…”

Section: Usmle Scores (Mean (Sd))mentioning

confidence: 99%

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

et al. 2020

View full text Add to dashboard Cite

Background: To evaluate if United States Medical Licensing Examination (USMLE) Step 1, USMLE Step 2 CK, USMLE Step 3, and residency third-year in-service training exam (ITE) scores predict the results of American Board of Internal Medicine Certifying Exam (ABIM-CE). Methods: We performed a retrospective review of USMLE Step 1, USMLE Step 2 CK, USMLE Step 3, third-year residency ITE scores and ABIM-CE results of IM residents at our residency program from 2004 through 2017. Statistical analysis was perfrormed using Pearson correlation coefficient, and logistic regression to assess the relationship between USMLE Step 1, USMLE Step 2CK, USMLE Step 3, 3rd year ITE scores and ABIM-CE results. We used Multivariate logistic regression to predict pass or fail results in ABIM-CE based on USMLE and third-year ITE test scores controlling for other covariates.Results: Among 114 Internal Medicine MD residents included in the study, 92% (n = 105) passed the ABIM-CE. The OR of passing ABIM-CE was 2.70 (95% CI = 1.38-5.29), 2.31 (95% CI = 1.33-4.01), and 1.63 (95% CI = 0.81-3.29) with a ten-point increase in USMLE Step 1, USMLE Step 2 CK and USMLE Step 3 scores respectively. The OR of ABIM-CE passing chance was 2.96 (95% CI = 0.95-9.20), with a ten-point increase in the average score of the above three exams. A 5 % increase in ITE percentage raised the likelihood of passing ABIM-CE (OR 2.92, 95% CI 1.15-7.38). All residents who failed ABIM-CE had Step 1 scores < 220. Among 31 residents with Step 2 CK score < 220, 20% (n = 6) failed ABIM. Similarly, 9% of residents with USMLE Step 3 score < 220 failed ABIM-CE; all residents who failed had scored < 220. The probability curve predicted that the chance of passing ABIM-CE was around 80% with USMLE scores greater than 200 and increased to almost 100% with USMLE scores of 250 or more. Conclusion: USMLE Step 1, USMLE Step 2 CK, and third-year ITE scores can predict the chances of passing ABIM-CE. The third-year ITE score has a higher preditive value compared to USMLE Step 1 and USMLE Step 2 scores. USMLE Step 1 scores more predictive of ABIM-CE results compared to USMLE Step 2CK scores. Thus, residency programs can identify internal medicine residents at risk of failing ABIM-CE and formulate interventions at an early stage during residency training. Measures such as enrolling them in question banks or board review courses can be helpful in improving their chances of passing ABIM-CE. Keywords: USMLE Step 1, USMLE Step 2CK, USMLE Step 3, 3rd year in-training exam results, American board of internal medicine certifying exam (ABIM-CE)

show abstract

Section: Usmle Scores (Mean (Sd))mentioning

confidence: 99%

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

et al. 2020

View full text Add to dashboard Cite

show abstract

“…As previously mentioned, residency programs in various specialties have developed a range of curricular interventions to improve the ITE scores as means of achieving a higher first-time board examination pass rate [ web-based directed reading program with an aim to increase medical knowledge and reduce ABIM exam failure rate [23]. Their strategy involved identifying incorrectly answered ITE educational objectives and encouraging residents to type a 'reflection' representing their understanding of the educational objective.…”

Section: Discussionmentioning

confidence: 99%

“…Several studies have identified specific cutoffs for ITE percentile ranking as predictors of successful first-time ABIM certification exam pass [8][9][10][11]. Accordingly, residency programs in various specialties have developed a range of curricular interventions, including frequent faculty meetings, instilling educational conferences, developing individualized study plans, and providing online cases, practice questions, group learning scenarios, and customized web-based teaching tools, to improve the ITE scores as means of achieving a higher first-time board examination pass rate [12][13][14][15][16][17][18][19][20][21][22][23].…”

Section: Introductionmentioning

confidence: 99%

Design and implementation of an academic enrichment program to improve performance on the internal medicine in-training exam

Dokmak

Radwan

Halpin

et al. 2019

Medical Education Online

View full text Add to dashboard Cite

The internal medicine In-Training Exam (ITE) is administered at residency training programs to assess medical knowledge. Our internal medicine residency program witnessed a performance decline on the ITE between 2011 and 2014. The goal of this quality improvement project was to improve medical knowledge among residents as measured by an improvement in performance on the ITE, through the design and implementation of an Academic Enrichment Program (AEP). The AEP was designed in 2014-2015, and entailed a multipronged approach, including strengthening and tailoring of the didactic curriculum, establishment of a minimum conference attendance rate, and adoption of the New England Journal of Medicine Knowledge-Plus Internal Medicine Board Review platform. Residents performing below a prespecified percentile rank cutoff on the previous year's ITE in any of the 12 content areas were required to complete a pre-specified percentage of the question bank in that specific topic. We examined a total of 164 residents enrolled in our program under the categorical training track. The mean (± SEM) ITE percentile for the 12 content areas increased significantly from calendar years 2011-2014 to 2015-2018, reflecting implementation of the AEP (p < 0.001). In brief, compared to the AEP-unexposed graduating classes of residents, the AEP-exposed graduating classes of residents displayed a significant improvement in the mean ITE percentile rank. This quality improvement project was carried out at a single institution. The implementation of a structured academic enrichment program significantly improves performance on the ITE.

show abstract

“…The exact nature and efficacy of remediation plans, including board review courses, conferences or self-study courses, in helping the resident pass the ABIM-CE are unclear [30]. Although there have been reports of improved ABIM-CE results with a directed reading program and individual education plan for residents, literature regarding the efficacy of these strategies is limited [31,32]. Furthermore, there are many other unexplained factors determining whether a resident passes an ABIM-CE.…”

Section: Discussionmentioning

confidence: 99%

Do USMLE Steps and ITE Results Predict Performance in the American Board of Internal Medicine Certifying Exam?

Rayamajhi

Dhakal

Manoj

et al. 2019

Preprint

View full text Add to dashboard Cite

Objective To evaluate if United States Medical Licensing Examination (USMLE) Step 1, USMLE Step 2, USMLE Step 3, and residency third-year in-service training exam (ITE) results predict performance of Internal Medicine (IM) residents in American Board of Internal Medicine Certifying Exam (ABIM-CE). Methods A retrospective review of USMLE Step 1, USMLE Step 2, USMLE Step 3 scores, residency third year ITE and ABIM-CE of IM residents at Michigan State University from 2004 through 2017 was conducted. Pearson correlation coefficient and two sample t-tests were used to assess the relationship between various scores and pass or fail results in ABIM-CE. Results Among 114 MD residents included in the study; 92% (n=105) passed the ABIM-CE. There was a significant correlation of passing ABIM-CE with USMLE Step 1 (OR 1.042; 95% CI 1.004- 1.082), Step 2 (OR 1.043; 95% CI 1.004-1.085) and Step 3 (OR 1.046; 95% CI 1.004- 1.089) independently, with the combined odds of all USMLE exams being 1.044 (p=0.031). Increase in ITE percentage increased the likelihood of passing ABIM-CE (OR 1.28, 95% CI 1.160-1.419). The increase in the gap was associated with decreased chances of passing ABIM-CE (OR 0.774; 95% CI 0.670-0.893). All residents who failed ABIM-CE had Step 1 scores <220. Among 31 residents with Step 2 score <220, 20% (n=6) failed ABIM. Similarly, 9% of residents with USMLE Step 3 score less than 220 failed ABIM-CE; all residents who failed had scores less than 220. The probability curve predicted that the chance of passing ABIM- CE was around 80% with USMLE scores greater than 200 and increased to almost 100% with USMLE scores of 250 or more. Conclusion There is a strong correlation between ABIM-CE results with scores of USMLE Steps and third-year ITE. Thus, performance in these exams may identify the internal medicine residents who might need more help in ABIM-CE. This helps the residents as well as the program to plan and implement various measures to improve the pass rate.

show abstract

A time-efficient web-based teaching tool to improve medical knowledge and decrease ABIM failure rate in select residents

Cited by 11 publications

References 16 publications

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?

Design and implementation of an academic enrichment program to improve performance on the internal medicine in-training exam

Do USMLE Steps and ITE Results Predict Performance in the American Board of Internal Medicine Certifying Exam?

Contact Info

Product

Resources

About