Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance

Abstract

Candidates' performance on the United States Medical Licensing Examination (USMLE) Step 1 examination had been correlated with the Medical College Admission Test (MCAT). However, in 2015, a new MCAT format was released and its correlation with Step 1 remains to be fully analyzed. Preparation for Step 1 typically involves purchasing and perusing practice tests from the National Board of Medical Examiners (NBME) and UWorld; however, their predictive value to performance on Step 1 remains to be ascertained, especially with the release of five new NBME practice tests. Additionally, there is a need for accurately predicting Step 1 scores to self-evaluate study progress and reduce student anxiety. Rationale Program directors rank USMLE Step 1 scores as the number one criterion in selecting interviewees for residency. Step 1 scores are more important than Step 2 scores, Dean's letter, or other letters of recommendation in determining the overall ranking of a candidate after interviews. Hypotheses The authors hypothesized that the new MCAT scores correlated positively with Step 1 scores and that the new NBME practice tests were more predictive of performance on Step 1 as compared to old NBME tests. Methods Linear regression analysis followed by either analysis of variance (ANOVA) or Student's t-tests were used to analyze 399 responses. Data obtained was used to update an existing Step 1 score predictor, which was then validated. Results A positive correlation between the MCAT (average score: 510.1 ± 6.3) and Step 1 scores (average score: 246.1 ± 14.2) was observed. While new NBME practice tests were more predictive of Step 1 scores than old NBME tests, UWorld test scores were the most predictive. Students who practiced with the new NBME practice tests scored significantly higher than students who did not use them. However, students using any of the UWorld practice tests did significantly better than students who practiced using only NBME practice tests but not UWorld practice tests. Ironically, NBME 16, the second-most correlative test to Step 1 performance, is no longer available for purchase. Overall, taking six or more practice tests significantly enhanced Step 1 scores; the optimal number of tests 1 2 3

Assess the Relationship between the Emirates Medical Residency Entry Examination, Grade Point Average, and Multiple Mini Interview Scores and the Resident’s End-of-Year-One Performance in the UAE

“…According to the research shown above, there was a significant positive association between EMREE and your The results of the study demonstrated a positive correlation between the resident's performance throughout the residency program's first year and the pre-entry exam [18]. Similarly, Saguil, Dong, and others discovered that the preentry exam is the best predictor of future success [19].…”

Factors Leading to Successful Performance on U.S. National Licensure Exams for Medical Students: A Scoping Review

“…60 In another study, the subjective rating that a COMLEX Qbank was helpful was associated with lower COMLEX 1 scores in the unadjusted analysis but not in the fully adjusted models. 61 Studies that examined performance on self-assessments found that Qbank percent correct scores 49,72 and practice exam scores were correlated with Step 1 scores. 49,51,60 A greater number of practice tests completed was associated with higher Step 1 scores in 1 study 49 but not in another study, 50 and reported use (vs nonuse) of a practice test was not associated with Step 1 scores in a third study.…”

Medical licensing examinations in both Sweden and the US favor pharmacology over lifestyle

“…The UWorld database does not contain questions actually given at licensing examinations which may be seen as a limitation. However, UWorld questions have been deemed as most closely resembling USMLE® ( Andyryka, 2014 ) and UWorld scores are good predictors of USMLE Step 1 scores ( Seal et al, 2020 , Giordano et al, 2016 ). Moreover, the fact that original USMLE® questions are kept secret limits their educational impact and makes comparison of UWorld with the equally open Swedish questions relevant.…”

“…From the Swedish national database of previous licensing examinations ( Karolinska Institutet, 2020 ) we retrieved all 34 examinations held between 2010 and fall 2018. 1 As we were denied access to the USMLE®-database 2 we chose a commercial question bank (UWorld for USMLE® step 3 ( UWorld for USMLE step 3., 2020 ), commonly used by students to prepare for USMLE® exams ( Bhatnagar et al, 2019 , Seal et al, 2020 ) and previously described as most representative of questions seen on USMLE® ( Andyryka, 2014 ). We confined ourselves to the following NCDs: coronary heart disease (CHD), chronic obstructive pulmonary disease (COPD), diabetes, hypertension, and stroke.…”