Preclinical Predictors of Surgery NBME Exam Performance

Kozar, Rosemary A.; Kao, Lillian S.; Miller, Charles C.; Schenarts, Kimberly D.

doi:10.1016/j.jss.2007.01.035

Cited by 19 publications

(9 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, Kozar et al,30 while attempting to identify students at risk of failing year 4 National Board of Medicine Examiners surgery, found that the apparently unrelated year 2 pathology was the best predictor of success for this examination. In the present study, the moderate (42% predictability) of unit 1 for the final National Board of Medicine Examiners clinical sciences examination almost 6 years later is difficult to explain, but warrants further investigation.…”

Section: Discussionmentioning

confidence: 99%

Predicting performance at medical school: can we identify at-risk students?

Shaban

McLean

2011

AMEP

View full text Add to dashboard Cite

BackgroundThe purpose of this study was to examine the predictive potential of multiple indicators (eg, preadmission scores, unit, module and clerkship grades, course and examination scores) on academic performance at medical school, with a view to identifying students at risk.MethodsAn analysis was undertaken of medical student grades in a 6-year medical school program at the Faculty of Medicine and Health Sciences, United Arab Emirates University, Al Ain, United Arab Emirates, over the past 14 years.ResultsWhile high school scores were significantly (P < 0.001) correlated with the final integrated examination, predictability was only 6.8%. Scores for the United Arab Emirates university placement assessment (Common Educational Proficiency Assessment) were only slightly more promising as predictors with 14.9% predictability for the final integrated examination. Each unit or module in the first four years was highly correlated with the next unit or module, with 25%–60% predictability. Course examination scores (end of years 2, 4, and 6) were significantly correlated (P < 0.001) with the average scores in that 2-year period (59.3%, 64.8%, and 55.8% predictability, respectively). Final integrated examination scores were significantly correlated (P < 0.001) with National Board of Medical Examiners scores (35% predictability). Multivariate linear regression identified key grades with the greatest predictability of the final integrated examination score at three stages in the program.ConclusionThis study has demonstrated that it may be possible to identify “at-risk” students relatively early in their studies through continuous data archiving and regular analysis. The data analysis techniques used in this study are not unique to this institution.

show abstract

Section: Discussionmentioning

confidence: 99%

Predicting performance at medical school: can we identify at-risk students?

Shaban

McLean

2011

AMEP

View full text Add to dashboard Cite

show abstract

“…Interestingly, other studies of program OITE YIT percentile rank and Abos-I or Abos-II score relationships have reported slightly different postgraduate years as being the most important predictors. [8][9][10] We attribute this discrepancy to likely academic program differences in regard to annual resident educational and performance expectations, possible differences in how the OITE is administered, and differing characteristics for residency program applicants. This conclusion supports our contention that the information provided by our study and that reported by others 8-10 is applied best locally within the individual program where the data were generated.…”

Section: Discussionmentioning

confidence: 99%

Relationship Among United States Medical Licensing Step I, Orthopedic In-Training, Subjective Clinical Performance Evaluations, and American Board of Orthopedic Surgery Examination Scores: A 12-Year Review of an Orthopedic Surgery Residency Program

Crawford

Nyland

Roberts

et al. 2010

Journal of Surgical Education

View full text Add to dashboard Cite

“…Step 3 is taken during the first year of residency and evaluates the application of medical knowledge to the supervised practice of medicine. Of these, Step 1 scores have been shown to play an important role in residency selection by standardizing academic achievements of students from different schools, in predicting success in clinical clerkships and Step 2 examinations, and in board examinations taken during residencies [3][4][5][6][7][8][9]. Therefore, parameters influencing student performance on Step 1 examinations such as the Medical College Admission Test (MCAT) and related preparatory materials are of interest to both students as well as medical schools.…”

Section: Introductionmentioning

confidence: 99%

Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance

Seal

Koek

Sharma

2020

Cureus

View full text Add to dashboard Cite

Candidates' performance on the United States Medical Licensing Examination (USMLE) Step 1 examination had been correlated with the Medical College Admission Test (MCAT). However, in 2015, a new MCAT format was released and its correlation with Step 1 remains to be fully analyzed. Preparation for Step 1 typically involves purchasing and perusing practice tests from the National Board of Medical Examiners (NBME) and UWorld; however, their predictive value to performance on Step 1 remains to be ascertained, especially with the release of five new NBME practice tests. Additionally, there is a need for accurately predicting Step 1 scores to self-evaluate study progress and reduce student anxiety. Rationale Program directors rank USMLE Step 1 scores as the number one criterion in selecting interviewees for residency. Step 1 scores are more important than Step 2 scores, Dean's letter, or other letters of recommendation in determining the overall ranking of a candidate after interviews. Hypotheses The authors hypothesized that the new MCAT scores correlated positively with Step 1 scores and that the new NBME practice tests were more predictive of performance on Step 1 as compared to old NBME tests. Methods Linear regression analysis followed by either analysis of variance (ANOVA) or Student's t-tests were used to analyze 399 responses. Data obtained was used to update an existing Step 1 score predictor, which was then validated. Results A positive correlation between the MCAT (average score: 510.1 ± 6.3) and Step 1 scores (average score: 246.1 ± 14.2) was observed. While new NBME practice tests were more predictive of Step 1 scores than old NBME tests, UWorld test scores were the most predictive. Students who practiced with the new NBME practice tests scored significantly higher than students who did not use them. However, students using any of the UWorld practice tests did significantly better than students who practiced using only NBME practice tests but not UWorld practice tests. Ironically, NBME 16, the second-most correlative test to Step 1 performance, is no longer available for purchase. Overall, taking six or more practice tests significantly enhanced Step 1 scores; the optimal number of tests 1 2 3

show abstract

Preclinical Predictors of Surgery NBME Exam Performance

Cited by 19 publications

References 8 publications

Predicting performance at medical school: can we identify at-risk students?

Predicting performance at medical school: can we identify at-risk students?

Relationship Among United States Medical Licensing Step I, Orthopedic In-Training, Subjective Clinical Performance Evaluations, and American Board of Orthopedic Surgery Examination Scores: A 12-Year Review of an Orthopedic Surgery Residency Program

Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance

Contact Info

Product

Resources

About