The Predictive Validity of the MCAT for Medical School Performance and Medical Board Licensing Examinations: A Meta-Analysis of the Published Research

Donnon, Tyrone; Paolucci, Elizabeth Oddone; Violato, Claudio

doi:10.1097/01.acm.0000249878.25186.b7

Cited by 253 publications

(211 citation statements)

References 26 publications

Supporting

Mentioning

182

Contrasting

Unclassified

Order By: Relevance

“…33 The association between individual USMLE Steps was not reported in either study. It is notable that the correlation coefficients we report for the effect of previous USMLE Step scores on subsequent USMLE Step scores is similar to those previously reported for MCAT scores.…”

mentioning

confidence: 78%

Associations Between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) Scores

2008

View full text Add to dashboard Cite

BACKGROUND:Little is known about the associations of previous standardized examination scores with scores on subsequent standardized examinations used to assess medical knowledge in internal medicine residencies. OBJECTIVE:To examine associations of previous standardized test scores on subsequent standardized test scores. DESIGN:Retrospective cohort study. PARTICIPANTS:One hundred ninety-five internal medicine residents. METHODS: Bivariate associations of United States Medical Licensing Examination (USMLE) Steps andInternal Medicine In-Training Examination (IM-ITE) scores were determined. Random effects analysis adjusting for repeated administrations of the IM-ITE and other variables known or hypothesized to affect IM-ITE score allowed for discrimination of associations of individual USMLE Step scores on IM-ITE scores. RESULTS:In bivariate associations, USMLE scores explained 17% to 27% of the variance in IME-ITE scores, and previous IM-ITE scores explained 66% of the variance in subsequent IM-ITE scores. Regression coefficients (95% CI) for adjusted associations of each USMLE Step with IM-ITE scores were USMLE-1 0.19 (0.12, 0.27), USMLE-2 0.23 (0.17, 0.30), 0.29). CONCLUSIONS: No single USMLEStep is more strongly associated with IM-ITE scores than the others. Because previous IM-ITE scores are strongly associated with subsequent IM-ITE scores, appropriate modeling, such as random effects methods, should be used to account for previous IM-ITE administrations in studies for which IM-ITE score is an outcome.

show abstract

mentioning

confidence: 78%

Associations Between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) Scores

2008

View full text Add to dashboard Cite

show abstract

“…A large body of literature provides evidence that Medical College Admission Test (MCAT) scores are predictive of USMLE scores [23–25], so if an institution needs to develop, for example, dermatologists, for a state that is lacking in such, the institution may be well-served to select students with high MCAT scores, or to provide extra USMLE study support. Conversely, if a state is in need of more family physicians, a focus on standardized exam scores over other priorities may be unwarranted.…”

Section: Discussionmentioning

confidence: 99%

The association of USMLE Step 1 and Step 2 CK scores with residency match specialty and location

Gauer

Jackson

2017

Medical Education Online

View full text Add to dashboard Cite

Background: For future physicians, residency programs offer necessary extended training in specific medical specialties. Medical schools benefit from an understanding of factors that lead their students to match into certain residency specialties. One such factor, often used during the residency application process, is scores on the USA Medical Licensing Exam (USMLE). Objectives: To determine the relationship between USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores and students’ residency specialty match, and the association between both USMLE scores and state of legal residency (Minnesota) at the time of admission with students staying in-state or leaving the state for residency program. Design: USMLE scores and residency match data were analyzed from five graduating classes of students at the University of Minnesota Medical School (N = 1054). Results: A MANOVA found significant differences (p < 0.001) between residency specialties and both USMLE Step 1 and Step 2 CK scores, as well as the combination of the two. Students who matched in Dermatology had the highest mean USMLE scores overall, while students who matched in Family Medicine had the lowest mean scores. Students who went out of state for residency had significantly higher Step 1 scores (p = 0.027) than students who stayed in-state for residency, while there was no significant difference between the groups for Step 2 scores. A significant positive association was found between a student who applied as a legal resident of Minnesota and whether the student stayed in Minnesota for their residency program. Conclusions: Residency specialty match was significantly associated with USMLE Step 1 and USMLE Step 2 CK scores, as was staying in-state or leaving the state for residency. Students who were legal residents of the state at the time of application were more likely to stay in-state for residency, regardless of USMLE score. Abbreviations: CK: Clinical knowledge; COMLEX: Comprehensive Osteopathic Medical Licensing Examination; GME: Graduate medical education; NRMP: National Resident Matching Program; UME: Undergraduate medical education; USMLE: United States Medical Licensing Examination

show abstract

“…More research, including a greater number of African American students, is needed to explore the relationship between communication skill and MCAT verbal score, noted in this study and in other studies. 18 Why do Asian students score lower on the communication portion of the CPX, even after accounting for MCAT verbal scores? There are two possible explanations: These students may be worse communicators, or the CPX may contain some form of measurement bias.…”

Section: Discussionmentioning

confidence: 99%

Impact of Student Ethnicity and Primary Childhood Language on Communication Skill Assessment in a Clinical Performance Examination

et al. 2007

View full text Add to dashboard Cite

BACKGROUND: Clinical performance examinations (CPX) with standardized patients (SPs) have become a preferred method to assess communication skills in US medical schools. Little is known about how trainees' backgrounds impact CPX performance. OBJECTIVE:The objective of this paper is to examine the impact of student ethnicity, primary childhood language, and experience of diversity on the communication scores of a high-stakes CPX using SPs. DESIGN:This research was designed as an observational study. PARTICIPANTS:The participants of this study were third-year medical students at one US medical school. MEASUREMENTS AND MAIN RESULTS:The measurements used in this study were CPX scores from mandatory exam, student demographics and experience with diversity measured by self-report on a survey, and Medical College Admission Test (MCAT) and United States Medical Licensing Examination (USMLE) scores. A total of 135 students participated. Asian and black students scored lower than white students on the communication portion of the CPX by approximately half a standard deviation (Asian, 67.4%; black, 64.4%; white, 69.4%, p< .05). There were no differences by ethnicity on history/ physical exam scores. Multivariate analysis controlling for MCAT verbal scores reduced ethnic differences in communication scores (Asian-white mean differences= 1.95, p=0.02), but Asian-white differences were eliminated only after sequential models included primary childhood language (difference=0.57, p=0.6).CONCLUSIONS: Even after controlling for English language knowledge as measured in MCAT verbal scores, speaking a primary childhood language other than English is associated with lower CPX communication scores for Asian students. While poorer communication skills cannot be ruled out, SP exams may contain measurement bias associated with differences in childhood language or culture. Caution is indicated when interpreting CPX communication scores among diverse examinees.

show abstract

The Predictive Validity of the MCAT for Medical School Performance and Medical Board Licensing Examinations: A Meta-Analysis of the Published Research

Cited by 253 publications

References 26 publications

Associations Between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) Scores

Associations Between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) Scores

The association of USMLE Step 1 and Step 2 CK scores with residency match specialty and location

Impact of Student Ethnicity and Primary Childhood Language on Communication Skill Assessment in a Clinical Performance Examination

Contact Info

Product

Resources

About