Correlation between MMI performance and OSCE performance – a pilot study

Abstract

ObjectiveThe multiple mini-interview (MMI) has been shown to have a positive correlation with early medical school performance, clerkship evaluations, and national licensing examinations. There is limited data on its predictive validity at the postgraduate level.MethodsSix hundred and nineteen internship candidates were interviewed using the MMI format by the internal medicine residency program of The Reading Health System, between September 2011 and February 2014. Fifty-two interns were recruited. Each intern participated in an objective structured clinical examination (OSCE) 3–4 months after the start of the program. The OSCE score of each intern was used as the independent variable to test the relationship with both the MMI interpersonal score and the MMI overall score.ResultsThere was a moderate positive correlation between the average MMI interpersonal score and the communication score on the OSCE, r=0.384, n=52, p=0.005, and a negligible relationship between the average MMI overall score and the communication score on the OSCE, r=0.175, n=52, p=0.214.ConclusionThe MMI is a useful tool for residency programs to assess interpersonal and communication skills prior to matriculation into residency training. This study provides evidence for its validity in assessing these competencies.

What is the value of Values Based Recruitment for nurse education programmes?

“…Studies focused on the measurement of non‐academic attributes (as mentioned previously: not values) in healthcare education recruitment often have academic performance, rather than actual practice and patient care, as an outcome measure (e.g. Husbands & Dowell, ; Oluwasanjo, Wasser, & Alweis, ; Patterson et al., ). In addition, most of these studies are conducted with applicants to courses in medicine and dentistry (Patterson et al., ).…”

Utilizing Multiple Mini Interviews in Medical School Admissions

“…As stated above, the MMI has been found to be reliable and valid meaning that the MMI consistently measures what it was designed to measure which are medical school applicants' noncognitive traits including interpersonal skills, communication skills, and professionalism [2][3][4][5][6][7][8][9][10][11]. In fact, the MMI has been found to assess these non-cognitive traits better than traditional interviews [2].…”

“…Reliability and validity studies are extremely critical because interviewers and medical schools may not be able to observe the benefits of the MMI over the individual interview. Subsequent to the work at McMaster University, reliability and validity has been repeatedly illustrated [2][3][4][5][6]. In 2009 and 2010 Hamburg University conducted a pilot study using MMI's for medical school admission and reviewed cost cutting measures [3].…”

“…Developing MMI's that are reliable, valid, and differentiate applicants would be ideal. Often the MMI will use situationally based questions as opposed to past-behaviouralbehavioral questions [5] often used in traditional individual interviews. In the study by Yoshimura et al, it was found that MMI's were reliable utilizing seven stations with one examiner per station and that all participants perceived MMI's as more fair than traditional interview methods.…”

What Can We Learn From Resident Selection Interviews?

“…15 A different novel interview process (CanMEDS) correlated in a negative fashion with academic metrics, but is thought to provide additional data for resident selection. 16 Unfortunately, our continued work with the MMI was unable to show an increased predictive value of the MMI beyond the standard selection process for end of year 1 performance in emergency medicine residents, which confirms similar concerns as those for the traditional approach in predicting success in residency.…”