Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme

Abstract

Purpose: To describe participants' attitudes, beliefs, and experiences with the use of two methods of scoring the Multiple Mini-Interview (MMI) for admission to a Master of Physical Therapy program: a rank-based scoring system (RBS; used from 2007 to 2013) and a criterion-based scoring system (CBS; tested in 2014). The MMI uses short independent assessments to obtain an aggregate score of candidates' professionalism and interpersonal skills, based on behavioural questions within scenarios that assess one attribute at a time. Method: This qualitative descriptive inquiry sought to capture the experiences of 18 MMI interviewers primarily through semi-structured interviews. Interviews were transcribed verbatim, and the data were analyzed using thematic analysis. The results were validated by theoretical and investigator triangulation and member checking. Results: One major theme, scoring systems, and two sub-themes, CBS and RBS, emerged across all data. Participants unanimously agreed that CBS is a more fair and objective way to score candidates' interviews. Conclusions: CBS was well accepted by participants, and the majority preferred it over RBS. Participants felt that CBS presented a more accurate depiction of candidates.

Evaluating a first fully automated interview grounded in Multiple Mini Interview (MMI) methodology: results from a feasibility study

“…Our online system provides for a fully automated interview as opposed to a human using videoconference technology to facilitate a human-assessed interview using MMI scenarios. Despite the concept of the automated interview being progressive, admissions staff saw substantial potential to mitigate subjectivity issues associated with human-led interviews through unintended bias and interviewer fatigue 22 . This was based on the consistency of the automated interview in contrast to the perceived nuanced differences between human interviewers conducting MMIs.…”

The Multiple Mini Interview for admission to nursing – male perspectives

“…Multiple Mini Interviews (MMIs) are being increasingly used in the selection processes for students in a number of professions ( Christensen et al ., 2018 ; van der Spuy, Busch and Bidonde, 2016 ; Andrades et al ., 2014 ). They are used to assess a number of professional attributes including communication, empathy, decision making and taking responsibility ( Kelly et al, 2014 ).…”

Clinician's Commentary on van der Spuy et al.

“…Over the past decade, there has been an ongoing discourse about the merits of the personal or panel interview versus the multiple mini-interview (MMI). 2–5 In their article “Interviewers' Experiences with Two Multiple Mini-Interview Scoring Methods Used for Admission to a Master of Physical Therapy Programme,” van der Spuy and colleagues 1 explored the fairness and objectivity of two methods of scoring the MMI.…”

“…The study by van der Spuy and colleagues 1 highlights the process that the University of Saskatchewan undertook to describe participants' attitudes, beliefs, and experiences using the rank-based and criterion-based methods of scoring. The results of their investigation revealed that the criterion-based scoring system was viewed more favourably by both interviewees and interviewers.…”

“…On the basis of the work of van der Spuy and colleagues, 1 one can surmise that physiotherapy programmes interested in adopting the MMI as an element of their admissions process should consider the criterion-based scoring system to assess critical non-cognitive skills. The MMI, through purposeful development of questions related to the physiotherapy essential competencies, offers an opportunity to assess the non-cognitive domains essential to the development of the compassionate, comprehensive, and competent physiotherapist of the 21st century.…”