The validity and reliability of the multiple mini-interview in assessing the capabilities of nursing education PhD candidates: A methodological study

Abstract

Objective: For a long time, the Single-Station Personal Interview (SSPI) used for nursing PhD admissions has merely evaluated the candidates’ cognitive skills. A new evolution emerged in exams by the introduction of effective evaluation methods such as the Multiple Mini-Interview (MMI) and the emphasis on noncognitive skills. The aim of study was to determine the validity and reliability of the MMI in evaluating PhD candidates’ competences. Materials and methods: This methodological study was conducted in September 2015 on PhD candidates in Golestan University of Medical Sciences, Iran. 38 nursing PhD candidates who had passed the first stage of the PhD exam and intend for interview, were recruited through census sampling for the second stage. The data was gathered using checklist based on the proposed and headings of the Ministry of Health and Medical Education in six stations with topics on ethical judgments, psychomotor skills, communication skills, rational reasoning and critical thinking. The face and content validity of the tool were assessed by an expert panel. The criterion validity was determined by measuring the correlation between the mean score of the first and the second stages. The construct validity was evaluated by determining the relationship between the mean score of each station and the mean score of MMI. The raters’ agreement was used to assess the reliability. Results: The face and content validity of the tool were approved by the panel of experts. The highest mean score pertained to the thesis station (74.25±9.10). The finding of criterion validity assessing show that there was not significant correlation between the first-stage written exam scores and the MMI scores (r=0.22, P=0.18). There was a significant relationship between the mean score of all stations and MMI in the evaluation of the construct validity (P<0.001). The rater reliability showed an inter-rater agreement at five stations (P<0.05). Conclusions: The validity and reliability of the MMI were approved for nursing PhD exams and PhD interviews held through this method can ensure the consistency and accuracy of postgraduate admissions. Bangladesh Journal of Medical Science Vol. 21 No. 04 October’22 Page : 788-794