BackgroundThe Multiple Mini-Interview (MMI) mostly uses ‘Situational’ Questions (SQs) as an interview format within a station, rather than ‘Past-Behavioural’ Questions (PBQs), which are most frequently adopted in traditional single-station personal interviews (SSPIs) for non-medical and medical selection. This study investigated reliability and acceptability of the postgraduate admissions MMI with PBQ and SQ interview formats within MMI stations.MethodsTwenty-six Japanese medical graduates, first completed the two-year national obligatory initial postgraduate clinical training programme and then applied to three specialty training programmes - internal medicine, general surgery, and emergency medicine - in a Japanese teaching hospital, where they underwent the Accreditation Council for Graduate Medical Education (ACGME)-competency-based MMI. This MMI contained five stations, with two examiners per station. In each station, a PBQ, and then an SQ were asked consecutively. PBQ and SQ interview formats were not separated into two different stations, or the order of questioning of PBQs and SQs in individual stations was not changed due to lack of space and experienced examiners. Reliability was analysed for the scores of these two MMI question types. Candidates and examiners were surveyed on this experience.ResultsThe PBQ and SQ formats had generalisability coefficients of 0.822 and 0.821, respectively. With one examiner per station, seven stations could produce a reliability of more than 0.80 in both PBQ and SQ formats. More than 60% of both candidates and examiners felt positive about the overall candidates’ ability. All participants liked the fairness of this MMI when compared with the previously experienced SSPI. SQs were perceived more favourable by candidates; in contrast, PBQs were perceived more relevant by examiners.ConclusionsBoth PBQs and SQs are equally reliable and acceptable as station interview formats in the postgraduate admissions MMI. However, the use of the two formats within the same station, and with a fixed order, is not the best to maximise its utility as an admission test. Future studies are required to evaluate how best the SQs and PBQs should be combined as station interview formats to enhance reliability, feasibility, acceptability and predictive validity of the MMI.
BackgroundThe multiple mini-interview (MMI) is increasingly used for postgraduate medical admissions and in undergraduate settings. MMIs use mostly Situational Questions (SQs) rather than Past-Behavioural Questions (PBQs). A previous study of MMIs in this setting, where PBQs and SQs were asked in the same order, reported that the reliability of PBQs was non-inferior to SQs and that SQs were more acceptable to candidates. The order in which the questions are asked may affect reliability and acceptability of an MMI. This study investigated the reliability of an MMI using both PBQs and SQs, minimising question order bias. Acceptability of PBQs and SQs was also assessed.MethodsForty candidates applying for a postgraduate medical admission for 2016–2017 were included; 24 examiners were used. The MMI consisted of six stations with one examiner per station; a PBQ and a SQ were asked at every station, and the order of questions was alternated between stations. Reliability was analysed for scores obtained for PBQs or SQs separately, and for both questions. A post-MMI survey was used to assess the acceptability of PBQs and SQs.ResultsThe generalisability (G) coefficients for PBQs only, SQs only, and both questions were 0.87, 0.96, and 0.80, respectively. Decision studies suggested that a four-station MMI would also be sufficiently reliable (G-coefficients 0.82 and 0.94 for PBQs and SQs, respectively). In total, 83% of participants were satisfied with the MMI. In terms of face validity, PBQs were more acceptable than SQs for candidates (p = 0.01), but equally acceptable for examiners (88% vs. 83% positive responses for PBQs vs. SQs; p = 0.377). Candidates preferred PBQs to SQs when asked to choose one, though this difference was not significant (p = 0.081); examiners showed a clear preference for PBQs (p = 0.007).ConclusionsReliability and acceptability of six-station MMI were good among 40 postgraduate candidates; modelling suggested that four stations would also be reliable. SQs were more reliable than PBQs. Candidates found PBQs more acceptable than SQs and examiners preferred PBQs when they had to choose between the two. Our findings suggest that it is better to ask both PBQs and SQs during an MMI to maximise acceptability.Electronic supplementary materialThe online version of this article (doi:10.1186/s12909-017-0898-z) contains supplementary material, which is available to authorized users.
Background: The purpose of this study was to identify the attributes of good clinical teachers in pediatrics (CTPs) in Japan, and to elucidate pediatricians and pediatric trainees' perceptions of these attributes. Methods: The attributes of good CTPs were identified qualitatively by conducting a thematic analysis of questionnaires answered by board-certified pediatricians and pediatric trainees. The attributes identified were rated quantitatively by a large number of participants in both groups. Results: Forty-eight individual attributes of good CTPs were identified, which were classified into three domains: personal, pediatrician, and teacher. The three domains and most of the attributes were consistent with previous studies. However, a few additional attributes, including "is kind/thoughtful toward others" and "defends trainees", which may be unique to pediatricians in Japan, were identified. Significant differences in the pediatricians' and trainees' perceptions of these attributes were elucidated: The differences were most noticeable for teacher attributes and least for personal attributes. Conclusion: Although most of the identified attributes of good CTPs in our study appear to be universal, there were significant differences in the pediatricians' and trainees' perceptions of good CTPs, especially in relation to teacher attributes. Our study provides additional bases for good CTPs and future faculty development, for enhanced pediatric clinical education.The education of modern health professions emphasizes the importance of the role of clinical teachers who have contemporary educational skills and attitudes. In order to improve such teaching competencies and create an improved clinical training program that enhances patient care, it is imperative to clarify clinical teachers' roles and attributes. 1,2 Furthermore, clinical teachers' reflections of their teaching skills are crucial for their continuing professional development. 3,4 A plethora of research on clinical teaching and the attributes of good clinical teachers has been conducted. 1 These studies have warned about the emphasis placed on research over teaching, the dearth of gifted clinicians, and the economic pressures on faculties to spend more time on clinical duties. 5 Studies on good clinical teachers have been conducted primarily in North America and Europe, 1,6 mainly in the field of internal and general medicine. Sutkin et al. 1 reviewed 68 articles and classified 49 characteristics of good clinical teachers into three categories: physician, teacher, and human characteristics. They noted that the most commonly reported characteristics were clinical knowledge, clinical skills, reasoning, positive relationship with students, communication skills, and enthusiasm. Only two known studies have been conducted in Asia. Li et al. 7 identified 40 behavioral competencies of clinical teachers and ranked the importance attached to these by clinical teachers. It is noteworthy that nine of the 10 topranked indicators were in the attitudes, traits or belief...
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.