Academic Primer Series: Five Key Papers about Study Designs in Medical Education

Abstract

IntroductionA proper understanding of study design is essential to creating successful studies. This is also important when reading or peer reviewing publications. In this article, we aimed to identify and summarize key papers that would be helpful for faculty members interested in learning more about study design in medical education research.MethodsThe online discussions of the 2016–2017 Academic Life in Emergency Medicine Faculty Incubator program included a robust and vigorous discussion about education study design, which highlighted a number of papers on that topic. We augmented this list of papers with further suggestions by expert mentors. Via this process, we created a list of 29 papers in total on the topic of medical education study design. After gathering these papers, our authorship group engaged in a modified Delphi approach to build consensus on the papers that were most valuable for the understanding of proper study design in medical education.ResultsWe selected the top five most highly rated papers on the topic domain of study design as determined by our study group. We subsequently summarized these papers with respect to their relevance to junior faculty members and to faculty developers.ConclusionThis article summarizes five key papers addressing study design in medical education with discussions and applications for junior faculty members and faculty developers. These papers provide a basis upon which junior faculty members might build for developing and analyzing studies.

Curated Collection for Educators: Five Key Papers about the Flipped Classroom Methodology

“…Similar methods were used by the ALiEM Faculty Incubator in a previous series of papers published in both the Western Journal of Emergency Medicine and Population Health [ 11 - 17 ] and Cureus [ 18 ]. This process does not satisfy traditional Delphi methodology [ 10 ] because the participants included novices (i.e., junior faculty participants in the ALiEM Faculty Incubator) as well as experienced medical educators (i.e., clinician educators, all of whom have published ten or more peer-reviewed publications and who serve as mentors and facilitators of the ALiEM Faculty Incubator).…”

Comparative Analysis of Junior and Senior Clinician Educator Evaluation of Relevant Articles Within Medical Education

“…Alternatively, it is possible that JCEs and SCEs valued the articles similarly, but for different reasons. For example, an introductory guide to scholarship in medical education may be valuable for JCEs by providing targeted advice on project development, while SCEs may value the mentorship discussion more highly [ 1 , 11 ].…”

“…The Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program was a year-long, virtual faculty development program for JCEs. Primer articles were developed for JCEs on topics relevant to medical education [ 1 - 9 ]. The study selection methodology included a modified Delphi approach utilizing both JCEs (i.e., junior faculty members) and SCEs (i.e., experienced educators with >10 peer-reviewed publications within the field).…”

“…There is a vast amount of literature within medical education and selecting the most high yield resources can be challenging for many educators. As there is no formalized system to rank all available resources with respect to their value for junior clinician educators (JCEs), many JCEs rely on recommendations from mentors or other sources [ 1 - 10 ]. It is generally believed that experts (i.e., senior clinician educators) are the best resource given their prior experience within the field.…”

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development

“…A fourth-round was required to break a tie between three papers with equal scores in the third round. The ALiEM Faculty Incubator used similar methods in an earlier series of papers published in the Western Journal of Emergency Medicine and Population Health [ 15 - 22 ] and Cureus [ 23 , 24 ].…”