Effectiveness of the Ophthalmological Training Component of the STOMP (Simulation Training for Operational Medical Providers) Curriculum

Abstract

Introduction: Simulation has been used in medicine to train clinicians to manage a variety of clinical scenarios. A key adaptation of the use of simulation in military healthcare occurred in 2015 with the development of the STOMP (Simulation Training for Operational Medical Providers) curriculum, a specific curriculum designed for the intern (PGY-1) trained physicians being sent into the military to practice primary care. Despite showing the curriculum's influence on self-perceived comfort scores, no study has determined whether simulation is an effective means of improving general medical officer (GMO) physicians' skills compared to other traditional styles of education. Specifically, this study sought to determine whether simulation-based education (SBE) of ophthalmologic skills improves GMO physicians' clinical performance, as compared to traditional didactic-based instruction. Methods: The study, conducted at Naval Medical Center Portsmouth, included GMO physicians who were enrolled in the 2019 STOMP class. Following a brief overview of the study, GMO physicians who elected to participate in the study were randomized to either SBE or lecture-based training for three commonly used ophthalmological procedures: slit lamp exam, tonometry, and corneal foreign body removal. After completing the simulation and lecture-based education training sessions, participants' procedural performance was evaluated utilizing a locally developed performance checklist, and completion time for each of the three procedures was recorded. Data were analyzed using the t-test and Mann-Whitney test. A significance level of 0.05 was considered to be statistically significant. Results: Of the 50 consented participants, 46 completed the study. The mean overall completion scores for the performance checklists were significantly higher for the SBE group (n=26) compared to the lecture group (n=20) [80% (95% CI 78-82%) vs 41% (95% CI 35-47%), respectively]. Time to completion of the individual tasks was also significantly shorter for the SBE group compared to the lecture group (with mean differences ranging from 27 to 126 seconds, all p<.05). Conclusions: Simulation-based training appeared to be more effective at teaching three ophthalmological procedures (slit lamp exam, tonometry, and corneal foreign body removal) to GMO physicians compared to didactic-based instruction alone.