Next-Generation Simulation—Integrating Extended Reality Technology Into Medical Education

Abstract

In recent years, the advancement of eXtended Reality (XR) technologies including Virtual and Augmented reality (VR and AR respectively) has created new human-computer interfaces that come increasingly closer to replicating natural human movements, interactions, and experiences. In medicine, there is a need for tools that accelerate learning and enhance the realism of training as medical procedures and responsibilities become increasingly complex and time constraints are placed on trainee work. XR and other novel simulation technologies are now being adapted for medical education and are enabling further interactivity, immersion, and safety in medical training. In this review, we investigate efforts to adopt XR into medical education curriculums and simulation labs to help trainees enhance their understanding of anatomy, practice empathetic communication, rehearse clinical procedures, and refine surgical skills. Furthermore, we discuss the current state of the field of XR technology and highlight the advantages of using virtual immersive teaching tools considering the COVID-19 pandemic. Finally, we lay out a vision for the next generation of medical simulation labs using XR devices summarizing the best practices from our and others’ experiences.

High fidelity simulation of the endoscopic transsphenoidal approach: Validation of the UpSurgeOn TNS Box

“…The integration of AR into high-fidelity simulators has been a promising new development. AR overlays have the potential to simulate variations in surgical anatomy, illustrate various surgical approaches and develop complex surgical skills ( 39 ). Furthermore, this provides a good solution for high-fidelity neurosurgical training in low-middle income countries ( 40 ).…”

Metaverse Wearables for Immersive Digital Healthcare: A Review

“…Studies in which medical training with surgical scenarios is provided through avatars in the metaverse with XR environments have been conducted in various medical fields such as radiology, internal medicine, nursing, and neurology. [ 1 , 129 , 130 , 131 ] The experiences allow medical students to enhance medical technology skills in a risk‐free decision‐making environment by learning surgical procedures and reviewing personalized feedback. A technology that visualizes digital data through AR and web‐based viewing has been developed to offer immersive information in research publications ( Figure 9 a ).…”

Applications of Extended Reality in Orthopaedic Surgery

“…Finally, the cost-related disadvantages already mentioned in association with virtual reality and augmented reality also limit the adoption of mixed reality in surgical training. However, extended reality-based courses may be more cost-efficient and time-efficient alternatives in the future compared with traditional surgical education using cadaveric specimens 43 . As technological advancements continue and further studies demonstrate the efficacy of mixed reality in the orthopaedic operating room, it is likely that mixed reality will start to become a more standardized way of performing various orthopaedic procedures.…”