Application of Mixed Reality in Medical Training and Surgical Planning Focused on Minimally Invasive Surgery

Abstract

Introduction: Medical training is a long and demanding process, in which the first stages are usually based on two-dimensional, static, and unrealistic content. Conversely, advances in preoperative imaging have made it an essential part of any successful surgical procedure. However, access to this information often requires the support of an assistant and may compromise sterility in the surgical process. Herein, we present two solutions based on mixed reality that aim to improve both training and planning in minimally invasive surgery.Materials and Methods: Applications were developed for the use of the Microsoft HoloLens device. The urology training application provided access to a variety of anatomical and surgical training contents. Expert urological surgeons completed a questionnaire to evaluate its use. The surgical planning solution was used during laparoscopic renal tumorectomy in an experimental model and video-assisted right upper lobectomy in an adult patient. Surgeons reported their experience using this preoperative planning tool for surgery.Results: The solution developed for medical training was considered a useful tool for training in urological anatomy, facilitating the translation of this knowledge to clinical practice. Regarding the solution developed for surgical planning, it allowed surgeons to access the patient’s clinical information in real-time, such as preoperative imaging studies, three-dimensional surgical planning models, or medical history, facilitating the surgical approach. The surgeon’s view through the mixed reality device was shared with the rest of the surgical team.Conclusions: The mixed reality-based solution for medical training facilitates the transfer of knowledge into clinical practice. The preoperative planning tool for surgery provides real-time access to essential patient information without losing the sterility of the surgical field. However, further studies are needed to comprehensively validate its clinical application.

Mixed-Reality-Assisted Puncture of the Common Femoral Artery in a Phantom Model

“…MR is a promising and futuristic imaging viewing technology and several studies have investigated its application in patient and student education, and procedural planning [36][37][38][39][40]. However, the true potential of MR can only be utilized in an application in which the physical and the virtual objects are equally obligatory components of the application.…”

The feasibility of virtual reality for anatomic training during temporal bone dissection course

“…The reduced costs and advances in virtual reality (VR) technology have opened new possibilities to overcome the restrictions in contemporary otological surgery training and anatomic education. There are now a growing number of studies highlighting that the VR simulators available on various platforms are efficient educational tools in the surgical training of novices (Arora et al, 2012;Fang et al, 2014;Lui and Hoy, 2017;Compton et al, 2020;Li et al, 2021;Sánchez-Margallo et al, 2021).…”

Impact of Self-View Latency on Quality of Experience: Analysis of Natural Interaction in XR Environments

“…Furthermore, XR environments are intended to facilitate training that involves logistical or security complexity. Some examples are industrial [2] and medical training [3,4]. Increasing the degree of immersion in interactive environments will improve user satisfaction and performance [5].…”