Virtual and augmented reality in biomedical engineering

Abstract

Background In the future, extended reality technology will be widely used. People will be led to utilize virtual reality (VR) and augmented reality (AR) technologies in their daily lives, hobbies, numerous types of entertainment, and employment. Medical augmented reality has evolved with applications ranging from medical education to picture-guided surgery. Moreover, a bulk of research is focused on clinical applications, with the majority of research devoted to surgery or intervention, followed by rehabilitation and treatment applications. Numerous studies have also looked into the use of augmented reality in medical education and training. Methods Using the databases Semantic Scholar, Web of Science, Scopus, IEEE Xplore, and ScienceDirect, a scoping review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. To find other articles, a manual search was also carried out in Google Scholar. This study presents studies carried out over the previous 14 years (from 2009 to 2023) in detail. We classify this area of study into the following categories: (1) AR and VR in surgery, which is presented in the following subsections: subsection A: MR in neurosurgery; subsection B: spine surgery; subsection C: oral and maxillofacial surgery; and subsection D: AR-enhanced human-robot interaction; (2) AR and VR in medical education presented in the following subsections; subsection A: medical training; subsection B: schools and curriculum; subsection C: XR in Biomedicine; (3) AR and VR for rehabilitation presented in the following subsections; subsection A: stroke rehabilitation during COVID-19; subsection B: cancer and VR, and (4) Millimeter-wave and MIMO systems for AR and VR. Results In total, 77 publications were selected based on the inclusion criteria. Four distinct AR and/or VR applications groups could be differentiated: AR and VR in surgery (N = 21), VR and AR in Medical Education (N = 30), AR and VR for Rehabilitation (N = 15), and Millimeter-Wave and MIMO Systems for AR and VR (N = 7), where N is number of cited studies. We found that the majority of research is devoted to medical training and education, with surgical or interventional applications coming in second. The research is mostly focused on rehabilitation, therapy, and clinical applications. Moreover, the application of XR in MIMO has been the subject of numerous research. Conclusion Examples of these diverse fields of applications are displayed in this review as follows: (1) augmented reality and virtual reality in surgery; (2) augmented reality and virtual reality in medical education; (3) augmented reality and virtual reality for rehabilitation; and (4) millimeter-wave and MIMO systems for augmented reality and virtual reality.

Early introduction of simulation in the medical curriculum: the MedInTo perspective

“…Another example of virtual reality is the 3D virtual reconstructions of organs ( 56 ). In the surgical field, they have proved to be valid tools in different settings, including aiding in surgical indications—helping the surgeon to choose, for example, between a radical or a partial surgery—and assisting in the decision-making process preceding surgery (i.e., surgical planning).…”

Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging Metaverse

“…In this progress landscape, advanced imaging modalities-virtual reality (VR), augmented reality (AR), and threedimensional imaging (3D)-have emerged, refining breast cancer treatment through precise tumor diagnosis and improved surgical interventions. These innovations reshape healthcare capabilities on a broader scale [8][9][10]. Beyond the clinic, these technologies extend into education, offering possibilities for online training [11,12] and interactive learning experiences [9,13].…”

“…Beyond the clinic, these technologies extend into education, offering possibilities for online training [11,12] and interactive learning experiences [9,13]. They transcend treatment confines, influencing patient rehabilitation and advancing comprehensive healthcare [10]. This review explores diagnostic techniques, focusing on VR, AR, and 3D imaging in breast cancer management, aiming to provide nuanced insights into transformative healthcare experiences.…”

Exploration of the application of augmented reality technology for teaching spinal tumor’s anatomy and surgical techniques

“…In the past decade, extended reality (XR) technology has developed exponentially, overlaying virtual reality (VR) onto the real-world environment to display information and data at various levels of the reality-virtuality continuum ( 1 , 2 ). Augmented reality (AR) technology combines computer-generated three-dimensional (3D) virtual models with real-world scenes to achieve real-time interaction among users, the physical environment, and digital content.…”