Mixed reality applications in urology: Requirements and future potential

Abstract

Background Mixed reality (MR), the computer-supported augmentation of a real environment with virtual elements, becomes ever more relevant in the medical domain, especially in urology, ranging from education and training over surgeries. We aimed to review existing MR technologies and their applications in urology. Methods A non-systematic review of current literature was performed using the PubMed-Medline database using the medical subject headings (MeSH) term “mixed reality”, combined with one of the following terms: “virtual reality”, “augmented reality”, ‘’urology’’ and “augmented virtuality”. The relevant studies were utilized. Results MR applications such as MR guided systems, immersive VR headsets, AR models, MR-simulated ureteroscopy and smart glasses have enormous potential in education, training and surgical interventions of urology. Medical students, urology residents and inexperienced urologists can gain experience thanks to MR technologies. MR applications are also used in patient education before interventions. Conclusions For surgical support, the achievable accuracy is often not sufficient. The main challenges are the non-rigid nature of the genitourinary organs, intraoperative data acquisition, online and multimodal registration and calibration of devices. However, the progress made in recent years is tremendous in all respects and the gap is constantly shrinking.

Augmented reality in medical education: students’ experiences and learning outcomes

“…Transrectal prostate biopsy practice and training can also be aided by this technology, to help control robot-assisted apparatus [ 32 ]. Multiple AR-based programs are already used for kidney surgery and training (and several more are likely to be soon adopted), including those to aid patient education [ 33 , 34 ]. Wolf et al describe the recent development of an AR program using Microsoft HoloLens 2, for training the surgical procedure of extracorporeal membrane oxygenation cannulation.…”

Virtual und Augmented Reality in der Urologie

“…Diese ermöglichen ebenfalls am „point of care“ eine Fusion realer Organe/Körper mit patientenindividuellen virtuellen Hologrammen und sollen so die Navigation während der Operation erleichtern (Abb. 2 ; [ 8 ]). Laut Yoon et al.…”

“…Dies verbunden mit dem Ziel, relevante Parameter wie Verringerung der Komplikationsraten, Kosteneinsparungen und präzisere chirurgische Ergebnisse mit entsprechend einhergehender verbesserter Lebensqualität und -erwartung für die Patienten zu ermöglichen. Isoliert das Fachgebiet der Urologie betrachtet haben bereits viele KollegInnen in systematischen Reviews umfassend die bestehenden Anwendungsversuche beleuchtet und mussten hierbei festhalten [ 1 , 6 , 8 ], dass zwar einige interessante Anwendungsideen und Ansätze in der Urologie bestehen, diese jedoch noch den Beweis schuldig bleiben, tatsächlich die urologische Versorgung hinsichtlich der oben genannten Parameter bzw. Endpunkte zu optimieren.…”

AEducaAR, Anatomical Education in Augmented Reality: A Pilot Experience of an Innovative Educational Tool Combining AR Technology and 3D Printing

“…Unlike VR, which creates a totally artificial environment, AR uses the existing real environment and overlays new information on top of it, thus providing a composite view. In recent years, AR has been proposed and applied as an aiding tool in many healthcare sectors, including neurosurgery [13], urology [14][15][16], orthopedics [17,18], and craniomaxillofacial surgery [19][20][21][22][23]. AR is rapidly growing with many new potential applications also in the medical education field [24].…”