Augmented reality assisted surgery: a urologic training tool

Abstract

Augmented reality is widely used in aeronautics and is a developing concept within surgery. In this pilot study, we developed an application for use on Google Glass® optical head-mounted display to train urology residents in how to place an inflatable penile prosthesis. We use the phrase Augmented Reality Assisted Surgery to describe this novel application of augmented reality in the setting of surgery. The application demonstrates the steps of the surgical procedure of inflatable penile prosthesis placement. It also contains software that allows for detection of interest points using a camera feed from the optical head-mounted display to enable faculty to interact with residents during placement of the penile prosthesis. Urology trainees and faculty who volunteered to take part in the study were given time to experience the technology in the operative or perioperative setting and asked to complete a feedback survey. From 30 total participants using a 10-point scale, educational usefulness was rated 8.6, ease of navigation was rated 7.6, likelihood to use was rated 7.4, and distraction in operating room was rated 4.9. When stratified between trainees and faculty, trainees found the technology more educationally useful, and less distracting. Overall, 81% of the participants want this technology in their residency program, and 93% see this technology in the operating room in the future. Further development of this technology is warranted before full release, and further studies are necessary to better characterize the effectiveness of Augmented Reality Assisted Surgery in urologic surgical training.

Review of the effect of 3D medical printing and virtual reality on urology training with ‘MedTRain3DModsim’ Erasmus + European Union Project

“…Aside from VR-based simulators, there is a new trend of the development and AR applications use in urology, such as laporoscopic skills [48] and PCNL [49]. There are also few published studies about the feasibility and safety of AR-assisted urological surgery using smart glasses [50,51]. Bertolo et al [52] stressed that, based on the existing evidence, they were unable to state that AR improved the outcomes of urological interventions.…”

Penile implants: a look into the future

“…Today, bacterial and fungal resistances becoming more of a reality for health care providers, the penile implant of the future should evolve to use newer technology that does not rely on antimicrobials, which are bound to encounter resistances. With the emergence of new surgical technology such as Augmented Reality Assisted Surgery (ARAS) may further educate surgeons and warn of potential dangers along with simplifying the IPP operation ( 43 ).…”

Tragbare Technologien für Urologen

“…In der Urologie wurde Google Glass unter Verwendung des Head-up-Displays (Blickfeldanzeige) zur Projektion der Operationsschritte erfolgreich als Trainingstool für Weiterbildungsassistenten bei der Durchführung einer Penisprothesenimplantation eingesetzt [14]. Eine Umfrage unter ärztlichen Google-Glass-Nutzern deckte mögliche Schwächen und ein damit verbundenes Entwicklungspotenzial auf: Als technische Limitationen wurden die Ergonomie (68 %), die Bildposition (87 %) und die Akkulaufzeit (87 %) sowie die Internet-und Serversicherheit (73 %) genannt [15].…”