Extended, virtual and augmented reality in thoracic surgery: a systematic review

Abstract

OBJECTIVES Extended reality (XR), encompassing both virtual reality (VR) and augmented reality, allows the user to interact with a computer-generated environment based on reality. In essence, the immersive nature of VR and augmented reality technology has been warmly welcomed in all aspects of medicine, gradually becoming increasingly feasible to incorporate into everyday practice. In recent years, XR has become increasingly adopted in thoracic surgery, although the extent of its applications is unclear. Here, we aim to review the current applications of XR in thoracic surgery. METHODS A systematic database search was conducted of original articles that explored the use of VR and/or augmented reality in thoracic surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar, from inception to December 2020. RESULTS Our search yielded 1494 citations, of which 21 studies published from 2007 to 2019 were included in this review. Three main areas were identified: (i) the application of XR in thoracic surgery training; (ii) preoperative planning of thoracic procedures; and (iii) intraoperative assistance. Overall, XR could produce progression along the learning curve, enabling trainees to reach acceptable standards before performing in the operating theatre. Preoperatively, through the generation of 3D-renderings of the thoracic cavity and lung anatomy, VR increases procedural accuracy and surgical confidence through familiarization of the patient’s anatomy. XR-assisted surgery may have therapeutic use particularly for complex cases, where conventional methods would yield inadequate outcomes due to inferior accuracy. CONCLUSION XR represents a salient step towards improving thoracic surgical training, as well as enhancing preoperative planning and intraoperative guidance.

Congenital Heart Surgery Skill Training Using Simulation Models: Not an Option but a Necessity

“…The extended reality simulators using virtual reality, augmented reality and mixed reality technologies can be advantageous over physical simulators as they can be used by multiple users and repeated any number of times with real-time instruction and feedback. 36 37 However, the user’s perception of the depth on a computer screen or in a holographic space and the tactile sensation can be unrealistic and may result in unforeseen procedural mistakes. 20 In general, usable extended reality-based simulators have not yet arrived in the field of CHS.…”

A Coordinate-Regression-Based Deep Learning Model for Catheter Detection during Structural Heart Interventions

“…Our group [15][16][17], among others [18][19][20][21], have shown the promise of augmented and mixed-reality visualization to address the limitations in depth perception for cardiac interventions by using 3D holographic headsets. In order to leverage mixed-reality technology as a navigation tool for fluoroscopy-guided percutaneous procedures, catheter tracking is a cornerstone of the image guidance system.…”

Gaze behavior is related to objective technical skills assessment during virtual reality simulator-based surgical training: a proof of concept

“…Virtual reality (VR) simulators offer high fidelity reusable environments [2] and the possibility to work on several procedures in a single device. VR simulation-based learning has been reported in many disciplines such as thoracic [3], urologic [4] and orthopedic [5] surgery. It has been demonstrated that VR training on arthroscopy significantly improves performance (e.g.…”