Virtual and augmented reality: potential applications in radiology

Elsayed, Mohammad; Kadom, Nadja; Ghobadi, Comeron W.; Strauss, Benjamin; Dandan, Omran Al; Aggarwal, Abhimanyu; Anzai, Yoshimi; Griffith, Brent; Lazarow, Frances; Straus, Christopher M.; Safdar, Nabile M.

doi:10.1177/0284185119897362

Cited by 49 publications

(21 citation statements)

References 78 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It allows the correlation of different morphometric characteristics with the size of the minimally invasive approach; and enables more accurate manual measurements of distances and angles of 3D structures. By reconstructing virtual reality from co-registered CT angiographic and MRI volumes, it is easier to take into consideration several important anatomic structures such as bones, vessels, nerves and other important structures, and to study how different structures affect the size and path of minimally invasive approach (Knez and Vrtovec, 2020;Deora et al, 2020;Elsayed et al, 2020). However, virtual reality also has some limitations, such as ergonomic limitations from prolonged use and relatively high costs for hardware and software adoption and use (Porcino et al, 2017;Sutherland et al, 2019).…”

Section: Discussionmentioning

confidence: 99%

“…The role of virtual reality has been increasingly recognised in surgical procedure planning where it can aid in the understanding of complex anatomical relationships, and its use has already been described for brain and abdominal tumour resections, nephrectomies, cerebral aneurysm clipping and others (Rizzetto et al, 2020). Moreover, it is also increasingly used for diagnosis since it allows "immersion" in the image to better visualize target areas and therefore improves detection, localization and evaluation of pathologic formations (Elsayed et al, 2020). In interventional radiology the use of virtual reality has been to date restricted mainly to visualization of complex structures before the procedure to improve operator confidence (Devcic et al, 2018) and for practicing interventional procedures using phantoms (Kuhlemann et al, 2017).…”

Section: Introductionmentioning

confidence: 99%

“…3D virtual probes are used for interactive measurement of various geometrical characteristics of organs (Janáček and Jirák, 2019). Virtual reality can be reconstructed from medical image data such as computed tomography (CT) volumes depicting bony structures, CT angiography volumes depicting bony structures and vessels, magnetic resonance imaging (MRI) volumes depicting soft tissue structures and co-registered CT with MRI that provide information on bony and soft tissue structures (Yoshinob et al, 2019;Elsayed et al, 2020).…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Quantification of the Interventional Approaches Into the Pterygopalatine Fossa by Solid Angles Using Virtual Reality

et al. 2021

View full text Add to dashboard Cite

Virtual reality is increasingly used in medicine for diagnostics, for visualisation of complex structures and for preoperative planning. In interventional radiology, minimally invasive approach could be described with a target point representing the desired needle tip position and an array of all possible trajectories leading to it resembling irregular “cone” or “pyramid”. We present a pilot study of planning a minimally invasive posterior infrazygomatic and suprazygomatic approaches into the pterygopalatine fossa using a solid angle as a measure of size of the approach in five virtually reconstructed heads. The minimally invasive approaches were planned by manually drawing the edges of “pyramids” that described each approach in 3D using virtual reality program Tracer. For each head, a transverse diameter was measured and for each approach a solid angle size, average edge length and estimated area on the skin from where the target point could be reached were calculated. We found that, the solid angle of posterior infrazygomatic approach was significantly larger than suprazygomatic approach (p0.001). Furthermore, the transverse head diameter and solid angle in posterior infrazygomatic approach were negatively correlated (ρ=-0.55, p=0.0002), while transverse head diameter and the estimated area on the skin from where the target point could be reached in the suprazygomatic approach were positively correlated (ρ=0.37, p=0.0206). In conclusion, our findings provide important preliminary evidence on the feasibility of evaluating and comparing different minimally invasive approaches using virtual reality systems, and affirm the validity of solid angle as a measure of the size of the approach.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Quantification of the Interventional Approaches Into the Pterygopalatine Fossa by Solid Angles Using Virtual Reality

et al. 2021

View full text Add to dashboard Cite

show abstract

“…If the information is available entirely in digital form, the user can view it on a monitor and manipulate it freely, e.g., in rotation, scale, brightness and contrast. This will aid in the understanding of complex anatomy, e.g., in the field of radiology [ 2 ]. Such visualization systems can even be extended into augmented or virtual reality (AR or VR).…”

Section: Introductionmentioning

confidence: 99%

Simulation-Based Estimation of the Number of Cameras Required for 3D Reconstruction in a Narrow-Baseline Multi-Camera Setup

Wachter¹,

Kost²,

Nahm³

2021

J. Imaging

View full text Add to dashboard Cite

Graphical visualization systems are a common clinical tool for displaying digital images and three-dimensional volumetric data. These systems provide a broad spectrum of information to support physicians in their clinical routine. For example, the field of radiology enjoys unrestricted options for interaction with the data, since information is pre-recorded and available entirely in digital form. However, some fields, such as microsurgery, do not benefit from this yet. Microscopes, endoscopes, and laparoscopes show the surgical site as it is. To allow free data manipulation and information fusion, 3D digitization of surgical sites is required. We aimed to find the number of cameras needed to add this functionality to surgical microscopes. For this, we performed in silico simulations of the 3D reconstruction of representative models of microsurgical sites with different numbers of cameras in narrow-baseline setups. Our results show that eight independent camera views are preferable, while at least four are necessary for a digital surgical site. In most cases, eight cameras allow the reconstruction of over 99% of the visible part. With four cameras, still over 95% can be achieved. This answers one of the key questions for the development of a prototype microscope. In future, such a system can provide functionality which is unattainable today.

show abstract

“…Augmented reality (AR) is an emerging technology that has the potential to help physicians with spatial reasoning during clinical interventions [4] – [8] . The term AR broadly describes computing devices that overlay digital information onto a view of the physical world.…”

Section: Introductionmentioning

confidence: 99%

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Andrews

Henry²,

Soriano³

et al. 2021

IEEE J. Transl. Eng. Health Med.

View full text Add to dashboard Cite

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergenceaccommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.

show abstract

Virtual and augmented reality: potential applications in radiology

Cited by 49 publications

References 78 publications

Quantification of the Interventional Approaches Into the Pterygopalatine Fossa by Solid Angles Using Virtual Reality

Quantification of the Interventional Approaches Into the Pterygopalatine Fossa by Solid Angles Using Virtual Reality

Simulation-Based Estimation of the Number of Cameras Required for 3D Reconstruction in a Narrow-Baseline Multi-Camera Setup

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Contact Info

Product

Resources

About