Exploring virtual reality technology and the Oculus Rift for the examination of digital pathology slides

Farahani, Navid; Post, Robert P.; Duboy, Jon; Ahmed, Ishtiaque; Kolowitz, Brian J.; Krinchai, Teppituk; Monaco, Sara E.; Fine, Jeffrey L.; Hartman, Douglas J.; Pantanowitz, Liron

doi:10.4103/2153-3539.181766

Cited by 55 publications

(37 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In 2016, after the release of two developer kits Oculus Rift DK1 and DK2, the first consumer‐grade Oculus Rift CV1 (Oculus VR, LLC., Menlo Park, CA) became available for the general public. Some examples of virtual reality applications within health science and medical education include: an examination of digital pathology slides using an Oculus Rift DK2 (Farahani et al, ); virtual drug design using gesture‐recognition instead of standard input devices (Norrby et al, ); and a 3D virtual anatomy puzzle using Oculus Rift DK2 (Messier et al, ). The release of modern 3D virtual systems has paved the way for new approaches to medical imaging and education and have demonstrated success as beneficial supplements in anatomical education (Miller, ; Peterson and Mlynarczyk, ).…”

Section: Introductionmentioning

confidence: 99%

The effectiveness of virtual and augmented reality in health sciences and medical anatomy

Moro

Štromberga

Raikos

et al. 2017

Anatomical Sciences Ed

633

612

View full text Add to dashboard Cite

Although cadavers constitute the gold standard for teaching anatomy to medical and health science students, there are substantial financial, ethical, and supervisory constraints on their use. In addition, although anatomy remains one of the fundamental areas of medical education, universities have decreased the hours allocated to teaching gross anatomy in favor of applied clinical work. The release of virtual (VR) and augmented reality (AR) devices allows learning to occur through hands-on immersive experiences. The aim of this research was to assess whether learning structural anatomy utilizing VR or AR is as effective as tablet-based (TB) applications, and whether these modes allowed enhanced student learning, engagement and performance. Participants (n = 59) were randomly allocated to one of the three learning modes: VR, AR, or TB and completed a lesson on skull anatomy, after which they completed an anatomical knowledge assessment. Student perceptions of each learning mode and any adverse effects experienced were recorded. No significant differences were found between mean assessment scores in VR, AR, or TB. During the lessons however, VR participants were more likely to exhibit adverse effects such as headaches (25% in VR P < 0.05), dizziness (40% in VR, P < 0.001), or blurred vision (35% in VR, P < 0.01). Both VR and AR are as valuable for teaching anatomy as tablet devices, but also promote intrinsic benefits such as increased learner immersion and engagement. These outcomes show great promise for the effective use of virtual and augmented reality as means to supplement lesson content in anatomical education. Anat Sci Educ 10: 549-559. © 2017 American Association of Anatomists.

show abstract

Section: Introductionmentioning

confidence: 99%

The effectiveness of virtual and augmented reality in health sciences and medical anatomy

Moro

Štromberga

Raikos

et al. 2017

Anatomical Sciences Ed

633

612

View full text Add to dashboard Cite

show abstract

“…18 Similarly, low image resolution of the Oculus Rift device was a major limitation for viewing WSIs. 1 This study showed that image quality with the HoloLens was sufficient for viewing gross and microscopic (eg, WSI) pathology images. The resolution of the HoloLens of 2536 3 1440 (1268 3 720 per eye) surpasses that of earlier VR/AR devices.…”

Section: Discussionmentioning

confidence: 81%

“…Compared to AR, VR solutions are more widely developed and used, even for use in pathology. 1,[12][13][14][15][16][17] To the best of our knowledge, we are not aware of any other studies demonstrating AR-specific applications using the Hol-oLens in pathology.…”

Section: Discussionmentioning

confidence: 99%

“…AR technology differs from devices for virtual reality (VR) that completely immerse a user within a virtual experience (eg, Oculus Rift [Menlo Park, California], HTC Vive [Taoyuan, Taiwan]). 1 Most AR and VR devices include a head-mounted display, where an ergonomically assembled headset provides a viewable display for humancomputer interaction. The Microsoft HoloLens is a wearable headset that projects a visible image in the user's point of view.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

Hanna¹,

Ahmed²,

Nine³

et al. 2018

Archives of Pathology &Amp; Laboratory Medicine

Self Cite

174

105

View full text Add to dashboard Cite

Context Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field. Objective To test the HoloLens for clinical and nonclinical applications in pathology. Design A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation. Results Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation. Conclusions The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

show abstract

“…Only recently, the first VR systems have been developed which are designed for diagnostic purposes. Examples are tools for the analysis of pathology slides [9] and tools which visualize the changes in sizes and shapes of tumors over time in a 3D virtual setting [21]. Ard et al [1] have developed a VR system which visualizes brain MRI scans as well as several augmentations of the data.…”

Section: Related Workmentioning

confidence: 99%