The status of augmented reality in laparoscopic surgery as of 2016

Bernhardt, Sylvain; Nicolau, Stéphane; Soler, Luc; Doignon, Christophe

doi:10.1016/j.media.2017.01.007

Cited by 260 publications

(176 citation statements)

References 235 publications

Supporting

Mentioning

157

Contrasting

Unclassified

Order By: Relevance

“…Another goal in AR is the inclusion of preoperative planning data by displaying cutting trajectories, virtual tumor models, and access routes (e.g. optimized trocar sites) to guide the surgeon through the surgery [1].…”

Section: Augmented Realitymentioning

confidence: 99%

Enhanced Visualization: From Intraoperative Tissue Differentiation to Augmented Reality

et al. 2018

View full text Add to dashboard Cite

Background: Optimal visualization of the operative field and methods that additionally provide supportive optical information form the basis for target-directed and successful surgery. This article strives to give an overview of current enhanced visualization techniques in visceral surgery and to highlight future developments. Methods: The article was written as a comprehensive review on this topic and is based on a MEDLINE search and ongoing research from our own group and from other working groups. Results: Various techniques for enhanced visualization are described comprising augmented reality, unspecific and targeted staining methods, and optical modalities such as narrow-band imaging. All facilitate our surgical performance; however, due to missing randomized controlled studies for most of the innovations reported on, the available evidence is low. Conclusion: Many new visualization technologies are emerging with the aim to improve our perception of the surgical field leading to less invasive, target-oriented, and elegant treatment forms that are of significant benefit to our patients.

show abstract

Section: Augmented Realitymentioning

confidence: 99%

Enhanced Visualization: From Intraoperative Tissue Differentiation to Augmented Reality

et al. 2018

View full text Add to dashboard Cite

show abstract

“…Third, a key challenge is acceptance of the HMD into the radiology reading room. There has been extensive research into the augmented reality in surgery [39][40][41] and experience has dictated that bulky HMDs will not be accepted into the operating room by surgeons [42].…”

Section: What Are the Potential Limitations Of The Ar/vr Approach Ovementioning

confidence: 99%

Augmented Reality: Advances in Diagnostic Imaging

Douglas

Wilke

Gibson

et al. 2017

MTI

View full text Add to dashboard Cite

Abstract:In recent years, advances in medical imaging have provided opportunities for enhanced diagnosis and characterization of diseases including cancer. The improved spatial resolution provides outstanding detail of intricate anatomical structures, but has challenged physicians on how to effectively and efficiently review the extremely large datasets of over 1000 images. Standard volume rendering attempts to tackle this problem as it provides a display of 3D information on a flat 2D screen, but it lacks depth perception and has poor human-machine interface (HMI). Most recently, Augmented Reality/Virtual Reality (AR/VR) with depth 3-dimensional (D3D) imaging provides depth perception through binocular vision, head tracking for improved HMI and other key AR features. In this article, we will discuss current and future medical applications of AR including assessing breast cancer. We contend that leveraging AR technology may enhance diagnosis, save cost and improve patient care.

show abstract

“…Laparoscopic surgery has significant advantages over open surgery due to less patient trauma and faster recovery times, yet it can be difficult to perform due to the restricted field of view and lack of haptic feedback. Image guidance, and specifically augmented reality, has been proposed as a way to alleviate this problem and reduce the risk of complication . Most guidance systems use optical tracking .…”

Section: Introductionmentioning

confidence: 99%

Electromagnetic tracking in image‐guided laparoscopic surgery: Comparison with optical tracking and feasibility study of a combined laparoscope and laparoscopic ultrasound system

et al. 2018

View full text Add to dashboard Cite

PurposeIn image‐guided laparoscopy, optical tracking is commonly employed, but electromagnetic (EM) systems have been proposed in the literature. In this paper, we provide a thorough comparison of EM and optical tracking systems for use in image‐guided laparoscopic surgery and a feasibility study of a combined, EM‐tracked laparoscope and laparoscopic ultrasound (LUS) image guidance system.MethodsWe first assess the tracking accuracy of a laparoscope with two optical trackers tracking retroreflective markers mounted on the shaft and an EM tracker with the sensor embedded at the proximal end, using a standard evaluation plate. We then use a stylus to test the precision of position measurement and accuracy of distance measurement of the trackers. Finally, we assess the accuracy of an image guidance system comprised of an EM‐tracked laparoscope and an EM‐tracked LUS probe.ResultsIn the experiment using a standard evaluation plate, the two optical trackers show less jitter in position and orientation measurement than the EM tracker. Also, the optical trackers demonstrate better consistency of orientation measurement within the test volume. However, their accuracy of measuring relative positions decreases significantly with longer distances whereas the EM tracker's performance is stable; at 50 mm distance, the RMS errors for the two optical trackers are 0.210 and 0.233 mm, respectively, and it is 0.214 mm for the EM tracker; at 250 mm distance, the RMS errors for the two optical trackers become 1.031 and 1.178 mm, respectively, while it is 0.367 mm for the EM tracker. In the experiment using the stylus, the two optical trackers have RMS errors of 1.278 and 1.555 mm in localizing the stylus tip, and it is 1.117 mm for the EM tracker. Our prototype of a combined, EM‐tracked laparoscope and LUS system using representative calibration methods showed a RMS point localization error of 3.0 mm for the laparoscope and 1.3 mm for the LUS probe, the lager error of the former being predominantly due to the triangulation error when using a narrow‐baseline stereo laparoscope.ConclusionsThe errors incurred by optical trackers, due to the lever‐arm effect and variation in tracking accuracy in the depth direction, would make EM‐tracked solutions preferable if the EM sensor is placed at the proximal end of the laparoscope.

show abstract

The status of augmented reality in laparoscopic surgery as of 2016

Cited by 260 publications

References 235 publications

Enhanced Visualization: From Intraoperative Tissue Differentiation to Augmented Reality

Enhanced Visualization: From Intraoperative Tissue Differentiation to Augmented Reality

Augmented Reality: Advances in Diagnostic Imaging

Electromagnetic tracking in image‐guided laparoscopic surgery: Comparison with optical tracking and feasibility study of a combined laparoscope and laparoscopic ultrasound system

Contact Info

Product

Resources

About