Overlay visualization in endoscopic ENT surgery

Winne, C.; Khan, Mubarak Muhamed; Stopp, F.; Jank, Emanuel; Keeve, Erwin

doi:10.1007/s11548-010-0507-7

Cited by 41 publications

(26 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…An earlier version of this platform featured optical-based tracking and was described by Winne et al in a report that included both a cadaveric study and a case series. 4 The current platform, used in this report, incorporates an optional electromagnetic-based tracking technology, and thus permits the incorporation of microsensors, which may be incorporated into the distal tips of instruments and wires. In addition, the current softeware offers a novel preoperative planning phase, known as Building Blocks; this software package facilitates highlighting of relevant anatomy throughout the paranasal sinuses and adjacent structures.…”

Section: Discussionmentioning

confidence: 99%

“…Technically, endoscopic procedures require a registration of the view obtained through the conventional telescope with corresponding 3D models built from preoperative imaging data. 5 The feasibility of overlaying target models on endoscopic images has been confirmed in a cadaveric model of sinus surgery and in a brief clinical report; 4 however, this report did not describe the specific clinical utility provided by augmented reality information. The current project uses a navigation system that is commercially available outside the US as a platform for exploring applications of AR in endoscopic sinus surgery.…”

Section: Introductionmentioning

confidence: 96%

“…Through AR, the surgeon may annotate images preoperatively and then visualize that information as a projection that is displayed over the anatomy in the surgeon's view. 3,4 To create this AR view for endoscopic procedures, the annotated models and endoscopic images must be aligned and then the computer system must present a hybrid image of actual endoscopy and the corresponding annotated models. Technically, endoscopic procedures require a registration of the view obtained through the conventional telescope with corresponding 3D models built from preoperative imaging data.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study

Citardi¹,

Agbetoba²,

Bigcas³

et al. 2015

Int Forum Allergy Rhinol

View full text Add to dashboard Cite

Introduction Augmented reality (AR) fuses computer-generated images of preoperative imaging data with real-time views of the surgical field. Scopis Hybrid Navigation (Scopis, GmbH, Berlin, Germany) is a surgical navigation system with AR capabilities for endoscopic sinus surgery (ESS). Methods Pre-dissection planning was performed with Scopis Hybrid Navigation software followed by ESS dissection on 2 human specimens using conventional ESS instruments. Results Pre-dissection planning included creating models of relevant frontal recess structures and the frontal sinus outflow pathway on orthogonal CT images. Positions of the optic nerve and internal carotid artery were marked on the CT images. Models and annotations were displayed as an overlay on the endoscopic images during the dissection, which was performed with electromagnetic surgical navigation. The accuracy of the AR images relative to underlying anatomy was better than 1.5 mm. The software's trajectory targeting tool was used to guide instrument placement along the frontal sinus outflow pathway. AR imaging of the optic nerve and internal carotid artery served to mark the positions of these structures during the dissection. Conclusions Surgical navigation with AR was easily deployed in this cadaveric model of ESS. This technology builds upon the positive impact of surgical navigation during ESS, particularly during frontal recess surgery. Instrument tracking with this technology facilitates identifying and cannulation of the frontal sinus outflow pathway without dissection of the frontal recess anatomy. AR can also highlight “anti-targets” (i.e., structures to be avoided), such as the optic nerve and internal carotid artery, and thus reduce surgical complications and morbidity.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 96%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study

Citardi¹,

Agbetoba²,

Bigcas³

et al. 2015

Int Forum Allergy Rhinol

View full text Add to dashboard Cite

show abstract

“…Wittenberg et al [166] (2006) presented a 3D reconstruction of the sphenoid sinus with a shape-from-motion approach. While several papers have used external tracking systems to enable real-time guidance during surgery (Konen et al [80] (2007), Winne et al [165] (2011), Schulze et al [124] (2010), Daly et al [45] (2010)), Shahidi et al [129] (2002) and Lapeer et al [85] (2008) used passive optical markers and image-processing techniques to substitute for the external tracking system. Mirota et al [102], [103] (2009-2012) argued that direct registration of a 3D reconstruction from endoscopic video and a preoperative CT scan can improve accuracy, since the detour through external tracking systems tends to introduce significant errors.…”

Section: Approachesmentioning

confidence: 99%

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

Bergen

Wittenberg

2016

IEEE J. Biomed. Health Inform.

View full text Add to dashboard Cite

Endoscopic procedures form part of routine clinical practice for minimally invasive examinations and interventions. While they are beneficial for the patient, reducing surgical trauma and making convalescence times shorter, they make orientation and manipulation more challenging for the physician, due to the limited field of view through the endoscope. However, this drawback can be reduced by means of medical image processing and computer vision, using image stitching and surface reconstruction methods to expand the field of view. This paper provides a comprehensive overview of the current state of the art in endoscopic image stitching and surface reconstruction. The literature in the relevant fields of application and algorithmic approaches is surveyed. The technological maturity of the methods and current challenges and trends are analyzed.

show abstract

“…More recently, Lapeer et al [4] evaluated a similar system, again using passive optical markers for tracking and reported that sub-millimeter accuracy still remains elusive. Various tracker-based methods have appeared recently, including [5] and [6], where a system similar to an Optotrak was used to track the endoscope and provided an augmented display. Schulze et al [7] reported a system using the Medtronic StealthStation along with novel rendering techniques to provide a side-by-side live versus virtual endoscopy.…”

mentioning

confidence: 99%

A System for Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery

Mirota

Wang

Taylor

et al. 2012

IEEE Trans. Med. Imaging

View full text Add to dashboard Cite

Abstract-Surgeries of the skull base require accuracy to safely navigate the critical anatomy. This is particularly the case for endoscopic endonasal skull base surgery (ESBS) where the surgeons work within millimeters of neurovascular structures at the skull base. Today's navigation systems provide approximately 2 mm accuracy. Accuracy is limited by the indirect relationship of the navigation system, the image and the patient. We propose a method to directly track the position of the endoscope using video data acquired from the endoscope camera. Our method first tracks image feature points in the video and reconstructs the image feature points to produce three-dimensional (3D) points, and then registers the reconstructed point cloud to a surface segmented from pre-operative computed tomography (CT) data. After the initial registration, the system tracks image features and maintains the two-dimensional (2D)-3D correspondence of image features and 3D locations. These data are then used to update the current camera pose. We present a method for validation of our system, which achieves sub-millimeter (0.70 mm mean) target registration error (TRE) results.

show abstract

Overlay visualization in endoscopic ENT surgery

Abstract: The new techniques safely support the surgeon in locating target structures in the paranasal sinuses with little change in the actual workflow.

Cited by 41 publications

References 11 publications

Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study

Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

A System for Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery

Contact Info

Product

Resources

About