Endoscopic navigation system with extended field of view using augmented reality technology

Bong, Jae Hwan; Song, Hyun Jong; Oh, Yoojin; Park, Namji; Kim, Hyung-Min; Park, Shinsuk

doi:10.1002/rcs.1886

Cited by 35 publications

(53 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[27]. Surgical navigation system prototypes with image fusion on the endoscopic view, have so far not reached TRE values of such low levels [21,22,42,43]. The use of intraoperative CBCT has been suggested as a solution to this problem, as higher registration accuracy on the endoscopic view can be achieved.…”

Section: Discussionmentioning

confidence: 99%

“…Thus, a computer-generated image of a pre-planned surgical target, path or risk organ, can be integrated in the endoscope's real-world view. In this way, sub-surface structures can be visualized and a pointer tool is not needed [20][21][22]. AR navigation systems have been successfully applied in several surgical fields, including microsurgery and spine surgery [23][24][25][26].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

et al. 2020

View full text Add to dashboard Cite

ObjectiveSurgical navigation is a well-established tool in endoscopic skull base surgery. However, navigational and endoscopic views are usually displayed on separate monitors, forcing the surgeon to focus on one or the other. Aiming to provide real-time integration of endoscopic and diagnostic imaging information, we present a new navigation technique based on augmented reality with fusion of intraoperative cone beam computed tomography (CBCT) on the endoscopic view. The aim of this study was to evaluate the accuracy of the method. Material and methodsAn augmented reality surgical navigation system (ARSN) with 3D CBCT capability was used. The navigation system incorporates an optical tracking system (OTS) with four video cameras embedded in the flat detector of the motorized C-arm. Intra-operative CBCT images were fused with the view of the surgical field obtained by the endoscope's camera. Accuracy of CBCT image co-registration was tested using a custom-made grid with incorporated 3D spheres.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

et al. 2020

View full text Add to dashboard Cite

show abstract

“…5 We used a similar approach in our attempt to analyze a diverse oncologic cohort in relationship to newer expanded endoscopic surgery. Recent technological developments in endoscopic procedures 6 and navigational software including augmented, and virtual reality systems [7][8][9] have advanced the field of endoscopic skull base surgery, warranting reevaluation of traditional paradigms with regard to management of skull base malignancies.…”

Section: Introductionmentioning

confidence: 99%

The Role of Advanced Endoscopic Resection of Diverse Skull Base Malignancies: Technological Analysis during an 8-Year Single Institutional Experience

Rutland

Goldrich

Loewenstern

et al. 2020

J Neurol Surg B Skull Base

View full text Add to dashboard Cite

Background Resection of skull base malignancies poses complex pathological and treatment-related morbidities. Recent technological advancements of endoscopic endonasal surgery (EES) offer the ability to reexamine traditional treatment paradigms with endoscopic procedures. The utility of EES was quantitatively examined in a longitudinal series with attention to morbidities and postoperative outcomes. Methods A single-center retrospective review was performed of all malignant sinonasal tumors from 2010 to 2018. Patients with purely EES were selected for analysis. Disease features, resection extent, complications, adjuvant treatment, recurrence, and survivability were assessed. Despite the mixed pathological cohort, analysis was performed to identify technical aspects of resection. Results A total of 68 patients (47.6% males and 52.4% females, average age: 60.3 years) were included. A diversity of histotypes included clival chordoma (22.1%), olfactory neuroblastoma (14.7%), squamous cell carcinoma (11.8%), and adenoid cystic carcinoma (11.8%). Gross total resection (GTR) was achieved in 83.8% of cases. Infection (4.4%) and cerebrospinal fluid leak (1.5%) were the most common postoperative complications. Total 46 patients (67.6%) underwent adjuvant treatment. The average time between surgery and initiation of adjunctive surgery was 55.7 days. Conclusion In our 8-year experience, we found that entirely endoscopic resection of mixed pathology of malignant skull base tumors is oncologically feasible and can be accomplished with high GTR rates. There may be a role for EES to reduce operative morbidity and attenuate time in between surgery and adjuvant treatment, which can be augmented through recent mixed reality platforms. Future studies are required to systematically compare the outcomes with those of open surgical approaches.

show abstract

“…Moreover, in most studies the set-up required a conventional tracking system (mechanical, optical or electromagnetic). Similarly, in cranial base domain, mutual information, contour-based and point-based registration methods such as ICP have been widely used 10,13,[15][16][17][18] . Clinically, 5-10 minutes registration time has been regarded as acceptable with submillimetric precision 19 .…”

mentioning

confidence: 99%

“…Moreover, anatomical landmarks are difficult to ascertain and track once the procedure starts as they may shift or become obscured from fluids or instruments. Different systems have adopted external tracking systems like optical or electromagnetic trackers to track the motion between the patient and the camera 10,16,20,21 . However, they are expensive and bulky.…”

mentioning

confidence: 99%

Video-based augmented reality combining CT-scan and instrument position data to microscope view in middle ear surgery

Hussain¹,

Lalande²,

Marroquin³

et al. 2020

Sci Rep

View full text Add to dashboard Cite

the aim of the study was to develop and assess the performance of a video-based augmented reality system, combining preoperative computed tomography (ct) and real-time microscopic video, as the first crucial step to keyhole middle ear procedures through a tympanic membrane puncture. Six different artificial human temporal bones were included in this prospective study. Six stainless steel fiducial markers were glued on the periphery of the eardrum, and a high-resolution CT-scan of the temporal bone was obtained. Virtual endoscopy of the middle ear based on this CT-scan was conducted on Osirix software. Virtual endoscopy image was registered to the microscope-based video of the intact tympanic membrane based on fiducial markers and a homography transformation was applied during microscope movements. These movements were tracked using Speeded-Up Robust Features (SURF) method. Simultaneously, a micro-surgical instrument was identified and tracked using a Kalman filter. The 3D position of the instrument was extracted by solving a three-point perspective framework. For evaluation, the instrument was introduced through the tympanic membrane and ink droplets were injected on three middle ear structures. An average initial registration accuracy of 0.21 ± 0.10 mm (n = 3) was achieved with a slow propagation error during tracking (0.04 ± 0.07 mm). The estimated surgical instrument tip position error was 0.33 ± 0.22 mm. The target structures' localization accuracy was 0.52 ± 0.15 mm. The submillimetric accuracy of our system without tracker is compatible with ear surgery.

show abstract

Endoscopic navigation system with extended field of view using augmented reality technology

Abstract: The results show that the human subject can perform the task more precisely and safely with the developed AR-based navigation system than with the conventional endoscopic system.

Cited by 35 publications

References 33 publications

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

The Role of Advanced Endoscopic Resection of Diverse Skull Base Malignancies: Technological Analysis during an 8-Year Single Institutional Experience

Video-based augmented reality combining CT-scan and instrument position data to microscope view in middle ear surgery

Contact Info

Product

Resources

About