Towards a Clinical Stereoscopic Augmented Reality System for Laparoscopic Surgery

Kang, Xin; Oh, Jihun; Wilson, Emmanuel; Yaniv, Ziv; Kane, Timothy D.; Peters, Craig A.; Shekhar, Raj

doi:10.1007/978-3-319-14127-5_14

Cited by 4 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the Brigham and Women’s Hospital (Boston, MA, USA) PLUS is used for US-based brain shift visualization during surgery (Fig. 10) and for MRI/US fusion to help diagnosis and treatment of prostate cancer ([10]), at University of British Columbia (Vancouver, BC, Canada) for research in US-guided spine interventions [9], [14], at the Children’s National Medical Center (Washington, DC, USA) for calibration of laparoscopic ultrasound probes ([13]), at the Duesseldorf University Hospital (Duesseldorf, Germany) for navigation in neck surgery ([42]) and several other groups are using or currently evaluating the toolkit (such as [12], [43], [15]).…”

Section: Resultsmentioning

confidence: 99%

“…However, most commercially available systems provide only basic features, such as real-time display of tool position, point marking, point-based registration, and volume reconstruction, reslicing, and fusion. Introduction of more advanced guidance techniques into products, such as automatic image or atlas-based registration, image-based tracking, robotic assistance, real-time motion compensation, real-time multi-modality image and data fusion ([9], [10], [11], [12], [13], [7], [14], [15]) need extensive explorative and development work.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems

Lassó

Heffter

Rankin

et al. 2014

IEEE Trans. Biomed. Eng.

337

194

View full text Add to dashboard Cite

A variety of advanced image analysis methods have been under development for ultrasound-guided interventions. Unfortunately, the transition from an image analysis algorithm to clinical feasibility trials as part of an intervention system requires integration of many components, such as imaging and tracking devices, data processing algorithms, and visualization software. The objective of our work is to provide a freely available open-source software platform – PLUS: Public software Library for Ultrasound – to facilitate rapid prototyping of ultrasound-guided intervention systems for translational clinical research. PLUS provides a variety of methods for interventional tool pose and ultrasound image acquisition from a wide range of tracking and imaging devices, spatial and temporal calibration, volume reconstruction, simulated image generation, and recording and live streaming of the acquired data. This paper introduces PLUS, explains its functionality and architecture, and presents typical uses and performance in ultrasound-guided intervention systems. PLUS fulfills the essential requirements for the development of ultrasound-guided intervention systems and it aspires to become a widely used translational research prototyping platform. PLUS is freely available as open source under BSD license, the code and documentation are available at http://www.plustoolkit.org.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems

Lassó

Heffter

Rankin

et al. 2014

IEEE Trans. Biomed. Eng.

337

194

View full text Add to dashboard Cite

show abstract

“…1–6 Specifically, it is critical to our recently developed augmented reality (AR) system, 7,8 which superimposes laparoscopic ultrasound images onto real-time laparoscopic video using device location and orientation data from optical tracking. These systems have the potential to help the surgeon better visualize and comprehend locations of critical internal structures, such as the blood vessels, bile ducts, and tumors, beneath the visible organ surfaces.…”

Section: Introductionmentioning

confidence: 99%

Application of single-image camera calibration for ultrasound augmented laparoscopic visualization

Liu

Kang

et al. 2015

SPIE Proceedings

Self Cite

View full text Add to dashboard Cite

Accurate calibration of laparoscopic cameras is essential for enabling many surgical visualization and navigation technologies such as the ultrasound-augmented visualization system that we have developed for laparoscopic surgery. In addition to accuracy and robustness, there is a practical need for a fast and easy camera calibration method that can be performed on demand in the operating room (OR). Conventional camera calibration methods are not suitable for the OR use because they are lengthy and tedious. They require acquisition of multiple images of a target pattern in its entirety to produce satisfactory result. In this work, we evaluated the performance of a single-image camera calibration tool (rdCalib; Percieve3D, Coimbra, Portugal) featuring automatic detection of corner points in the image, whether partial or complete, of a custom target pattern. Intrinsic camera parameters of a 5-mm and a 10-mm standard Stryker® laparoscopes obtained using rdCalib and the well-accepted OpenCV camera calibration method were compared. Target registration error (TRE) as a measure of camera calibration accuracy for our optical tracking-based AR system was also compared between the two calibration methods. Based on our experiments, the single-image camera calibration yields consistent and accurate results (mean TRE = 1.18 ± 0.35 mm for the 5-mm scope and mean TRE = 1.13 ± 0.32 mm for the 10-mm scope), which are comparable to the results obtained using the OpenCV method with 30 images. The new single-image camera calibration method is promising to be applied to our augmented reality visualization system for laparoscopic surgery.

show abstract