Augmented reality in laparoscopic surgical oncology

Nicolau, Stéphane; Soler, Luc; Mutter, Didier; Marescaux, Jacques

doi:10.1016/j.suronc.2011.07.002

Cited by 335 publications

(198 citation statements)

References 52 publications

Supporting

Mentioning

183

Contrasting

Unclassified

Order By: Relevance

“…AR is an image-guided surgical navigation system in which computer-based patient-specific images (virtual clone of the patient) are overlapped (registered) with real-life images. This allows to visualize some anatomical structures such as vessels (88,89) by transparency. The virtual clone of the patient is obtained through 3D reconstruction of preoperative CT or MRI images and computed with a specific software to obtain organ segmentation.…”

Section: Table 6 Miscellaneous (Most Significant) Complicationsmentioning

confidence: 99%

High intensity focused ultrasound (HIFU) applied to hepato-bilio-pancreatic and the digestive system—current state of the art and future perspectives

Diana¹,

Schiraldi²,

Liu³

et al. 2016

Hepatobiliary Surg. Nutr.

Self Cite

View full text Add to dashboard Cite

Background: High intensity focused ultrasound (HIFU) is emerging as a valid minimally-invasive imageguided treatment of malignancies. We aimed to review to current state of the art of HIFU therapy applied to the digestive system and discuss some promising avenues of the technology.Methods: Pertinent studies were identified through PubMed and Embase search engines using the following keywords, combined in different ways: HIFU, esophagus, stomach, liver, pancreas, gallbladder, colon, rectum, and cancer. Experimental proof of the concept of endoluminal HIFU mucosa/submucosa ablation using a custom-made transducer has been obtained in vivo in the porcine model. Results:Forty-four studies reported on the clinical use of HIFU to treat liver lesions, while 19 series were found on HIFU treatment of pancreatic cancers and four studies included patients suffering from both liver and pancreatic cancers, reporting on a total of 1,682 and 823 cases for liver and pancreas, respectively. Only very limited comparative prospective studies have been reported. Conclusions:Digestive system clinical applications of HIFU are limited to pancreatic and liver cancer. It is safe and well tolerated. The exact place in the hepatocellular carcinoma (HCC) management algorithm remains to be defined. HIFU seems to add clear survival advantages over trans arterial chemo embolization (TACE) alone and similar results when compared to radio frequency (RF). For pancreatic cancer, HIFU achieves consistent cancer-related pain relief. Further research is warranted to improve targeting accuracy and efficacy monitoring. Furthermore, additional work is required to transfer this technology on appealing treatments such as endoscopic HIFU-based therapies.Keywords: High intensity focused ultrasound (HIFU); liver cancer; pancreatic cancer; miniature HIFU delivery system; endoluminal applications of HIFU; mucosa and submucosal ablations using HIFU

show abstract

Section: Table 6 Miscellaneous (Most Significant) Complicationsmentioning

confidence: 99%

High intensity focused ultrasound (HIFU) applied to hepato-bilio-pancreatic and the digestive system—current state of the art and future perspectives

Diana¹,

Schiraldi²,

Liu³

et al. 2016

Hepatobiliary Surg. Nutr.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Augmented Reality (AR) or Augmented Virtuality (AV) systems can provide a more comfortable and e cient environment for the surgeon during surgery [15]. For example, in [16], pre-operative information about the disease and a surgical plan are fused with the intra-operative visualization of the surgical field.…”

Section: Introductionmentioning

confidence: 99%

Dense soft tissue 3D reconstruction refined with super-pixel segmentation for robotic abdominal surgery

et al. 2015

View full text Add to dashboard Cite

Purpose: Single Incision Laparoscopic Surgery (SILS) decreases post-operative infections, but introduces limitations in the surgeon's manoeuverability and in the surgical field of view. This work aims at enhancing intraoperative surgical visualization by exploiting the 3D information about the surgical site. An interactive guidance system is proposed wherein the pose of pre-operative tissue models is updated online. A critical process involves the intraoperative acquisition of tissue surfaces. It can be achieved using stereoscopic imaging and 3D reconstruction techniques. This work contributes to this process by proposing new methods for improved dense 3D reconstruction of soft tissues, which allows a more accurate deformation identification and facilitates the registration process.Methods: Two methods for soft tissue 3D reconstruction are proposed: Method 1 follows the traditional approach of the block matching algorithm. Method 2 performs a non-parametric Modified Census Transform to be more robust to illumination variation. The Simple Linear Iterative Clustering (SLIC) super pixel al- gorithm is exploited for disparity refinement by filling holes in the disparity images.Results: The methods were validated using two video datasets from the Hamlyn Centre, achieving an accuracy of 2.95 mm and 1.66 mm respectively. A comparison with ground truth data demonstrated the disparity refinement procedure: (i) increases the number of reconstructed points by up to 43%; (ii) does not a↵ect the accuracy of the 3D reconstructions significantly.Conclusion: Both methods give results that compare favourably with the state-of-the-art methods. The computational time constraints their applicability in realtime, but can be greatly improved by using a GPU implementation.

show abstract

“…The term registration refers to the alignment of pre-operative patient-specific models to intra-operatively acquired data. It may be used to augment the surgeon's view by visualization of structures below the tissue surface (Nicolau et al, 2011) (cf. Fig.…”

Section: Intra-operative Registration For Augmented Reality Guidancementioning

confidence: 99%

“…Recent reviews have discussed the role of computer vision in MIS Mirota et al, 2011;Stoyanov et al, 2012) and for surgical navigation (Baumhauer et al, 2008;Nicolau et al, 2011;Cleary and Peters, 2010). With this paper, which evolved from a tutorial on 3D surface reconstruction organized at the 14th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) 2011, we address a technical audience that is already familiar with the fundamental concepts in surgical navigation and computer vision.…”

Section: Introductionmentioning

confidence: 99%

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Maier-Hein

Mountney

Bartoli

et al. 2013

Medical Image Analysis

236

130

View full text Add to dashboard Cite

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-operative morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon's navigation capabilites by observing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted instruments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D optical imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions.

show abstract

Augmented reality in laparoscopic surgical oncology

Cited by 335 publications

References 52 publications

High intensity focused ultrasound (HIFU) applied to hepato-bilio-pancreatic and the digestive system—current state of the art and future perspectives

High intensity focused ultrasound (HIFU) applied to hepato-bilio-pancreatic and the digestive system—current state of the art and future perspectives

Dense soft tissue 3D reconstruction refined with super-pixel segmentation for robotic abdominal surgery

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Contact Info

Product

Resources

About