Comparative Validation of Single-Shot Optical Techniques for Laparoscopic 3-D Surface Reconstruction

Intra-operative tissue classification is one of the prerequisites for providing context-aware visualization in computerassisted minimally invasive surgeries. As many anatomical structures are difficult to differentiate in conventional RGB medical images, we propose a classification method based on multispectral image patches. In a comprehensive ex vivo study we show (1) that multispectral imaging data is superior to RGB data for organ tissue classification when used in conjunction with widely applied feature descriptors and (2) that combining the tissue texture with the reflectance spectrum improves the classification performance. Multispectral tissue analysis could thus evolve as a key enabling technique in computer-assisted laparoscopy.

show abstract

“…18 Therefore, we obtained an image set containing 27 subsets for each organ denoted by (pig i , θ j , d k ) ∈ {pig 1 , pig 2 , pig 3 }×{30…”

Section: Methodsmentioning

confidence: 99%

Tissue classification for laparoscopic image understanding based on multispectral texture analysis

Zhang

Wirkert

Iszatt

et al. 2016

Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling

View full text Add to dashboard Cite

show abstract

“…This intuition forms the backbone of 3D computer vision, and has been formalized and thoroughly studied in the past few decades [8,6]. 3D computer vision has numerous applications, such as depth perception in computer-aided surgery [19].…”

Section: Principlementioning

confidence: 99%

3D conformation of a flexible fiber in a turbulent flow

Verhille

Bartoli

2016

Exp Fluids

View full text Add to dashboard Cite

A growing number of studies is devoted to anisotropic particles in turbulent flows. In most cases the particles are assumed to be rigid and their deformations are neglected. We present an adaptation of classical computer vision tools to reconstruct from two different images the 3D conformation of a fiber distorted by the turbulent fluctuations in a von Kármán flow. This technique allows us notably to characterize the fiber deformation by computing the correlation function of the orientation of the tangent vector. This function allows us to tackle the analogy between polymers and flexible fibers proposed by Brouzet et al. (Phys. Rev. Lett. 112(7) 074501 (2014)). We show that this function depends on an elastic length e which characterizes the particle flexibility, as is the case for polymers, but also on the fiber length L, contrary to polymers.

show abstract

“…An optical fibre-based miniaturized structured light (SL) projector, which has been described in detail previously 7,8 , was positioned on a rigid metal arm so that the position of its tip remained fixed with respect to the tip of the laparoscope. The pose of this arm was adjusted so that the SL pattern filled a region in the centre of the imager's field-of-view.…”

Section: Structured Lightmentioning

confidence: 99%

Dual multispectral and 3D structured light laparoscope

et al. 2015

View full text Add to dashboard Cite

Intraoperative feedback on tissue function, such as blood volume and oxygenation would be useful to the surgeon in cases where current clinical practice relies on subjective measures, such as identification of ischaemic bowel or tissue viability during anastomosis formation. Also, tissue surface profiling may be used to detect and identify certain pathologies, as well as diagnosing aspects of tissue health such as gut motility. In this paper a dual modality laparoscopic system is presented that combines multispectral reflectance and 3D surface imaging. White light illumination from a xenon source is detected by a laparoscope-mounted fast filter wheel camera to assemble a multispectral image (MSI) cube. Surface shape is then calculated using a spectrally-encoded structured light (SL) pattern detected by the same camera and triangulated using an active stereo technique. Images of porcine small bowel were acquired during open surgery. Tissue reflectance spectra were acquired and blood volume was calculated at each spatial pixel across the bowel wall and mesentery. SL features were segmented and identified using a 'normalised cut' algoritm and the colour vector of each spot. Using the 3D geometry defined by the camera coordinate system the multispectral data could be overlaid onto the surface mesh. Dual MSI and SL imaging has the potential to provide augmented views to the surgeon supplying diagnostic information related to blood supply health and organ function. Future work on this system will include filter optimisation to reduce noise in tissue optical property measurement, and minimise spot identification errors in the SL pattern.

show abstract

Comparative Validation of Single-Shot Optical Techniques for Laparoscopic 3-D Surface Reconstruction

Cited by 97 publications

References 46 publications

Tissue classification for laparoscopic image understanding based on multispectral texture analysis

Tissue classification for laparoscopic image understanding based on multispectral texture analysis

3D conformation of a flexible fiber in a turbulent flow

Dual multispectral and 3D structured light laparoscope

Contact Info

Product

Resources

About