Streaming video-based 3D reconstruction method compatible with existing monoscopic and stereoscopic endoscopy systems

Bouma, Henri; Mark, W. van der; Eendebak, Pieter; Landsmeer, Sander H.; Eekeren, Adam W. M. van; Haar, Frank B. ter; Wieringa, Fokko; Basten, Jean-Paul van

doi:10.1117/12.918592

Cited by 3 publications

(6 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This function is kept constant for all images, implicitly assuming an invariant vignetting effect. This approach has been followed by Behrens et al [16], Bouma et al [26], and Soper et al [133]. Mountney and Yang [108] have also addressed the vignetting problem in SLAM-based mosaicking.…”

Section: B De-vignettingmentioning

confidence: 98%

“…Most blending algorithms can be applied to both scenarios, but with different results. Only Bouma et al [26], Soper et al [133] and Weibel et al [162] therefore use all available frames for blending; the majority of authors follow the incremental approach. The goal of any blending scheme is to provide smooth transitions between the images and at the same time preserve as much structural information from the input images as possible.…”

Section: F Blending and Visualizationmentioning

confidence: 98%

“…The reconstruction of sinusoidal cavities for video/CT registration with SfM has been described by Mirota et al [102], [103], Wang et al [155], [156], Burschka et al [30], [31] and Wittenberg et al [166]. In laparoscopy, Bouma et al [26] have used SfM to reconstruct the abdominal cavity (using either monocular or stereoscopic images). The majority of reconstruction approaches in laparoscopy use EKF-based SLAM methods for scene reconstruction (Grasa et al [58]- [60] and Mountney et al [108]), and these have also been extended to handle tissue deformation [106], [109]).…”

Section: E Projection Surfacementioning

confidence: 99%

“…The specific goal of using surface reconstruction to provide the surgeon with an extended field of view has been addressed under the heading of dynamic view expansion by several authors. Dense surface reconstruction from image data from a da Vinci surgical robotic system 1 was described in 2012 by Bouma et al [26]. Due to the challenging characteristics of endoscopic image data, dense reconstruction has gained increasing focus in the recent past.…”

Section: Laparoscopymentioning

confidence: 99%

See 3 more Smart Citations

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

Bergen

Wittenberg

2016

IEEE J. Biomed. Health Inform.

View full text Add to dashboard Cite

Endoscopic procedures form part of routine clinical practice for minimally invasive examinations and interventions. While they are beneficial for the patient, reducing surgical trauma and making convalescence times shorter, they make orientation and manipulation more challenging for the physician, due to the limited field of view through the endoscope. However, this drawback can be reduced by means of medical image processing and computer vision, using image stitching and surface reconstruction methods to expand the field of view. This paper provides a comprehensive overview of the current state of the art in endoscopic image stitching and surface reconstruction. The literature in the relevant fields of application and algorithmic approaches is surveyed. The technological maturity of the methods and current challenges and trends are analyzed.

show abstract

Section: B De-vignettingmentioning

confidence: 98%

Section: F Blending and Visualizationmentioning

confidence: 98%

Section: E Projection Surfacementioning

confidence: 99%

Section: Laparoscopymentioning

confidence: 99%

See 2 more Smart Citations

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

Bergen

Wittenberg

2016

IEEE J. Biomed. Health Inform.

View full text Add to dashboard Cite

show abstract

“…An extensive further technical description of the applied image processing method is described in "Streaming video-based 3-D reconstruction method compatible with existing monoscopic and stereoscopic endoscopy systems." 17 …”

Section: Software For 3-d Reconstructionmentioning

confidence: 99%

Improved depth perception with three-dimensional auxiliary display and computer generated three-dimensional panoramic overviews in robot-assisted laparoscopy

et al. 2014

Self Cite

View full text Add to dashboard Cite

Abstract.In comparison to open surgery, endoscopic surgery offers impaired depth perception and narrower field-of-view. To improve depth perception, the Da Vinci robot offers three-dimensional (3-D) video on the console for the surgeon but not for assistants, although both must collaborate. We improved the shared perception of the whole surgical team by connecting live 3-D monitors to all three available Da Vinci generations, probed user experience after two years by questionnaire, and compared time measurements of a predefined complex interaction task performed with a 3-D monitor versus two-dimensional. Additionally, we investigated whether the complex mental task of reconstructing a 3-D overview from an endoscopic video can be performed by a computer and shared among users. During the study, 925 robot-assisted laparoscopic procedures were performed in three hospitals, including prostatectomies, cystectomies, and nephrectomies. Thirty-one users participated in our questionnaire. Eighty-four percent preferred 3-D monitors and 100% reported spatial-perception improvement. All participating urologists indicated quicker performance of tasks requiring delicate collaboration (e.g., clip placement) when assistants used 3-D monitors. Eighteen users participated in a timing experiment during a delicate cooperation task in vitro. Teamwork was significantly (40%) faster with the 3-D monitor. Computer-generated 3-D reconstructions from recordings offered very wide interactive panoramas with educational value, although the present embodiment is vulnerable to movement artifacts.

show abstract

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Maier-Hein

Mountney

Bartoli

et al. 2013

Medical Image Analysis

236

130

View full text Add to dashboard Cite

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-operative morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon's navigation capabilites by observing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted instruments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D optical imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions.

show abstract

Streaming video-based 3D reconstruction method compatible with existing monoscopic and stereoscopic endoscopy systems

Cited by 3 publications

References 27 publications

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

Stitching and Surface Reconstruction From Endoscopic Image Sequences: A Review of Applications and Methods

Improved depth perception with three-dimensional auxiliary display and computer generated three-dimensional panoramic overviews in robot-assisted laparoscopy

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Contact Info

Product

Resources

About