A multi-threaded mosaicking algorithm for fast image composition of fluorescence bladder images

Behrens, Axel; Bommes, Michael; Stehlé, Thomas; Groß, Sebastian; Leonhardt, Steffen; Aach, Til

doi:10.1117/12.843685

Cited by 8 publications

(15 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The composition of a fluorescence image mosaic is applied by our real-time capable PDD multi-threaded image mosaicking algorithm [3,4]. Implemented in the RealTimeFrame software framework [14,15], the multi-threaded algorithm stitches subsequent images of an endoscopic video sequence into one global image composition.…”

Section: Pdd Image Mosaickingmentioning

confidence: 99%

See 1 more Smart Citation

A non-linear multi-scale blending algorithm for fluorescence bladder images

et al. 2010

Self Cite

View full text Add to dashboard Cite

The composition of panoramic images of the internal urinary bladder wall from single endoscope images can strongly support the off-line documentation and surgery planning for cancer treatment, as well as assist the reidentification of multi-focal tumors during a cystoscopy. Unlike white light endoscopy, fluorescence techniques such as photodynamic diagnostics (PDD) lower the risk of missing flat and small tumors due to an enhanced tissue contrast. As a result of the low illumination power and the free hand movement of the endoscope, PDD video sequences usually show strong variations in illumination and resolution. During the subsequent mosaicking and blending process, these effects impede the preservation of original and unbiased input image information in the composed panoramic overview image, and make it difficult to avoid visual interpolation artifacts. Thus, a non-linear intensity based multi-scale blending method for fluorescence images is developed. Based on a highest intensity decision, a region mask modeling the endoscopic illumination characteristic is used to weight the input images on several sub-bands of a Laplacian pyramid. In comparison to basic linear interpolation and standard multiscale methods the new method preserves high fluorescence intensities as well as fine vessel structures in the final image composition. Furthermore the adaptive characteristics of the blending algorithm allow the physician to move the endoscope more freely along the bladder wall during the image mosaicking process.A. Behrens ( ) · M. Guski · T. Stehle · S. Gross · T. Aach

show abstract

Section: Pdd Image Mosaickingmentioning

confidence: 99%

“…To overcome this problem, methods to provide a larger field of view of the operation field in one panoramic image, were recently published in the literature [3,4,[18][19][20].…”

Section: Introductionmentioning

confidence: 99%

A non-linear multi-scale blending algorithm for fluorescence bladder images

et al. 2010

Self Cite

View full text Add to dashboard Cite

show abstract

“…By addressing and minimizing the projection errors during the mapping of the sphere-shape bladder onto a planar surface, we proposed a visualization method of global and local panorama mosaics using hemicube projection [7]. Based on preparatory work [5,6] we discuss in this paper our flexible multi-threaded algorithm design using the C++ RealTimeFrame software framework [14,15] to provide fast image mosaicking of fluorescence images for realtime image-based navigation assistance.…”

Section: Previous Workmentioning

confidence: 99%

“…Assuming an almost constant illumination across the image sequence, we showed in previous work [6] that a basic alpha-blending approach,…”

Section: Blendingmentioning

confidence: 99%

See 1 more Smart Citation

Real-time image composition of bladder mosaics in fluorescence endoscopy

et al. 2010

Self Cite

View full text Add to dashboard Cite

Today, photodynamic diagnostics is commonly used in endoscopic intervention of the urinary bladder. Excited by a narrow band illumination, fluorescence markers enhance the visual contrast between benign and malignant tissue. Since in this modality the endoscope must be moved close to the bladder wall to provide sufficiently exposed images, the field of view (FOV) of the endoscope is very limited. This impedes the navigation and the re-identifying of multi-focal tumors for the physician. Thus, an image providing a larger FOV, composed from single images is highly desired during the intervention for surgery assistance. Since endoscopic mosaicking in real-time is still an open issue, we introduce a new feature-based image mosaicking algorithm for fluorescence endoscopy. Using a multi-threaded software design, the extraction of SURF features, the matching and the image stitching are separated in single processing threads. In an optimization step we discuss the tradeoff between feature repeatability and processing time. After adjusting an optimal thread synchronization, the optimal workload of each thread results in a fast and real-time capable computation of image mosaics. On a standard hardware platform our algorithm performs within the RealTimeFrame framework with an update rate of 8.17 frames per second at full input image resolution (780 × 576). Providing a fast A. Behrens ( ) · M. Bommes · T. Stehle · S. Gross · T. Aach growing image with an extended FOV during the intervention, the mosaic displayed on a second monitor promises high potential for surgery assistance.

show abstract