A new application for displaying and fusing multimodal data sets

Baum, Karl G.; Helguera, María; Król, Andrzej

doi:10.1117/12.702153

Cited by 4 publications

(2 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Not only does Fusion Viewer keep multiple data sets synchronized, but it also provides tools for displaying them as a single color data set. Several fusion options are already provided as plug-ins, and a simple interface exists for experimenting with new fusion schemes 18 . In addition to these capabilities, Fusion Viewer provides interfaces to evaluate various projection techniques, such as the popular Maximum Intensity Projection (MIP).…”

Section: Discussionmentioning

confidence: 99%

Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

2007

Self Cite

View full text Add to dashboard Cite

A new application, Fusion Viewer, available for free, has been designed and implemented with a modular objectoriented design. The viewer provides both traditional and novel tools to fuse 3D data sets such as CT (computed tomography), MRI (magnetic resonance imaging), PET (positron emission tomography), and SPECT (single photon emission tomography) of the same subject, to create maximum intensity projections (MIP) and to adjust dynamic range. In many situations, it is desirable and advantageous to acquire biomedical images in more than one modality. For example, PET can be used to acquire functional data, whereas MRI can be used to acquire morphological data. In some situations, a side-by-side comparison of the images provides enough information, but in most of the cases it may be necessary to have the exact spatial relationship between the modalities presented to the observer. To accomplish this task, the images need to first be registered and then combined (fused) to create a single image. In this paper, we discuss the options for performing such fusion in the context of multimodal breast imaging. Additionally, a novel spline-based dynamic range technique is presented in detail. It has the advantage of obtaining a high level of contrast in the intensity range of interest without discarding the intensity information outside of this range while maintaining a user interface similar to the standard window/level windowing procedure.

show abstract

Section: Discussionmentioning

confidence: 99%

Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

2007

Self Cite

View full text Add to dashboard Cite

show abstract

“…Fusion was performed using the Fusion Viewer 1 software package [22,23]. Fusion Viewer was developed in-house and available for free.…”

Section: Fusion Softwarementioning

confidence: 99%

Evaluation of Novel Genetic Algorithm Generated Schemes for Positron Emission Tomography (PET)/Magnetic Resonance Imaging (MRI) Image Fusion

Baum

Schmidt²,

Rafferty

et al. 2011

J Digit Imaging

Self Cite

View full text Add to dashboard Cite

The use and benefits of a multimodality approach in the context of breast cancer imaging are discussed. Fusion techniques that allow multiple images to be viewed simultaneously are discussed. Many of these fusion techniques rely on the use of color tables. A genetic algorithm that generates color tables that have desired properties such as satisfying the order principle, the rows, and columns principle, have perceivable uniformity and have maximum contrast is introduced. The generated 2D color tables can be used for displaying fused datasets. The advantage the proposed method has over other techniques is the ability to consider a much larger set of possible color tables, ensuring that the best one is found. We asked radiologists to perform a set of tasks reading fused PET/ MRI breast images obtained using eight different fusion techniques. This preliminary study clearly demonstrates the need and benefit of a joint display by estimating the inaccuracies incurred when using a side-by-side display. The study suggests that the color tables generated by the genetic algorithm are good choices for fusing MR and PET images. It is interesting to note that popular techniques such as the Fire/Gray and techniques based on the HSV color space, which are prevalent in the literature and clinical practice, appear to give poorer performance.

show abstract

Investigation of PET/MRI image fusion schemes for enhanced breast cancer diagnosis

Baum¹,

Rafferty²,

Helguera³

et al. 2007

2007 IEEE Nuclear Science Symposium Conference Record

View full text Add to dashboard Cite

A new application for displaying and fusing multimodal data sets

Cited by 4 publications

References 3 publications

Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

Evaluation of Novel Genetic Algorithm Generated Schemes for Positron Emission Tomography (PET)/Magnetic Resonance Imaging (MRI) Image Fusion

Investigation of PET/MRI image fusion schemes for enhanced breast cancer diagnosis

Contact Info

Product

Resources

About