Fusion Viewer: A New Tool for Fusion and Visualization of Multimodal Medical Data Sets

A new application, Fusion Viewer, available for free, has been designed and implemented with a modular object-oriented design. The viewer provides both traditional and novel tools to fuse 3D data sets such as CT (computed tomography), MRI (magnetic resonance imaging), PET (positron emission tomography), and SPECT (single photon emission tomography) of the same subject, to create maximum intensity projections (MIP) and to adjust dynamic range. In many situations, it is desirable and advantageous to acquire biomedical images in more than one modality. For example, PET can be used to acquire functional data, whereas MRI can be used to acquire morphological data. In some situations, a side-by-side comparison of the images provides enough information, but in most of the cases it may be necessary to have the exact spatial relationship between the modalities presented to the observer. To accomplish this task, the images need to first be registered and then combined (fused) to create a single image. In this paper, we discuss the options for performing such fusion in the context of multimodal breast imaging. Additionally, a novel spline-based dynamic range technique is presented in detail. It has the advantage of obtaining a high level of contrast in the intensity range of interest without discarding the intensity information outside of this range while maintaining a user interface similar to the standard window/level windowing procedure.

[1]  S C Strother,et al.  Display of merged multimodality brain images using interleaved pixels with independent color scales. , 1994, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[2]  Shang-Hong Lai,et al.  An adaptive window width/center adjustment system with online training capabilities for MR images , 2005, Artif. Intell. Medicine.

[3]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  J S Fowler,et al.  Intimate combination of low‐ and high‐resolution image data: I. real‐space PET and 1H2O MRI, PETAMRI , 1999, Magnetic resonance in medicine.

[5]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[6]  Andrzej Krol,et al.  A new application for displaying and fusing multimodal data sets , 2007, SPIE BiOS.

[7]  Tatsuya Ishikawa,et al.  Interactive visualization of coregistered tomographic images , 1995 .

[8]  Andrew F. Laine,et al.  Contrast enhancement by multiscale adaptive histogram equalization , 2001, SPIE Optics + Photonics.

[9]  M. C. Lee,et al.  Fusion of coregistered cross-modality images using a temporally alternating display method , 2000, Medical and Biological Engineering and Computing.

[10]  Shang-Hong Lai,et al.  A hierarchical neural network algorithm for robust and automatic windowing of MR images , 2000, Artif. Intell. Medicine.

[11]  J. Todd Book Review: Digital image processing (second edition). By R. C. Gonzalez and P. Wintz, Addison-Wesley, 1987. 503 pp. Price: £29.95. (ISBN 0-201-11026-1) , 1988 .

[12]  D M Ikeda,et al.  Intensity-modulated parametric mapping for simultaneous display of rapid dynamic and high-spatial-resolution breast MR imaging data. , 2001, Radiographics : a review publication of the Radiological Society of North America, Inc.

[13]  John P. Kerekes,et al.  Techniques for Fusion of Multimodal Images: Application to Breast Imaging , 2006, 2006 International Conference on Image Processing.

[14]  Shoji Hara,et al.  Generalized dynamic range compression algorithm for visualization of chest CT images , 2004, Medical Imaging: Image-Guided Procedures.

[15]  L. Fayad,et al.  Chest CT window settings with multiscale adaptive histogram equalization: pilot study. , 2002, Radiology.

[16]  John C. Russ,et al.  The image processing handbook (3. ed.) , 1995 .

[17]  Andrzej Król,et al.  Genetic Algorithm Automated Generation of Multivariate Color Tables for Visualization of Multimodal Medical Data Sets , 2006, CIC.