The Generalised Image Fusion Toolkit (GIFT)

Image fusion provides a mechanism to combine multiple images into a single representation to aid human visual perception and image processing tasks. Such algorithms endeavour to create a fused image containing the salient information from each source image, without introducing artefacts or inconsistencies. Image fusion is applicable for numerous fields including: defence systems, remote sensing and geoscience, robotics and industrial engineering, and medical imaging. In the medical imaging domain, image fusion may aid diagnosis and surgical planning tasks requiring the segmentation, feature extraction, and/or visualisation of multi-modal datasets. This paper discusses the implementation of an image fusion toolkit built upon the Insight Toolkit (ITK). Based on an existing architecture, the proposed framework (GIFT) offers a 'plug-and-play' environment for the construction of n-D multi-scale image fusion methods. We give a brief overview of the toolkit design and demonstrate how to construct image fusion algorithms from low-level components (such as multi-scale methods and feature generators). A number of worked examples for medical applications are presented in Appendix A, including quadrature mirror filter discrete wavelet transform (QMF DWT) image fusion.

[1]  Gang Liu,et al.  A region-based image fusion algorithm using multiresolution segmentation , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[2]  Vladimir S. Petrovic,et al.  Subjective tests for image fusion evaluation and objective metric validation , 2007, Inf. Fusion.

[3]  C. N. Canagarajah,et al.  Image fusion using a 3-D wavelet transform , 1999 .

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  P. Geladi,et al.  Multivariate image analysis , 1996 .

[6]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[7]  David Bull,et al.  Region-Based Image Fusion Using Complex Wavelets , 2004 .

[8]  Bhabatosh Chanda,et al.  Fusion of 2D grayscale images using multiscale morphology , 2001, Pattern Recognit..

[9]  Stewart Marshall,et al.  Multires-olution morphological fusion of mr and ct images of the human brain , 1994 .

[10]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[11]  Alexander Toet,et al.  Performance comparison of different gray-level image fusion schemes through a universal image quality index , 2003, SPIE Defense + Commercial Sensing.

[12]  Yufeng Zheng,et al.  An advanced image fusion algorithm based on wavelet transform: incorporation with PCA and morphological processing , 2004, IS&T/SPIE Electronic Imaging.

[13]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[14]  Tian Pu,et al.  Contrast-based image fusion using the discrete wavelet transform , 2000 .

[15]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[16]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[17]  Gemma Piella,et al.  Adaptive wavelets and their applications to image fusion and compression , 2003 .

[18]  Sonya A. H. McMullen,et al.  Mathematical Techniques in Multisensor Data Fusion (Artech House Information Warfare Library) , 2004 .

[19]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[20]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[22]  James Llinas,et al.  Multisensor Data Fusion , 1990 .