Feature-Based Image Fusion with a Uniform Discrete Curvelet Transform

Abstract The uniform discrete curvelet transform (UDCT) is a novel tool for multiscale representations with several desirable properties compared to previous representation methods. A novel algorithm based on UDCT is proposed for the fusion of multi-source images. A novel fusion rule for different subband coefficients obtained by UDCT decomposition is discussed in detail. Low-pass subband coefficients are merged to develop a fusion rule based on a feature similarity (FSIM) index. High-pass directional subband coefficients are merged for a fusion rule based on a complex coefficients feature similarity (CCFSIM) index. Experimental results demonstrate that the proposed algorithm fuses all of the useful information from source images without introducing artefacts. Compared with several state-of-the-art fusion methods, it yields a better performance and achieves higher efficiency.

[1]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[2]  Soontorn Oraintara,et al.  The Shiftable Complex Directional Pyramid—Part I: Theoretical Aspects , 2008, IEEE Transactions on Signal Processing.

[3]  Long Wang,et al.  Similarity-based multimodality image fusion with shiftable complex directional pyramid , 2011, Pattern Recognit. Lett..

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  Bhabatosh Chanda,et al.  A simple and efficient algorithm for multifocus image fusion using morphological wavelets , 2006, Signal Process..

[6]  Zheng Liu,et al.  A Data-Fusion Scheme for Quantitative Image Analysis by Using Locally Weighted Regression and Dempster–Shafer Theory , 2008, IEEE Transactions on Instrumentation and Measurement.

[7]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[8]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[9]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[10]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[11]  Nikolaos Mitianoudis,et al.  Pixel-based and region-based image fusion schemes using ICA bases , 2007, Inf. Fusion.

[12]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[13]  Hervé Chauris,et al.  Uniform Discrete Curvelet Transform , 2010, IEEE Transactions on Signal Processing.

[14]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[15]  Zhou Wang,et al.  Complex Wavelet Structural Similarity: A New Image Similarity Index , 2009, IEEE Transactions on Image Processing.

[16]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[17]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[18]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[19]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[20]  M. Vetterli,et al.  Nonseparable two- and three-dimensional wavelets , 1995, IEEE Trans. Signal Process..

[21]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[22]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[23]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[24]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[25]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[26]  Minh N. Do,et al.  The finite ridgelet transform for image representation , 2003, IEEE Trans. Image Process..

[27]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[28]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[29]  Thierry Ranchin,et al.  The wavelet transform for the analysis of remotely sensed images , 1993 .

[30]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[31]  Rangachar Kasturi,et al.  Machine vision , 1995 .