Image fusion based on simultaneous empirical wavelet transform

In this paper, a new multi-scale image fusion algorithm for multi-sensor images is proposed based on Empirical Wavelet Transform (EWT). Different from traditional wavelet transform, the wavelets of EWT are not fixed, but the ones generated according to the processed signals themselves, which ensures that these wavelets are optimal for processed signals. In order to make EWT can be used in image fusion, Simultaneous Empirical Wavelet Transform (SEWT) for 1D and 2D signals are proposed, by which different signals can be projected into the same wavelet set generated according to all the signals. The fusion algorithm constructed on the 2D SEWT contains three steps: source images are decomposed into a coarse layer and a detail layer first; then, the algorithm fuses detail layers using maximum absolute values, and fuses coarse layers using the maximum global contrast selection; finally, coefficients in all the fused layers are combined to obtain the final fused image using 2D inverse SEWT. Experiments on various images are conducted to examine the performance of the proposed algorithm. The experimental results have shown that the fused images obtained by the proposed algorithm achieve satisfying visual perception; meanwhile, the algorithm is superior to other traditional algorithms in terms of objective measures.

[1]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2007, IPMI.

[2]  Min Huang,et al.  Multifocus image fusion method of Ripplet transform based on cycle spinning , 2014, Multimedia Tools and Applications.

[3]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[4]  Stanley Osher,et al.  Empirical Transforms . Wavelets , Ridgelets and Curvelets revisited , 2013 .

[5]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[6]  Yu-Chiang Frank Wang,et al.  Exploring Visual and Motion Saliency for Automatic Video Object Extraction , 2013, IEEE Transactions on Image Processing.

[7]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[8]  Rynson W. H. Lau,et al.  Image registration for image-based rendering , 2005, IEEE Transactions on Image Processing.

[9]  Yuanyuan Wang,et al.  Biological image fusion using a NSCT based variable-weight method , 2011, Inf. Fusion.

[10]  Shao Zhenfeng,et al.  Fusion of infrared and visible images based on focus measure operators in the curvelet domain. , 2012, Applied optics.

[11]  Yu Han,et al.  A new image fusion performance metric based on visual information fidelity , 2013, Inf. Fusion.

[12]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[13]  Danilo P. Mandic,et al.  Multiscale Image Fusion Using Complex Extensions of EMD , 2009, IEEE Transactions on Signal Processing.

[14]  Andreas Koschan,et al.  Image Fusion and Enhancement via Empirical Mode Decomposition , 2006 .

[15]  Jérôme Gilles,et al.  Empirical Wavelet Transform , 2013, IEEE Transactions on Signal Processing.

[16]  Tao Chen,et al.  Remote sensing image fusion based on ridgelet transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[17]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[18]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[19]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[20]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Vladimir Petrovic,et al.  Objective evaluation of signal-level image fusion performance , 2005 .

[22]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[23]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[24]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.