Image fusion using multivariate and multidimensional EMD

We present a novel methodology for the fusion of multiple (two or more) images using the multivariate extension of empirical mode decomposition (MEMD). Empirical mode decomposition (EMD) is a data-driven method which decomposes input data into its intrinsic oscillatory modes, known as intrinsic mode functions (IMFs), without making a priori assumptions regarding the data. We show that the multivariate and multidimensional extensions of EMD are suitable for image fusion purposes. We further demonstrate that while multidimensional extensions, by design, may seem more appropriate for tasks related to image processing, the proposed multivariate extension outperforms these in image fusion applications owing to its mode-alignment property for IMFs. Case studies involving multi-focus image fusion and pan-sharpening of multi-spectral images are presented to demonstrate the effectiveness of the proposed method.

[1]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[2]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[3]  D. P. Mandic,et al.  Multivariate empirical mode decomposition , 2010, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[4]  Jinshan Tang,et al.  A contrast based image fusion technique in the DCT domain , 2004, Digit. Signal Process..

[5]  Anna Linderhed,et al.  Image Empirical Mode Decomposition: a New Tool for Image Processing , 2009, Adv. Data Sci. Adapt. Anal..

[6]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[7]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[8]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[9]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[10]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[11]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.