A Multivariate Empirical Mode DecompositionBased Approach to Pansharpening

We propose a novel class of schemes for the pansharpening of multispectral (MS) images using a multivariate empirical mode decomposition (MEMD) algorithm. MEMD is an extension of the empirical mode decomposition (EMD) algorithm, which enables the decomposition of multivariate data into its intrinsic oscillatory scales. The ability of MEMD to process multichannel data directly by performing data-driven, local, and multiscale analysis makes it a perfect match for pansharpening applications, a task for which standard univariate EMD is ill-equipped due to the nonuniqueness, mode-mixing, and mode-misalignment issues. We show that MEMD overcomes the limitations of standard EMD and yields improved spatial and spectral performance in the context of pansharpening of MS images. The potential of the proposed schemes is further demonstrated through comparative analysis against a number of standard pansharpening algorithms on both simulated Pleiades and real-world IKONOS data sets.

[1]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[2]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Liangpei Zhang,et al.  Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[5]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[6]  Tee-Ann Teo,et al.  Pyramid-based image empirical mode decomposition for the fusion of multispectral and panchromatic images , 2012, EURASIP J. Adv. Signal Process..

[7]  Jing Tian,et al.  SAR and Multispectral Image Fusion Using Generalized IHS Transform Based on à Trous Wavelet and EMD Decompositions , 2010, IEEE Sensors Journal.

[8]  D. P. Mandic,et al.  Multivariate empirical mode decomposition , 2010, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  Liangpei Zhang,et al.  A Practical Compressed Sensing-Based Pan-Sharpening Method , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[11]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[12]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[13]  Roger L. King,et al.  An adaptive PCA-based approach to pan-sharpening , 2007, SPIE Remote Sensing.

[14]  Danilo P. Mandic,et al.  Empirical Mode Decomposition-Based Time-Frequency Analysis of Multivariate Signals: The Power of Adaptive Data Analysis , 2013, IEEE Signal Processing Magazine.

[15]  Danilo P. Mandic,et al.  Multiscale Image Fusion Using Complex Extensions of EMD , 2009, IEEE Transactions on Signal Processing.

[16]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[17]  Liangpei Zhang,et al.  Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[19]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[22]  Danilo P. Mandic,et al.  Dynamically-Sampled Bivariate Empirical Mode Decomposition , 2014, IEEE Signal Processing Letters.

[23]  Jocelyn Chanussot,et al.  Improving MODIS Spatial Resolution for Snow Mapping Using Wavelet Fusion and ARSIS Concept , 2008, IEEE Geoscience and Remote Sensing Letters.

[24]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[25]  Qian Du,et al.  Performance evaluation for pan-sharpening techniques , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[26]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[27]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[28]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[29]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[30]  Gabriel Rilling,et al.  Bivariate Empirical Mode Decomposition , 2007, IEEE Signal Processing Letters.

[31]  Klaus D. McDonald-Maier,et al.  Image fusion using multivariate and multidimensional EMD , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[32]  Henry Leung,et al.  Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method , 2009, IEEE Transactions on Geoscience and Remote Sensing.