Pansharpening approach using Hilbert vibration decomposition

In this study, a new approach for pansharpening of multispectral and panchromatic (PAN) images is proposed. The proposed technique is based on recently developed signal decomposition technique known as Hilbert vibration decomposition (HVD). In the proposed method, the histogram equalised PAN image is decomposed into many instantaneous amplitude (IA) and frequency components in the decreasing order of energy using the HVD. The IA of the first component (having highest energy) in the decomposition of the PAN image is used to generate the pansharpened image using appropriate pansharpening model. The tuning factor associated with the pansharpening model is optimised by single-objective particle swarm optimization algorithm. This method is also extended for the hyperspectral images. Experimental results of the proposed technique are compared with existing pansharpening methods in terms of both visual perception and objective metrics. It is observed that the proposed pansharpening scheme has improved spectral and spatial qualities as compared with the existing schemes. The effects of aliasing and misregistration errors in the proposed method are also investigated and it is observed that the proposed method is robust against aliasing and misregistration errors as compared with other existing methods.

[1]  Brian D. Rigling,et al.  A Sequential Framework for Image Change Detection , 2014, IEEE Transactions on Image Processing.

[2]  Marwan Younis,et al.  Tandem-L: A Highly Innovative Bistatic SAR Mission for Global Observation of Dynamic Processes on the Earth's Surface , 2015, IEEE Geoscience and Remote Sensing Magazine.

[3]  Hassan Ghassemian,et al.  Fusion of MS and PAN Images Preserving Spectral Quality , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Orhan Arikan,et al.  Short-time Fourier transform: two fundamental properties and an optimal implementation , 2003, IEEE Trans. Signal Process..

[5]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Hilbert vibration decomposition based image fusion , 2016 .

[8]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[9]  Chulhee Lee,et al.  Fast and Efficient Panchromatic Sharpening , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[13]  L. Alparone,et al.  An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[14]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[15]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[16]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[18]  Jocelyn Chanussot,et al.  Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique , 2008, IEEE Geoscience and Remote Sensing Letters.

[19]  E. Barocio,et al.  An improved Hilbert Vibration Decomposition method for analysis of low frequency oscillations , 2014, 2014 IEEE PES Transmission & Distribution Conference and Exposition - Latin America (PES T&D-LA).

[20]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[21]  Chaomin Luo,et al.  Generic object recognition based on the fusion of 2D and 3D SIFT descriptors , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[22]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[23]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[24]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[26]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[27]  Manfred Ehlers,et al.  FFT-enhanced IHS transform method for fusing high-resolution satellite images , 2007 .

[28]  Michael Feldman,et al.  Time-varying vibration decomposition and analysis based on the Hilbert transform , 2006 .

[29]  Weihua Dong,et al.  A Bidimensional Empirical Mode Decomposition Method for Fusion of Multispectral and Panchromatic Remote Sensing Images , 2014, Remote. Sens..

[30]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Guy Flouzat,et al.  Thematic and statistical evaluations of five panchromatic/multispectral fusion methods on simulated PLEIADES-HR images , 2005, Inf. Fusion.

[32]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[33]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[34]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[35]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[36]  M. Nasipuri,et al.  Multisensor fusion of visual and thermal images for human face identification using different SVM kernels , 2012, 2012 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[37]  Luciano Alparone,et al.  Bi-cubic interpolation for shift-free pan-sharpening , 2013 .

[38]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[39]  D. Roberts,et al.  Mapping forest degradation in the Eastern Amazon from SPOT 4 through spectral mixture models , 2003 .

[40]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[42]  Jocelyn Chanussot,et al.  MultiResolution Analysis and Component Substitution techniques for hyperspectral Pansharpening , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[43]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[44]  A. Mohammadzadeh,et al.  Road extraction based on fuzzy logic and mathematical morphology from pan‐sharpened ikonos images , 2006 .