Hyperspectral pansharpening via improved PCA approach and optimal weighted fusion strategy

Abstract The purpose of hyperspectral pansharpening is to fuse the hyperspectral (HS) image and the panchromatic (PAN) image to generate an HS image with high spectral and spatial resolution. In this paper, a novel hyperspectral pansharpening method based on improved PCA approach and optimal weighted fusion strategy is proposed. First, the HS image is interpolated, and an improved PCA approach is proposed to obtain the spatial information of the HS image. To overcome the spectral distortion of the standard PCA method, the improved PCA approach utilizes the structural similarity index to select the appropriate component channel serving as the spatial information of the HS image. Subsequently, the PAN image is histogram matched with the selected component channel. In order to reduce the spatial distortion, an optimal weighted fusion strategy is presented to generate the adequate spatial details from the PAN and HS images. Finally, the injection gains matrix is generated to reduce the spectral distortion, and the fused HS image is obtained by injecting the extracted spatial details into the interpolated HS image. Experimental results demonstrate that the proposed method is superior to the state-of-the-art fusion methods in both subjective and objective evaluations.

[1]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[3]  Fang Liu,et al.  Pansharpening Based on Low-Rank and Sparse Decomposition , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[5]  Jun Huang,et al.  Robust GBM hyperspectral image unmixing with superpixel segmentation based low rank and sparse representation , 2018, Neurocomputing.

[6]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[7]  Yanfeng Gu,et al.  Rare signal component extraction based on kernel methods for anomaly detection in hyperspectral imagery , 2013, Neurocomputing.

[8]  Bo Du,et al.  Hyperspectral anomaly change detection with slow feature analysis , 2015, Neurocomputing.

[9]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for hyperspectral images , 2012, Signal Process..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Wei Li,et al.  Hyperspectral image classification by AdaBoost weighted composite kernel extreme learning machines , 2018, Neurocomputing.

[13]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[14]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[15]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[17]  Manuel Graña,et al.  Hyperspectral image nonlinear unmixing and reconstruction by ELM regression ensemble , 2016, Neurocomputing.

[18]  Carlos Roberto de Souza Filho,et al.  A review on spectral processing methods for geological remote sensing , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[19]  A. Mookambiga,et al.  Comprehensive review on fusion techniques for spatial information enhancement in hyperspectral imagery , 2016, Multidimens. Syst. Signal Process..

[20]  Kinjiro Amano,et al.  Information limits on neural identification of colored surfaces in natural scenes , 2004, Visual Neuroscience.

[21]  Xinbo Gao,et al.  Collaborative learning for hyperspectral image classification , 2018, Neurocomputing.

[22]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[23]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[25]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[26]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[27]  Stefano Baronti,et al.  On the Use of the Expanded Image in Quality Assessment of Pansharpened Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[28]  Bo Du,et al.  Hyperspectral Anomaly Detection via a Sparsity Score Estimation Framework , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[31]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[32]  Yunsong Li,et al.  Hyperspectral image super-resolution using deep convolutional neural network , 2017, Neurocomputing.

[33]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[34]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Xiangtao Zheng,et al.  A target detection method for hyperspectral image based on mixture noise model , 2016, Neurocomputing.

[36]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[37]  Xiangtao Zheng,et al.  Hyperspectral Image Superresolution by Transfer Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[39]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .

[40]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Yanfeng Gu,et al.  Hyperspectral target detection via exploiting spatial-spectral joint sparsity , 2015, Neurocomputing.

[42]  Ziyu Wang,et al.  Matched shrunken subspace detectors for hyperspectral target detection , 2018, Neurocomputing.

[43]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.