Hyperspectral pansharpening based on guided filter and Gaussian filter

Abstract Hyperspectral pansharpening aims to integrate the panchromatic (PAN) and hyperspectral (HS) images into a single HS image with high spatial and high spectral resolution. This paper proposes a novel hyperspectral pansharpening method based on guided filter and gaussian filter. Most guided filter based researches extract the spatial details from the PAN image or the single band HS intensity component, and incorrect generation of the intensity component causes the spectral distortion. Different from the traditional guided filter based methods, the structure of the HS image is fully considered by the proposed method. We first use the high frequency layer of each band of the HS image as the guidance image of the guided filter. Then, the total spatial details are extracted from both the PAN image and the HS image. The total spatial details are finally injected into each band of the HS image low frequency layer to generate the fused image. Experiments demonstrate that the proposed method outperforms some state-of-the-art methods in terms of objective quality assessment and subjective visual effect.

[1]  A. Mookambiga,et al.  Comprehensive review on fusion techniques for spatial information enhancement in hyperspectral imagery , 2016, Multidimens. Syst. Signal Process..

[2]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[3]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[4]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[6]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[7]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[8]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[9]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[10]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[12]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[13]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[15]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[16]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[17]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yunsong Li,et al.  Hyperspectral Pansharpening With Guided Filter , 2017, IEEE Geoscience and Remote Sensing Letters.

[19]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[20]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[23]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.