Multiband Remote Sensing Image Pansharpening Based on Dual-Injection Model

Pansharpening exploits the high-frequency component (HFC) of panchromatic (PAN) images to restore the spatial-resolution of the corresponding multispectral (MS) image. In this article, a dual-injection model-based multiband remote sensing image pansharpening method is presented that focuses on how to correctly use the HFC to improve the MS image for obtaining a high-spatial resolution and MS image. The model is based on a two-step HFC injection algorithm with two different injection gains. In the first step, an HFC is reconstructed with sparse theory, and an injection gain based on the relationship between PAN and MS images is developed. Employing the previous injection gain and the reconstructed HFC on an upsampling MS image, an improved LRMS (ILRMS) image is then produced. In the second step, another injection gain based on the differences and similarities between the PAN and MS images is designed. With the help of this injection gain, the fusion image is achieved via the adaptive integration of the ILRMS image and the HFC from the PAN image. Experiments confirm that the proposed method is more effective than some popular widely used pansharpening methods.

[1]  Jiangshe Zhang,et al.  An Improved Adaptive Intensity–Hue–Saturation Method for the Fusion of Remote Sensing Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Liangpei Zhang,et al.  A Practical Compressed Sensing-Based Pan-Sharpening Method , 2012, IEEE Geoscience and Remote Sensing Letters.

[3]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Shuyuan Yang,et al.  Learning Low-Rank Decomposition for Pan-Sharpening With Spatial-Spectral Offsets , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[6]  Hassan Ghassemian,et al.  Remote Sensing Image Fusion Using Ripplet Transform and Compressed Sensing , 2015, IEEE Geoscience and Remote Sensing Letters.

[7]  Shuyuan Yang,et al.  Pansharpening With Multiscale Geometric Support Tensor Machine , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[8]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[9]  Lei Wu,et al.  Compensation Details-Based Injection Model for Remote Sensing Image Fusion , 2018, IEEE Geoscience and Remote Sensing Letters.

[10]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[11]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[12]  Yaonan Wang,et al.  Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images , 2002, Inf. Fusion.

[13]  Isin Erer,et al.  Bilateral Filtering-Based Enhanced Pansharpening of Multispectral Satellite Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[14]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[15]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[16]  Audrey Minghelli-Roman,et al.  Fusion of Multispectral Images by Extension of the Pan-Sharpening ARSIS Method , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Lei Wu,et al.  Remote Sensing Image Fusion Based on Adaptively Weighted Joint Detail Injection , 2018, IEEE Access.

[18]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Julien Radoux,et al.  Bayesian Data Fusion for Adaptable Image Pansharpening , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[20]  D. Holcomb,et al.  Optimizing the High-Pass Filter Addition Technique for Image Fusion , 2007 .

[21]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[22]  Manjunath V. Joshi,et al.  MAP Estimation for Multiresolution Fusion in Remotely Sensed Images Using an IGMRF Prior Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Andrea Garzelli,et al.  Hypercomplex Quality Assessment of Multi/Hyperspectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[24]  Liangpei Zhang,et al.  An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[26]  Hongyi Liu,et al.  A New Pan-Sharpening Method With Deep Neural Networks , 2015, IEEE Geoscience and Remote Sensing Letters.

[27]  Lei Wu,et al.  Pansharpening for Multiband Images With Adaptive Spectral–Intensity Modulation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Liangpei Zhang,et al.  Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Jinying Zhong,et al.  Remote Sensing Image Fusion with Convolutional Neural Network , 2016 .

[31]  Shutao Li,et al.  Remote Sensing Image Fusion Method Based on Nonsubsampled Shearlet Transform and Sparse Representation , 2015, Sensing and Imaging.

[32]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Wei Gao,et al.  Multisensor Satellite Image Fusion and Networking for All-Weather Environmental Monitoring , 2018, IEEE Systems Journal.

[34]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[35]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[36]  Feiniu Yuan,et al.  Remote Sensing Image Fusion Based on Adaptive IHS and Multiscale Guided Filter , 2016, IEEE Access.

[37]  Shuyuan Yang,et al.  Fusion of multispectral and panchromatic images based on support value transform and adaptive principal component analysis , 2012, Inf. Fusion.

[38]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[39]  Liangpei Zhang,et al.  A Remote Sensing Image Fusion Method Based on the Analysis Sparse Model , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.