Pansharpening Using Guided Filtering to Improve the Spatial Clarity of VHR Satellite Imagery

Pansharpening algorithms are designed to enhance the spatial resolution of multispectral images using panchromatic images with high spatial resolutions. Panchromatic and multispectral images acquired from very high resolution (VHR) satellite sensors used as input data in the pansharpening process are characterized by spatial dissimilarities due to differences in their spectral/spatial characteristics and time lags between panchromatic and multispectral sensors. In this manuscript, a new pansharpening framework is proposed to improve the spatial clarity of VHR satellite imagery. This algorithm aims to remove the spatial dissimilarity between panchromatic and multispectral images using guided filtering (GF) and to generate the optimal local injection gains for pansharpening. First, we generate optimal multispectral images with spatial characteristics similar to those of panchromatic images using GF. Then, multiresolution analysis (MRA)-based pansharpening is applied using normalized difference vegetation index (NDVI)-based optimal injection gains and spatial details obtained through GF. The algorithm is applied to Korea multipurpose satellite (KOMPSAT)-3/3A satellite sensor data, and the experimental results show that the pansharpened images obtained with the proposed algorithm exhibit a superior spatial quality and preserve spectral information better than those based on existing algorithms.

[1]  Ye Zhang,et al.  Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Chiman Kwan,et al.  A Super-Resolution and Fusion Approach to Enhancing Hyperspectral Images , 2018, Remote. Sens..

[3]  Hyung-Sup Jung,et al.  Pansharpening Method for KOMPSAT-2/3 High-Spatial Resolution Satellite Image , 2015 .

[4]  Mattia Crespi,et al.  A Procedure for High Resolution Satellite Imagery Quality Assessment , 2009, Sensors.

[5]  Lin Ding,et al.  Pansharpening Using Regression of Classified MS and Pan Images to Reduce Color Distortion , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Farhad Samadzadegan,et al.  Spatial Quality Assessment of Pan-Sharpened High Resolution Satellite Imagery Based on an Automatically Estimated Edge Based Metric , 2013, Remote. Sens..

[7]  Junfeng Yang,et al.  PanNet: A Deep Network Architecture for Pan-Sharpening , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  Shunlin Liang,et al.  Pan-sharpening using a guided filter , 2016 .

[9]  Yonghyun Kim,et al.  Disaggregation of Landsat-8 Thermal Data Using Guided SWIR Imagery on the Scene of a Wildfire , 2018, Remote. Sens..

[10]  Jocelyn Chanussot,et al.  Fusion of Multispectral and Panchromatic Images Based on Morphological Operators , 2016, IEEE Transactions on Image Processing.

[11]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Johannes R. Sveinsson,et al.  Quantitative Quality Evaluation of Pansharpened Imagery: Consistency Versus Synthesis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Fei Ye,et al.  Learning an Efficient Convolution Neural Network for Pansharpening , 2019, Algorithms.

[14]  Jocelyn Chanussot,et al.  Pansharpening Based on Deconvolution for Multiband Filter Estimation , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Seok-Keun Choi,et al.  Unsupervised Change Detection of KOMPSAT-3 Satellite Imagery Based on Cross-sharpened Images by Guided Filter , 2018 .

[16]  Jocelyn Chanussot,et al.  Context-Adaptive Pansharpening Based on Image Segmentation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[18]  Junho Yeom,et al.  Hybrid Pansharpening Algorithm for High Spatial Resolution Satellite Imagery to Improve Spatial Quality , 2013, IEEE Geoscience and Remote Sensing Letters.

[19]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[20]  Yonghyun Kim,et al.  Image Fusion of Spectrally Nonoverlapping Imagery Using SPCA and MTF-Based Filters , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Abdul Ghafoor,et al.  Guided Filter and IHS-Based Pan-Sharpening , 2016, IEEE Sensors Journal.

[22]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Johannes R. Sveinsson,et al.  MTF-Based Deblurring Using a Wiener Filter for CS and MRA Pansharpening Methods , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Hui Li,et al.  An Image Fusion Method Based on Image Segmentation for High-Resolution Remotely-Sensed Imagery , 2018, Remote. Sens..

[26]  Jie Li,et al.  Pansharpening with a Guided Filter Based on Three-Layer Decomposition , 2016, Sensors.

[27]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[29]  Bruno Aiazzi,et al.  Hyper-Sharpening: A First Approach on SIM-GA Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[31]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[32]  Lucien Wald,et al.  A Method to Better Account for Modulation Transfer Functions in ARSIS-Based Pansharpening Methods , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Leiguang Wang,et al.  Guided Image Filtering-Based Pan-Sharpening Method: A Case Study of GaoFen-2 Imagery , 2017, ISPRS Int. J. Geo Inf..

[34]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Xavier Otazu,et al.  Comparison between Mallat's and the ‘à trous’ discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images , 2005 .

[36]  Hyung-Sup Jung,et al.  Comparison Analysis of Quality Assessment Protocols for Image Fusion of KOMPSAT-2/3/3A , 2016 .

[37]  B. Aiazzi,et al.  Multispectral Pansharpening with Radiative Transfer-Based Detail-Injection Modeling for Preserving Changes in Vegetation Cover , 2018 .

[38]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[39]  Liangpei Zhang,et al.  Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[40]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[41]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[42]  Jaewan Choi,et al.  A Hybrid Pansharpening Algorithm of VHR Satellite Images that Employs Injection Gains Based on NDVI to Reduce Computational Costs , 2017, Remote. Sens..

[43]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[44]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[45]  Qing Liu,et al.  A regularised model-based pan-sharpening method for remote sensing images with local dissimilarities , 2018, International Journal of Remote Sensing.

[46]  Jocelyn Chanussot,et al.  Pansharpening Based on Semiblind Deconvolution , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Wen Dou,et al.  A general framework for component substitution image fusion: An implementation using the fast image fusion method , 2007, Comput. Geosci..