Pan-sharpening using a guided filter

ABSTRACT Pan-sharpening aims to integrate the spatial details of a high-resolution panchromatic (Pan) image with the spectral information of low-resolution multispectral (MS) images to produce high-resolution MS images. The key is to appropriately estimate the missing spatial details of the MS images while preserving their spectral contents. However, many existing methods extract the spatial details from the Pan image without fully considering the structures of the MS images, resulting in spectral distortion due to redundant detail injection. A guided filter can transfer the structures of the MS images into the intensity component or the low-pass approximation of the Pan image. Using the guided filter, we propose two novel pan-sharpening methods to reduce the redundant details among the MS and Pan images. Specifically, we extract the missing spatial details of the MS images by minimizing the difference between the Pan image and its corresponding filtering output, with the help of the MS images. Two different ways of using the MS images as guided images lead to two proposed methods, which can be grouped into component substitution (CS) family. Extensive experimental results over three data sets collected by different satellite sensors demonstrate the effectiveness of the proposed methods.

[1]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[2]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[3]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Ming Cheng,et al.  Sparse Representation Based Pansharpening Using Trained Dictionary , 2014, IEEE Geoscience and Remote Sensing Letters.

[8]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Liangpei Zhang,et al.  Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[11]  Manuel A. Aguilar,et al.  GeoEye-1 and WorldView-2 pan-sharpened imagery for object-based classification in urban environments , 2013 .

[12]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[13]  Julien Radoux,et al.  Bayesian Data Fusion for Adaptable Image Pansharpening , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[15]  Yunhong Wang,et al.  Adaptive steepest descent method for pan-sharpening of multispectral images , 2011 .

[16]  Aleksandra Pizurica,et al.  Two-stage fusion of thermal hyperspectral and visible RGB image by PCA and guided filter , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[17]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[18]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Kidiyo Kpalma,et al.  A Pan-Sharpening Based on the Non-Subsampled Contourlet Transform: Application to Worldview-2 Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Kishor P. Upla,et al.  An edge preserving multi-resolution image fusion: Use of joint bilateral filter , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[21]  Andrea Garzelli,et al.  Pansharpening of Multispectral Images Based on Nonlocal Parameter Optimization , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[23]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jing Xiao,et al.  Importance filtering for image retargeting , 2011, CVPR 2011.

[25]  Jocelyn Chanussot,et al.  A New Pansharpening Method Based on Spatial and Spectral Sparsity Priors , 2014, IEEE Transactions on Image Processing.

[26]  Bo Li,et al.  High-Fidelity Component Substitution Pansharpening by the Fitting of Substitution Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  S. Liang.  Quantitative Remote Sensing of Land Surfaces , 2003 .

[28]  Bruno Aiazzi,et al.  A Comparison Between Global and Context-Adaptive Pansharpening of Multispectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[29]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[30]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[31]  Fang Liu,et al.  Pansharpening Based on Low-Rank and Sparse Decomposition , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Klaus Steinnocher,et al.  Influence of image fusion approaches on classification accuracy: a case study , 2006 .

[33]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[34]  S. Baronti,et al.  Twenty-Five Years of Pansharpening: A Critical Review and New Developments , 2012 .

[35]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[38]  Chun-Liang Chien,et al.  Image Fusion With No Gamut Problem by Improved Nonlinear IHS Transforms for Remote Sensing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Isin Erer,et al.  Bilateral Filtering-Based Enhanced Pansharpening of Multispectral Satellite Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[40]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[41]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[42]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[43]  D. Yocky.  Image merging and data fusion by means of the discrete two-dimensional wavelet transform , 1995 .

[44]  C. A. Shah,et al.  ANALYZING MULTI-SENSOR DATA FUSION TECHNIQUES : A MULTI-TEMPORAL CHANGE DETECTION APPROACH , 2007 .

[45]  Bruno Aiazzi,et al.  Hyper-Sharpening: A First Approach on SIM-GA Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Shutao Li,et al.  Fusion of panchromatic and multispectral images using multiscale dual bilateral filter , 2011, 2011 18th IEEE International Conference on Image Processing.

[48]  Dehong Liu,et al.  Dictionary learning based pan-sharpening , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Kishor P. Upla,et al.  Multi-resolution image fusion using multistage guided filter , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[51]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[52]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[53]  Jocelyn Chanussot,et al.  Pansharpening Based on Semiblind Deconvolution , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[55]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[56]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[57]  Kidiyo Kpalma,et al.  An IHS-Based Fusion for Color Distortion Reduction and Vegetation Enhancement in IKONOS Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Yun Zhang,et al.  Detection of urban housing development by fusing multisensor satellite data and performing spatial feature post-classification , 2001 .

[60]  Jon Atli Benediktsson,et al.  Pansharpening With Matting Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.