An Efficient Pan Sharpening via Texture Based Dictionary Learning and Sparse Representation

Remote sensing image pan sharpening has attracted researchers’ interest, since spatial resolution of multispectral (MS) image can be enhanced by injecting spatial details of a panchromatic image to MS image. In this paper, a novel sparse representation based pan sharpening method is proposed to overcome the disadvantages of traditional methods such as color distortion and blurring effect. This learning based method utilizes a compact single dictionary generated from texture information of high-resolution MS images in order to provide more effective and robust pan sharpening. Two data sets acquired from IKONOS and Quickbird satellites are used to evaluate the performance and robustness of the proposed algorithm. The proposed method is compared with nine well-known component substitution and multiresolution analysis methods and a state-of-art method using several quality measurement indices with references. The experimental results demonstrate that the proposed algorithm is competitive or superior to other conventional methods in terms of visual and quantitative analysis, as it preserves spectral information and provides high quality spatial details in the final product image.

[1]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[3]  Roger L. King,et al.  Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[5]  Liangpei Zhang,et al.  A Practical Compressed Sensing-Based Pan-Sharpening Method , 2012, IEEE Geoscience and Remote Sensing Letters.

[6]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[7]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[8]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[9]  Aboul Ella Hassanien,et al.  Remote Sensing Image Fusion Approach Based on Brovey and Wavelets Transforms , 2014, IBICA.

[10]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[11]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[12]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[13]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Yun Zhang PROBLEMS IN THE FUSION OF COMMERCIAL HIGH-RESOLUTION SATELLITE AS WELL AS LANDSAT 7 IMAGES AND INITIAL SOLUTIONS , 2002 .

[15]  Shutao Li,et al.  Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[17]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Ye Zhang,et al.  Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Andrea Garzelli,et al.  A Review of Image Fusion Algorithms Based on the Super-Resolution Paradigm , 2016, Remote. Sens..

[21]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[22]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[23]  Richard Bamler,et al.  Super-Resolution Power and Robustness of Compressive Sensing for Spectral Estimation With Application to Spaceborne Tomographic SAR , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Michael Elad,et al.  K-SVD : DESIGN OF DICTIONARIES FOR SPARSE REPRESENTATION , 2005 .

[25]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[26]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[28]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Richard Bamler,et al.  Tomographic SAR Inversion by $L_{1}$ -Norm Regularization—The Compressive Sensing Approach , 2010, IEEE Transactions on Geoscience and Remote Sensing.