Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images

Remote sensing image pan-sharpening is an important way of enhancing the spatial resolution of a multispectral (MS) image by fusing it with a registered panchromatic (PAN) image. The traditional pan-sharpening methods often suffer from color distortion and are still far from being able to synthesize a real high-resolution MS image, as could be directly acquired by a better sensor. Inspired by the rapid development of sparse representation theory, we propose a two-step sparse coding method with patch normalization (PN-TSSC) for image pan-sharpening. Traditional one-step sparse coding has difficulty in choosing dictionary atoms when the structural information is weak or lost. By exploiting the local similarity between the MS and PAN images, the proposed sparse coding method deals with the dictionary atoms in two steps, which has been found to be an effective way of overcoming this problem. The experimental results with IKONOS, QuickBird, and WorldView-2 data suggest that the proposed method can effectively improve the spatial resolution of a MS image, with little color distortion. The pan-sharpened high-resolution MS image outperforms those images fused by other traditional and state-of-the-art methods, both quantitatively and perceptually.

[1]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[2]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[3]  Henry Leung,et al.  Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[5]  Lucien Wald,et al.  Comparing distances for quality assessment of fused images , 2006 .

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[8]  Yun Zhang.  PROBLEMS IN THE FUSION OF COMMERCIAL HIGH-RESOLUTION SATELLITE AS WELL AS LANDSAT 7 IMAGES AND INITIAL SOLUTIONS , 2002 .

[9]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[10]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[11]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[13]  Liangpei Zhang,et al.  Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Stephen J. Wright,et al.  Computational Methods for Sparse Solution of Linear Inverse Problems , 2010, Proceedings of the IEEE.

[15]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[16]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[17]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Bin Luo,et al.  Decision-Based Fusion for Pansharpening of Remote Sensing Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[21]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[22]  Lorenzo Bruzzone,et al.  A Model-Based Approach to Multiresolution Fusion in Remotely Sensed Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[24]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[25]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[26]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[27]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[28]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[29]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[30]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[31]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[32]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Liangpei Zhang,et al.  A Practical Compressed Sensing-Based Pan-Sharpening Method , 2012, IEEE Geoscience and Remote Sensing Letters.

[34]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.