Pansharpening via sparse regression

Abstract. Pansharpening is an effective way to enhance the spatial resolution of a multispectral (MS) image by fusing it with a provided panchromatic image. Instead of restricting the coding coefficients of low-resolution (LR) and high-resolution (HR) images to be equal, we propose a pansharpening approach via sparse regression in which the relationship between sparse coefficients of HR and LR MS images is modeled by ridge regression and elastic-net regression simultaneously learning the corresponding dictionaries. The compact dictionaries are learned based on the sampled patch pairs from the high- and low-resolution images, which can greatly characterize the structural information of the LR MS and HR MS images. Later, taking the complex relationship between the coding coefficients of LR MS and HR MS images into account, the ridge regression is used to characterize the relationship of intrapatches. The elastic-net regression is employed to describe the relationship of interpatches. Thus, the HR MS image can be almost identically reconstructed by multiplying the HR dictionary and the calculated sparse coefficient vector with the learned regression relationship. The simulated and real experimental results illustrate that the proposed method outperforms several well-known methods, both quantitatively and perceptually.

[1]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[2]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jon Atli Benediktsson,et al.  Pansharpening With Matting Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Richard Bamler,et al.  Exploiting Joint Sparsity for Pansharpening: The J-SparseFI Algorithm , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Peyman Kabiri,et al.  New intensity-hue-saturation pan-sharpening method based on texture analysis and genetic algorithm-adaption , 2014 .

[6]  Kidiyo Kpalma,et al.  A Pan-Sharpening Based on the Non-Subsampled Contourlet Transform: Application to Worldview-2 Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  C. Elvidge,et al.  Brazil's 2001 energy crisis monitored from space , 2004 .

[8]  Shutao Li,et al.  Pansharpening With Multiscale Normalized Nonlocal Means Filter: A Two-Step Approach , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Mehran Yazdi,et al.  Panchromatic and Multispectral Image Fusion Based on Maximization of Both Spectral and Spatial Similarities , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[12]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Yufeng Chen,et al.  Joint dictionary learning with ridge regression for pansharpening , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[14]  Pengfei Liu,et al.  Spatial-Hessian-Feature-Guided Variational Model for Pan-Sharpening , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[16]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[17]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[18]  Liangpei Zhang,et al.  An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[19]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[20]  Liangpei Zhang,et al.  Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  T. Fearn Ridge Regression , 2013 .

[22]  Claire Soussen-Max,et al.  La question de la violence rituelle et de ses enjeux dans l'espace aragonais , 2007 .

[23]  Liang Xiao,et al.  Pan-sharpening using 2D CCA , 2015 .

[24]  Te-Ming Tu,et al.  An Adjustable Pan-Sharpening Approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 Imagery , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Liang Xiao,et al.  Edge and color preserving single image superresolution , 2014, J. Electronic Imaging.

[26]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[27]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[28]  Karl Rohr,et al.  Exterior orientation — an automatic approach based on fitting analytic landmark models , 1997 .

[29]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[30]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[31]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[33]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Liangpei Zhang,et al.  Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[36]  R. Molina,et al.  Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images , 2008 .

[37]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[38]  Thomas S. Huang,et al.  Close the loop: Joint blind image restoration and recognition with sparse representation prior , 2011, 2011 International Conference on Computer Vision.