Fusion of Panchromatic and Multispectral Images via Coupled Sparse Non-Negative Matrix Factorization

In this paper, we construct a new coupled sparse non-negative matrix factorization (CSNMF) model for the fusion of panchromatic (PAN) and multispectral (MS) images. Two CSNMFs are developed for a joint sparse representation of MS and PAN images. Moreover, a sequential iterative algorithm is proposed to simultaneously find the solution to CSNMF. Because learned dictionaries can reveal the latent structure of images in spatial and spectral domains, the fused high-resolution MS images can be calculated by multiplying the dictionary of PAN image and the sparse coefficients of MS images. Some experiments are taken on simulated and real QuickBird data, and the results show that CSNMF outperforms its counterparts in both visual quality and numerical guidelines.

[1]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[2]  Liangpei Zhang,et al.  A Practical Compressed Sensing-Based Pan-Sharpening Method , 2012, IEEE Geoscience and Remote Sensing Letters.

[3]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[4]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[5]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[6]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[7]  Richard Bamler,et al.  A Sparse Image Fusion Algorithm With Application to Pan-Sharpening , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[9]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[10]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Stefan M. Wild,et al.  Improving non-negative matrix factorizations through structured initialization , 2004, Pattern Recognit..

[12]  Wenzhong Shi,et al.  Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[13]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[14]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[15]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[16]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[17]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[18]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jocelyn Chanussot,et al.  Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[21]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[22]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Xianchuan Yu,et al.  A Remote Sensing Image Fusion Algorithm Based on Constrained Nonnegative Matrix Factorization , 2008, 2008 Congress on Image and Signal Processing.

[24]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[25]  Christos Boutsidis,et al.  SVD based initialization: A head start for nonnegative matrix factorization , 2008, Pattern Recognit..

[26]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[27]  G. A. Boggione,et al.  Simulation of a Panchromatic Band by Spectral Combination of Multispectral ETM + Bands , 2003 .

[28]  Shutao Li,et al.  A New Pan-Sharpening Method Using a Compressed Sensing Technique , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Henry Leung,et al.  Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.