Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion

Coupled nonnegative matrix factorization (CNMF) unmixing is proposed for the fusion of low-spatial-resolution hyperspectral and high-spatial-resolution multispectral data to produce fused data with high spatial and spectral resolutions. Both hyperspectral and multispectral data are alternately unmixed into end member and abundance matrices by the CNMF algorithm based on a linear spectral mixture model. Sensor observation models that relate the two data are built into the initialization matrix of each NMF unmixing procedure. This algorithm is physically straightforward and easy to implement owing to its simple update rules. Simulations with various image data sets demonstrate that the CNMF algorithm can produce high-quality fused data both in terms of spatial and spectral domains, which contributes to the accurate identification and classification of materials observed at a high spatial resolution.

[1]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[2]  V. P. Pauca,et al.  Nonnegative matrix factorization for spectral data analysis , 2006 .

[3]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[4]  John R. Schott,et al.  Application of Spectral Mixture Analysis and Image Fusion Techniques for Image Sharpening , 1998 .

[5]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[6]  Mingyi He,et al.  Multi-spectral and hyperspectral image fusion using 3-D wavelet transform , 2007 .

[7]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[8]  Ryuei Nishii,et al.  Enhancement of low spatial resolution image based on high resolution-bands , 1996, IEEE Trans. Geosci. Remote. Sens..

[9]  J. C. Price,et al.  Combining panchromatic and multispectral imagery dual resolution satellite instruments , 1987 .

[10]  Wei Xia,et al.  An approach based on constrained nonnegative matrix factorization to unmix hyperspectral data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[13]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[14]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[15]  J. Boardman,et al.  Geometric mixture analysis of imaging spectrometry data , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[16]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[18]  Paul E. Johnson,et al.  Quantitative determination of mineral types and abundances from reflectance spectra using principal components analysis , 1985 .

[19]  Russell C. Hardie,et al.  Application of the stochastic mixing model to hyperspectral resolution enhancement , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Robert W. Basedow,et al.  HYDICE system: implementation and performance , 1995, Defense, Security, and Sensing.

[21]  Nirmal Keshava,et al.  A Survey of Spectral Unmixing Algorithms , 2003 .

[22]  Michael Theodore Eismann Resolution enhancement of hyperspectral imagery using maximum a posteriori estimation with a stochastic mixing model , 2004 .

[23]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2003, IEEE Transactions on Geoscience and Remote Sensing.

[24]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[25]  Akira Iwasaki,et al.  Japanese hyper-multi spectral mission , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[27]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[29]  John R. Schott,et al.  Evaluation of Two Applications of Spectral Mixing Models to Image Fusion , 2000 .

[30]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[31]  Mireille Guillaume,et al.  Minimum Dispersion Constrained Nonnegative Matrix Factorization to Unmix Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[33]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[34]  S. Macenka,et al.  Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1988 .

[35]  Glenn Healey,et al.  Models and methods for automated material identification in hyperspectral imagery acquired under unknown illumination and atmospheric conditions , 1999, IEEE Trans. Geosci. Remote. Sens..

[36]  Menas Kafatos,et al.  Wavelet-based hyperspectral and multispectral image fusion , 2001, SPIE Defense + Commercial Sensing.

[37]  Vance Faber,et al.  Evaluation of algorithms for compressing hyperspectral data , 2004, SPIE Remote Sensing.

[38]  Hairong Qi,et al.  Endmember Extraction From Highly Mixed Data Using Minimum Volume Constrained Nonnegative Matrix Factorization , 2007, IEEE Transactions on Geoscience and Remote Sensing.