An approach based on constrained nonnegative matrix factorization to unmix hyperspectral data

Nonnegative matrix factorization (NMF) has been recently applied to solve the hyperspectral unmixing problem because it ensures nonnegativity and needs no assumption for the presence of pure pixels. However, the algorithm has a large amount of local minima due to the obvious nonconvexity of the objective function. In order to improve its performance, auxiliary constraints can be introduced into the algorithm. In this paper, we propose a new approach named abundance separation and smoothness constrained NMF by introducing two constraints, namely, abundance separation and smoothness, into the NMF algorithm. These constraints are based on two properties of hyperspectral imagery. First, usually, every ground object presents dominance in a specific region of the entire image scene and the correlation is weak between different endmembers. Second, moving through various regions, ground objects usually vary slowly and abrupt changes rarely appear. We also propose a learning algorithm to further improve the performance of our method, from which the auxiliary constraints are removed at an appropriate time. The proposed algorithm retains all the advantages of NMF and effectively overcomes the shortcoming of local minima at the same time. Experimental results based on synthetic and real hyperspectral data show the superiority of the proposed algorithm with respect to other state-of-the-art approaches.

[1]  Lucas C. Parra,et al.  Recovery of constituent spectra using non-negative matrix factorization , 2003, SPIE Optics + Photonics.

[2]  Jon Atli Benediktsson,et al.  On the decomposition of Mars hyperspectral data by ICA and Bayesian positive source separation , 2008, Neurocomputing.

[3]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[4]  Christos Boutsidis,et al.  SVD based initialization: A head start for nonnegative matrix factorization , 2008, Pattern Recognit..

[5]  J. Boardman Automating spectral unmixing of AVIRIS data using convex geometry concepts , 1993 .

[6]  Antonio J. Plaza,et al.  Spatial/spectral endmember extraction by multidimensional morphological operations , 2002, IEEE Trans. Geosci. Remote. Sens..

[7]  Chein-I Chang,et al.  A New Growing Method for Simplex-Based Endmember Extraction Algorithm , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[9]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[10]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[12]  José M. P. Nascimento,et al.  Signal subspace identification in hyperspectral imagery , 2012 .

[13]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[14]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[15]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[16]  E. Oja,et al.  Independent Component Analysis , 2001 .

[17]  Hairong Qi,et al.  Endmember Extraction From Highly Mixed Data Using Minimum Volume Constrained Nonnegative Matrix Factorization , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  C. Liou,et al.  Unsupervised Classification of Remote Sensing Imagery With Non-negative Matrix Factorization , 2005 .

[19]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[20]  Jing Wang,et al.  A novel approach for spectral unmixing, classification, and concentration estimation of chemical and biological agents , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[23]  V. P. Pauca,et al.  Object Characterization from Spectral Data Using Nonnegative Factorization and Information Theory , 2004 .

[24]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[25]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[26]  A. Cichocki,et al.  Nonnegative Matrix Factorization with Temporal Smoothness and / or Spatial Decorrelation Constraints , 2005 .

[27]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[28]  Zhaoshui He,et al.  Extended SMART Algorithms for Non-negative Matrix Factorization , 2006, ICAISC.

[29]  Liming Zhang,et al.  A new approach based on orthogonal bases of data space to decomposition of mixed pixels for hyperspectral imagery , 2009, Science in China Series F: Information Sciences.

[30]  Stefan M. Wild,et al.  Improving non-negative matrix factorizations through structured initialization , 2004, Pattern Recognit..

[31]  V. P. Pauca,et al.  Nonnegative matrix factorization for spectral data analysis , 2006 .

[32]  Antonio J. Plaza,et al.  Spatial Preprocessing for Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Nirmal Keshava,et al.  A Survey of Spectral Unmixing Algorithms , 2003 .

[34]  Feng Qianjin,et al.  Projected gradient methods for Non-negative Matrix Factorization based relevance feedback algorithm in medical image retrieval , 2011 .

[35]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[36]  Jing Wang,et al.  Applications of Independent Component Analysis in Endmember Extraction and Abundance Quantification for Hyperspectral Imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[37]  José M. Bioucas-Dias,et al.  Minimum Volume Simplex Analysis: A Fast Algorithm to Unmix Hyperspectral Data , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[38]  Antonio J. Plaza,et al.  Impact of Initialization on Design of Endmember Extraction Algorithms , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jeff J. Settle,et al.  On the relationship between spectral unmixing and subspace projection , 1996, IEEE Trans. Geosci. Remote. Sens..

[40]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[41]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[42]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2005, IEEE Trans. Geosci. Remote. Sens..

[43]  Nanning Zheng,et al.  Learning sparse features for classification by mixture models , 2004, Pattern Recognit. Lett..

[44]  Victoria Stodden,et al.  When Does Non-Negative Matrix Factorization Give a Correct Decomposition into Parts? , 2003, NIPS.

[45]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[46]  Nanning Zheng,et al.  Relative gradient speeding up additive updates for nonnegative matrix factorization , 2004, Neurocomputing.

[47]  Chein-I. Chang Spectral information divergence for hyperspectral image analysis , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[48]  Maurice D. Craig,et al.  Minimum-volume transforms for remotely sensed data , 1994, IEEE Trans. Geosci. Remote. Sens..