Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation

Hyperspectral unmixing is an important processing step for many hyperspectral applications, mainly including: 1) estimation of pure spectral signatures (endmembers) and 2) estimation of the abundance of each endmember in each pixel of the image. In recent years, nonnegative matrix factorization (NMF) has been highly attractive for this purpose due to the nonnegativity constraint that is often imposed in the abundance estimation step. However, most of the existing NMF-based methods only consider the information in a single layer while neglecting the hierarchical features with hidden information. To alleviate such limitation, in this paper, we propose a new sparsity-constrained deep NMF with total variation (SDNMF-TV) technique for hyperspectral unmixing. First, by adopting the concept of deep learning, the NMF algorithm is extended to deep NMF model. The proposed model consists of pretraining stage and fine-tuning stage, where the former pretrains all factors layer by layer and the latter is used to reduce the total reconstruction error. Second, in order to exploit adequately the spectral and spatial information included in the original hyperspectral image, we enforce two constraints on the abundance matrix. Specifically, the $L_{1/2}$ constraint is adopted, since the distribution of each endmember is sparse in the 2-D space. The TV regularizer is further introduced to promote piecewise smoothness in abundance maps. For the optimization of the proposed model, multiplicative update rules are derived using the gradient descent method. The effectiveness and superiority of the SDNMF-TV algorithm are demonstrated by comparing with other unmixing methods on both synthetic and real data sets.

[1]  Angshul Majumdar,et al.  Hyperspectral Unmixing in the Presence of Mixed Noise Using Joint-Sparsity and Total Variation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Xiaorun Li,et al.  Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Robert F. Cromp,et al.  Analyzing hyperspectral data with independent component analysis , 1998, Other Conferences.

[4]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Zhenwei Shi,et al.  Nonnegative matrix factorization for hyperspectral unmixing using prior knowledge of spectral signatures , 2012 .

[6]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[8]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Liangpei Zhang,et al.  Total Variation Regularized Reweighted Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jun Zhou,et al.  VHR Object Detection Based on Structural Feature Extraction and Query Expansion , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Yunsong Li,et al.  Hyperspectral Imagery Denoising by Deep Learning With Trainable Nonlinearity Function , 2017, IEEE Geoscience and Remote Sensing Letters.

[12]  Nicolas Dobigeon,et al.  Nonlinear Hyperspectral Unmixing With Robust Nonnegative Matrix Factorization , 2014, IEEE Transactions on Image Processing.

[13]  Jun Zhou,et al.  Nonnegative-Matrix-Factorization-Based Hyperspectral Unmixing With Partially Known Endmembers , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[15]  Jochen J. Steil,et al.  Online learning and generalization of parts-based image representations by non-negative sparse autoencoders , 2012, Neural Networks.

[16]  Guixu Zhang,et al.  Similarity-Guided and $\ell_p$-Regularized Sparse Unmixing of Hyperspectral Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[17]  George Trigeorgis,et al.  A Deep Matrix Factorization Method for Learning Attribute Representations , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[19]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jun Zhou,et al.  Semisupervised Hyperspectral Band Selection Via Spectral–Spatial Hypergraph Model , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Saeed Gazor,et al.  Smooth and Sparse Regularization for NMF Hyperspectral Unmixing , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Rui Wang,et al.  Centralized Collaborative Sparse Unmixing for Hyperspectral Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Johannes R. Sveinsson,et al.  Neural network hyperspectral unmixing with spectral information divergence objective , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[26]  Jun Zhou,et al.  On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Yoann Altmann,et al.  Nonlinear unmixing of Hyperspectral images , 2013 .

[28]  Naoto Yokoya,et al.  Nonlinear Unmixing of Hyperspectral Data Using Semi-Nonnegative Matrix Factorization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yuntao Qian,et al.  Adaptive ${L}_{\bf 1/2}$ Sparsity-Constrained NMF With Half-Thresholding Algorithm for Hyperspectral Unmixing , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Yuan Yan Tang,et al.  Hypergraph-Regularized Sparse NMF for Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Rui Guo,et al.  Hyperspectral image unmixing using autoencoder cascade , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[33]  Liangpei Zhang,et al.  Spectral–Spatial Sparse Subspace Clustering for Hyperspectral Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[35]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[36]  Yan Zhang,et al.  Sparse Hyperspectral Unmixing Based on Constrained lp - l2 Optimization , 2013, IEEE Geoscience and Remote Sensing Letters.

[37]  Paul E. Johnson,et al.  Spectral mixture modeling: A new analysis of rock and soil types at the Viking Lander 1 Site , 1986 .

[38]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Shuyuan Yang,et al.  Geometric Nonnegative Matrix Factorization (GNMF) for Hyperspectral Unmixing , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Antonio J. Plaza,et al.  Nonnegative sparse autoencoder for robust endmember extraction from remotely sensed hyperspectral images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[41]  Hassan Ghassemian,et al.  Spectral Unmixing of Hyperspectral Imagery Using Multilayer NMF , 2014, IEEE Geoscience and Remote Sensing Letters.

[42]  Johannes R. Sveinsson,et al.  Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[43]  Andreas T. Ernst,et al.  ICE: a statistical approach to identifying endmembers in hyperspectral images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Gaofeng Meng,et al.  Spectral Unmixing via Data-Guided Sparsity , 2014, IEEE Transactions on Image Processing.

[45]  Zongben Xu,et al.  L1/2 regularization , 2010, Science China Information Sciences.

[46]  Jun Zhou,et al.  Region-Based Structure Preserving Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[48]  Wei Xia,et al.  Independent Component Analysis for Blind Unmixing of Hyperspectral Imagery With Additional Constraints , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Hao Wu,et al.  Double Constrained NMF for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Wang Yao,et al.  L 1/2 regularization , 2010 .

[51]  Liangpei Zhang,et al.  Sparsity-Regularized Robust Non-Negative Matrix Factorization for Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[52]  Aleksandra Pizurica,et al.  Hyperspectral Unmixing Using Double Reweighted Sparse Regression and Total Variation , 2017, IEEE Geoscience and Remote Sensing Letters.

[53]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[54]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[55]  Bo Du,et al.  An Abundance Characteristic-Based Independent Component Analysis for Hyperspectral Unmixing , 2015, IEEE Transactions on Geoscience and Remote Sensing.