Subspace Structure Regularized Nonnegative Matrix Factorization for Hyperspectral Unmixing

Hyperspectral unmixing is a crucial task for hyperspectral images (HSIs) processing, which estimates the proportions of constituent materials of a mixed pixel. Usually, the mixed pixels can be approximated using a linear mixing model. Since each material only occurs in a few pixels in real HSI, sparse nonnegative matrix factorization (NMF), and its extensions are widely used as solutions. Some recent works assume that materials are distributed in certain structures, which can be added as constraints to sparse NMF model. However, they only consider the spatial distribution within a local neighborhood and define the distribution structure manually, while ignoring the real distribution of materials that is diverse in different images. In this article, we propose a new unmixing method that learns a subspace structure from the original image and incorporate it into the sparse NMF framework to promote unmixing performance. Based on the self-representation property of data points lying in the same subspace, the learned subspace structure can indicate the global similar graph of pixels that represents the real distribution of materials. Then the similar graph is used as a robust global spatial prior which is expected to be maintained in the decomposed abundance matrix. The experiments conducted on both simulated and real-world HSI datasets demonstrate the superior performance of our proposed method.

[1]  Xuelong Li,et al.  Manifold Regularized Sparse NMF for Hyperspectral Unmixing , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Qian Du,et al.  Local Spectral Similarity Preserving Regularized Robust Sparse Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Qian Du,et al.  Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Liangpei Zhang,et al.  Total Variation Regularized Reweighted Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[6]  Maurice D. Craig,et al.  Minimum-volume transforms for remotely sensed data , 1994, IEEE Trans. Geosci. Remote. Sens..

[7]  Hao Wu,et al.  Double Constrained NMF for Hyperspectral Unmixing , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  F. J. García-Haro,et al.  Linear spectral mixture modelling to estimate vegetation amount from optical spectral data , 1996 .

[9]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[10]  Liangpei Zhang,et al.  Sparsity-Regularized Robust Non-Negative Matrix Factorization for Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Ricardo Augusto Borsoi,et al.  Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing , 2019, IEEE Transactions on Computational Imaging.

[12]  Jun Zhou,et al.  Nonnegative-Matrix-Factorization-Based Hyperspectral Unmixing With Partially Known Endmembers , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Tong Zhang,et al.  Deep Subspace Clustering Networks , 2017, NIPS.

[14]  Chris H. Q. Ding,et al.  Robust nonnegative matrix factorization using L21-norm , 2011, CIKM '11.

[15]  Qian Du,et al.  Simultaneous Spatial and Spectral Low-Rank Representation of Hyperspectral Images for Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[18]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[19]  Liangpei Zhang,et al.  Spatial Group Sparsity Regularized Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jiayi Ma,et al.  Robust Sparse Hyperspectral Unmixing With $\ell_{2,1}$ Norm , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[23]  Xianglong Liu,et al.  Latent Distribution Preserving Deep Subspace Clustering , 2019, IJCAI.

[24]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jun Zhou,et al.  VHR Object Detection Based on Structural Feature Extraction and Query Expansion , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[27]  Jing Wang,et al.  Applications of Independent Component Analysis in Endmember Extraction and Abundance Quantification for Hyperspectral Imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Zhenwei Shi,et al.  Robust Sparse Unmixing for Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[30]  Jie Huang,et al.  Joint-Sparse-Blocks and Low-Rank Representation for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Nirmal Keshava,et al.  A Survey of Spectral Unmixing Algorithms , 2003 .

[32]  Jun Zhou,et al.  Nonlocal Similarity Based Nonnegative Tucker Decomposition for Hyperspectral Image Denoising , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Mohamed Cheriet,et al.  Sparse Hyperspectral Unmixing via Heuristic $\ell _p$ -Norm Approach , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Jun Zhou,et al.  Material Based Object Tracking in Hyperspectral Videos , 2018, IEEE Transactions on Image Processing.

[35]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[36]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[37]  Jun Zhou,et al.  On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Hassan Ghassemian,et al.  Hyperspectral Unmixing Using Deep Convolutional Autoencoders in a Supervised Scenario , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[40]  J. Boardman Automating spectral unmixing of AVIRIS data using convex geometry concepts , 1993 .

[41]  Seung-Jean Kim,et al.  Hyperspectral Image Unmixing via Alternating Projected Subgradients , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[42]  Wei Xia,et al.  An approach based on constrained nonnegative matrix factorization to unmix hyperspectral data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Xiaorun Li,et al.  Spectral–Spatial Robust Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Bin Wang,et al.  Nonlinear Hyperspectral Unmixing Based on Geometric Characteristics of Bilinear Mixture Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[45]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[46]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Liangpei Zhang,et al.  Spectral–Spatial Sparse Subspace Clustering for Hyperspectral Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[48]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[49]  Yuanchao Su,et al.  DAEN: Deep Autoencoder Networks for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Hadi Zayyani,et al.  Clustered multitask non-negative matrix factorization for spectral unmixing of hyperspectral data , 2019, Journal of Applied Remote Sensing.

[51]  Hassan Ghassemian,et al.  Spectral Unmixing of Hyperspectral Imagery Using Multilayer NMF , 2014, IEEE Geoscience and Remote Sensing Letters.

[52]  Xianglong Liu,et al.  Learning binary code for fast nearest subspace search , 2020, Pattern Recognit..

[53]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.