Self-Paced Nonnegative Matrix Factorization for Hyperspectral Unmixing

The presence of mixed pixels in the hyperspectral data makes unmixing to be a key step for many applications. Unsupervised unmixing needs to estimate the number of endmembers, their spectral signatures, and their abundances at each pixel. Since both endmember and abundance matrices are unknown, unsupervised unmixing can be considered as a blind source separation problem and can be solved by nonnegative matrix factorization (NMF). However, most of the existing NMF unmixing methods use a least-squares objective function that is sensitive to the noise and outliers. To deal with different types of noises in hyperspectral data, such as the noise in different bands (band noise), the noise in different pixels (pixel noise), and the noise in different elements of hyperspectral data matrix (element noise), we propose three self-paced learning based NMF (SpNMF) unmixing models in this article. The SpNMF models replace the least-squares loss in the standard NMF model with weighted least-squares losses and adopt a self-paced learning (SPL) strategy to learn the weights adaptively. In each iteration of SPL, atoms (bands or pixels or elements) with weight zero are considered as complex atoms and are excluded, while atoms with nonzero weights are considered as easy atoms and are included in the current unmixing model. By gradually enlarging the size of the current model set, SpNMF can select atoms from easy to complex. Usually, noisy or outlying atoms are complex atoms that are excluded from the unmixing model. Thus, SpNMF models are robust to noise and outliers. Experimental results on the simulated and two real hyperspectral data sets demonstrate that our proposed SpNMF methods are more accurate and robust than the existing NMF methods, especially in the case of heavy noise.

[1]  Seungjin Choi,et al.  Weighted nonnegative matrix factorization , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Bo Du,et al.  An Endmember Dissimilarity Constrained Non-Negative Matrix Factorization Method for Hyperspectral Unmixing , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Sen Jia,et al.  Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Jiayi Ma,et al.  Robust Sparse Hyperspectral Unmixing With $\ell_{2,1}$ Norm , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Chris H. Q. Ding,et al.  Robust nonnegative matrix factorization using L21-norm , 2011, CIKM '11.

[7]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[9]  Yuan Yan Tang,et al.  Maximum Likelihood Estimation-Based Joint Sparse Representation for the Classification of Hyperspectral Remote Sensing Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Xiangxiang Zhu,et al.  Improved self-paced learning framework for nonnegative matrix factorization , 2017, Pattern Recognit. Lett..

[11]  Ying Wang,et al.  Robust Hyperspectral Unmixing With Correntropy-Based Metric , 2013, IEEE Transactions on Image Processing.

[12]  Nanning Zheng,et al.  Correntropy Maximization via ADMM: Application to Robust Hyperspectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[14]  Gaofeng Meng,et al.  Effective Spectral Unmixing via Robust Representation and Learning-based Sparsity , 2014, ArXiv.

[15]  Xiaorun Li,et al.  Spectral–Spatial Robust Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[17]  Qian Du,et al.  Robust Joint Sparse Representation Based on Maximum Correntropy Criterion for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Xuan Li,et al.  Robust Nonnegative Matrix Factorization via Half-Quadratic Minimization , 2012, 2012 IEEE 12th International Conference on Data Mining.

[20]  Hairong Qi,et al.  Endmember Extraction From Highly Mixed Data Using Minimum Volume Constrained Nonnegative Matrix Factorization , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[22]  Qian Du,et al.  Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Qi Xie,et al.  Self-Paced Learning for Matrix Factorization , 2015, AAAI.