NMF-SAE: An Interpretable Sparse Autoencoder for Hyperspectral Unmixing

Hyperspectral unmixing is an important tool to learn the material constitution and distribution of a scene. Model-based unmixing methods depend on well-designed iterative optimization algorithms, which is usually time consuming. Learning-based methods perform unmixing in a data-driven manner but heavily rely on the quality and quantity of the training samples due to the lack of physical interpretability. In this paper, we combine the advantages of both model-based and learning-based methods and propose a nonnegative matrix factorization (NMF) inspired sparse autoencoder (NMF-SAE) for hyperspectral unmixing. NMF-SAE consists of an encoder and a decoder, both of which are constructed by unrolling the iterative optimization rules of L1 sparsity-constrained NMF for the linear spectral mixture model. All parameters in our method are obtained by end-to-end training in a data-driven manner. Our network is not only physically interpretable and flexible but also has higher learning capacity with fewer parameters. Experimental results on both synthetic and real-world data demonstrate that our method is capable of producing desirable unmixing results when compared against several alternative approaches.

[1]  Hairong Qi,et al.  uDAS: An Untied Denoising Autoencoder With Sparsity for Spectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Yuan Yuan,et al.  Subspace Clustering Constrained Sparse NMF for Hyperspectral Unmixing , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Jun Zhou,et al.  Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Gozde Bozdagi Akar,et al.  EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yuntao Qian,et al.  Spectral Mixture Model Inspired Network Architectures for Hyperspectral Unmixing , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Hassan Ghassemian,et al.  Hyperspectral Unmixing Using Deep Convolutional Autoencoders in a Supervised Scenario , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Liangpei Zhang,et al.  Total Variation Regularized Reweighted Sparse Nonnegative Matrix Factorization for Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Johannes R. Sveinsson,et al.  Convolutional Autoencoder for Spectral-Spatial Hyperspectral Unmixing , 2021, IEEE Trans. Geosci. Remote. Sens..

[10]  Jiasong Zhu,et al.  Cascade Superpixel Regularized Gabor Feature Fusion for Hyperspectral Image Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Kun Gao,et al.  Blind Hyperspectral Unmixing using Dual Branch Deep Autoencoder with Orthogonal Sparse Prior , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Yuan Yan Tang,et al.  Matrix-Vector Nonnegative Tensor Factorization for Blind Unmixing of Hyperspectral Imagery , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Licheng Jiao,et al.  Hyperspectral Unmixing via Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[14]  Bin Yang,et al.  Constrained Nonnegative Matrix Factorization Based on Particle Swarm Optimization for Hyperspectral Unmixing , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[16]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Jun Zhou,et al.  Material Based Object Tracking in Hyperspectral Videos , 2018, IEEE Transactions on Image Processing.

[18]  Yuanchao Su,et al.  DAEN: Deep Autoencoder Networks for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Yuan Yan Tang,et al.  Hyperspectral Unmixing via Total Variation Regularized Nonnegative Tensor Factorization , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Raja Giryes,et al.  Image Restoration by Iterative Denoising and Backward Projections , 2017, IEEE Transactions on Image Processing.

[21]  Ricardo Augusto Borsoi,et al.  Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing , 2019, IEEE Transactions on Computational Imaging.

[22]  Yi He,et al.  On the Convergence of Learning-Based Iterative Methods for Nonconvex Inverse Problems , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.