LSTM-DNN Based Autoencoder Network for Nonlinear Hyperspectral Image Unmixing

Blind hyperspectral unmixing is an important technique in hyperspectral image analysis, aiming at estimating endmembers and their respective fractional abundances. Consider the limitations of using the linear model, nonlinear unmixing methods have been studied under different model assumptions. However, existing nonlinear unmixing algorithms do not fully exploit spectral and spatial correlation information. This paper proposes a nonsymmetric autoencoder network to overcome this issue. The proposed scheme benefits from the universal modeling ability of deep neural networks and enables to learn the nonlinear relation from the data. Particularly, the long short-term memory network (LSTM) structure is included to capture spectral correlation information, and a spatial regularization is introduced to improve the spatial continuity of results. An attention mechanism is also used to further enhance the unmixing performance. Experiments with synthetic and real data are conducted to illustrate the effectiveness of the proposed method.

[1]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[2]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[3]  Min Zhao,et al.  A Laboratory-Created Dataset With Ground Truth for Hyperspectral Unmixing Evaluation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Mark A. Richardson,et al.  An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition , 2010 .

[6]  Jakob Uszkoreit,et al.  A Decomposable Attention Model for Natural Language Inference , 2016, EMNLP.

[7]  Johannes R. Sveinsson,et al.  Hyperspectral Unmixing Using a Neural Network Autoencoder , 2018, IEEE Access.

[8]  Hairong Qi,et al.  uDAS: An Untied Denoising Autoencoder With Sparsity for Spectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Susanto Rahardja,et al.  Kernel-Based Nonlinear Spectral Unmixing with Dictionary Pruning , 2019, Remote. Sens..

[10]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Bo Du,et al.  Spectral–Spatial Unified Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Licheng Jiao,et al.  Hyperspectral Unmixing via Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[13]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[14]  Johannes R. Sveinsson,et al.  Convolutional Autoencoder for Spatial-Spectral Hyperspectral Unmixing , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Yuanchao Su,et al.  DAEN: Deep Autoencoder Networks for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Rob Heylen,et al.  A Multilinear Mixing Model for Nonlinear Spectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[17]  John R. Miller,et al.  Comparative study between a new nonlinear model and common linear model for analysing laboratory simulated‐forest hyperspectral data , 2009 .

[18]  Jean-Yves Tourneret,et al.  Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery , 2012, IEEE Transactions on Image Processing.

[19]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Alfonso Fernández-Manso,et al.  Spectral unmixing , 2012 .

[22]  Jean-Yves Tourneret,et al.  Unsupervised Post-Nonlinear Unmixing of Hyperspectral Images Using a Hamiltonian Monte Carlo Algorithm , 2014, IEEE Transactions on Image Processing.

[23]  Hassan Ghassemian,et al.  Hyperspectral Unmixing Using Deep Convolutional Autoencoders in a Supervised Scenario , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Rob Heylen,et al.  Non-Linear Spectral Unmixing by Geodesic Simplex Volume Maximization , 2011, IEEE Journal of Selected Topics in Signal Processing.

[25]  Ricardo Augusto Borsoi,et al.  Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing , 2019, IEEE Transactions on Computational Imaging.

[26]  S. Gerstl,et al.  Nonlinear spectral mixing models for vegetative and soil surfaces , 1994 .

[27]  Jean-Yves Tourneret,et al.  Unmixing hyperspectral images using the generalized bilinear model , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Cédric Richard,et al.  Nonlinear Unmixing of Hyperspectral Data With Vector-Valued Kernel Functions , 2017, IEEE Transactions on Image Processing.

[29]  Yuanchao Su,et al.  Stacked Nonnegative Sparse Autoencoders for Robust Hyperspectral Unmixing , 2018, IEEE Geoscience and Remote Sensing Letters.

[30]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[31]  Nicolas Dobigeon,et al.  Nonlinear Hyperspectral Unmixing With Robust Nonnegative Matrix Factorization , 2014, IEEE Transactions on Image Processing.

[32]  B. Hapke,et al.  The Opposition Effect of the Moon: The Contribution of Coherent Backscatter , 1993, Science.

[33]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[34]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[35]  Gozde Bozdagi Akar,et al.  EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Qingshan Liu,et al.  Hyperspectral Image Classification Using Spectral-Spatial LSTMs , 2017, CCCV.

[37]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[38]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[41]  Min Zhao,et al.  Nonlinear Unmixing of Hyperspectral Data via Deep Autoencoder Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[42]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[43]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[44]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Xiangtao Zheng,et al.  Hyperspectral Image Superresolution by Transfer Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Johannes R. Sveinsson,et al.  Neural network hyperspectral unmixing with spectral information divergence objective , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[47]  Bin Luo,et al.  Empirical Automatic Estimation of the Number of Endmembers in Hyperspectral Images , 2013, IEEE Geoscience and Remote Sensing Letters.