Hyperspectral Unmixing Using Deep Convolutional Autoencoders in a Supervised Scenario

Hyperspectral unmixing (HSU) is an essential technique that aims to address the mixed pixels problem in hyperspectral imagery via estimating the abundance of each endmember at every pixel given the endmembers. This article introduces two approaches intending to solve the challenge of the mixed pixels using deep convolutional autoencoders (DCAEs), namely pixel-based DCAE, and cube-based DCAE. The former estimates abundances with the help of only spectral information, while the latter utilizes both spectral and spatial information which results in better unmixing performance. In the proposed frameworks, the weights of the decoder are set equal to the endmembers in order to address the issue in a supervised scenario. The proposed frameworks are also adapted to the VGG-Net that proved increasing depth with small convolution filters ($\text{3}\times \text{3}$) leads to a considerable improvement. In other words, inspired by this idea, we utilize small and fixed kernels of size 3 in all layers of both proposed frameworks. The network is trained via the spectral information divergence objective function, and the dropout and regularization techniques are utilized to prevent overfitting. The superiority of the proposed frameworks is proven via conducting some experiments on both synthetic and real hyperspectral datasets and drawing a comparison with state-of-the-art methods. Moreover, the quantitative and visual evaluation of the proposed frameworks indicate the necessity of integrating spatial information into the HSU.

[1]  Gaofeng Meng,et al.  Spectral Unmixing via Data-Guided Sparsity , 2014, IEEE Transactions on Image Processing.

[2]  Naoto Yokoya,et al.  An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing , 2018, IEEE Transactions on Image Processing.

[3]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[5]  Hairong Qi,et al.  uDAS: An Untied Denoising Autoencoder With Sparsity for Spectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[7]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[8]  Gozde Bozdagi Akar,et al.  EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Xiaorun Li,et al.  Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing , 2016, IEEE Geoscience and Remote Sensing Letters.

[10]  Filiberto Pla,et al.  Hyperspectral Unmixing Based on Dual-Depth Sparse Probabilistic Latent Semantic Analysis , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[13]  Hassan Ghassemian,et al.  Enhancing Hyperspectral Endmember Extraction Using Clustering and Oversegmentation-Based Preprocessing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Hassan Ghassemian,et al.  Spectral Unmixing of Hyperspectral Imagery Using Multilayer NMF , 2014, IEEE Geoscience and Remote Sensing Letters.

[16]  Mohamed Cheriet,et al.  Sparse Hyperspectral Unmixing via Heuristic $\ell _p$ -Norm Approach , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Chein-I. Chang Spectral information divergence for hyperspectral image analysis , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[19]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[20]  Qian Du,et al.  Hyperspectral Unmixing Using Sparsity-Constrained Deep Nonnegative Matrix Factorization With Total Variation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jie Chen,et al.  Nonlinear Estimation of Material Abundances in Hyperspectral Images With $\ell_{1}$-Norm Spatial Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Johannes R. Sveinsson,et al.  Hyperspectral Unmixing Using a Neural Network Autoencoder , 2018, IEEE Access.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[26]  Antonio J. Plaza,et al.  Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Zhenwei Shi,et al.  A supervised abundance estimation method for hyperspectral unmixing , 2018 .

[30]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[31]  Hassan Ghassemian,et al.  Hybrid Preprocessing Algorithm for Endmember Extraction Using Clustering, Over-Segmentation, and Local Entropy Criterion , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Yuanchao Su,et al.  DAEN: Deep Autoencoder Networks for Hyperspectral Unmixing , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Licheng Jiao,et al.  Hyperspectral Unmixing via Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[34]  Jean-Yves Tourneret,et al.  Hyperspectral Unmixing With Spectral Variability Using a Perturbed Linear Mixing Model , 2015, IEEE Transactions on Signal Processing.

[35]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[36]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[37]  S. J. Sutley,et al.  USGS Digital Spectral Library splib06a , 2007 .

[38]  Fabio Del Frate,et al.  Nonlinear Spectral Unmixing of Landsat Imagery for Urban Surface Cover Mapping , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.