Latent Relationship Guided Stacked Sparse Autoencoder for Hyperspectral Imagery Classification

Classification is an important application of hyperspectral image (HSI). However, it is also a challenging research topic due to the spatial variability of spectral signature and limited training samples. To address these problems, a novel unsupervised feature learning method called latent relationship guided the stacked sparse autoencoder (LRSSAE) is developed in this article, which can effectively exploit the latent relationship under feature space to improve the ability of feature learning. Moreover, the superpixels constraint is employed on the feature representation to avoid the “salt-and-pepper” problem, and it is enforced on the latent relationship to enhance the latent relationship learning additionally. In LRSSAE, combining the stacked sparse autoencoder (SSAE) with the graph regularizations of latent relationship in each hidden layer and the superpixel constraints in the top layer, we extract feature representation in an unsupervised manner. And then, we present a customized iterative algorithm to optimize the LRSSAE. We evaluate the proposed method on three widely used HSI data sets comprehensively. The results demonstrate that our method achieves promising classification performance on these data sets and obtains improvements of 5.06%, 5.77%, and 2.11% in overall accuracy compared to the best SSAE method.

[1]  Bo Du,et al.  A Novel Semisupervised Active-Learning Algorithm for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[3]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[5]  Zhang Liangpei,et al.  Spatial-Spectral Unsupervised Convolutional Sparse Auto-Encoder Classifier for Hyperspectral Imagery , 2017 .

[6]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Licheng Jiao,et al.  Classification of Hyperspectral Images Based on Multiclass Spatial–Spectral Generative Adversarial Networks , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Yansheng Li,et al.  Unsupervised Spectral–Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[9]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[10]  Weibei Dou,et al.  Facial expression recognition and generation using sparse autoencoder , 2014, 2014 International Conference on Smart Computing.

[11]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Farhad Samadzadegan,et al.  Spectral–spatial feature learning for hyperspectral imagery classification using deep stacked sparse autoencoder , 2017 .

[13]  Yao Zhao,et al.  Graph regularized ICA for over-complete feature learning , 2012, CVM'12.

[14]  Tao Chen,et al.  Superpixel Guided Deep-Sparse-Representation Learning for Hyperspectral Image Classification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Bo Du,et al.  Unsupervised Scene Change Detection via Latent Dirichlet Allocation and Multivariate Alteration Detection , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Bo Li,et al.  Multi-scale 3D deep convolutional neural network for hyperspectral image classification , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[19]  Yicong Zhou,et al.  Spectral-Spatial Response for Hyperspectral Image Classification , 2017, Remote. Sens..

[20]  J. Anthony Gualtieri,et al.  Support vector machines for hyperspectral remote sensing classification , 1999, Other Conferences.

[21]  Kim-Kwang Raymond Choo,et al.  Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification , 2016, Soft Computing.

[22]  Stanley Osher,et al.  Unsupervised Classification in Hyperspectral Imagery With Nonlocal Total Variation and Primal-Dual Hybrid Gradient Algorithm , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Suhong Liu,et al.  PSASL: Pixel-Level and Superpixel-Level Aware Subspace Learning for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Mihai Datcu,et al.  Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation , 2010, IEEE Geoscience and Remote Sensing Letters.

[26]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[27]  Bing Zhang,et al.  Self-Supervised Low-Rank Representation (SSLRR) for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Feiping Nie,et al.  LRAGE: Learning Latent Relationships With Adaptive Graph Embedding for Aerial Scene Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Pabitra Mitra,et al.  BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Concetto Spampinato,et al.  Semi Supervised Semantic Segmentation Using Generative Adversarial Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Yan Xu,et al.  Deep learning of feature representation with multiple instance learning for medical image analysis , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[34]  Lorenzo Bruzzone,et al.  Class-wise dictionary learning for hyperspectral image classification , 2017, Neurocomputing.

[35]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[36]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[37]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[38]  Jun Li,et al.  Unsupervised Feature Extraction in Hyperspectral Images Based on Wasserstein Generative Adversarial Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Bo Du,et al.  An Improved Quantum-Behaved Particle Swarm Optimization for Endmember Extraction , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Ming-Hsuan Yang,et al.  Adversarial Learning for Semi-supervised Semantic Segmentation , 2018, BMVC.

[41]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[43]  Jie Geng,et al.  Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Yan Guo,et al.  Local-Manifold-Learning-Based Graph Construction for Semisupervised Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Pengfei Wei,et al.  Deep Nonlinear Feature Coding for Unsupervised Domain Adaptation , 2016, IJCAI.

[46]  Quoc V. Le,et al.  ICA with Reconstruction Cost for Efficient Overcomplete Feature Learning , 2011, NIPS.

[47]  Chunhui Zhao,et al.  Local receptive field constrained stacked sparse autoencoder for classification of hyperspectral images. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[48]  Zongben Xu,et al.  Enhancing Low-Rank Subspace Clustering by Manifold Regularization , 2014, IEEE Transactions on Image Processing.

[49]  Gianluca Sapienza,et al.  Robust Real-Time Load Profile Encoding and Classification Framework for Efficient Power Systems Operation , 2015, IEEE Transactions on Power Systems.

[50]  Yicong Zhou,et al.  Learning Hierarchical Spectral–Spatial Features for Hyperspectral Image Classification , 2016, IEEE Transactions on Cybernetics.

[51]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[52]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.