SLCRF: Subspace Learning With Conditional Random Field for Hyperspectral Image Classification

Subspace learning (SL) plays an important role in hyperspectral image (HSI) classification, since it can provide an effective solution to reduce the redundant information in the image pixels of HSIs. Previous works about SL aim to improve the accuracy of HSI recognition. Using a large number of labeled samples, related methods can train the parameters of the proposed solutions to obtain better representations of HSI pixels. However, the data instances may not be sufficient enough to learn a precise model for HSI classification in real applications. Moreover, it is well-known that it takes much time, labor and human expertise to label HSI images. To avoid the aforementioned problems, a novel SL method that includes the probability assumption called subspace learning with conditional random field (SLCRF) is developed. In SLCRF, first, the 3D convolutional autoencoder (3DCAE) is introduced to remove the redundant information in HSI pixels. In addition, the relationships are also constructed using the spectral-spatial information among the adjacent pixels. Then, the conditional random field (CRF) framework can be constructed and further embedded into the HSI SL procedure with the semi-supervised approach. Through the linearized alternating direction method termed LADMAP, the objective function of SLCRF is optimized using a defined iterative algorithm. The proposed method is comprehensively evaluated using the challenging public HSI datasets. We can achieve stateof-the-art performance using these HSI sets.

[1]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[2]  Jing Liu,et al.  Robust Structured Subspace Learning for Data Representation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jean-Yves Tourneret,et al.  Bayesian Estimation of Linear Mixtures Using the Normal Compositional Model. Application to Hyperspectral Imagery , 2010, IEEE Transactions on Image Processing.

[4]  Volodymyr Turchenko,et al.  A Deep Convolutional Auto-Encoder with Pooling - Unpooling Layers in Caffe , 2017, Int. J. Comput..

[5]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Liangpei Zhang,et al.  A Multifeature Tensor for Remote-Sensing Target Recognition , 2011, IEEE Geoscience and Remote Sensing Letters.

[7]  Bo Du,et al.  Semisupervised Discriminative Locally Enhanced Alignment for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  P. Niyogi,et al.  Locality Preserving Projections (LPP) , 2002 .

[9]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[10]  Ming-Hsuan Yang,et al.  Top-down visual saliency via joint CRF and dictionary learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Wesley E. Snyder,et al.  Band selection using independent component analysis for hyperspectral image processing , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[12]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[13]  Yang Li,et al.  Self-Supervised Feature Learning With CRF Embedding for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bo Du,et al.  Robust Graph-Based Semisupervised Learning for Noisy Labeled Data via Maximum Correntropy Criterion , 2019, IEEE Transactions on Cybernetics.

[15]  Suhong Liu,et al.  PSASL: Pixel-Level and Superpixel-Level Aware Subspace Learning for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Yan Liu,et al.  Learning Deep Conditional Neural Network for Image Segmentation , 2019, IEEE Transactions on Multimedia.

[17]  Weiwei Liu,et al.  Projection learning with local and global consistency constraints for scene classification , 2018 .

[18]  Gang Hua,et al.  Hyperspectral Image Classification Through Bilayer Graph-Based Learning , 2014, IEEE Transactions on Image Processing.

[19]  Andrew Owens,et al.  Ambient Sound Provides Supervision for Visual Learning , 2016, ECCV.

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[21]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[22]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[23]  Liangpei Zhang,et al.  Joint Collaborative Representation With Multitask Learning for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jinde Cao,et al.  FuseGAN: Learning to Fuse Multi-Focus Image via Conditional Generative Adversarial Network , 2019, IEEE Transactions on Multimedia.

[25]  Onkar Dikshit,et al.  SPECTRAL-SPATIAL CLASSIFICATION OF HYPERSPECTRAL REMOTE SENSING IMAGES USING VARIATIONAL AUTOENCODER AND CONVOLUTION NEURAL NETWORK , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[26]  Alexei A. Efros,et al.  Unsupervised Visual Representation Learning by Context Prediction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Tianli Yu,et al.  Kernelized structural SVM learning for supervised object segmentation , 2011, CVPR 2011.

[28]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[29]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[30]  Tülay Yildirim,et al.  Unsupervised classification of hyperspectral-image data using fuzzy approaches that spatially exploit membership relations , 2008, IEEE Geoscience and Remote Sensing Letters.

[31]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Farhad Samadzadegan,et al.  Spectral–spatial feature learning for hyperspectral imagery classification using deep stacked sparse autoencoder , 2017 .

[33]  C. V. Jawahar,et al.  Self-Supervised Learning of Visual Features through Embedding Images into Text Topic Spaces , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Qian Du,et al.  Unsupervised Spatial–Spectral Feature Learning by 3D Convolutional Autoencoder for Hyperspectral Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.