Hyperspectral Image Classification Via Spectral-Spatial Random Patches Network

Hyperspectral imageclassification is one of the most important steps in HSI analysis and challenging task for hyperspectral data processing, hyperspectral image contains rich spatial and spectral information. The abundance of spectral and spatial information is helpful to improve the classification accuracy. In this article, we propose a spectral-spatial random patches network (SSRPNet), which directly regards the random patches taken from the image as the convolution kernels without any training. The spectral-spatial feature extracted by SSRPNet stacked into a high dimensional vector, which combined with shallow, deep, spectral, spatial feature. Then, the high dimensional vector is fed into graph-based learning methods for classification, which can achieve excellent classification performance by randomly selecting a subset of features from a small sample point to create a graph. Experimental results on three datasets show that the proposed method can achieve satisfactory classification results compared with closely related methods.

[1]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[2]  Qian Du,et al.  Hyperspectral Anomaly Detection by Fractional Fourier Entropy , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[4]  Bo Du,et al.  Hyperspectral image classification via a random patches network , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[5]  Xiangtao Zheng,et al.  Spectral–Spatial Attention Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Junyu Dong,et al.  Spectral and Spatial Classification of Hyperspectral Images Based on Random Multi-Graphs , 2018, Remote. Sens..

[7]  Bing Liu,et al.  Deep Induction Network for Small Samples Classification of Hyperspectral Images , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Ran Tao,et al.  Joint Classification of Hyperspectral and LiDAR Data Using Hierarchical Random Walk and Deep CNN Architecture , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Mingli Ding,et al.  Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[10]  C. L. Philip Chen,et al.  Hyperspectral Image Classification Based on Multiscale Spatial Information Fusion , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Hong Huang,et al.  Local Manifold-Based Sparse Discriminant Learning for Feature Extraction of Hyperspectral Image , 2020, IEEE Transactions on Cybernetics.

[12]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[14]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[15]  Lianru Gao,et al.  Combining t-Distributed Stochastic Neighbor Embedding With Convolutional Neural Networks for Hyperspectral Image Classification , 2020, IEEE Geoscience and Remote Sensing Letters.

[16]  Liang Xiao,et al.  Spatial-Spectral Kernel Sparse Representation for Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Haibo He,et al.  Dimensionality Reduction of Hyperspectral Imagery Based on Spatial–Spectral Manifold Learning , 2018, IEEE Transactions on Cybernetics.

[18]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lei Tong,et al.  Hyperspectral Image Classification With Spectral and Spatial Graph Using Inductive Representation Learning Network , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Li Ma,et al.  Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification , 2016, Pattern Recognit. Lett..

[21]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Chen Gong,et al.  Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Qin Zhang,et al.  Random Multi-Graphs: A semi-supervised learning framework for classification of high dimensional data , 2017, Image Vis. Comput..

[25]  Fan Zhang,et al.  Hierarchical feature learning with dropout k-means for hyperspectral image classification , 2016, Neurocomputing.

[26]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Yuan Yan Tang,et al.  Hyperspectral Image Classification Using Principal Components-Based Smooth Ordering and Multiple 1-D Interpolation , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jiasong Zhu,et al.  Cascade Superpixel Regularized Gabor Feature Fusion for Hyperspectral Image Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Guangyao Shi,et al.  Unsupervised Dimensionality Reduction for Hyperspectral Imagery via Local Geometric Structure Feature Learning , 2020, IEEE Geoscience and Remote Sensing Letters.

[32]  Cheng Shi,et al.  Multiscale Superpixel-Based Hyperspectral Image Classification Using Recurrent Neural Networks With Stacked Autoencoders , 2020, IEEE Transactions on Multimedia.

[33]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[34]  Meiping Song,et al.  A Simplified 2D-3D CNN Architecture for Hyperspectral Image Classification Based on Spatial–Spectral Fusion , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Qian Du,et al.  Deep Multilayer Fusion Dense Network for Hyperspectral Image Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[37]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Qian Du,et al.  Feature Extraction for Classification of Hyperspectral and LiDAR Data Using Patch-to-Patch CNN , 2020, IEEE Transactions on Cybernetics.

[39]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[40]  Shiming Xiang,et al.  Semisupervised Pair-Wise Band Selection for Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Javier Plaza,et al.  FLOP-Reduction Through Memory Allocations Within CNN for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Huan Liu,et al.  Sample-screening MKL method via boosting strategy for hyperspectral image classification , 2016, Neurocomputing.

[44]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.