Composite kernel learning network for hyperspectral image classification

ABSTRACT The small sample problem has always been a serious challenge in hyperspectral image (HSI) classification. In order to obtain satisfactory results when the training samples are insufficient, the information around the training samples should be fully utilized. In this paper, we focus on small sample learning and propose a novel composite kernel learning network (CKLNet) for HSI classification. First, principal component analysis and extended morphological analysis are utilized to extract features. Then, we introduce generalized kernel method into deep learning technology. The spatial-spectral composite kernel learning (SSCKL) module is developed to construct discriminative and robust spatial-spectral generalized kernel features. In the process of constructing kernel features, the deep correlation information between samples is extracted simultaneously. The kernel hyperparameters in SSCKL are automatically learnt through backpropagation, thus avoiding the need to spend a lot of time on cross-validation. Finally, inspired by U-Net, a global-local feature extraction (GLFE) module is designed to extract spatial features of different scales. A set of classification probability maps can be obtained by the 1 1 convolutional layer in the GLFE module. Experimental results on three widely used datasets demonstrate the effectiveness of the proposed CKLNet.

[1]  Bor-Chen Kuo,et al.  A kernel-based feature extraction method for hyperspectral image classification , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[2]  Yuan Yan Tang,et al.  Spectral–Spatial Shared Linear Regression for Hyperspectral Image Classification , 2017, IEEE Transactions on Cybernetics.

[3]  Kai Feng,et al.  Spatial-spectral multiple kernel learning for hyperspectral image classification , 2013, 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[4]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[5]  Mario Parente,et al.  Uniformity-Based Superpixel Segmentation of Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Saeid Homayouni,et al.  Semi-supervised classification of hyperspectral image using random forest algorithm , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[7]  Antonio J. Plaza,et al.  Deep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Qian Du,et al.  Gabor-Filtering-Based Nearest Regularized Subspace for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Peijun Du,et al.  Hyperspectral remote sensing image classification based on the integration of support vector machine and random forest , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Qian Du,et al.  Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images via Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Ying Wang,et al.  A label propagation method using spatial-spectral consistency for hyperspectral image classification , 2016 .

[12]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Antonio J. Plaza,et al.  Multiple Morphological Component Analysis Based Decomposition for Remote Sensing Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[16]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Liang Xiao,et al.  Deep CNN-based hyperspectral image classification using discriminative multiple spatial-spectral feature fusion , 2020 .

[19]  Feng Zhou,et al.  Classification of Hyperspectral Images via Multitask Generative Adversarial Networks , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jinghui Yang,et al.  Hyperspectral Image Classification via Multiscale Joint Collaborative Representation With Locally Adaptive Dictionary , 2018, IEEE Geoscience and Remote Sensing Letters.

[21]  Antonio J. Plaza,et al.  New Postprocessing Methods for Remote Sensing Image Classification: A Systematic Study , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Yicong Zhou,et al.  Learning Hierarchical Spectral–Spatial Features for Hyperspectral Image Classification , 2016, IEEE Transactions on Cybernetics.

[23]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[24]  Weiwei Sun,et al.  Spatial-Spectral Squeeze-and-Excitation Residual Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[25]  Peijun Du,et al.  (Semi-) Supervised Probabilistic Principal Component Analysis for Hyperspectral Remote Sensing Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Ajmal Mian,et al.  Nonparametric Coupled Bayesian Dictionary and Classifier Learning for Hyperspectral Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[29]  Jon Atli Benediktsson,et al.  Spectral and Spatial Classification of Hyperspectral Images Based on ICA and Reduced Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Rick Archibald,et al.  Feature Selection and Classification of Hyperspectral Images With Support Vector Machines , 2007, IEEE Geoscience and Remote Sensing Letters.

[31]  Hong Yan,et al.  Learning Multiple Parameters for Kernel Collaborative Representation Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Pedram Ghamisi,et al.  Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[34]  Zhuo Zheng,et al.  FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Lifu Zhang,et al.  Progress in Hyperspectral Remote Sensing Science and Technology in China Over the Past Three Decades , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jon Atli Benediktsson,et al.  Extinction Profiles for the Classification of Remote Sensing Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Hong Yan,et al.  Generalized Tensor Regression for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Wilfried Philips,et al.  Taking Optimal Advantage of Fine Spatial Resolution: Promoting partial image reconstruction for the morphological analysis of very-high-resolution images , 2017, IEEE Geoscience and Remote Sensing Magazine.

[41]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[42]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Deyu Meng,et al.  Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network , 2017, IEEE Transactions on Image Processing.

[44]  Antonio J. Plaza,et al.  Probabilistic-Kernel Collaborative Representation for Spatial–Spectral Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Tanmay Chakraborty,et al.  SpectralNET: Exploring Spatial-Spectral WaveletCNN for Hyperspectral Image Classification , 2021, ArXiv.

[47]  Mingli Ding,et al.  Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[49]  Qian Du,et al.  Multiscale Low-Rank Spatial Features for Hyperspectral Image Classification , 2020, IEEE Geoscience and Remote Sensing Letters.

[50]  Wenju Wang,et al.  A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification , 2018, Remote. Sens..

[51]  Liang Xiao,et al.  An improved composite kernel framework for hyperspectral image classification using canonical correlation analysis , 2019, Remote Sensing Letters.

[52]  Jonathan Cheung-Wai Chan,et al.  Hyperspectral image classification using two-channel deep convolutional neural network , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[53]  Bidyut Baran Chaudhuri,et al.  HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[54]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Shuyuan Yang,et al.  Self-Paced Learning-Based Probability Subspace Projection for Hyperspectral Image Classification , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[56]  Liang Xiao,et al.  Superpixel-guided multiscale kernel collaborative representation for hyperspectral image classification , 2016 .

[57]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[58]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[59]  Hai Su,et al.  Deep Learning in Microscopy Image Analysis: A Survey , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[60]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Mercedes Eugenia Paoletti,et al.  Visual Attention-Driven Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Jonathan Cheung-Wai Chan,et al.  Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Liang Xiao,et al.  Content-Guided Convolutional Neural Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Xiao Xiang Zhu,et al.  Deep learning in remote sensing: a review , 2017, ArXiv.

[66]  Fuyong Xing,et al.  Deep Learning in Microscopy Image Analysis: A Survey. , 2018, IEEE transactions on neural networks and learning systems.