A Hyperspectral Image Classification Approach Based on Feature Fusion and Multi-Layered Gradient Boosting Decision Trees

At present, many Deep Neural Network (DNN) methods have been widely used for hyperspectral image classification. Promising classification results have been obtained by utilizing such models. However, due to the complexity and depth of the model, increasing the number of model parameters may lead to an overfitting of the model, especially when training data are insufficient. As the performance of the model mainly depends on sufficient data and a large network with reasonably optimized hyperparameters, using DNNs for classification requires better hardware conditions and sufficient training time. This paper proposes a feature fusion and multi-layered gradient boosting decision tree model (FF-DT) for hyperspectral image classification. First, we fuse extended morphology profiles (EMPs), linear multi-scale spatial characteristics, and nonlinear multi-scale spatial characteristics as final features to extract both special and spectral features. Furthermore, a multi-layered gradient boosting decision tree model is constructed for classification. We conduct experiments based on three datasets, which in this paper are referred to as the Pavia University, Indiana Pines, and Salinas datasets. It is shown that the proposed FF-DT achieves better performance in classification accuracy, training conditions, and time consumption than other current classical hyperspectral image classification methods.

[1]  Zhiyuan Zeng,et al.  Remote Sensing Image Classification Based on the HSI Transformation and Fuzzy Support Vector Machine , 2009, 2009 International Conference on Future Computer and Communication.

[2]  Qingquan Li,et al.  Multiple 3-D Feature Fusion Framework for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[4]  Mario Manzo,et al.  Attributed Relational SIFT-Based Regions Graph: Concepts and Applications , 2020, Mach. Learn. Knowl. Extr..

[5]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Nan Jiang,et al.  Semi-supervised classification of hyperspectral image based on spectral and extended morphological profiles , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[7]  Peijun Du,et al.  Random Subspace Ensembles for Hyperspectral Image Classification With Extended Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Xiao Xiang Zhu,et al.  Nonlocal Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Cristina Conde,et al.  Convolutional Neural Network Approach for Multispectral Facial Presentation Attack Detection in Automated Border Control Systems , 2020, Entropy.

[10]  Fan Zhang,et al.  An Optimized Training Method for GAN-Based Hyperspectral Image Classification , 2021, IEEE Geoscience and Remote Sensing Letters.

[11]  Karim H. Moussa,et al.  A Novel Color Image Encryption Algorithm Based on Hyperchaotic Maps and Mitochondrial DNA Sequences , 2020, Entropy.

[12]  Chen Gong,et al.  Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Chunming Wu,et al.  Convolutional Neural Network with Expert Knowledge for Hyperspectral Remote Sensing Imagery Classification , 2019, KSII Trans. Internet Inf. Syst..

[14]  Jing Bai,et al.  Class Incremental Learning With Few-Shots Based on Linear Programming for Hyperspectral Image Classification , 2020, IEEE Transactions on Cybernetics.

[15]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[18]  Yi Shen,et al.  Convolutional neural network based classification for hyperspectral data , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[19]  Jon Atli Benediktsson,et al.  Linear Versus Nonlinear PCA for the Classification of Hyperspectral Data Based on the Extended Morphological Profiles , 2012, IEEE Geoscience and Remote Sensing Letters.

[20]  Ji Feng,et al.  Multi-Layered Gradient Boosting Decision Trees , 2018, NeurIPS.

[21]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[22]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[24]  Wei Wu,et al.  Spectral–Spatial Classification of Hyperspectral Images via Spatial Translation-Invariant Wavelet-Based Sparse Representation , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[25]  P. Deepa,et al.  Feature extraction of hyperspectral image using principal component analysis and folded-principal component analysis , 2015, 2015 2nd International Conference on Electronics and Communication Systems (ICECS).

[26]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[27]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[28]  Arko Lucieer,et al.  Uncertainty Assessment of Hyperspectral Image Classification: Deep Learning vs. Random Forest , 2019, Entropy.

[29]  Sarawut Ninsawat,et al.  Non-Destructive Trace Detection of Explosives Using Pushbroom Scanning Hyperspectral Imaging System , 2018, Sensors.

[30]  Peiyao Li,et al.  Development of High Performance Quantum Image Algorithm on Constrained Least Squares Filtering Computation , 2020, Entropy.

[31]  Teddy Furon,et al.  Are Classification Deep Neural Networks Good for Blind Image Watermarking? , 2020, Entropy.

[32]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Fan Feng,et al.  Learning Deep Hierarchical Spatial–Spectral Features for Hyperspectral Image Classification Based on Residual 3D-2D CNN , 2019, Sensors.

[34]  Antonio J. Plaza,et al.  A new approach to mixed pixel classification of hyperspectral imagery based on extended morphological profiles , 2004, Pattern Recognit..