Wavelet enabled ranking and clustering-based band selection and three-dimensional spatial feature extraction for hyperspectral remote sensing image classification

Abstract. Hyperspectral image (HSI) classification is major and necessary task related to HSI analysis in the field of remote sensing. The fundamental steps in this task are band selection (BS), spatial feature extraction, and classification. HSIs generally equipped with rich spectral and spatial information and having the properties such as non-stationary and non-Gaussian. To process such rich information, wavelet transform (WT) is the perfect candidate. Also, the multiscale system in wavelets will be used in complete information extraction. So, classification task is implemented by the application of WT in BS and spatial feature extraction. Here, BS is achieved by the combination of clustering based on key band identification and ranking using wavelet entropy (WE). Discrete wavelet transform is applied along three dimensions to extract spatial features. The extracted spectral and spatial features are used in final classification by convolution neural networks classifier. From the obtained results it is observed that, with the advantage of using WT, the proposed method has successfully addressed overfitting and huge data dimensionality problems. Comparison and detailed analysis of the class-wise accuracies also clearly shows the impact of using WT in HSI classification. Evaluation results on three publicly used datasets namely Indian Pines, University of Pavia, and Salinas shows the significant performance over state-of-the-art methods. The proposed method has attained overall accuracy of 93.85%, 99.05%, and 97.13% for the three datasets, respectively.

[1]  Prabukumar Manoharan,et al.  A new framework for hyperspectral image classification using Gabor embedded patch based convolution neural network , 2020 .

[2]  Berrin A. Yanikoglu,et al.  Deep Learning With Attribute Profiles for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Xiuping Jia,et al.  Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning , 2018, Remote. Sens..

[4]  Shrutika S. Sawant,et al.  A hybrid optimization approach for hyperspectral band selection based on wind driven optimization and modified cuckoo search optimization , 2021, Multim. Tools Appl..

[5]  M. Gilabert,et al.  Vegetation dynamics from NDVI time series analysis using the wavelet transform , 2009 .

[6]  Kang Sun,et al.  A New Band Selection Method for Hyperspectral Image Based on Data Quality , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[8]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[9]  M. Prabukumar,et al.  Survey on classification methods for hyper spectral remote sensing imagery , 2017, 2017 International Conference on Intelligent Computing and Control Systems (ICICCS).

[10]  Qian Du,et al.  Hyperspectral Band Selection Using Weighted Kernel Regularization , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Prabukumar Manoharan,et al.  Classification of Hyper Spectral Remote Sensing Imagery Using Intrinsic Parameter Estimation , 2018, ISDA.

[12]  Shrutika S. Sawant,et al.  A review on graph-based semi-supervised learning methods for hyperspectral image classification , 2020 .

[13]  Sam Navin MohanRajan,et al.  Survey on Land Use/Land Cover (LU/LC) change analysis in remote sensing and GIS environment: Techniques and Challenges , 2020, Environmental Science and Pollution Research.

[14]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Licheng Jiao,et al.  Supervised Band Selection Using Local Spatial Information for Hyperspectral Image , 2016, IEEE Geoscience and Remote Sensing Letters.

[16]  Qi Wang,et al.  Hyperspectral Band Selection via Optimal Neighborhood Reconstruction , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Shrutika S. Sawant,et al.  New framework for hyperspectral band selection using modified wind-driven optimization algorithm , 2019 .

[19]  Prabukumar Manoharan,et al.  Hyperspectral image classification using CNN with spectral and spatial features integration , 2020, Infrared Physics & Technology.

[20]  Jonathan Cheung-Wai Chan,et al.  Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  John Daugman,et al.  An information-theoretic view of analog representation in striate cortex , 1993 .

[22]  Liangpei Zhang,et al.  Three-Dimensional Wavelet Texture Feature Extraction and Classification for Multi/Hyperspectral Imagery , 2014, IEEE Geoscience and Remote Sensing Letters.

[23]  Qian Du,et al.  Fast and Latent Low-Rank Subspace Clustering for Hyperspectral Band Selection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Yang Lu,et al.  Hyperspectral Image Classification Based on Three-Dimensional Scattering Wavelet Transform , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[25]  M. Prabukumar,et al.  Comparative study of feature extraction techniques for hyper spectral remote sensing image classification : A survey , 2017, 2017 International Conference on Intelligent Computing and Control Systems (ICICCS).

[26]  Thierry Ranchin,et al.  The wavelet transform for the analysis of remotely sensed images , 1993 .

[27]  Meiping Song,et al.  Hyperspectral Image Classification Method Based on CNN Architecture Embedding With Hashing Semantic Feature , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  B L N Phaneendra Kumar,et al.  Classification of Hyperspectral Images using Edge Preserving Filter and Nonlinear Support Vector Machine (SVM) , 2020, 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS).

[29]  Ying Wang,et al.  Hyperspectral image classification based on convolutional neural network and random forest , 2019, Remote Sensing Letters.

[30]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[31]  Bo Du,et al.  Dimensionality Reduction With Enhanced Hybrid-Graph Discriminant Learning for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Ashish Ghosh,et al.  Combination of Clustering and Ranking Techniques for Unsupervised Band Selection of Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[34]  Shrutika S. Sawant,et al.  Unsupervised band selection based on weighted information entropy and 3D discrete cosine transform for hyperspectral image classification , 2020 .

[35]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[36]  P. Manoharan,et al.  Band selection strategies for hyperspectral image classification based on machine learning and artificial intelligent techniques –Survey , 2021, Arabian Journal of Geosciences.

[37]  Deyu Meng,et al.  Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification , 2017, Neurocomputing.

[38]  M. Prabukumar,et al.  Band clustering using expectation–maximization algorithm and weighted average fusion-based feature extraction for hyperspectral image classification , 2018, Journal of Applied Remote Sensing.

[39]  P. Manoharan,et al.  Whale optimization-based band selection technique for hyperspectral image classification , 2021, International Journal of Remote Sensing.

[40]  E. Basar,et al.  Wavelet entropy: a new tool for analysis of short duration brain electrical signals , 2001, Journal of Neuroscience Methods.

[41]  Prabukumar Manoharan,et al.  Probabilistic PCA Based Hyper Spectral Image Classification for Remote Sensing Applications , 2018, ISDA.

[42]  Jing Yao,et al.  An Enhanced 3-D Discrete Wavelet Transform for Hyperspectral Image Classification , 2021, IEEE Geoscience and Remote Sensing Letters.

[43]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[44]  Simon X. Yang,et al.  Hyperspectral Remote Sensing Image Classification Based on Maximum Overlap Pooling Convolutional Neural Network , 2018, Sensors.

[45]  Yonghui Wang,et al.  Hyperspectral image feature classification using stationary wavelet transform , 2014, 2014 International Conference on Wavelet Analysis and Pattern Recognition.

[46]  Huayi Wu,et al.  Spectral DWT Multilevel Decomposition with Spatial Filtering Enhancement Preprocessing-Based Approaches for Hyperspectral Imagery Classification , 2019, Remote. Sens..

[47]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[48]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[49]  Sergio Benini,et al.  Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review , 2019, J. Imaging.

[50]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Xiangjun Zou,et al.  Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review , 2020, Frontiers in Plant Science.

[52]  Lin Zhu,et al.  Hyperspectral Images Classification With Gabor Filtering and Convolutional Neural Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[53]  Fan Feng,et al.  Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN , 2020, Sensors.

[54]  Shrutika S. Sawant,et al.  Hyperspectral band selection based on metaheuristic optimization approach , 2020, Infrared Physics & Technology.

[55]  Ebrahim Ghaderpour,et al.  Non-stationary and unequally spaced NDVI time series analyses by the LSWAVE software , 2020, International Journal of Remote Sensing.

[56]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Sathishkumar Samiappan,et al.  Three-dimensional discrete cosine transform-based feature extraction for hyperspectral image classification , 2018, Journal of Applied Remote Sensing.

[58]  Syamala Dasi,et al.  Hyperspectral Image Classification using Machine Learning Approaches , 2020, 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS).

[59]  Maoguo Gong,et al.  Unsupervised Hyperspectral Band Selection by Fuzzy Clustering With Particle Swarm Optimization , 2017, IEEE Geoscience and Remote Sensing Letters.

[60]  Prabukumar Manoharan,et al.  CNN based hyperspectral image classification using unsupervised band selection and structure-preserving spatial features , 2020 .