Spatial Spectral Band Selection for Enhanced Hyperspectral Remote Sensing Classification Applications

Despite the numerous band selection (BS) algorithms reported in the field, most if not all have exhibited maximal accuracy when more spectral bands are utilized for classification. This apparently disagrees with the theoretical model of the ‘curse of dimensionality’ phenomenon, without apparent explanations. If it were true, then BS would be deemed as an academic piece of research without real benefits to practical applications. This paper presents a spatial spectral mutual information (SSMI) BS scheme that utilizes a spatial feature extraction technique as a preprocessing step, followed by the clustering of the mutual information (MI) of spectral bands for enhancing the efficiency of the BS. Through the SSMI BS scheme, a sharp ’bell’-shaped accuracy-dimensionality characteristic that peaks at about 20 bands has been observed for the very first time. The performance of the proposed SSMI BS scheme has been validated through 6 hyperspectral imaging (HSI) datasets (Indian Pines, Botswana, Barrax, Pavia University, Salinas, and Kennedy Space Center (KSC)), and its classification accuracy is shown to be approximately 10% better than seven state-of-the-art BS schemes (Saliency, HyperBS, SLN, OCF, FDPC, ISSC, and Convolution Neural Network (CNN)). The present result confirms that the high efficiency of the BS scheme is essentially important to observe and validate the Hughes’ phenomenon in the analysis of HSI data. Experiments also show that the classification accuracy can be affected by as much as approximately 10% when a single ‘crucial’ band is included or missed out for classification.

[1]  Shuicheng Yan,et al.  Latent Low-Rank Representation for subspace segmentation and feature extraction , 2011, 2011 International Conference on Computer Vision.

[2]  Junyu Dong,et al.  Spectral and Spatial Classification of Hyperspectral Images Based on Random Multi-Graphs , 2018, Remote. Sens..

[3]  Elcio Hideiti Shiguemori,et al.  Supervised band selection in hyperspectral images using single-layer neural networks , 2018, International Journal of Remote Sensing.

[4]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  B. Guo,et al.  Adaptive band selection for hyperspectral image fusion using mutual information , 2005, 2005 7th International Conference on Information Fusion.

[6]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[8]  Zhen Ji,et al.  Band Selection for Hyperspectral Imagery Using Affinity Propagation , 2008, 2008 Digital Image Computing: Techniques and Applications.

[9]  Edward J. Milton,et al.  Supervised band selection for optimal use of data from airborne hyperspectral sensors , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[10]  Shaheera Rashwan,et al.  A Split-and-Merge Approach for Hyperspectral Band Selection , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[12]  Bing Zhang,et al.  A Review of Remote Sensing Image Classification Techniques: the Role of Spatio-contextual Information , 2014 .

[13]  Luc Van Gool,et al.  Hyperspectral CNN for image classification & band selection, with application to face recognition , 2016 .

[14]  Huayi Wu,et al.  DCT-Based Preprocessing Approach for ICA in Hyperspectral Data Analysis , 2018, Sensors.

[15]  Lorenzo Bruzzone,et al.  Superpixel-Based Unsupervised Band Selection for Classification of Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[16]  R. Younes,et al.  Dimensionality reduction on hyperspectral images: A comparative review based on artificial datas , 2011, 2011 4th International Congress on Image and Signal Processing.

[17]  Maoguo Gong,et al.  Unsupervised Band Selection Based on Evolutionary Multiobjective Optimization for Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[19]  Nagesh Poojary,et al.  Automatic target detection in hyperspectral image processing: A review of algorithms , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Chein-I Chang,et al.  Band-Specified Virtual Dimensionality for Band Selection: An Orthogonal Subspace Projection Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Nicolas Courty,et al.  Sparse Hilbert Schmidt Independence Criterion and Surrogate-Kernel-Based Feature Selection for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Onkar Dikshit,et al.  Unsupervised band selection of hyperspectral data based on mutual information derived from weighted cluster entropy for snow classification , 2019, Geocarto International.

[23]  Jane You,et al.  Hyperspectral Image Classification Based on Two-Stage Subspace Projection , 2018, Remote. Sens..

[24]  Chuleerat Jaruskulchai,et al.  Band Selection for Dimension Reduction in Hyper Spectral Image Using Integrated InformationGain and Principal Components Analysis Technique , 2012 .

[25]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[26]  Xiangtao Zheng,et al.  Dimensionality Reduction by Spatial–Spectral Preservation in Selected Bands , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Fang Liu,et al.  Mutual-Information-Based Semi-Supervised Hyperspectral Band Selection With High Discrimination, High Information, and Low Redundancy , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Peng Zhang,et al.  Dynamic Learning of SMLR for Feature Selection and Classification of Hyperspectral Data , 2008, IEEE Geoscience and Remote Sensing Letters.

[29]  Yulei Wang,et al.  Fusion of Various Band Selection Methods for Hyperspectral Imagery , 2019, Remote. Sens..

[30]  Xiaohui Wei,et al.  Local-View-Assisted Discriminative Band Selection With Hypergraph Autolearning for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Qian Du,et al.  Fast and Robust Self-Representation Method for Hyperspectral Band Selection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Weiwei Sun,et al.  A Symmetric Sparse Representation Based Band Selection Method for Hyperspectral Imagery Classification , 2016, Remote. Sens..

[33]  Chein-I Chang,et al.  Class Signature-Constrained Background- Suppressed Approach to Band Selection for Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[34]  A. Agarwal,et al.  Efficient Hierarchical-PCA Dimension Reduction for Hyperspectral Imagery , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[35]  Xiaohui Wei,et al.  Matrix-Based Margin-Maximization Band Selection With Data-Driven Diversity for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[36]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[37]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[38]  O. Mutanga,et al.  Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: a review , 2010, Wetlands Ecology and Management.

[39]  Moussa Sofiane Karoui,et al.  Unsupervised hyperspectral band selection by combination of unmixing and sequential clustering techniques , 2019 .

[40]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[42]  Qi Wang,et al.  Dual-Clustering-Based Hyperspectral Band Selection by Contextual Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Zhenyu He,et al.  A HYPERSPECTRAL BAND SELECTION BASED ON GAME THEORY AND DIFFERENTIAL EVOLUTION ALGORITHM , 2016 .

[44]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[46]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Lorenzo Bruzzone,et al.  Hyperspectral Band Selection Based on Rough Set , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Yongchao Zhao,et al.  A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Anthony Amankwah,et al.  Spatial Mutual Information Based Hyperspectral Band Selection for Classification , 2015, TheScientificWorldJournal.

[50]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[51]  Baocai Yin,et al.  Hyperspectral Image Classification Based on Deep Deconvolution Network With Skip Architecture , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Ashish Ghosh,et al.  Combination of Clustering and Ranking Techniques for Unsupervised Band Selection of Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[53]  Zhenwei Shi,et al.  Analysis for the Weakly Pareto Optimum in Multiobjective-Based Hyperspectral Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[54]  José Carlos Príncipe,et al.  Correntropy as a Novel Measure for Nonlinearity Tests , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[55]  Weiwei Sun,et al.  A Dissimilarity-Weighted Sparse Self-Representation Method for Band Selection in Hyperspectral Imagery Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[57]  Xiaorun Li,et al.  A Geometry-Based Band Selection Approach for Hyperspectral Image Analysis , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Qian Du,et al.  Graph-Regularized Fast and Robust Principal Component Analysis for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Licheng Jiao,et al.  Multiple Kernel Learning Based on Discriminative Kernel Clustering for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Hong Shi,et al.  Hyperspectral bands reduction based on rough sets and fuzzy C-means clustering , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[62]  Barat Mojaradi,et al.  Unsupervised Feature Selection Using Geometrical Measures in Prototype Space for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Xiuping Jia,et al.  Band Dual Density Discrimination Analysis for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Qian Du,et al.  Semisupervised Band Clustering for Dimensionality Reduction of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[65]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[66]  Zhigang Liu,et al.  A Saliency-Based Band Selection Approach for Hyperspectral Imagery Inspired by Scale Selection , 2018, IEEE Geoscience and Remote Sensing Letters.

[67]  Weiwei Sun,et al.  Band Selection Using Improved Sparse Subspace Clustering for Hyperspectral Imagery Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[68]  Megan M. Lewis,et al.  Hyperspectral Classification of Plants: A Review of Waveband Selection Generalisability , 2020, Remote. Sens..

[69]  Qian Du,et al.  Fast SVD With Random Hadamard Projection for Hyperspectral Dimensionality Reduction , 2016, IEEE Geoscience and Remote Sensing Letters.

[70]  Jayadeva,et al.  Feature Selection for classification of hyperspectral data by minimizing a tight bound on the VC dimension , 2015, ArXiv.

[71]  Shanshan Zhang,et al.  Superpixel Segmentation of Hyperspectral Images Based on Entropy and Mutual Information , 2020 .

[72]  Qi Wang,et al.  Hyperspectral Band Selection by Multitask Sparsity Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[73]  Stephen Marshall,et al.  MIMR-DGSA: Unsupervised hyperspectral band selection based on information theory and a modified discrete gravitational search algorithm , 2019, Inf. Fusion.

[74]  Da-Wen Sun,et al.  Hyperspectral imaging with multivariate analysis for technological parameters prediction and classification of muscle foods: A review. , 2017, Meat science.

[75]  Chein-I Chang,et al.  Unsupervised hyperspectral image analysis with projection pursuit , 2000, IEEE Trans. Geosci. Remote. Sens..

[76]  Xiaohui Wei,et al.  Scalable One-Pass Self-Representation Learning for Hyperspectral Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Mark A. Richardson,et al.  An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition , 2010 .

[78]  F. Fleuret Fast Binary Feature Selection with Conditional Mutual Information , 2004, J. Mach. Learn. Res..

[79]  Jakub Nalepa,et al.  Hyperspectral Band Selection Using Attention-Based Convolutional Neural Networks , 2020, IEEE Access.

[80]  Licheng Jiao,et al.  Automatic Band Selection Using Spatial-Structure Information and Classifier-Based Clustering , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[81]  Zhen Xu,et al.  Maximum relevance, minimum redundancy band selection based on neighborhood rough set for hyperspectral data classification , 2016 .

[82]  Qian Du,et al.  Fast and Latent Low-Rank Subspace Clustering for Hyperspectral Band Selection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[83]  Stephen Marshall,et al.  Adaptive clustering of spectral components for band selection in hyperspectral imagery , 2011 .

[84]  Mateus Habermann,et al.  Band selection in hyperspectral images using artificial neural networks. (Sélection de bandes d'images hyperspectrales basée sur réseau de neurones) , 2018 .

[85]  Lei Liu,et al.  Feature selection with dynamic mutual information , 2009, Pattern Recognit..

[86]  Quan Wang,et al.  Selection of Informative Spectral Bands for PLS Models to Estimate Foliar Chlorophyll Content Using Hyperspectral Reflectance , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[87]  Weiwei Sun,et al.  Band selection using sparse nonnegative matrix factorization with the thresholded Earth’s mover distance for hyperspectral imagery classification , 2015, Earth Science Informatics.

[88]  Chein-I Chang,et al.  Progressive Band Selection of Spectral Unmixing for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[89]  Liangpei Zhang,et al.  Laplacian-Regularized Low-Rank Subspace Clustering for Hyperspectral Image Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[90]  Mathieu Fauvel,et al.  Fast Forward Feature Selection of Hyperspectral Images for Classification With Gaussian Mixture Models , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[91]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.