Unsupervised hyperspectral feature selection based on fuzzy c-means and grey wolf optimizer

ABSTRACT Hyperspectral image (HSI) with hundreds of narrow and consecutive spectral bands provides substantial information to discriminate various land-covers. However, the existence of redundant features/bands not only gives rise to increasing of computation time but also interferes the classification result of hyperspectral images. Obviously, it is a very challenging problem how to select an effective feature subset from original bands to reduce the dimensionality of the hyperspectral dataset. In this study, a novel unsupervised feature selection method is suggested to remove the redundant features of HSI by feature subspace decomposition and optimization of feature combination. Feature subset decomposition is achieved by the fuzzy c-means (FCM) algorithm. The optimal feature selection is based on the optimization process of grey wolf optimizer (GWO) algorithm and maximum entropy (ME) principle. To evaluate the effectiveness of the proposed method, experiments are conducted on three well-known hyperspectral datasets, Indian Pines, Pavia University, and Salinas. Six state-of-the-art feature selection methods are used to compare with the proposed method. Experimental results successfully confirm the superior performance of our proposal with respect to three classification accuracy indices overall accuracy (OA), average accuracy (AA) and kappa coefficient (κ).

[1]  Filiberto Pla,et al.  Supervised feature selection by clustering using conditional mutual information-based distances , 2010, Pattern Recognit..

[2]  Jun Yang,et al.  A novel cluster validity index for fuzzy clustering based on bipartite modularity , 2014, Fuzzy Sets Syst..

[3]  M. Siegel,et al.  Hyperspectral classification via deep networks and superpixel segmentation , 2015 .

[4]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[5]  Saurabh Chaudhury,et al.  Multilevel thresholding using grey wolf optimizer for image segmentation , 2017, Expert Syst. Appl..

[6]  Yannick Berthoumieu,et al.  Unsupervised hyperspectral band selection via multi-feature information-maximization clustering , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[7]  Jon Atli Benediktsson,et al.  Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization , 2015, IEEE Geoscience and Remote Sensing Letters.

[8]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[9]  Fang Liu,et al.  Mutual-Information-Based Semi-Supervised Hyperspectral Band Selection With High Discrimination, High Information, and Low Redundancy , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Chein-I Chang,et al.  Band Subset Selection for Hyperspectral Image Classification , 2018, Remote. Sens..

[11]  Yuan Yan Tang,et al.  Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images , 2019, IEEE Transactions on Cybernetics.

[12]  Shih-Yu Chen,et al.  Progressive Sample Processing of Band Selection for Hyperspectral Image Transmission , 2018, Remote. Sens..

[13]  Jon Atli Benediktsson,et al.  A Novel Feature Selection Approach Based on FODPSO and SVM , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Henri Luchian,et al.  A unifying criterion for unsupervised clustering and feature selection , 2011, Pattern Recognit..

[15]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[16]  Seoung Bum Kim,et al.  Unsupervised feature selection using weighted principal components , 2011, Expert Syst. Appl..

[17]  Oscar Castillo,et al.  A fuzzy hierarchical operator in the grey wolf optimizer algorithm , 2017, Appl. Soft Comput..

[18]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[21]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[22]  Chengfan Li,et al.  Feature extraction for hyperspectral remote sensing image using weighted PCA-ICA , 2017, Arabian Journal of Geosciences.

[23]  Xia Wang,et al.  A novel hybrid algorithm based on Biogeography-Based Optimization and Grey Wolf Optimizer , 2018, Appl. Soft Comput..

[24]  Abdelkader Benyettou,et al.  Gray Wolf Optimizer for hyperspectral band selection , 2016, Appl. Soft Comput..

[25]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[26]  Ying Wang,et al.  A label propagation method using spatial-spectral consistency for hyperspectral image classification , 2016 .

[27]  I. Ginsberg,et al.  Unsupervised hyperspectral image analysis using independent component analysis , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[28]  Licheng Jiao,et al.  Hyperspectral Band Selection Using Improved Classification Map , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Maoguo Gong,et al.  Memetic algorithm based feature selection for hyperspectral images classification , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[30]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[33]  Frank Klawonn,et al.  Fuzzy c-means in High Dimensional Spaces , 2011, Int. J. Fuzzy Syst. Appl..

[34]  Steven Verstockt,et al.  Unsupervised spectral sub-feature learning for hyperspectral image classification , 2016 .

[35]  Licheng Jiao,et al.  Supervised Band Selection Using Local Spatial Information for Hyperspectral Image , 2016, IEEE Geoscience and Remote Sensing Letters.

[36]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[37]  Robert F. Cromp,et al.  Support Vector Machine Classifiers as Applied to AVIRIS Data , 1999 .

[38]  A. Agarwal,et al.  Efficient Hierarchical-PCA Dimension Reduction for Hyperspectral Imagery , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[39]  Dervis Karaboga,et al.  A novel clustering approach: Artificial Bee Colony (ABC) algorithm , 2011, Appl. Soft Comput..

[40]  Yang Wang,et al.  Differential weights-based band selection for hyperspectral image classification , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[41]  Arko Lucieer,et al.  Please Scroll down for Article International Journal of Remote Sensing Interactive Exploration of Uncertainty in Fuzzy Classifications by Isosurface Visualization of Class Clusters Interactive Exploration of Uncertainty in Fuzzy Classifications by Isosurface Visualization of Class Clusters , 2022 .

[42]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Seyed Mohammad Mirjalili How effective is the Grey Wolf optimizer in training multi-layer perceptrons , 2014, Applied Intelligence.

[44]  Liangpei Zhang,et al.  Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jiasong Zhu,et al.  Discriminative Gabor Feature Selection for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[47]  Wu Jian Unsupervised Intrusion Feature Selection based on Genetic Algorithm and FCM , 2012 .

[48]  Fang Liu,et al.  Unsupervised feature selection based on maximum information and minimum redundancy for hyperspectral images , 2016, Pattern Recognit..

[49]  Zhiwei Ye,et al.  A band selection method for airborne hyperspectral image based on chaotic binary coded gravitational search algorithm , 2018, Neurocomputing.

[50]  Xiangrong Zhang,et al.  Semisupervised Dimensionality Reduction of Hyperspectral Images via Local Scaling Cut Criterion , 2013, IEEE Geoscience and Remote Sensing Letters.

[51]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Ye Zhang,et al.  Adaptive subspace decomposition for hyperspectral data dimensionality reduction , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[53]  Leandro dos Santos Coelho,et al.  Multi-objective grey wolf optimizer: A novel algorithm for multi-criterion optimization , 2016, Expert Syst. Appl..

[54]  Filiberto Pla,et al.  Clustering-Based Feature Selection in Semi-supervised Problems , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.