Multiobjective Hyperspectral Feature Selection Based on Discrete Sine Cosine Algorithm

Feature selection is an effective way to reduce the data dimensionality of hyperspectral imagery and obtain a better performance in the subsequent applications, such as classification. The ideal approach is to obtain the optimal tradeoff between two criteria for hyperspectral image feature selection: 1) information preservation and 2) redundancy reduction. However, constructing a hyperspectral feature selection model for the above two criteria is difficult due to the complexity of hyperspectral imagery. Although evolutionary multiobjective optimization methods have been recently presented to simultaneously optimize the above criteria, they cannot control the global exploration versus local exploitation capabilities in the search space for the hyperspectral feature selection problem. Thus, in this article, a novel discrete sine cosine algorithm (SCA)-based multiobjective feature selection (MOSCA_FS) approach is proposed for hyperspectral imagery. In the proposed method, a novel and effective framework of multiobjective hyperspectral feature selection is designed. In the framework, the ratio between the Jeffries–Matusita (JM) distance and mutual information (MI) is modeled to minimize the redundancy and maximize the relevance of the selected feature subset. In addition, another measurement—the variance (Var)—is applied for maximizing the information amount. Furthermore, to resolve the discrete hyperspectral feature selection problem, a novel discrete SCA is first proposed, which enhances the selection of the ideal feature subset. The effectiveness and universality of the proposed method was verified by experiments with ten University of California at Irvine (UCI) data sets, five hyperspectral image data sets, and one spectral data set of typical surface features.

[1]  Marcel J. T. Reinders,et al.  Random subspace method for multivariate feature selection , 2006, Pattern Recognit. Lett..

[2]  K.Z. Mao,et al.  Orthogonal forward selection and backward elimination algorithms for feature subset selection , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Liangpei Zhang,et al.  A fast clonal selection algorithm for feature selection in hyperspectral imagery , 2009 .

[4]  Mauro Conti,et al.  Computational intelligence approaches for energy load forecasting in smart energy management grids: state of the art, future challenges, and research directionsand Research Directions , 2018 .

[5]  Peng Zhang,et al.  Dynamic Learning of SMLR for Feature Selection and Classification of Hyperspectral Data , 2008, IEEE Geoscience and Remote Sensing Letters.

[6]  Claudio De Stefano,et al.  A GA-based feature selection approach with an application to handwritten character recognition , 2014, Pattern Recognit. Lett..

[7]  Myong Kee Jeong,et al.  An evolutionary algorithm with the partial sequential forward floating search mutation for large-scale feature selection problems , 2015, J. Oper. Res. Soc..

[8]  Alper Ekrem Murat,et al.  A discrete particle swarm optimization method for feature selection in binary classification problems , 2010, Eur. J. Oper. Res..

[9]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Nicolas H. Younan,et al.  On the Use of the Genetic Algorithm Filter-Based Feature Selection Technique for Satellite Precipitation Estimation , 2012, IEEE Geoscience and Remote Sensing Letters.

[11]  Qian Du,et al.  Hyperspectral Image Classification Using Band Selection and Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jungho Im,et al.  Fusion of feature selection and optimized immune networks for hyperspectral image classification of urban landscapes , 2012 .

[13]  Jiasong Zhu,et al.  3-D Gaussian–Gabor Feature Extraction and Selection for Hyperspectral Imagery Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Maoguo Gong,et al.  A Multiobjective Cooperative Coevolutionary Algorithm for Hyperspectral Sparse Unmixing , 2017, IEEE Transactions on Evolutionary Computation.

[15]  Zexuan Zhu,et al.  Computational intelligence in optical remote sensing image processing , 2018, Appl. Soft Comput..

[16]  Ailong Ma,et al.  Fully Automatic Spectral–Spatial Fuzzy Clustering Using an Adaptive Multiobjective Memetic Algorithm for Multispectral Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Aboul Ella Hassanien,et al.  Sine cosine optimization algorithm for feature selection , 2016, 2016 International Symposium on INnovations in Intelligent SysTems and Applications (INISTA).

[18]  Juan-Zi Li,et al.  A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure , 2015, Inf. Sci..

[19]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[20]  Xiaodong Li,et al.  A time-varying transfer function for balancing the exploration and exploitation ability of a binary PSO , 2017, Appl. Soft Comput..

[21]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[22]  Qian Du,et al.  Hyperspectral Band Selection Using Improved Firefly Algorithm , 2016, IEEE Geoscience and Remote Sensing Letters.

[23]  Sujatha Srinivasan,et al.  Multi Criteria Decision Making in Financial Risk Management with a Multi-objective Genetic Algorithm , 2018 .

[24]  Siddhartha Bhattacharyya,et al.  A group incremental feature selection for classification using rough set theory based genetic algorithm , 2018, Appl. Soft Comput..

[25]  Jin-Kao Hao,et al.  A memetic algorithm for gene selection and molecular classification of cancer , 2009, GECCO.

[26]  Kun-Huang Chen,et al.  An improved particle swarm optimization for feature selection , 2011, Intell. Data Anal..

[27]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[28]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognition Letters.

[29]  Ahmad Taher Azar,et al.  A novel hybrid feature selection method based on rough set and improved harmony search , 2015, Neural Computing and Applications.

[30]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jian Zhuang,et al.  Multi-objective unsupervised feature selection algorithm utilizing redundancy measure and negative epsilon-dominance for fault diagnosis , 2014, Neurocomputing.

[32]  Zhiyong Zeng,et al.  Feature Selection Based on Dependency Margin , 2015, IEEE Transactions on Cybernetics.

[33]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[34]  Qi Wang,et al.  Dual-Clustering-Based Hyperspectral Band Selection by Contextual Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Stjepan Oreski,et al.  Genetic algorithm-based heuristic for feature selection in credit risk assessment , 2014, Expert Syst. Appl..

[36]  Lianru Gao,et al.  A new kernel method for hyperspectral image feature extraction , 2017, Geo spatial Inf. Sci..

[37]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[38]  Yaochu Jin,et al.  Feature selection for high-dimensional classification using a competitive swarm optimizer , 2016, Soft Computing.

[39]  Mengjie Zhang,et al.  Differential evolution for filter feature selection based on information theory and feature ranking , 2018, Knowl. Based Syst..

[40]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Liangpei Zhang,et al.  Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[43]  Sang Hyuk Son,et al.  Temporal Information Services in Large-Scale Vehicular Networks Through Evolutionary Multi-Objective Optimization , 2019, IEEE Transactions on Intelligent Transportation Systems.

[44]  Mohamed A. Tawhid,et al.  Discrete Sine-Cosine Algorithm (DSCA) with Local Search for Solving Traveling Salesman Problem , 2018, Arabian Journal for Science and Engineering.

[45]  Zhigang Liu,et al.  A Saliency-Based Band Selection Approach for Hyperspectral Imagery Inspired by Scale Selection , 2018, IEEE Geoscience and Remote Sensing Letters.

[46]  Yannick Berthoumieu,et al.  Multiple-Feature Kernel-Based Probabilistic Clustering for Unsupervised Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Karim Faez,et al.  AMOF: adaptive multi-objective optimization framework for coverage and topology control in heterogeneous wireless sensor networks , 2016, Telecommun. Syst..

[48]  Jae-Hyun Seo,et al.  Feature Selection for Very Short-Term Heavy Rainfall Prediction Using Evolutionary Computation , 2014 .

[49]  Abdelhak M. Zoubir,et al.  Contributions to Automatic Target Recognition Systems for Underwater Mine Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Maoguo Gong,et al.  Hyperspectral band selection based on multi-objective optimization with high information and low redundancy , 2018, Appl. Soft Comput..

[51]  Aboul Ella Hassanien,et al.  Modified cuckoo search algorithm with rough sets for feature selection , 2018, Neural Computing and Applications.

[52]  R. E. Roger A faster way to compute the noise-adjusted principal components transform matrix , 1994, IEEE Trans. Geosci. Remote. Sens..

[53]  P. Groves,et al.  Methodology For Hyperspectral Band Selection , 2004 .

[54]  Dae-Won Kim,et al.  Memetic feature selection algorithm for multi-label classification , 2015, Inf. Sci..

[55]  J. B. Lee,et al.  Enhancement of high spectral resolution remote-sensing data by a noise-adjusted principal components transform , 1990 .

[56]  Qian Du,et al.  Particle Swarm Optimization-Based Hyperspectral Dimensionality Reduction for Urban Land Cover Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[57]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[58]  Jianzhou Wang,et al.  A novel hybrid forecasting system of wind speed based on a newly developed multi-objective sine cosine algorithm , 2018 .

[59]  Lajos Hanzo,et al.  A Survey of Multi-Objective Optimization in Wireless Sensor Networks: Metrics, Algorithms, and Open Problems , 2016, IEEE Communications Surveys & Tutorials.

[60]  Fangfei Li,et al.  Unsupervised band selection based on artificial bee colony algorithm for hyperspectral image classification , 2019, Appl. Soft Comput..

[61]  Kewei Cheng,et al.  Feature Selection , 2016, ACM Comput. Surv..

[62]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[63]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[64]  Zhenwei Shi,et al.  Analysis for the Weakly Pareto Optimum in Multiobjective-Based Hyperspectral Band Selection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Lorenzo Bruzzone,et al.  An extension of the Jeffreys-Matusita distance to multiclass cases for feature selection , 1995, IEEE Trans. Geosci. Remote. Sens..

[66]  Kalyanmoy Deb,et al.  Financial time series prediction using hybrids of chaos theory, multi-layer perceptron and multi-objective evolutionary algorithms , 2017, Swarm Evol. Comput..

[67]  Renato Oliveira Arbex,et al.  Efficient transit network design and frequencies setting multi-objective optimization by alternating objective genetic algorithm , 2015 .

[68]  Vimal J. Savsani,et al.  Multi-objective sine-cosine algorithm (MO-SCA) for multi-objective engineering design problems , 2017, Neural Computing and Applications.

[69]  Maoguo Gong,et al.  Change detection in synthetic aperture radar images based on evolutionary multiobjective optimization with ensemble learning , 2015, Memetic Computing.

[70]  Qian Du,et al.  Graph-Regularized Fast and Robust Principal Component Analysis for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.

[73]  Yang Li,et al.  Feature selection for transient stability assessment based on kernelized fuzzy rough sets and memetic algorithm , 2018, 1808.08790.

[74]  Kalyanmoy Deb,et al.  Finding Knees in Multi-objective Optimization , 2004, PPSN.

[75]  Qian Du,et al.  Hyperspectral Band Selection: A Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[76]  Robert F. Cromp,et al.  Support Vector Machine Classifiers as Applied to AVIRIS Data , 1999 .

[77]  Lifei Wei,et al.  Mini-UAV-Borne Hyperspectral Remote Sensing: From Observation and Processing to Applications , 2018, IEEE Geoscience and Remote Sensing Magazine.

[78]  Ruyi Feng,et al.  Multiobjective Sparse Subpixel Mapping for Remote Sensing Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[79]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[80]  J. Campbell Introduction to remote sensing , 1987 .

[81]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[82]  A. Cracknell,et al.  Introduction to Remote Sensing , 1993 .