A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets

Support vector machines (SVM) are one of the important techniques used to solve classifications problems efficiently. Setting support vector machine kernel factors affects the classification performance. Feature selection is a powerful technique to solve dimensionality problems. In this paper, we optimized SVM factors and chose features using a Grasshopper Optimization Algorithm (GOA). GOA is a new heuristic optimization algorithm inspired by grasshoppers searching for food. It approved its ability to solve real-world problems with anonymous search space. We applied the proposed GOA + SVM approach on biomedical data sets for Iraqi cancer patients in 2010–2012 and for University of California Irvine data sets.

[1]  Nasser Hassan Sweilam,et al.  Support vector machine for diagnosis cancer disease: A comparative study , 2010 .

[2]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[3]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[4]  Adel Al-Jumaily,et al.  Differential evolution based feature subset selection , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  M. Burrows,et al.  Mechanosensory-induced behavioural gregarization in the desert locust Schistocerca gregaria , 2003, Journal of Experimental Biology.

[6]  Oguzhan Ceylan,et al.  A comparison of differential evolution and Harmony Search methods for SVM model selection in hyperspectral image classification , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[7]  Charles P. Staelin.  Parameter selection for support vector machines , 2002 .

[8]  Aboul Ella Hassanien,et al.  Firefly Optimization Algorithm for Feature Selection , 2015, BCI.

[9]  Seong-Whan Lee,et al.  Retrieval of the top N matches with support vector machines , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Karim Faez,et al.  Feature Selection Using Ant Colony Optimization (ACO): A New Method and Comparative Study in the Application of Face Recognition System , 2007, ICDM.

[12]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[13]  A. F. Izmailov.  Solution sensitivity for Karush–Kuhn–Tucker systems with non-unique Lagrange multipliers , 2010 .

[14]  José Luis Rojo-Álvarez,et al.  Support vector machines in engineering: an overview , 2014, WIREs Data Mining Knowl. Discov..

[15]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[16]  Siti Anom Ahmad,et al.  Review on Support Vector Machine (SVM) classifier for human emotion pattern recognition from EEG signals , 2015 .

[17]  Hossam Faris,et al.  A multi-verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture , 2017, Neural Computing and Applications.

[18]  L. Chuang,et al.  Chaotic maps in binary particle swarm optimization for feature selection , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[19]  Xin-She Yang,et al.  A Novel Hybrid Firefly Algorithm for Global Optimization , 2016, PloS one.

[20]  Giorgio Roffo,et al.  Feature Selection Library (MATLAB Toolbox) , 2016, 1607.01327.

[21]  Mikko Lehtokangas.  Pattern recognition with novel support vector machine learning method , 2000, 2000 10th European Signal Processing Conference.

[22]  Hossam Faris,et al.  Grasshopper optimization algorithm for multi-objective optimization problems , 2017, Applied Intelligence.

[23]  Ming-Hsuan Yang,et al.  Gender classification using support vector machines , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[24]  Bo Zhang,et al.  Support vector machine learning for image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[25]  Rami N. Khushaba,et al.  Feature subset selection using differential evolution and a wheel based search strategy , 2013, Swarm Evol. Comput..

[26]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[27]  Harris Drucker,et al.  Support vector machines for spam categorization , 1999, IEEE Trans. Neural Networks.

[28]  R. Leardi,et al.  Genetic algorithms applied to feature selection in PLS regression: how and when to use them , 1998 .

[29]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[30]  Woody Sherman,et al.  Improved Docking of Polypeptides with Glide , 2013, J. Chem. Inf. Model..

[31]  Joachim M. Buhmann,et al.  Feature selection for support vector machines , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[32]  Eid Emary,et al.  Feature selection approach based on moth-flame optimization algorithm , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[33]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[34]  Crina Grosan,et al.  Feature Subset Selection Approach by Gray-Wolf Optimization , 2014, AECIA.

[35]  Fuzhong Nian,et al.  An Adaptive Particle Swarm Optimization Algorithm Based on Directed Weighted Complex Network , 2014 .

[36]  Aboul Ella Hassanien,et al.  New approach for feature selection based on rough set and bat algorithm , 2014, 2014 9th International Conference on Computer Engineering & Systems (ICCES).

[37]  Silvio Romero de Lemos Meira,et al.  A GA-based feature selection and parameters optimization for support vector regression applied to software effort estimation , 2008, SAC '08.