Bare Bones Fireworks Algorithm for Feature Selection and SVM Optimization

Machine learning algorithms are used in various application and the need for faster and more accurate algorithms is urgent. Classification problem, as one of the most common machine learning tasks, has numerous proposed algorithms for solving it. One of the main factors that affects the classification accuracy, regardless of the used classifier, is the chosen feature set. Due to the fact that the classification quality depends on the features, feature selection represents an important task in machine learning. In this paper we propose adjusted bare bone fireworks algorithm for feature selection. Support vector machine is used as classifier, thus we additionally added SVM parameter optimization. The proposed method is tested on standard benchmark classification datasets from the UCI repository and the results are compared with other swarm intelligence methods. The results show that the proposed method achieves higher accuracy compared to the other methods even without SVM parameters tuning. As expected, parameter tuning has additionally increased the classification accuracy.

[1]  Farshad Almasganj,et al.  Voice Disorder Signal Classification Using M-Band Wavelets and Support Vector Machine , 2015, Circuits Syst. Signal Process..

[2]  Milan Tuba,et al.  Adjusted bat algorithm for tuning of support vector machine parameters , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[3]  Ying Tan,et al.  Fireworks Algorithm for Optimization , 2010, ICSI.

[4]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[5]  P. Velmurugan,et al.  Detection of Unhealthy Region of Plant Leaves and Classification of Plant Leaf Diseases using Texture Based Clustering Features , 2017 .

[6]  Nihat Yilmaz,et al.  Feature Selection Method Based on Artificial Bee Colony Algorithm and Support Vector Machines for Medical Datasets Classification , 2013, TheScientificWorldJournal.

[7]  Marko Beko,et al.  Support Vector Machine Parameters Optimization by Enhanced Fireworks Algorithm , 2016, ICSI.

[8]  Milan Tuba,et al.  Extreme Learning Machines for Data Classification Tuning by Improved Bat Algorithm , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[9]  Milan Tuba,et al.  JPEG Quantization Table Optimization by Guided Fireworks Algorithm , 2017, IWCIA.

[10]  Julien Velcin,et al.  Sentiment analysis on social media for stock movement prediction , 2015, Expert Syst. Appl..

[11]  Kamlesh Mistry,et al.  Facial expression recongition using firefly-based feature optimization , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[12]  Chee Peng Lim,et al.  A new PSO-based approach to fire flame detection using K-Medoids clustering , 2017, Expert Syst. Appl..

[13]  Ying Tan,et al.  Fireworks algorithm with covariance mutation , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[14]  Md. Al Mehedi Hasan,et al.  Feature Fusion Based SVM Classifier for Protein Subcellular Localization Prediction. , 2016, Journal of integrative bioinformatics.

[15]  Aboul Ella Hassanien,et al.  Binary grey wolf optimization approaches for feature selection , 2016, Neurocomputing.

[16]  Mohd Saberi Mohamad,et al.  Feature Selection and Classifier Parameters Estimation for EEG Signals Peak Detection Using Particle Swarm Optimization , 2014, TheScientificWorldJournal.

[17]  Ying Tan,et al.  Enhanced Fireworks Algorithm , 2013, 2013 IEEE Congress on Evolutionary Computation.

[18]  Milan Tuba,et al.  Retinal blood vessel segmentation by support vector machine classification , 2017, 2017 27th International Conference Radioelektronika (RADIOELEKTRONIKA).

[19]  Milan Tuba,et al.  Fireworks algorithm applied to constrained portfolio optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[20]  João Miguel da Costa Sousa,et al.  Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients , 2013, Appl. Soft Comput..

[21]  Dun-Wei Gong,et al.  Feature selection of unreliable data using an improved multi-objective PSO algorithm , 2016, Neurocomputing.

[22]  Ying Tan,et al.  The bare bones fireworks algorithm: A minimalist global optimizer , 2018, Appl. Soft Comput..

[23]  Deepak Khazanchi,et al.  Optimizing Feature Selection Using Particle Swarm Optimization and Utilizing Ventral Sides of Leaves for Plant Leaf Classification , 2016 .

[24]  Hélio Pedrini,et al.  Data feature selection based on Artificial Bee Colony algorithm , 2013, EURASIP J. Image Video Process..

[25]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[26]  Milan Tuba,et al.  Multilevel image thresholding by fireworks algorithm , 2015, 2015 25th International Conference Radioelektronika (RADIOELEKTRONIKA).

[27]  Ying Tan,et al.  A Cooperative Framework for Fireworks Algorithm , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[28]  Zidong Wang,et al.  A new switching-delayed-PSO-based optimized SVM algorithm for diagnosis of Alzheimer's disease , 2018, Neurocomputing.

[29]  Milan Tuba,et al.  Adjusted Fireworks Algorithm Applied to Retinal Image Registration , 2017 .

[30]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[31]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[32]  Andrés Larroza,et al.  Support vector machine classification of brain metastasis and radiation necrosis based on texture analysis in MRI , 2015, Journal of magnetic resonance imaging : JMRI.

[33]  Crina Grosan,et al.  Feature Subset Selection Approach by Gray-Wolf Optimization , 2014, AECIA.

[34]  Milan Tuba,et al.  An algorithm for automated segmentation for bleeding detection in endoscopic images , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[35]  Ying Tan,et al.  The Effect of Information Utilization: Introducing a Novel Guiding Spark in the Fireworks Algorithm , 2017, IEEE Transactions on Evolutionary Computation.

[36]  Ying Tan,et al.  Adaptive Fireworks Algorithm , 2014 .

[37]  Ying Tan,et al.  Dynamic search in fireworks algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[38]  Ahmad Taher Azar,et al.  Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis , 2014, Comput. Methods Programs Biomed..

[39]  Cristiano Premebida,et al.  Dynamic Bayesian network for semantic place classification in mobile robotics , 2017, Auton. Robots.