Dragonfly Algorithm: Theory, Literature Review, and Application in Feature Selection

In this chapter, a wrapper-based feature selection algorithm is designed and substantiated based on the binary variant of Dragonfly Algorithm (BDA). DA is a successful, well-established metaheuristic that revealed superior efficacy in dealing with various optimization problems including feature selection. In this chapter we are going first present the inspirations and methamatical modeds of DA in details. Then, the performance of this algorithm is tested on a special type of datasets that contain a huge number of features with low number of samples. This type of datasets makes the optimization process harder, because of the large search space, and the lack of adequate samples to train the model. The experimental results showed the ability of DA to deal with this type of datasets better than other optimizers in the literature. Moreover, an extensive literature review for the DA is provided in this chapter.

[1]  Jihong Wang,et al.  Adaptive engine optimisation using NSGA-II and MODA based on a sub-structured artificial neural network , 2017, 2017 23rd International Conference on Automation and Computing (ICAC).

[2]  Salwani Abdullah,et al.  Fuzzy Modified Great Deluge Algorithm for Attribute Reduction , 2014, SCDM.

[3]  Salwani Abdullah,et al.  A fuzzy record-to-record travel algorithm for solving rough set attribute reduction , 2015, Int. J. Syst. Sci..

[4]  Salwani Abdullah,et al.  Investigating memetic algorithm in solving rough set attribute reduction , 2013, Int. J. Comput. Appl. Technol..

[5]  Hossam Faris,et al.  Optimizing connection weights in neural networks using the whale optimization algorithm , 2016, Soft Computing.

[6]  C. Ashok Kumar,et al.  FDLA: Fractional Dragonfly based Load balancing Algorithm in cluster cloud model , 2018, Cluster Computing.

[7]  Hossein Nezamabadi-pour,et al.  An advanced ACO algorithm for feature subset selection , 2015, Neurocomputing.

[8]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[9]  Ibrahim Aljarah,et al.  A MapReduce based glowworm swarm optimization approach for multimodal functions , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[10]  Len Fisher The Perfect Swarm: The Science of Complexity in Everyday Life , 2009 .

[11]  Sazali Yaacob,et al.  Improved binary dragonfly optimization algorithm and wavelet packet based non-linear features for infant cry classification , 2018, Comput. Methods Programs Biomed..

[12]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[13]  Mohammad Aminisharifabad,et al.  A penalized autologistic regression with application for modeling the microstructure of dual-phase high-strength steel , 2020, Journal of Quality Technology.

[14]  Tao Li,et al.  Recent advances in feature selection and its applications , 2017, Knowledge and Information Systems.

[15]  Koushik Guha,et al.  Novel analytical model for optimizing the pull-in voltage in a flexured MEMS switch incorporating beam perforation effect , 2017 .

[16]  Seyed Mohammad Mirjalili,et al.  Whale optimization approaches for wrapper feature selection , 2018, Appl. Soft Comput..

[17]  Soo Young Shin,et al.  Range based wireless node localization using Dragonfly Algorithm , 2016, 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN).

[18]  Seyedali Mirjalili,et al.  Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems , 2015, Neural Computing and Applications.

[19]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[20]  Tao Li,et al.  Particle swarm optimizer with crossover operation , 2018, Eng. Appl. Artif. Intell..

[21]  Ibrahim Aljarah,et al.  A Scalable MapReduce-enabled Glowworm Swarm Optimization Approach for High Dimensional Multimodal Functions , 2016, Int. J. Swarm Intell. Res..

[22]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[23]  Hossam Faris,et al.  Optimizing Software Effort Estimation Models Using Firefly Algorithm , 2015, ArXiv.

[24]  Salwani Abdullah,et al.  Modified great deluge for attribute reduction in rough set theory , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[25]  Ibrahim Aljarah,et al.  Link Prediction Based on Whale Optimization Algorithm , 2017, 2017 International Conference on New Trends in Computing Sciences (ICTCS).

[26]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[27]  Qiang Li,et al.  An Enhanced Grey Wolf Optimization Based Feature Selection Wrapped Kernel Extreme Learning Machine for Medical Diagnosis , 2017, Comput. Math. Methods Medicine.

[28]  Hossam Faris,et al.  Binary dragonfly optimization for feature selection using time-varying transfer functions , 2018, Knowl. Based Syst..

[29]  M. R. Delavar,et al.  A MODIFIED GENETIC ALGORITHM FOR FINDING FUZZY SHORTEST PATHS IN UNCERTAIN NETWORKS , 2016 .

[30]  Aboul Ella Hassanien,et al.  Classification of Toxicity Effects of Biotransformed Hepatic Drugs Using Optimized Support Vector Machine , 2017, AISI.

[31]  Velamuri Suresh,et al.  Generation dispatch of combined solar thermal systems using dragonfly algorithm , 2016, Computing.

[32]  P. Langley Selection of Relevant Features in Machine Learning , 1994 .

[33]  Selma Ayse Özel,et al.  A hybrid approach of differential evolution and artificial bee colony for feature selection , 2016, Expert Syst. Appl..

[34]  Shangping Li,et al.  Elite opposition learning and exponential function steps-based dragonfly algorithm for global optimization , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).

[35]  A. Rezaee Jordehi,et al.  Gaussian bare-bones water cycle algorithm for optimal reactive power dispatch in electrical power systems , 2017, Appl. Soft Comput..

[36]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[37]  Chakkarapani Manickam,et al.  Dragonfly Algorithm Based Global Maximum Power Point Tracker for Photovoltaic Systems , 2016, ICSI.

[38]  Hossam Faris,et al.  Chapter 28 – Evolving Radial Basis Function Networks Using Moth–Flame Optimizer , 2017 .

[39]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[40]  Parham Pahlavani,et al.  An efficient modified grey wolf optimizer with Lévy flight for optimization tasks , 2017, Appl. Soft Comput..

[41]  Hossam Faris,et al.  Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems , 2017, Knowl. Based Syst..

[42]  Rahim Ali Abbaspour,et al.  Enhanced Chaotic Grey Wolf Optimizer for Real-World Optimization Problems: A Comparative Study , 2018 .

[43]  Amit Kumar,et al.  Design and Analysis of Tilt Integral Derivative Controller for Frequency Control in an Islanded Microgrid: A Novel Hybrid Dragonfly and Pattern Search Algorithm Approach , 2018 .

[44]  Majdi M. Mafarja,et al.  S-Shaped vs. V-Shaped Transfer Functions for Ant Lion Optimization Algorithm in Feature Selection Problem , 2017, ICFNDS.

[45]  Hossam Faris,et al.  Optimizing the Learning Process of Feedforward Neural Networks Using Lightning Search Algorithm , 2016, Int. J. Artif. Intell. Tools.

[46]  Eid Emary,et al.  A hybrid dragonfly algorithm with extreme learning machine for prediction , 2016, 2016 International Symposium on INnovations in Intelligent SysTems and Applications (INISTA).

[47]  Ismail Musirin,et al.  Power System Voltage Stability Assessment Using a Hybrid Approach Combining Dragonfly Optimization Algorithm and Support Vector Regression , 2018, Arabian Journal for Science and Engineering.

[48]  Majdi M. Mafarja,et al.  Binary Dragonfly Algorithm for Feature Selection , 2017, 2017 International Conference on New Trends in Computing Sciences (ICTCS).

[49]  B. Eswara Reddy,et al.  DDF: Diversity Dragonfly Algorithm for cost-aware test suite minimization approach for software testing , 2017, 2017 International Conference on Intelligent Computing and Control Systems (ICICCS).

[50]  Hossam Faris,et al.  Simultaneous Feature Selection and Support Vector Machine Optimization Using the Grasshopper Optimization Algorithm , 2018, Cognitive Computation.

[51]  A. Rezaee Jordehi,et al.  An efficient chaotic water cycle algorithm for optimization tasks , 2015, Neural Computing and Applications.

[52]  Shivani Mehta,et al.  Economic load dispatch of wind thermal integrated system using dragonfly algorithm , 2016, 2016 7th India International Conference on Power Electronics (IICPE).

[53]  R. J. Kuo,et al.  Five discrete symbiotic organisms search algorithms for simultaneous optimization of feature subset and neighborhood size of KNN classification models , 2018, Appl. Soft Comput..

[54]  Hossam Faris,et al.  Evolutionary static and dynamic clustering algorithms based on multi-verse optimizer , 2018, Eng. Appl. Artif. Intell..

[55]  Mehrdad Maeen,et al.  Providing a load balancing method based on dragonfly optimization algorithm for resource allocation in cloud computing , 2018, Int. J. Networked Distributed Comput..

[56]  Yongquan Zhou,et al.  Solving 0-1 Knapsack Problems by Binary Dragonfly Algorithm , 2017, ICIC.

[57]  Ibrahim Aljarah,et al.  Parallel particle swarm optimization clustering algorithm based on MapReduce methodology , 2012, 2012 Fourth World Congress on Nature and Biologically Inspired Computing (NaBIC).

[58]  Aboul Ella Hassanien,et al.  Parameter Optimization of Support Vector Machine Using Dragonfly Algorithm , 2017, AISI.

[59]  Anh Tuan Nguyen,et al.  A performance comparison of multi-objective optimization algorithms for solving nearly-zero-energy-building design problems , 2016 .

[60]  Ibrahim Aljarah,et al.  Towards a scalable intrusion detection system based on parallel PSO clustering using mapreduce , 2013, GECCO.

[61]  Sharmila Sankar,et al.  Energy efficient cluster based protocol to extend the RFID network lifetime using dragonfly algorithm , 2016, 2016 International Conference on Communication and Signal Processing (ICCSP).

[62]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[63]  Sasikala Jayaraman,et al.  Self-adaptive dragonfly based optimal thresholding for multilevel segmentation of digital images , 2016, J. King Saud Univ. Comput. Inf. Sci..

[64]  Hamidreza Chitsaz,et al.  Exact Learning of RNA Energy Parameters from Structure , 2013, RECOMB.

[65]  Ch. Ratnam,et al.  Application of dragonfly algorithm for optimal performance analysis of process parameters in turn-mill operations- A case study , 2018 .

[66]  Hossam Faris,et al.  Training radial basis function networks using biogeography-based optimizer , 2018, Neural Computing and Applications.

[67]  Salwani Abdullah,et al.  Record-to-Record Travel algorithm for attribute reduction in rough set theory , 2013 .

[68]  Hossam Faris,et al.  An intelligent system for spam detection and identification of the most relevant features based on evolutionary Random Weight Networks , 2019, Inf. Fusion.

[69]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[70]  Hossam Faris,et al.  Optimizing Feedforward neural networks using Krill Herd algorithm for E-mail spam detection , 2015, 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[71]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[72]  Ibrahim Aljarah,et al.  A new clustering approach based on Glowworm Swarm Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[73]  Hossam Faris,et al.  An efficient hybrid multilayer perceptron neural network with grasshopper optimization , 2018, Soft Computing.

[74]  Indrajit N. Trivedi,et al.  Price penalty factors based approach for combined economic emission dispatch problem solution using Dragonfly Algorithm , 2016, 2016 International Conference on Energy Efficient Technologies for Sustainability (ICEETS).

[75]  Hiroshi Motoda,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998, The Springer International Series in Engineering and Computer Science.

[76]  Oguz Bayat,et al.  A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets , 2019, Neural Computing and Applications.

[77]  K. Umamaheswari,et al.  Hybrid approach of improved binary particle swarm optimization and shuffled frog leaping for feature selection , 2018, Comput. Electr. Eng..

[78]  M. Mohanapriya,et al.  Map-Reduce framework based cluster architecture for academic student’s performance prediction using cumulative dragonfly based neural network , 2018, Cluster Computing.

[79]  J Vanishree,et al.  Optimization of Size and Cost of Static VAR Compensator using Dragonfly Algorithm for Voltage Profile Improvement in Power Transmission Systems , 2018, International Journal of Renewable Energy Research.

[80]  Hossam Faris,et al.  A Hybrid Approach Based on Particle Swarm Optimization and Random Forests for E-Mail Spam Filtering , 2016, ICCCI.

[81]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[82]  S. SreeRanjiniK.,et al.  Expert Systems With Applications , 2022 .

[83]  Rabeh Abbassi,et al.  An efficient salp swarm-inspired algorithm for parameters identification of photovoltaic cell models , 2019, Energy Conversion and Management.

[84]  Aboul Ella Hassanien,et al.  Bio-inspired optimization for feature set dimensionality reduction , 2016, 2016 3rd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA).

[85]  Constantin F. Aliferis,et al.  A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis , 2004, Bioinform..

[86]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[87]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[88]  Hossam Faris,et al.  An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems , 2018, Knowl. Based Syst..

[89]  Majdi M. Mafarja,et al.  Hybrid Whale Optimization Algorithm with simulated annealing for feature selection , 2017, Neurocomputing.

[90]  C. Shilaja,et al.  Optimal Power Flow Using Hybrid DA-APSO Algorithm in Renewable Energy Resources , 2017 .

[91]  Ibrahim Aljarah,et al.  Parallel glowworm swarm optimization clustering algorithm based on MapReduce , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[92]  Jun Wu,et al.  A novel ship classification approach for high resolution SAR images based on the BDA-KELM classification model , 2017 .

[93]  Hossam Faris,et al.  Asynchronous accelerating multi-leader salp chains for feature selection , 2018, Appl. Soft Comput..

[94]  Bilal Babayigit,et al.  Synthesis of concentric circular antenna arrays using dragonfly algorithm , 2018 .

[95]  Mark P. Silverman,et al.  The Wisdom of Crowds. .The Wisdom of CrowdsJamesSurowiecki . 306 pp. Random House, New York, 2004. $24.95 (cloth) ISBN 0-385-50386-5; $14.00 (paper) ISBN 0-385-72170-6. , 2007 .

[96]  Mohammad Jafari,et al.  Using dragonfly algorithm for optimization of orthotropic infinite plates with a quasi-triangular cut-out , 2017 .

[97]  Huan Liu,et al.  A Probabilistic Approach to Feature Selection - A Filter Solution , 1996, ICML.