Topologies and performance of intelligent algorithms: a comprehensive review

Recently, optimization makes an important role in our day-to-day life. Evolutionary and population-based optimization algorithms are widely employed in several of engineering areas. The design of an optimization algorithm is a challenging endeavor caused of physical phenomena in order to obtain appropriate local and global search operators. Generally, local operators are fast. In contrast, global operators are used to find best solution in the search space; therefore they are slower compare to the local ones. The best review-knowledge of papers show that there are many optimization algorithms such as genetic algorithm, particle swarm optimization, artificial bee colony and etc in the engineering as a powerful tools. However, there is not a comprehensive review for theirs topologies and performance; therefore, the main goal of this paper is filling of this scientific gap. Moreover, several aspects of optimization heuristic designs and analysis are discussed in this paper. As a result, detailed explanation, comparison, and discussion on AI are achieved. Furthermore, some future research fields on AI are well summarized.

[1]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[2]  Aboul Ella Hassanien,et al.  Minimizing molecular potential energy function using genetic Nelder-Mead algorithm , 2013, 2013 8th International Conference on Computer Engineering & Systems (ICCES).

[3]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[4]  OVEIS ABEDINIA,et al.  A new metaheuristic algorithm based on shark smell optimization , 2016, Complex..

[5]  Osamu Inoue,et al.  New evolutionary direction operator for genetic algorithms , 1995 .

[6]  Ebrahim Farjah,et al.  An efficient scenario-based and fuzzy self-adaptive learning particle swarm optimization approach for dynamic economic emission dispatch considering load and wind power uncertainties , 2013 .

[7]  Sakti Prasad Ghoshal,et al.  An opposition-based harmony search algorithm for engineering optimization problems , 2014 .

[8]  Sylvain Delisle,et al.  Self-adaptive parameters in genetic algorithms , 2004, SPIE Defense + Commercial Sensing.

[9]  Mohammad Yusri Hassan,et al.  Multi-distributed generation planning using hybrid particle swarm optimisation- gravitational search algorithm including voltage rise issue , 2013 .

[10]  Thomas Stützle,et al.  Incremental Social Learning in Particle Swarms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[12]  Chao-Lung Chiang,et al.  Improved genetic algorithm for power economic dispatch of units with valve-point effects and multiple fuels , 2005, IEEE Transactions on Power Systems.

[13]  Yaonan Wang,et al.  Hybrid parallel chaos optimization algorithm with harmony search algorithm , 2014, Appl. Soft Comput..

[14]  Mohammad Hassan Moradi,et al.  A combination of Genetic Algorithm and Particle Swarm Optimization for optimal DG location and sizing in distribution systems , 2010 .

[15]  Rajesh Kumar,et al.  An Intelligent Tuned Harmony Search algorithm for optimisation , 2012, Inf. Sci..

[16]  Amin Safari,et al.  Robust PWMSC Damping Controller Tuning on the Augmented Lagrangian PSO Algorithm , 2013, IEEE Transactions on Power Systems.

[17]  Ayse T. Daloglu,et al.  An improved genetic algorithm with initial population strategy and self-adaptive member grouping , 2008 .

[18]  Chun-Lung Chen,et al.  Non-convex economic dispatch: A direct search approach , 2007 .

[19]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[20]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[21]  Jing J. Liang,et al.  A local-best harmony search algorithm with dynamic sub-harmony memories for lot-streaming flow shop scheduling problem , 2011, Expert Syst. Appl..

[22]  Sangyum Lee,et al.  Improving a model for the dynamic modulus of asphalt using the modified harmony search algorithm , 2014, Expert Syst. Appl..

[23]  Barry J. Adams,et al.  Honey-bee mating optimization (HBMO) algorithm for optimal reservoir operation , 2007, J. Frankl. Inst..

[24]  D. M. Vinod Kumar,et al.  Strategic bidding using fuzzy adaptive gravitational search algorithm in a pool based electricity market , 2013, Appl. Soft Comput..

[25]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[26]  Tai-shan Yan An Improved Genetic Algorithm and Its Blending Application with Neural Network , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[27]  Stephan M. Winkler,et al.  Self-adaptive Population Size Adjustment for Genetic Algorithms , 2007, EUROCAST.

[28]  Karim Salahshoor,et al.  Global Dynamic Harmony Search algorithm: GDHS , 2014, Appl. Math. Comput..

[29]  Lingling Huang,et al.  Enhancing artificial bee colony algorithm using more information-based search equations , 2014, Inf. Sci..

[30]  Huaguang Zhang,et al.  Distributed Cooperative Optimal Control for Multiagent Systems on Directed Graphs: An Inverse Optimal Approach , 2015, IEEE Transactions on Cybernetics.

[31]  Chao-Hong Chen,et al.  Real-coded ECGA for economic dispatch , 2007, GECCO '07.

[32]  Iván Amaya,et al.  An improved variant of the conventional Harmony Search algorithm , 2014, Appl. Math. Comput..

[33]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[34]  Hossein Nezamabadi-pour,et al.  A quantum inspired gravitational search algorithm for numerical function optimization , 2014, Inf. Sci..

[35]  João Tomé Saraiva,et al.  A discrete evolutionary PSO based approach to the multiyear transmission expansion planning problem considering demand uncertainties , 2013 .

[36]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[37]  Quan-Ke Pan,et al.  Harmony search algorithm with dynamic control parameters , 2012, Appl. Math. Comput..

[38]  Ebrahim Babaei,et al.  Exchange market algorithm for economic load dispatch , 2016 .

[39]  K. Hindi,et al.  Dynamic economic dispatch for large scale power systems: a Lagrangian relaxation approach , 1991 .

[40]  Hossein Shayeghi,et al.  Iteration particle swarm optimization procedure for economic load dispatch with generator constraints , 2011, Expert Syst. Appl..

[41]  Feng Lu,et al.  A novel Genetic Algorithm with multiple sub-population parallel search mechanism , 2010, 2010 Sixth International Conference on Natural Computation.

[42]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[43]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[44]  Taher Niknam,et al.  A new fuzzy adaptive particle swarm optimization for daily Volt/Var control in distribution networks considering distributed generators , 2010 .

[45]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[46]  Ali Azizi Vahed,et al.  Enhanced gravitational search algorithm for multi-objective distribution feeder reconfiguration considering reliability, loss and operational cost , 2014 .

[47]  Mohsen Khatibinia,et al.  A hybrid approach based on an improved gravitational search algorithm and orthogonal crossover for optimal shape design of concrete gravity dams , 2014, Appl. Soft Comput..

[48]  N. Poursalehi,et al.  Self-adaptive global best harmony search algorithm applied to reactor core fuel management optimization , 2013 .

[49]  Taher Niknam,et al.  A new honey bee mating optimization algorithm for non-smooth economic dispatch , 2011 .

[50]  Wei-Chiang Hong,et al.  Application of seasonal SVR with chaotic gravitational search algorithm in electricity forecasting , 2013 .

[51]  Dinesh Kumar,et al.  Parameter adaptive harmony search algorithm for unimodal and multimodal optimization problems , 2014, J. Comput. Sci..

[52]  M. Sydulu,et al.  A Fast Computational Genetic Algorithm for Economic Load Dispatch , 2009 .

[53]  Sunan Wang,et al.  Self-organizing genetic algorithm based tuning of PID controllers , 2009, Inf. Sci..

[54]  M. Affenzeller,et al.  Offspring Selection: A New Self-Adaptive Selection Scheme for Genetic Algorithms , 2005 .

[55]  Li Cheng,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010 .

[56]  B. J. Cory,et al.  A homogeneous linear programming algorithm for the security constrained economic dispatch problem , 2000 .

[57]  Seyed Hossein Hosseinian,et al.  Modified artificial bee colony algorithm based on fuzzy multi-objective technique for optimal power flow problem , 2013 .

[58]  Wan-li Xiang,et al.  An efficient and robust artificial bee colony algorithm for numerical optimization , 2013, Comput. Oper. Res..

[59]  Ali Husseinzadeh Kashan,et al.  League Championship Algorithm (LCA): An algorithm for global optimization inspired by sport championships , 2014, Appl. Soft Comput..

[60]  Komla A. Folly,et al.  Application of Breeder GA to power system controller design , 2008, 2008 IEEE Swarm Intelligence Symposium.

[61]  Kevin E Lansey,et al.  Optimization of Water Distribution Network Design Using the Shuffled Frog Leaping Algorithm , 2003 .

[62]  Caro Lucas,et al.  Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition , 2007, 2007 IEEE Congress on Evolutionary Computation.

[63]  Ebrahim Babaei,et al.  BEMA: Binary Exchange Market Algorithm , 2017 .

[64]  Ali Ghasemi,et al.  A fuzzified multi objective Interactive Honey Bee Mating Optimization for Environmental/Economic Power Dispatch with valve point effect , 2013 .

[65]  Ardeshir Bahreininejad,et al.  Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems , 2013, Appl. Soft Comput..

[66]  James Kennedy,et al.  The Behavior of Particles , 1998, Evolutionary Programming.

[67]  Azah Mohamed,et al.  Optimal Tuning of Power System Stabilizers Using Modified Particle Swarm Optimization , 2010 .

[68]  Tianjun Liao,et al.  Artificial bee colony algorithm with dynamic population size to combined economic and emission dispatch problem , 2014 .

[69]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[70]  Andre G. C. Pereira,et al.  Convergence analysis of an elitist non-homogeneous genetic algorithm with mutation probability adjusted by a fuzzy controller , 2013, 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS).

[71]  Kai Cheng,et al.  Fire Distribution Optimization Based on Quantum Immune Genetic Algorithm , 2011, 2011 International Conference of Information Technology, Computer Engineering and Management Sciences.

[72]  Frans van den Bergh,et al.  Particle Swarm Weight Initialization In Multi-Layer Perceptron Artificial Neural Networks , 1999 .

[73]  Ramin Rajabioun,et al.  Cuckoo Optimization Algorithm , 2011, Appl. Soft Comput..

[74]  Kai Xiong,et al.  A Novel Variable-Boundary-Coded Quantum Genetic Algorithm for Function Optimization , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[75]  M.E.H. Benbouzid,et al.  Optimal power flow for large-scale power system with shunt FACTS using efficient parallel GA , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[76]  Ling Wang,et al.  An effective differential harmony search algorithm for the solving non-convex economic load dispatch problems , 2013 .

[77]  Jiangye Yuan,et al.  A modified particle swarm optimizer with dynamic adaptation , 2007, Appl. Math. Comput..

[78]  Hasan Alkhatib,et al.  Dynamic genetic algorithms for robust design of multimachine power system stabilizers , 2013 .

[79]  J. Sasikala,et al.  Optimal gamma based fixed head hydrothermal scheduling using genetic algorithm , 2010, Expert Syst. Appl..

[80]  Yongqiang Wang,et al.  An improved self-adaptive PSO technique for short-term hydrothermal scheduling , 2012, Expert Syst. Appl..

[81]  Y. Volkan Pehlivanoglu,et al.  A New Particle Swarm Optimization Method Enhanced With a Periodic Mutation Strategy and Neural Networks , 2013, IEEE Transactions on Evolutionary Computation.

[82]  Prabhas Chongstitvatana,et al.  Parallel genetic algorithm with parameter adaptation , 2002, Inf. Process. Lett..

[83]  L. Papageorgiou,et al.  A mixed integer quadratic programming formulation for the economic dispatch of generators with prohibited operating zones , 2007 .

[84]  Lingling Huang,et al.  A novel artificial bee colony algorithm with Powell's method , 2013, Appl. Soft Comput..

[85]  Reza Akbari,et al.  A rank based particle swarm optimization algorithm with dynamic adaptation , 2011, J. Comput. Appl. Math..

[86]  Joao P. S. Catalao,et al.  Electricity prices forecasting by a hybrid evolutionary-adaptive methodology , 2014 .

[87]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[88]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[89]  H A Abbass,et al.  MARRIAGE IN HONEY-BEE OPTIMIZATION (MBO): A HAPLOMETROSIS POLYGYNOUS SWARMING APPROACH , 2001 .

[90]  Songfeng Lu,et al.  An improved quantum-behaved particle swarm optimization method for short-term combined economic emission hydrothermal scheduling , 2010 .

[91]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[92]  Hsing-Chih Tsai,et al.  Integrating the artificial bee colony and bees algorithm to face constrained optimization problems , 2014, Inf. Sci..

[93]  Mahmoud R. Maheri,et al.  An enhanced harmony search algorithm for optimum design of side sway steel frames , 2014 .

[94]  Mohammad Hassan Moradi,et al.  A Combination of Genetic Algorithm and Particle Swarm Optimization for Optimal Distributed Generation Location and Sizing in Distribution Systems with Fuzzy Optimal Theory , 2012 .

[95]  R. Arul,et al.  Chaotic self-adaptive differential harmony search algorithm based dynamic economic dispatch , 2013 .

[96]  Sakti Prasad Ghoshal,et al.  Solution of reactive power dispatch of power systems by an opposition-based gravitational search algorithm , 2014 .

[97]  Ahmed S. Ghiduk Automatic generation of basis test paths using variable length genetic algorithm , 2014, Inf. Process. Lett..

[98]  Fuhao Zhang,et al.  A Combination of Genetic Algorithm and Particle Swarm Optimization for Vehicle Routing Problem with Time Windows , 2015, Sensors.

[99]  M. Pandit,et al.  Self-Organizing Hierarchical Particle Swarm Optimization for Nonconvex Economic Dispatch , 2008, IEEE Transactions on Power Systems.

[100]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[101]  Xin-Ping Guan,et al.  A new particle swarm optimization algorithm with adaptive inertia weight based on Bayesian techniques , 2015, Appl. Soft Comput..

[102]  Ji-Pyng Chiou,et al.  A hybrid method of differential evolution with application to optimal control problems of a bioprocess system , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[103]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[104]  Xiaohui Yuan,et al.  Improved gravitational search algorithm for parameter identification of water turbine regulation system , 2014 .

[105]  Abdul Hanan Abdullah,et al.  LAHS: A novel harmony search algorithm based on learning automata , 2013, Commun. Nonlinear Sci. Numer. Simul..

[106]  Mohammad S. Naderi,et al.  Optimal Placement and Tuning of Robust Multimachine PSS via HBMO , 2011 .

[107]  Ahmed El-Shafie,et al.  A modified gravitational search algorithm for slope stability analysis , 2012, Eng. Appl. Artif. Intell..

[108]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[109]  Taher Niknam,et al.  A new fuzzy adaptive particle swarm optimization for non-smooth economic dispatch , 2010 .

[110]  K. G. Srinivasa,et al.  A self-adaptive migration model genetic algorithm for data mining applications , 2007, Inf. Sci..

[111]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[112]  Bin Wu,et al.  Hybrid harmony search and artificial bee colony algorithm for global optimization problems , 2012, Comput. Math. Appl..

[113]  Eugene Semenkin,et al.  Self-configuring Genetic Algorithm with Modified Uniform Crossover Operator , 2012, ICSI.

[114]  J. H. Zhang,et al.  Reactive power optimization and voltage control using an improved genetic algorithm , 2010, 2010 International Conference on Power System Technology.

[115]  Wei Zhang,et al.  A parameter selection strategy for particle swarm optimization based on particle positions , 2014, Expert Syst. Appl..

[116]  Xin-She Yang,et al.  Flower Pollination Algorithm for Global Optimization , 2012, UCNC.

[117]  Khalil Valipour,et al.  Multi objective optimal reactive power dispatch using a new multi objective strategy , 2014 .

[118]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .