1 – Metaheuristic Algorithms in Modeling and Optimization

Metaheuristic algorithms have become powerful tools for modeling and optimization. This chapter provides an overview of nature-inspired metaheuristic algorithms, especially those developed in the last two decades, and their applications. We will briefly introduce algorithms such as genetic algorithms, differential evolution, genetic programming, fuzzy logic, and most importantly, swarm-intelligence-based algorithms such as ant and bee algorithms, particle swarm optimization, cuckoo search, firefly algorithm, bat algorithm, and krill herd algorithm. We also briefly describe the main characteristics of these algorithms and outline some recent applications of these algorithms.

[1]  Deepti Rani,et al.  Genetic Algorithms and Their Applications to Water Resources Systems , 2013 .

[2]  A. Gandomi,et al.  Nonlinear Genetic-Based Models for Prediction of Flow Number of Asphalt Mixtures , 2011 .

[3]  Kevin E Lansey,et al.  Optimization of Water Distribution Network Design Using the Shuffled Frog Leaping Algorithm , 2003 .

[4]  S. O. Degertekin.  Optimum design of steel frames using harmony search algorithm , 2008 .

[5]  Nichael Lynn Cramer,et al.  A Representation for the Adaptive Generation of Simple Sequential Programs , 1985, ICGA.

[6]  Mahdi Zarghami,et al.  Water Distribution Networks Designing by the Multiobjective Genetic Algorithm and Game Theory , 2013 .

[7]  Craig A. Tovey,et al.  On Honey Bees and Dynamic Server Allocation in Internet Hosting Centers , 2004, Adapt. Behav..

[8]  Xin-She Yang,et al.  Review of Metaheuristics and Generalized Evolutionary Walk Algorithm , 2011, 1105.3668.

[9]  A. Goh,et al.  Support vector machines: Their use in geotechnical engineering as illustrated using seismic liquefaction data , 2007 .

[10]  Xin-She Yang,et al.  Chaos-enhanced accelerated particle swarm optimization , 2013, Commun. Nonlinear Sci. Numer. Simul..

[11]  Józef Korbicz,et al.  A novel genetic programming approach to nonlinear system modelling: application to the DAMADICS benchmark problem , 2004, Eng. Appl. Artif. Intell..

[12]  Markus Brameier,et al.  On linear genetic programming , 2005 .

[13]  Mohammad Ghasem Sahab,et al.  New formulation for compressive strength of CFRP confined concrete cylinders using linear genetic programming , 2010 .

[14]  Xin-She Yang,et al.  Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms , 2005, IWINAC.

[15]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[18]  Siamak Talatahari,et al.  An improved ant colony optimization for constrained engineering design problems , 2010 .

[19]  Mehmet Polat Saka,et al.  Optimum Geometry Design of Geodesic Domes Using Harmony Search Algorithm , 2007 .

[20]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Xin-She Yang,et al.  Design optimization of truss structures using cuckoo search algorithm , 2013 .

[22]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[23]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[24]  Amir Hossein Gandomi,et al.  Bat algorithm for constrained optimization tasks , 2012, Neural Computing and Applications.

[25]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[26]  Mihai Oltean,et al.  A Comparison of Several Linear Genetic Programming Techniques , 2003, Complex Syst..

[27]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[28]  Xin-She Yang,et al.  Bat algorithm for multi-objective optimisation , 2011, Int. J. Bio Inspired Comput..

[29]  Barry J. Adams,et al.  Honey-bee mating optimization (HBMO) algorithm for optimal reservoir operation , 2007, J. Frankl. Inst..

[30]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[31]  Mihai Oltean,et al.  Evolving Evolutionary Algorithms Using Multi Expression Programming , 2003, ECAL.

[32]  Amir Hossein Gandomi,et al.  Multi-stage genetic programming: A new strategy to nonlinear system modeling , 2011, Inf. Sci..

[33]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[34]  Xin-She Yang,et al.  Firefly algorithm with chaos , 2013, Commun. Nonlinear Sci. Numer. Simul..

[35]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[36]  Siamak Talatahari,et al.  Optimal design of skeletal structures via the charged system search algorithm , 2010 .

[37]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[38]  Vijay P. Singh,et al.  Ant Colony Optimization for Estimating Parameters of Flood Frequency Distributions , 2013 .

[39]  Erhan Kenan Çeven,et al.  Using Fuzzy Logic to Evaluate and Predict Chenille Yarn’s Shrinkage Behaviour , 2007 .

[40]  Amir Hossein Alavi,et al.  Discussion on “Soft computing approach for real-time estimation of missing wave heights” by S.N. Londhe [Ocean Engineering 35 (2008) 1080–1089] , 2010 .

[41]  Siamak Talatahari,et al.  Hybrid Algorithm of Harmony Search, Particle Swarm and Ant Colony for Structural Design Optimization , 2009 .

[42]  Siamak Talatahari,et al.  Particle swarm optimizer, ant colony strategy and harmony search scheme hybridized for optimization of truss structures , 2009 .

[43]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[44]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[45]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[46]  Siamak Talatahari,et al.  A DISCRETE PARTICLE SWARM ANT COLONY OPTIMIZATION FOR DESIGN OF STEEL FRAMES , 2008 .

[47]  Norman R. Paterson,et al.  Genetic programming with context-sensitive grammars , 2003 .

[48]  J. Deneubourg,et al.  Collective patterns and decision-making , 1989 .

[49]  Laurent Tambayong,et al.  Boolean Network and Simmelian Tie in the Co-Author Model: a Study of Dynamics and Structure of a Strategic Alliance Model , 2011, Adv. Complex Syst..

[50]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[51]  Xin-She Yang,et al.  Chaos-Enhanced Firefly Algorithm with Automatic Parameter Tuning , 2011, Int. J. Swarm Intell. Res..

[52]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[53]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[54]  Frank D. Francone,et al.  Extending the boundaries of design optimization by integrating fast optimization techniques with machine-code-based, linear genetic programming , 2004, Inf. Sci..

[55]  Mustafa Tamer Ayvaz,et al.  Application of the Hybrid HS–Solver Algorithm to the Solution of Groundwater Management Problems , 2013 .

[56]  A. Kaveh,et al.  Parameter identification of Bouc-Wen model for MR fluid dampers using adaptive charged system search optimization , 2012 .

[57]  Amir Hossein Alavi,et al.  A robust data mining approach for formulation of geotechnical engineering systems , 2011 .

[58]  Julian Francis Miller,et al.  Cartesian genetic programming , 2000, GECCO '10.

[59]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[60]  Xin-She Yang,et al.  Bat algorithm: a novel approach for global engineering optimization , 2012, 1211.6663.

[61]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[62]  K. Lee,et al.  The harmony search heuristic algorithm for discrete structural optimization , 2005 .

[63]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[64]  Amir Hossein Gandomi,et al.  A new multi-gene genetic programming approach to nonlinear system modeling. Part I: materials and structural engineering problems , 2011, Neural Computing and Applications.

[65]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[66]  Shreenivas Londhe,et al.  Soft computing approach for real-time estimation of missing wave heights , 2008 .

[67]  Amir Hossein Gandomi,et al.  A new multi-gene genetic programming approach to non-linear system modeling. Part II: geotechnical and earthquake engineering problems , 2011, Neural Computing and Applications.

[68]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[69]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[70]  Amir Hossein Alavi,et al.  Novel Approach to Strength Modeling of Concrete under Triaxial Compression , 2012 .

[71]  Mihai Oltean,et al.  Solving Classification Problems Using Infix Form Genetic Programming , 2003, IDA.

[72]  M. Gandomi,et al.  Prediction of maximum dry density and optimum moisture content of stabilised soil using RBF neural networks , 2009 .

[73]  A. Gandomi,et al.  Mixed variable structural optimization using Firefly Algorithm , 2011 .

[74]  Riccardo Poli,et al.  Genetic Programming An Introductory Tutorial and a Survey of Techniques and Applications , 2011 .

[75]  Wolfgang Banzhaf,et al.  A comparison of linear genetic programming and neural networks in medical data mining , 2001, IEEE Trans. Evol. Comput..

[76]  B. Farahmand Azar,et al.  OPTIMUM DESIGN OF COMPOSITE OPEN CHANNELS USING CHARGED SYSTEM SEARCH ALGORITHM , 2012 .

[77]  Siamak Talatahari,et al.  A particle swarm ant colony optimization for truss structures with discrete variables , 2009 .

[78]  S. O. Degertekin.  Harmony search algorithm for optimum design of steel frame structures: A comparative study with other optimization methods , 2008 .

[79]  Akbar A. Javadi,et al.  Applications of artificial intelligence and data mining techniques in soil modeling , 2009 .

[80]  Amir Hossein Alavi,et al.  Linear and Tree-Based Genetic Programming for Solving Geotechnical Engineering Problems , 2013 .

[81]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[82]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..

[83]  Ilya Pavlyukevich.  Lévy flights, non-local search and simulated annealing , 2007, J. Comput. Phys..

[84]  Amir Hossein Alavi,et al.  Prediction of principal ground-motion parameters using a hybrid method coupling artificial neural networks and simulated annealing , 2011 .

[85]  A. Gandomi,et al.  Modeling of maximum dry density and optimum moisture content of stabilized soil using artificial neural networks , 2010 .

[86]  Z. Geem.  Optimal Design of Water Distribution Networks Using Harmony Search , 2009 .

[87]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[88]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[89]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[90]  Amir Hossein Gandomi,et al.  A computational intelligence‐based approach for short‐term traffic flow prediction , 2010, Expert Syst. J. Knowl. Eng..

[91]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[92]  Dervis Karaboga,et al.  Artificial bee colony algorithm , 2010, Scholarpedia.

[93]  Theofanis Apostolopoulos,et al.  Application of the Firefly Algorithm for Solving the Economic Emissions Load Dispatch Problem , 2011 .

[94]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[95]  A. Gandomi,et al.  Nonlinear modeling of shear strength of SFRC beams using linear genetic programming , 2011 .

[96]  T. Poggio,et al.  Networks and the best approximation property , 1990, Biological Cybernetics.

[97]  Amir Hossein Gandomi,et al.  Multi expression programming: a new approach to formulation of soil classification , 2010, Engineering with Computers.

[98]  Amir Hossein Gandomi,et al.  Coupled eagle strategy and differential evolution for unconstrained and constrained global optimization , 2012, Comput. Math. Appl..

[99]  Amir Hossein Gandomi,et al.  Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems , 2011, Engineering with Computers.

[100]  M. Sayadi,et al.  A discrete firefly meta-heuristic with local search for makespan minimization in permutation flow shop scheduling problems , 2010 .

[101]  Xin-She Yang,et al.  Metaheuristic Optimization: Algorithm Analysis and Open Problems , 2011, SEA.

[102]  A. Kaveh,et al.  Charged system search for optimum grillage system design using the LRFD-AISC code , 2010 .

[103]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[104]  Zong Woo Geem,et al.  Hybrid Heuristic Optimization Methods in Geotechnical Engineering , 2013 .

[105]  Edward A. Fox,et al.  A genetic programming framework for content-based image retrieval , 2009, Pattern Recognit..

[106]  Siamak Talatahari,et al.  Optimum design of tower structures using Firefly Algorithm , 2014 .

[107]  J. Deneubourg,et al.  How Trail Laying and Trail Following Can Solve Foraging Problems for Ant Colonies , 1990 .

[108]  Ashraf F. Ashour,et al.  Prediction of tensile capacity of single adhesive anchors using neural networks , 2005 .

[109]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[110]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[111]  S. Sorooshian,et al.  Shuffled complex evolution approach for effective and efficient global minimization , 1993 .

[112]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence , 2014, Studies in Computational Intelligence.

[113]  İlker Bekir Topçu,et al.  Prediction of compressive strength of concrete containing fly ash using artificial neural networks and fuzzy logic , 2008 .

[114]  Amir Hossein Gandomi,et al.  A multi-stage particle swarm for optimum design of truss structures , 2013, Neural Computing and Applications.

[115]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[116]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .