A comprehensive investigation into the performance, robustness, scalability and convergence of chaos-enhanced evolutionary algorithms with boundary constraints

The purpose of this research is to investigate the effects of different chaotic maps on the exploration/exploitation capabilities of evolutionary algorithms (EAs). To do so, some well-known chaotic maps are embedded into a self-organizing version of EAs. This combination is implemented through using chaotic sequences instead of random parameters of optimization algorithm. However, using a chaos system may result in exceeding of the optimization variables beyond their practical boundaries. In order to cope with such a deficiency, the evolutionary method is equipped with a recent spotlighted technique, known as the boundary constraint handling method, which controls the movements of chromosomes within the feasible solution domain. Such a technique aids the heuristic agents towards the feasible solutions, and thus, abates the undesired effects of the chaotic diversification. In this study, 9 different variants of chaotic maps are considered to precisely investigate different aspects of coupling the chaos phenomenon with the baseline EA, i.e. the convergence, scalability, robustness, performance and complexity. The simulation results reveal that some of the maps (chaotic number generators) are more successful than the others, and thus, can be used to enhance the performance of the standard EA.

[1]  Nasser L. Azad,et al.  An empirical investigation into the effects of chaos on different types of evolutionary crossover operators for efficient global search in complicated landscapes , 2016, Int. J. Comput. Math..

[2]  Xiaohui Yuan,et al.  Multi-objective optimization of short-term hydrothermal scheduling using non-dominated sorting gravitational search algorithm with chaotic mutation , 2014 .

[3]  Viviana C. Mariani,et al.  Multiobjective Optimization of Transformer Design Using a Chaotic Evolutionary Approach , 2014, IEEE Transactions on Magnetics.

[4]  Michal Pluhacek,et al.  Utilising the chaos-induced discrete self organising migrating algorithm to solve the lot-streaming flowshop scheduling problem with setup time , 2014, Soft Comput..

[5]  Markus Brameier,et al.  On linear genetic programming , 2005 .

[6]  Mohammad Reza Meybodi,et al.  Brownian Motion Optimization : an Algorithm for Optimization ( GBMO ) , 2012 .

[7]  Karim Faez,et al.  Chaotic target representation for robust object tracking , 2017, Signal Process. Image Commun..

[8]  Amir Hossein Gandomi,et al.  Evolutionary boundary constraint handling scheme , 2012, Neural Computing and Applications.

[9]  Ming Xiao,et al.  A Rapid Chaos Genetic Algorithm , 2010, ICSI.

[10]  Shanlin Yang,et al.  A novel chaotic differential evolution algorithm for short-term cascaded hydroelectric system scheduling , 2014 .

[11]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[12]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[13]  Ahmad Mozaffari,et al.  Analyzing, controlling, and optimizing Damavand power plant operating parameters using a synchronous parallel shuffling self-organized Pareto strategy and neural network: a survey , 2012 .

[14]  Kwok-Wo Wong,et al.  An improved particle swarm optimization algorithm combined with piecewise linear chaotic map , 2007, Appl. Math. Comput..

[15]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[16]  Ying-Cheng Lai,et al.  Controlling chaos , 1994 .

[17]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[18]  M. Cheng,et al.  Using a fuzzy clustering chaotic-based differential evolution with serial method to solve resource-constrained project scheduling problems , 2014 .

[19]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[20]  Ivan Zelinka,et al.  Evolutionary Decryption of Chaotically Encrypted Information , 2010, Evolutionary Algorithms and Chaotic Systems.

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  A. Rezaee Jordehi,et al.  An efficient chaotic water cycle algorithm for optimization tasks , 2015, Neural Computing and Applications.

[23]  Xin Zhang,et al.  A new chaotic algorithm for image encryption , 2006 .

[24]  Ahmad Mozaffari,et al.  Optimal design of classic Atkinson engine with dynamic specific heat using adaptive neuro-fuzzy inference system and mutable smart bee algorithm , 2013, Swarm Evol. Comput..

[25]  Saeed Behzadipour,et al.  The great salmon run: a novel bio-inspired algorithm for artificial system design and optimisation , 2012, Int. J. Bio Inspired Comput..

[26]  Kusum Deep,et al.  A new crossover operator for real coded genetic algorithms , 2007, Appl. Math. Comput..

[27]  B. Fourcade,et al.  Universal multifractal properties of circle maps from the point of view of critical phenomena II. Analytical results , 1990 .

[28]  Zhiqiang Jiang,et al.  A Chaotic Differential Evolution Algorithm for Flexible Job Shop Scheduling , 2016 .

[29]  Xiaoling Huang,et al.  Image encryption algorithm using chaotic Chebyshev generator , 2011, Nonlinear Dynamics.

[30]  Amir Hossein Gandomi,et al.  Chaotic bat algorithm , 2014, J. Comput. Sci..

[31]  Huaguang Zhang,et al.  Robust Global Exponential Synchronization of Uncertain Chaotic Delayed Neural Networks via Dual-Stage Impulsive Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[33]  R. Devaney An Introduction to Chaotic Dynamical Systems , 1990 .

[34]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[35]  Biruk G. Tessema,et al.  A self-adaptive genetic algorithm for constrained optimization , 2006 .

[36]  A. Kaveh,et al.  Chaotic swarming of particles: A new method for size optimization of truss structures , 2014, Adv. Eng. Softw..

[37]  Ahmad Mozaffari,et al.  Optimal design of constraint engineering systems: application of mutable smart bee algorithm , 2012, Int. J. Bio Inspired Comput..

[38]  Ahmad Mozaffari,et al.  Modeling a shape memory alloy actuator using an evolvable recursive black-box and hybrid heuristic algorithms inspired based on the annual migration of salmons in nature , 2014, Appl. Soft Comput..

[39]  A. Mousa,et al.  A chaos-based evolutionary algorithm for general nonlinear programming problems , 2016 .

[40]  Manoj Thakur,et al.  A new genetic algorithm for global optimization of multimodal continuous functions , 2014, J. Comput. Sci..

[41]  P. Arena,et al.  Self-Organization in nonrecurrent Complex Systems , 2000, Int. J. Bifurc. Chaos.

[42]  Mohammad Saleh Tavazoei,et al.  Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms , 2007, Appl. Math. Comput..

[43]  Ahmad Mozaffari,et al.  Ensemble mutable smart bee algorithm and a robust neural identifier for optimal design of a large scale power system , 2014, J. Comput. Sci..

[44]  G. Manganaro,et al.  DNA computing based on chaos , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[45]  Ali Öztürk,et al.  Determination of voltage stability boundary values in electrical power systems by using the Chaotic Particle Swarm Optimization algorithm , 2015 .

[46]  H. Schuster Deterministic chaos: An introduction , 1984 .

[47]  Leandro dos Santos Coelho,et al.  A backtracking search algorithm combined with Burger's chaotic map for parameter estimation of PEMFC electrochemical model , 2014 .

[48]  Javad Alikhani Koupaei,et al.  A new optimization algorithm based on chaotic maps and golden section search method , 2016, Eng. Appl. Artif. Intell..

[49]  Xin-She Yang,et al.  Chaos-enhanced accelerated particle swarm optimization , 2013, Commun. Nonlinear Sci. Numer. Simul..

[50]  Bilal Alatas,et al.  Chaotic harmony search algorithms , 2010, Appl. Math. Comput..

[51]  H. Amindavar,et al.  The chaotic dynamics of high-dimensional systems , 2016, Nonlinear Dynamics.

[52]  Haibin Duan,et al.  Chaotic predator–prey biogeography-based optimization approach for UCAV path planning , 2014 .

[53]  Laxmi Srivastava,et al.  Modified Differential Evolution algorithm for multi-objective VAR management , 2014 .

[54]  Wei-Chiang Hong,et al.  Berth and quay crane coordinated scheduling using multi-objective chaos cloud particle swarm optimization algorithm , 2017, Neural Computing and Applications.

[55]  Ivan Zelinka,et al.  Evolutionary Algorithms and Chaotic Systems , 2010, Evolutionary Algorithms and Chaotic Systems.

[56]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[57]  Michal Pluhacek,et al.  Comparison of Chaos Driven PSO and Differential Evolution on the Selected PID Tuning Problem , 2014, CISIM.

[58]  Pinar Civicioglu,et al.  A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms , 2013, Artificial Intelligence Review.

[59]  Yushun Fan,et al.  A chaos search immune algorithm with its application to neuro-fuzzy controller design , 2006 .

[60]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[61]  Amir Hossein Gandomi,et al.  Chaotic gravitational constants for the gravitational search algorithm , 2017, Appl. Soft Comput..

[62]  Huanwen Tang,et al.  Application of chaos in simulated annealing , 2004 .

[63]  B. Alatas,et al.  Chaotically encoded particle swarm optimization algorithm and its applications , 2009 .

[64]  Louis M Pecora,et al.  Synchronization of chaotic systems. , 2015, Chaos.

[65]  Amir Hossein Gandomi,et al.  Chaotic Krill Herd algorithm , 2014, Inf. Sci..

[66]  B. Alatas Uniform Big Bang–Chaotic Big Crunch optimization , 2011 .

[67]  A. Gandomi,et al.  Imperialist competitive algorithm combined with chaos for global optimization , 2012 .

[68]  Zhong Jin,et al.  A novel SVM by combining kernel principal component analysis and improved chaotic particle swarm optimization for intrusion detection , 2014, Soft Computing.

[69]  Wei Gong,et al.  Chaos Ant Colony Optimization and Application , 2009, 2009 Fourth International Conference on Internet Computing for Science and Engineering.

[70]  S. Hosseini,et al.  A new hybrid algorithm based on chaotic maps for solving systems of nonlinear equations , 2015 .

[71]  Nasser L. Azad,et al.  On the efficacy of chaos-enhanced heuristic walks with nature-based controllers for robust and accurate intelligent search, part A: an experimental analysis , 2015, J. Exp. Theor. Artif. Intell..

[72]  Ahmad Mozaffari,et al.  Vector optimization of laser solid freeform fabrication system using a hierarchical mutable smart bee-fuzzy inference system and hybrid NSGA-II/self-organizing map , 2014, J. Intell. Manuf..

[73]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[74]  Zhang Huaguang,et al.  Modeling, identification, and control of a class of nonlinear systems , 2001, IEEE Trans. Fuzzy Syst..

[75]  X. Liao,et al.  A More Secure Chaotic Cryptographic Scheme Based on the Dynamic Look-Up Table , 2005 .

[76]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[77]  Peng Lu,et al.  Chaotic differential bee colony optimization algorithm for dynamic economic dispatch problem with valve-point effects , 2014 .

[78]  Karim Faez,et al.  Visual object tracking with online weighted chaotic multiple instance learning , 2017, Neurocomputing.

[79]  Li Li,et al.  Multi-fault diagnosis study on roller bearing based on multi-kernel support vector machine with chaotic particle swarm optimization , 2014 .

[80]  Bilal Alatas,et al.  Chaotic League Championship Algorithms , 2016 .

[81]  B. Alatas,et al.  Chaos embedded particle swarm optimization algorithms , 2009 .

[82]  Yanbin Yuan,et al.  A hybrid chaotic genetic algorithm for short-term hydro system scheduling , 2002, Math. Comput. Simul..

[83]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[84]  Millie Pant,et al.  Coordination of directional overcurrent relays using opposition based chaotic differential evolution algorithm , 2014 .

[85]  Chen Tian-Lun,et al.  Application of Chaos in Genetic Algorithms , 2002 .

[86]  Xin-She Yang,et al.  Firefly algorithm with chaos , 2013, Commun. Nonlinear Sci. Numer. Simul..

[87]  Jiang Chuanwen,et al.  A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation , 2005, Math. Comput. Simul..

[88]  Bilal Alatas,et al.  Chaotic bee colony algorithms for global numerical optimization , 2010, Expert Syst. Appl..

[89]  Dervis Karaboga,et al.  A survey: algorithms simulating bee swarm intelligence , 2009, Artificial Intelligence Review.

[90]  Luigi Fortuna,et al.  Chaotic sequences to improve the performance of evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[91]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[92]  Liang-Hong Wu,et al.  A mutative-scale pseudo-parallel chaos optimization algorithm , 2015, Soft Comput..