Behaviour of pseudo-random and chaotic sources of stochasticity in nature-inspired optimization methods

Stochasticity, noisiness, and ergodicity are the key concepts behind many natural processes and its modeling is an important part of their implementation. There is a handful of soft-computing methods that are directly inspired by nature or stochastic natural processes. The implementation of such a nature-inspired optimization and search methods usually depends on streams of integer and floating point numbers generated in course of their execution. The pseudo-random numbers are utilized for in-silico emulation of probability-driven natural processes such as arbitrary modification of genetic information (mutation, crossover), partner selection, and survival of the fittest (selection, migration) and environmental effects (small random changes in motion direction and velocity). Deterministic chaos is a well known mathematical concept that can be used to generate sequences of seemingly random real numbers within selected interval in a predictable and well controllable way. In the past, it has been used as a basis for various pseudo-random number generators (PRNGs) with interesting properties. This work provides an empirical comparison of the behavior of selected nature-inspired optimization algorithms using different PRNGs and chaotic systems as sources of stochasticity.

[1]  Mark M. Meysenburg,et al.  Randomness and GA performance, revisited , 1999 .

[2]  K. Kurihara,et al.  Particle swarm optimization with external chaotic noise , 2009, 2009 ICCAS-SICE.

[3]  Josef Tvrdík,et al.  A COMBINED APPROACH TO ADAPTIVE DIFFERENTIAL EVOLUTION , 2013 .

[4]  Chen Tian-Lun,et al.  Application of Chaos in Genetic Algorithms , 2002 .

[5]  Erick Cantú-Paz,et al.  On Random Numbers and the Performance of Genetic Algorithms , 2002, GECCO.

[6]  Hans A. Kestler,et al.  Search heuristics and the influence of non-perfect randomness: examining Genetic Algorithms and Simulated Annealing , 2011, Comput. Stat..

[7]  Zhiliang Zhu,et al.  Application of Chaos Genetic Algorithm to Transformer Optimal Design , 2009, 2009 International Workshop on Chaos-Fractals Theories and Applications.

[8]  Miguel A. Vega-Rodríguez,et al.  Sensitiveness of Evolutionary Algorithms to the Random Number Generator , 2011, ICANNGA.

[9]  M. Luescher,et al.  A Portable High-quality Random Number Generator for Lattice Field Theory Simulations , 1993 .

[10]  G. Vandenbosch,et al.  Impact of Random Number Generators on the performance of particle swarm optimization in antenna design , 2012, 2012 6th European Conference on Antennas and Propagation (EUCAP).

[11]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[12]  Deborah M. Gordon,et al.  Ant Encounters: Interaction Networks and Colony Behavior , 2010 .

[13]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[14]  Wen-Wei Lin,et al.  Randomness Enhancement Using Digitalized Modified Logistic Map , 2010, IEEE Transactions on Circuits and Systems II: Express Briefs.

[15]  Ville Tirronen,et al.  Study on the Effects of Pseudorandom Generation Quality on the Performance of Differential Evolution , 2011, ICANNGA.

[16]  Carmelo J. A. Bastos Filho,et al.  Impact of the quality of random numbers generators on the performance of particle swarm optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[17]  B. Z. Yao,et al.  HYBRID MODEL FOR DISPLACEMENT PREDICTION OF TUNNEL SURROUNDING ROCK , 2012 .

[18]  Petr Bujok,et al.  SYNCHRONOUS AND ASYNCHRONOUS MIGRATION IN ADAPTIVE DIFFERENTIAL EVOLUTION ALGORITHMS , 2013 .

[19]  Guanghua Xu,et al.  Real-coded chaotic quantum-inspired genetic algorithm for training of fuzzy neural networks , 2009, Comput. Math. Appl..

[20]  Christian Blum,et al.  Swarm Intelligence: Introduction and Applications , 2008, Swarm Intelligence.

[21]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[22]  Rainer Storn,et al.  Differential evolution design of an IIR-filter , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[23]  Graham M. Megson,et al.  Systolic random number generation for genetic algorithms , 1996 .

[24]  Annie S. Wu,et al.  Empirical Observations on the Roles of Crossover and Mutation , 1997, ICGA.

[25]  James A. Foster,et al.  Using chaos in genetic algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[26]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[27]  M. Andrecut,et al.  Logistic Map as a Random Number Generator , 1998 .

[28]  Reza Boostani,et al.  USING GENETIC PROGRAMMING TO SELECT THE INFORMATIVE EEG-BASED FEATURES TO DISTINGUISH SCHIZOPHRENIC PATIENTS , 2012 .

[29]  R. Povinelli,et al.  Analyzing Logistic Map Pseudorandom Number Generators for Periodicity Induced by Finite Precision Floating-Point Representation , 2012 .

[30]  Min-Yuan Cheng,et al.  Dynamic guiding particle swarm optimization with embedded chaotic search for solving multidimensional problems , 2011, Optimization Letters.

[31]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[32]  Marcos A. C. Oliveira,et al.  Impact of the Random Number generator quality on particle swarm optimization algorithm running on graphic processor units , 2010, 2010 10th International Conference on Hybrid Intelligent Systems.

[33]  Nithin Nagaraj,et al.  The B-Exponential Map: A Generalization of the Logistic Map, and Its Applications In Generating Pseudo-random Numbers , 2006, ArXiv.

[34]  Zbigniew Kotulski,et al.  Pseudorandom Number Generators Based on Chaotic Dynamical Systems , 2001, Open Syst. Inf. Dyn..

[35]  Lu Wang,et al.  Self-adapting Differential Evolution Algorithm with Chaos Random for Global Numerical Optimization , 2010, ISICA.

[36]  Wenbin Hu,et al.  A Hybrid Chaos-Particle Swarm Optimization Algorithm for the Vehicle Routing Problem with Time Window , 2013, Entropy.

[37]  James A. Foster,et al.  How Random Generator Quality Impacts GA Performance , 2002, GECCO.

[38]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[39]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[40]  Berwin A. Turlach,et al.  Statistical Exploratory Analysis of Genetic Algorithms: The Influence of Gray Codes upon the Difficulty of a Problem , 2004, Australian Conference on Artificial Intelligence.

[41]  Stephan M. Winkler,et al.  Genetic Algorithms and Genetic Programming - Modern Concepts and Practical Applications , 2009 .

[42]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[43]  Daniel L. Stein Primers in complex systems , 2013 .

[44]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[45]  Vadlamani Ravi,et al.  A particle swarm optimization-threshold accepting hybrid algorithm for unconstrained optimization , 2013 .