Cauchy annealing schedule: an annealing schedule for Boltzmann selection scheme in evolutionary algorithms

Boltzmann selection is an important selection mechanism in evolutionary algorithms as it has theoretical properties which help in theoretical analysis. However, Boltzmann selection is not used in practice because a good annealing schedule for the inverse temperature parameter is lacking. In this paper, we propose a Cauchy annealing schedule for Boltzmann selection scheme based on a hypothesis that selection-strength should increase as evolutionary process goes on and distance between two selection strengths should decrease for the process to converge. To formalize these aspects, we develop formalism for selection mechanisms using fitness distributions and give an appropriate measure for selection strength. In this paper, we prove an important result, by which we derive an annealing schedule called Cauchy annealing schedule. We demonstrate the novelty of proposed annealing schedule using simulations in the framework of genetic algorithms.

[1]  E. Hill Journal of Theoretical Biology , 1961, Nature.

[2]  W. Rudin Principles of mathematical analysis , 1964 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[5]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[6]  Lashon B. Booker,et al.  Proceedings of the fourth international conference on Genetic algorithms , 1991 .

[7]  J. N. Kapur,et al.  Entropy optimization principles with applications , 1992 .

[8]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[9]  Bruce Tidor,et al.  An Analysis of Selection Procedures with Particular Attention Paid to Proportional and Boltzmann Selection , 1993, International Conference on Genetic Algorithms.

[10]  K. Maekawa Proceedings of the First IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence, Orlando, Florida, USA, June 27-29, 1994 , 1994, International Conference on Evolutionary Computation.

[11]  Prügel-Bennett,et al.  Analysis of genetic algorithms using statistical mechanics. , 1994, Physical review letters.

[12]  Thomas Bäck,et al.  Selective Pressure in Evolutionary Algorithms: A Characterization of Selection Mechanisms , 1994, International Conference on Evolutionary Computation.

[13]  Magnus Rattray,et al.  The Dynamics of a Genetic Algorithm under Stabilizing Selection , 1995, Complex Syst..

[14]  Lothar Thiele,et al.  A Comparison of Selection Schemes Used in Evolutionary Algorithms , 1996, Evolutionary Computation.

[15]  A. Prügel-Bennett Modelling evolving populations. , 1997, Journal of theoretical biology.

[16]  Georges R. Harik,et al.  Foundations of Genetic Algorithms , 1997 .

[17]  S. Bornholdt Annealing schedule from population dynamics , 1999, cond-mat/9903077.

[18]  Alex RogersOctober Modelling Ga Dynamics , 1999 .

[19]  T. Mahnig,et al.  A new adaptive Boltzmann selection schedule SDS , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[20]  L. Kallel,et al.  Theoretical Aspects of Evolutionary Computing , 2001, Natural Computing Series.

[21]  A. Prügel-Bennett,et al.  Modelling genetic algorithm dynamics , 2001 .

[22]  Zbigniew J. Czech,et al.  Selection Schemes in Evolutionary Algorithms , 2002, Intelligent Information Systems.

[23]  M. N. Murty,et al.  Quotient evolutionary space: abstraction of evolutionary process w.r.t macroscopic properties , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[24]  R. L.Magnus,et al.  The Dynamics of a Genetic Algorithm under Stabilizing Selection , 2006 .

[25]  October I Physical Review Letters , 2022 .