Population sizing for entropy-based model building in discrete estimation of distribution algorithms

This paper proposes a population-sizing model for entropy-based model building in discrete estimation of distribution algorithms. Specifically, the population size required for building an accurate model is investigated. The effect of selection pressure on population sizing is also preliminarily incorporated. The proposed model indicates that the population size required for building an accurate model scales as Θ(m log m), where m is the number of substructures of the given problem and is proportional to the problem size. Experiments are conducted to verify the derivations, and the results agree with the proposed model.

[1]  David E. Goldberg,et al.  Conquering hierarchical difficulty by explicit chunking: substructural chromosome compression , 2006, GECCO '06.

[2]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications (Studies in Computational Intelligence) , 2006 .

[3]  G. Harik.  Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[4]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[5]  Prabhas Chongstitvatana,et al.  Building-block Identification by Simultaneity Matrix , 2007, Soft Comput..

[6]  Thomas Bck.  Generalized convergence models for tournament|and (1; ?)|selection , 1995 .

[7]  Thomas Bäck,et al.  Generalized Convergence Models for Tournament- and (mu, lambda)-Selection , 1995, ICGA.

[8]  David E. Goldberg,et al.  Sizing Populations for Serial and Parallel Genetic Algorithms , 1989, ICGA.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  Jiri Ocenasek.  Entropy-based Convergence Measurement in Discrete Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[11]  David E. Goldberg,et al.  Scalability of the Bayesian optimization algorithm , 2002, Int. J. Approx. Reason..

[12]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[13]  Marco Zaffalon,et al.  Distribution of mutual information from complete and incomplete data , 2004, Comput. Stat. Data Anal..

[14]  下平 丕作士,et al.  The Genetic and Evolutionary Computation Conference , 2002 .

[15]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[16]  Thomas D. LaToza,et al.  On the supply of building blocks , 2001 .

[17]  Lothar Thiele,et al.  A Mathematical Analysis of Tournament Selection , 1995, ICGA.

[18]  Melanie Mitchell,et al.  The royal road for genetic algorithms: Fitness landscapes and GA performance , 1991 .

[19]  Petr Posík.  Estimation of Distribution Algorithms , 2006 .

[20]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[21]  D. E. Goldberg,et al.  Simple Genetic Algorithms and the Minimal, Deceptive Problem , 1987 .

[22]  David E. Goldberg,et al.  Designing Competent Mutation Operators Via Probabilistic Model Building of Neighborhoods , 2004, GECCO.

[23]  Heinz Mühlenbein,et al.  The Estimation of Distributions and the Minimum Relative Entropy Principle , 2005, Evol. Comput..

[24]  David E. Goldberg,et al.  Genetic Algorithm Design Inspired by Organizational Theory: Pilot Study of a Dependency Structure Matrix Driven Genetic Algorithm , 2003, GECCO.

[25]  David E. Goldberg,et al.  Bayesian Optimization Algorithm, Population Sizing, and Time to Convergence , 2000, GECCO.

[26]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[27]  David E. Goldberg,et al.  The Gambler's Ruin Problem, Genetic Algorithms, and the Sizing of Populations , 1999, Evolutionary Computation.

[28]  Masaharu Munetomo,et al.  Identifying Linkage Groups by Nonlinearity/Non-monotonicity Detection , 1999 .

[29]  Alden H. Wright,et al.  An Estimation of Distribution Algorithm Based on Maximum Entropy , 2004, GECCO.

[30]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Colin R. Reeves,et al.  Using Genetic Algorithms with Small Populations , 1993, ICGA.