Eeciency Enhancement of Probabilistic Model Building Genetic Algorithms Eeciency Enhancement of Probabilistic Model Building Genetic Algorithms

This paper presents two diierent eeciency-enhancement techniques for probabilistic model building genetic algorithms. The rst technique proposes the use of a mutation operator which performs local search in the sub-solution neighborhood identiied through the probabilistic model. The second technique proposes building and using an internal probabilistic model of the tness along with the probabilistic model of variable interactions. The tness values of some oospring are estimated using the probabilistic model, thereby avoiding computationally expensive function evaluations. The scalability of the aforementioned techniques are analyzed using facetwise models for convergence time and population sizing. The speed-up obtained by each of the methods is predicted and veriied with empirical results. The results show that for additively separable problems the competent mutation operator requires O(p k log m)|where k is the building-block size, and m is the number of building blocks|less function evaluations than its selectorecombinative counterpart. The results also show that the use of an internal probabilistic tness model reduces the required number of function evaluations to as low as 1-10% and yields a speed-up of 2{50.

[1]  Martin Pelikan,et al.  Fitness Inheritance in the Bayesian Optimization Algorithm , 2004, GECCO.

[2]  J. -F. M. Barthelemy,et al.  Approximation concepts for optimum structural design — a review , 1993 .

[3]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[4]  David E. Goldberg,et al.  Scalability of the Bayesian optimization algorithm , 2002, Int. J. Approx. Reason..

[5]  David E. Goldberg,et al.  Optimizing Global-Local Search Hybrids , 1999, GECCO.

[6]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[7]  David E. Goldberg,et al.  Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[8]  D. Goldberg,et al.  Don't evaluate, inherit , 2001 .

[9]  David E. Goldberg,et al.  Bayesian Optimization Algorithm, Population Sizing, and Time to Convergence , 2000, GECCO.

[10]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[11]  David E. Goldberg,et al.  Let's Get Ready to Rumble: Crossover Versus Mutation Head to Head , 2004, GECCO.

[12]  David E. Goldberg Using Time Efficiently: Genetic-Evolutionary Algorithms and the Continuation Problem , 1999, GECCO.

[13]  David E. Goldberg,et al.  Genetic Algorithm Design Inspired by Organizational Theory: Pilot Study of a Dependency Structure Matrix Driven Genetic Algorithm , 2003, GECCO.

[14]  David E. Goldberg,et al.  Fitness Inheritance In Multi-objective Optimization , 2002, GECCO.

[15]  B. Julstrom,et al.  Design of vector quantization codebooks using a genetic algorithm , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[16]  David E. Goldberg,et al.  Designing Competent Mutation Operators Via Probabilistic Model Building of Neighborhoods , 2004, GECCO.

[17]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[18]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[19]  Franz Rothlauf,et al.  Evaluation-Relaxation Schemes for Genetic and Evolutionary Algorithms , 2004 .

[20]  G. Harik Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .