Toward the optimization of a class of black box optimization algorithms

Many black box optimization algorithms have sufficient flexibility to allow them to adapt to the varying circumstances they encounter. These capabilities are of two primary sorts: user-determined choices among alternative parameters, operations, and logic structures; and the algorithm-determined alternative paths chosen during the process of seeking a solution to a particular problem. We discuss the process of algorithm design and operation, with the intent of integrating the seemingly distinct aspects described above within a unified framework. We relate this algorithmic optimization process to the field of dynamic process control. An approach is proposed toward the optimization of a process for controlling a specific class of systems, and its application to dynamic adjustment of the algorithm used in the search problem. An instance of this approach in genetic algorithms is demonstrated. The experimental results show the adaptability and robustness of the proposed approach.

[1]  Elizabeth Goodman,et al.  An Introduction to GALOPPS-the "Genetic Algorithm Optimized for Portability and Parallelism" System , 1994 .

[2]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[3]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[4]  Heinz Mühlenbein,et al.  Adaptation of population sizes by competing subpopulations , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[5]  Michael de la Maza The Fifth International Conference on Genetic Algorithms , 1994, AI Mag..

[6]  Lawrence Davis,et al.  Adapting Operator Probabilities in Genetic Algorithms , 1989, ICGA.

[7]  Terence C. Fogarty,et al.  Varying the Probability of Mutation in the Genetic Algorithm , 1989, ICGA.

[8]  John H. Holland,et al.  When will a Genetic Algorithm Outperform Hill Climbing , 1993, NIPS.

[9]  Kenneth A. De Jong,et al.  Using Markov Chains to Analyze GAFOs , 1994, FOGA.

[10]  M. M. Martin,et al.  R. Gabasov, F. Kirillova: The Qualitative theory of optimal processes , 1978 .

[11]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  J. Casti,et al.  The qualitative theory of optimal processes , 1976 .

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  David J. Goodman,et al.  Personal Communications , 1994, Mobile Communications.