A robust stochastic genetic algorithm (StGA) for global numerical optimization

Many real-life problems can be formulated as numerical optimization of certain objective functions. However, often an objective function possesses numerous local optima, which could trap an algorithm from moving toward the desired global solution. Evolutionary algorithms (EAs) have emerged to enable global optimization; however, at the present stage, EAs are basically limited to solving small-scale problems due to the constraint of computational efficiency. To improve the search efficiency, this paper presents a stochastic genetic algorithm (StGA). A novel stochastic coding strategy is employed so that the search space is dynamically divided into regions using a stochastic method and explored region-by-region. In each region, a number of children are produced through random sampling, and the best child is chosen to represent the region. The variance values are decreased if at least one of five generated children results in improved fitness, otherwise, the variance values are increased. Experiments on 20 test functions of diverse complexities show that the StGA is able to find the near-optimal solution in all cases. Compared with several other algorithms, StGA achieves not only an improved accuracy, but also a considerable reduction of the computational effort. On average, the computational cost required by StGA is about one order less than the other algorithms. The StGA is also shown to be able to solve large-scale problems.

[1]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[2]  Greg L. Zacharias,et al.  Air combat tactics optimization using stochastic genetic algorithms , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[3]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[4]  D. E. Goldberg,et al.  Genetic Algorithm in Search , 1989 .

[5]  Patrick Siarry,et al.  Enhanced simulated annealing for globally minimizing functions of many-continuous variables , 1997, TOMS.

[6]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[7]  N. Schraudolph,et al.  Dynamic Parameter Encoding for Genetic Algorithms , 1992, Machine Learning.

[8]  H. K. Birru,et al.  Evolving nonlinear time-series models using evolutionary programming , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Hans Seywald,et al.  Genetic Algorithm Approach for Optimal Control Problems with Linearly Appearing Controls , 1995 .

[10]  Garrison W. Greenwood,et al.  Scheduling tasks in real-time systems using evolutionary strategies , 1995, Proceedings of Third Workshop on Parallel and Distributed Real-Time Systems.

[11]  K Krishnakumar,et al.  Solving large parameter optimization problems using genetic algorithms , 1995 .

[12]  K. Deb Binary and floating-point function optimization using messy genetic algorithms , 1991 .

[13]  Panos M. Pardalos,et al.  Large Scale Optimization , 1994 .

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[16]  Xinhe Xu,et al.  An efficient evolutionary programming algorithm , 1999, Comput. Oper. Res..

[17]  Kumar Chellapilla,et al.  Combining mutation operators in evolutionary programming , 1998, IEEE Trans. Evol. Comput..

[18]  Seamus D. Garvey,et al.  A COMBINED GENETIC AND EIGENSENSITIVITY ALGORITHM FOR THE LOCATION OF DAMAGE IN STRUCTURES , 1998 .

[19]  John J. Grefenstette,et al.  Genetic Search with Approximate Function Evaluation , 1985, ICGA.

[20]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[21]  David B. Fogel,et al.  Evolving artificial intelligence , 1992 .

[22]  Hong Hao,et al.  Vibration-based Damage Detection of Structures by Genetic Algorithm , 2002 .

[23]  W. Hager,et al.  Large Scale Optimization : State of the Art , 1993 .