Momentum coefficient for promoting accuracy and convergence speed of evolutionary programming

Many practical problems culminate with solving optimization problems. Thus, many methods have been introduced for solving these types of problems. The need for algorithms that are fast and more accurate at finding global minimums is ever increasing. One of the promising methods is a heuristic and iterative method called Evolutionary Programming (EP). It is one of the computational methods used in optimization that is implemented for many practical applications. Many papers have shown the capability of this algorithm for addressing a variety of optimization problems. These studies have opened a vast new and interesting field of research. Recently, many methods have been proposed for promoting the performance of EP when finding the optimum point of functions or applications; however, EP has some shortcomings that cause slow convergence on some functions, especially multimodal functions. By overcoming these shortcomings, EP could be more effective in the optimization research field. This paper introduces new methods for overcoming these disadvantages and promoting the performance of EP. One of these methods, which has the best results on cost functions, changes the searching procedure by adding a new factor to produce offspring and pulling offspring toward a gathering point (the mean value of the parents). This method was tested on 50 well-known test functions discussed in the literature and was compared with state-of-the-art algorithms on twenty-two new cost functions. Finally, a hybrid method of CEP and MCEP (Momentum Coefficient Evolutionary Programming) called IMCEP (Improved Momentum Coefficient Evolutionary Programming) is introduced. The results of the calculations reported here show the efficiency of MCEP and IMCEP.

[1]  Mohammad Ali Badamchizadeh,et al.  Average Gene Method for increasing the convegence speed of discrete genetic algorithms , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[2]  Jun Zhou,et al.  Applications of evolutionary programming in Markov Random Field to IR image segmentation , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[3]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[4]  Satchidananda Dehuri,et al.  Evolutionary Algorithms for Multi-Criterion Optimization: A Survey , 2004 .

[5]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[6]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[7]  Zhang Jie,et al.  Evolutionary Programming Based on Ladder-changed Mutation for Adaptive System Recognition , 2006, 2006 International Conference on Communications, Circuits and Systems.

[8]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[9]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[10]  S. N. Sivanandam,et al.  Introduction to genetic algorithms , 2007 .

[11]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[12]  Li Ren Efficient evolutionary programming based on a self-adaptive mutation rule , 2002 .

[13]  Yoonseon Song,et al.  Evolutionary programming using the Levy probability distribution , 1999 .

[14]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[15]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[16]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[17]  Kim-Fung Man,et al.  A real-coding jumping gene genetic algorithm (RJGGA) for multiobjective optimization , 2007, Inf. Sci..

[18]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[19]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[20]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[21]  Ji Dou,et al.  An Efficient Evolutionary Programming , 2008, 2008 International Symposium on Information Science and Engineering.

[22]  David B. Fogel,et al.  Two new mutation operators for enhanced search and optimization in evolutionary programming , 1997, Optics & Photonics.

[23]  Bin-Da Liu,et al.  A backpropagation algorithm with adaptive learning rate and momentum coefficient , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).