A New Dynamic Population Variation in Genetic Programming

A dynamic population variation (DPV) in genetic programming (GP) with four innovations is proposed for reducing computational effort and accelerating convergence during the run of GP. Firstly, we give a new stagnation phase definition and the characteristic measure for it. Secondly, we propose an exponential pivot function (EXP) in conjunction with the new stagnation phase definition. Thirdly, we propose an appropriate population variation formula for EXP. Finally, we introduce a scheme using an instruction matrix for producing new individuals to maintain diversity of the population. The efficacy of these innovations in our DPV is examined using four typical benchmark problems. Comparisons among the different characteristic measures have been conducted for regression problems and the proposed measure performed best in all characteristic measures. It is demonstrated that the proposed population variation scheme is superior to fixed and proportionate population variation schemes for sequence induction. It is proved that the new DPV has the capacity to provide solutions at a lower computational effort compared with previously proposed population variation methods and standard genetic programming in most problems.

[1]  Tim Jones Evolutionary Algorithms, Fitness Landscapes and Search , 1995 .

[2]  Christopher H. Messom,et al.  Confidence Intervals for Computational Effort Comparisons , 2007, EuroGP.

[3]  Julian Francis Miller,et al.  Cartesian genetic programming , 2010, GECCO.

[4]  J.M. Daida,et al.  Evolving feature-extraction algorithms: adapting genetic programming for image analysis in geoscience and remote sensing , 1996, IGARSS '96. 1996 International Geoscience and Remote Sensing Symposium.

[5]  Nguyen Xuan Hoai,et al.  Solving the symbolic regression problem with tree-adjunct grammar guided genetic programming: the comparative results , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[6]  Thomas Bräunl,et al.  Population variation in genetic programming , 2007, Inf. Sci..

[7]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[8]  Kwong-Sak Leung,et al.  Applying Genetic Parallel Programming to Synthesize Combinational Logic Circuits , 2007, IEEE Transactions on Evolutionary Computation.

[9]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex adaptive systems.

[10]  Leonardo Vanneschi,et al.  A new technique for dynamic size populations in genetic programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[11]  Gang Li,et al.  Instruction-Matrix-Based Genetic Programming , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Steffen Christensen,et al.  Solving the artificial ant on the Santa Fe trail problem in 20,696 fitness evaluations , 2007, GECCO '07.

[13]  Wolfgang Banzhaf,et al.  More on Computational Effort Statistics for Genetic Programming , 2003, EuroGP.

[14]  Huang Yu-zhen The Automatic Modeling of Complex Functions Based on Genetic Programming , 2003 .

[15]  Thomas Bräunl,et al.  Dynamic population variation in genetic programming , 2009, Inf. Sci..

[16]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[17]  Byoung-Tak Zhang,et al.  Learning robot behaviors by evolving genetic programs , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[18]  Prabhas Chongstitvatana,et al.  Improving robustness of robot programs generated by genetic programming for dynamic environments , 1998, IEEE. APCCAS 1998. 1998 IEEE Asia-Pacific Conference on Circuits and Systems. Microelectronics and Integrating Systems. Proceedings (Cat. No.98EX242).

[19]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[20]  M. Tomassini,et al.  Saving computational effort in genetic programming by means of plagues , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[21]  Graham Kendall,et al.  Diversity in genetic programming: an analysis of measures and correlation with fitness , 2004, IEEE Transactions on Evolutionary Computation.

[22]  Julian Francis Miller,et al.  Principles in the Evolutionary Design of Digital Circuits—Part II , 2000, Genetic Programming and Evolvable Machines.

[23]  Jan K. Sykulski,et al.  Reducing computational effort in field optimisation problems , 2004 .

[24]  Hitoshi Iba,et al.  Estimation of Distribution Programming: EDA-based Approach to Program Generation , 2006, Towards a New Evolutionary Computation.

[25]  Byoung-Tak Zhang,et al.  Evolutionary neural trees for modeling and predicting complex systems , 1997 .