On Improving Generalisation in Genetic Programming

This paper is concerned with the generalisation performance of GP. We examine the generalisation of GP on some well-studied test problems and also critically examine the performance of some well known GP improvements from a generalisation perspective. From this, the need for GP practitioners to provide more accurate reports on the generalisation performance of their systems on problems studied is highlighted. Based on the results achieved, it is shown that improvements in training performance thanks to GP-enhancements represent only half of the battle.

[1]  Leonardo Vanneschi,et al.  A Survey of Problem Difficulty in Genetic Programming , 2005, AI*IA.

[2]  A. Topchy,et al.  Faster genetic programming based on local gradient search of numeric leaf values , 2001 .

[3]  Stefania Bandini,et al.  AI*IA 2005: Advances in Artificial Intelligence, 9th Congress of the Italian Association for Artificial Intelligence, Milan, Italy, September 21-23, 2005, Proceedings , 2005, AI*IA.

[4]  Maarten Keijzer,et al.  Scaled Symbolic Regression , 2004, Genetic Programming and Evolvable Machines.

[5]  Conor Ryan,et al.  Real-Time, Non-intrusive Evaluation of VoIP , 2007, EuroGP.

[6]  Maarten Keijzer,et al.  Improving Symbolic Regression with Interval Arithmetic and Linear Scaling , 2003, EuroGP.

[7]  Cyril Fonlupt,et al.  Analysis of GP Improvement Techniques over the Real-World Inverse Problem of Ocean Color , 2004, EuroGP.

[8]  Edmund K. Burke,et al.  On improving genetic programming for symbolic regression , 2005, 2005 IEEE Congress on Evolutionary Computation.

[9]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[10]  A. E. Eiben,et al.  Evolutionary Programming VII , 1998, Lecture Notes in Computer Science.

[11]  Terence Soule,et al.  Genetic Programming Theory and Practice IV , 2007 .

[12]  Hammad Majeed,et al.  A Re-Examination of a Real World Blood Flow Modeling Problem Using Context-Aware Crossover , 2007 .

[13]  Matthew P. Evett,et al.  Numeric Mutation as an Improvement to Symbolic Regression in Genetic Programming , 1998, Evolutionary Programming.

[14]  Sean Luke,et al.  Is The Perfect The Enemy Of The Good? , 2002, GECCO.

[15]  Larry Wasserman,et al.  All of Statistics , 2004 .