Exposing a Bias Toward Short-Length Numbers in Grammatical Evolution

Many automatically-synthesized programs have, like their hand-made counterparts, numerical parameters that need to be set properly before they can show an acceptable performance. Hence, any approach to the automatic synthesis of programs needs the ability to tune numerical parameters efficiently. Grammatical Evolution (GE) is a promising grammar-based genetic programming technique that synthesizes numbers by concatenating digits. In this paper, we show that a naive application of this approach can lead to a serious number length bias that in turn affects efficiency. The root of the problem is the way the context-free grammar used by GE is defined. A simple, yet effective, solution to this problem is proposed.

[1]  Anthony Brabazon,et al.  Grammatical Constant Creation , 2004, GECCO.

[2]  Hitoshi Iba,et al.  Genetic Programming 1998: Proceedings of the Third Annual Conference , 1999, IEEE Trans. Evol. Comput..

[3]  Conor Ryan,et al.  Analysis of a Digit Concatenation Approach to Constant Creation , 2003, EuroGP.

[4]  Michael O'Neill,et al.  Grammatical evolution - evolutionary automatic programming in an arbitrary language , 2003, Genetic programming.

[5]  E. Glavas,et al.  Neural network construction using grammatical evolution , 2005, Proceedings of the Fifth IEEE International Symposium on Signal Processing and Information Technology, 2005..

[6]  Michael O'Neill,et al.  An Attribute Grammar Decoder for the 01 MultiConstrained Knapsack Problem , 2005, EvoCOP.

[7]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[8]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[9]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[10]  Matthew P. Evett,et al.  Numeric Mutation Improves the Discovery of Numeric Constants in Genetic Programming , 2007 .

[11]  J. Koza Automatic Synthesis of Topologies and Numerical Parameters , 2003 .

[12]  Anthony Brabazon,et al.  Meta-grammar constant creation with grammatical evolution by grammatical evolution , 2005, GECCO '05.

[13]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[14]  Peter C. Nelson,et al.  Investigation of Constant Creation Techniques in the Context of Gene Expression Programming , 2004 .

[15]  Conor Ryan,et al.  Grammatical evolution , 2007, GECCO '07.

[16]  Anthony Brabazon,et al.  Constant creation in grammatical evolution , 2007 .

[17]  Conor Ryan,et al.  Grammatical Evolution , 2001, Genetic Programming Series.

[18]  John R. Koza,et al.  Genetic Programming: Automatic Synthesis of Topologies and Numerical Parameters , 2003, Handbook of Metaheuristics.

[19]  Brad G. Kyer Review of 5 of biologically inspired algorithms for financial modelling by Anthony Brabazon, Michael O'Neill Springer-Verlag Berlin Heidelberg, 2006 , 2010, SIGA.

[20]  A. Topchy,et al.  Faster genetic programming based on local gradient search of numeric leaf values , 2001 .

[21]  Jens Gottlieb,et al.  Evolutionary Computation in Combinatorial Optimization , 2006, Lecture Notes in Computer Science.

[22]  Anthony Brabazon,et al.  Biologically inspired algorithms for financial modelling , 2006, Natural computing series.

[23]  Michael O'Neill,et al.  Biologically Inspired Algorithms for Financial Modelling (Natural Computing Series) , 2005 .