DepthLimited crossover in GP for classifier evolution

Genetic Programming (GP) provides a novel way of classification with key features like transparency, flexibility and versatility. Presence of these properties makes GP a powerful tool for classifier evolution. However, GP suffers from code bloat, which is highly undesirable in case of classifier evolution. In this paper, we have proposed an operator named ''DepthLimited crossover''. The proposed crossover does not let trees increase in complexity while maintaining diversity and efficient search during evolution. We have compared performance of traditional GP with DepthLimited crossover GP, on data classification problems and found that DepthLimited crossover technique provides compatible results without expanding the search space beyond initial limits. The proposed technique is found efficient in terms of classification accuracy, reduced complexity of population and simplicity of evolved classifiers.

[1]  Ivanoe De Falco,et al.  Discovering interesting classification rules with genetic programming , 2002, Appl. Soft Comput..

[2]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[3]  Riccardo Poli,et al.  Fitness Causes Bloat , 1998 .

[4]  Mengjie Zhang,et al.  Using Genetic Programming for Multiclass Classification by Simultaneously Solving Component Binary Classification Problems , 2005, EuroGP.

[5]  Alex Alves Freitas,et al.  Evolving rule induction algorithms with multi-objective grammar-based genetic programming , 2009, Knowledge and Information Systems.

[6]  Lars Niklasson,et al.  Genetic programming - a tool for flexible rule extraction , 2007, 2007 IEEE Congress on Evolutionary Computation.

[7]  Alex Alves Freitas,et al.  Automatically Evolving Rule Induction Algorithms , 2006, ECML.

[8]  Sean Luke,et al.  Issues in Scaling Genetic Programming: Breeding Strategies, Tree Generation, and Bloat , 2000 .

[9]  Guillermo Leguizamón,et al.  Evolution of classification rules for comprehensible knowledge discovery , 2007, 2007 IEEE Congress on Evolutionary Computation.

[10]  Nikhil R. Pal,et al.  A novel approach to design classifiers using genetic programming , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Mengjie Zhang,et al.  Genetic programming for medical classification: a program simplification approach , 2008, Genetic Programming and Evolvable Machines.

[12]  Satoshi Sato,et al.  Non-destructive Depth-Dependent Crossover for Genetic Programming , 1998, EuroGP.

[13]  William B. Langdon,et al.  Size Fair and Homologous Tree Crossovers for Tree Genetic Programming , 2000, Genetic Programming and Evolvable Machines.

[14]  Stephan M. Winkler,et al.  Using enhanced genetic programming techniques for evolving classifiers in the context of medical diagnosis , 2009, Genetic Programming and Evolvable Machines.

[15]  Andries P. Engelbrecht,et al.  A Building Block Approach to Genetic Programming for Rule Discovery , 2002 .

[16]  Alex A. Freitas,et al.  A Genetic Programming Framework for Two Data Mining Tasks: Classification and Generalized Rule Induction , 1997 .

[17]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[18]  Vic Ciesielski,et al.  Representing classification problems in genetic programming , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[19]  Athanasios Tsakonas,et al.  A comparison of classification accuracy of four genetic programming-evolved intelligent structures , 2006, Inf. Sci..

[20]  Walter Alden Tackett,et al.  Recombination, selection, and the genetic construction of computer programs , 1994 .

[21]  Conor Ryan,et al.  On the constructiveness of context-aware crossover , 2007, GECCO '07.

[22]  Terence Soule,et al.  An Analysis of the Causes of Code Growth in Genetic Programming , 2002, Genetic Programming and Evolvable Machines.

[23]  Mengjie Zhang,et al.  Multiclass Object Classification Using Genetic Programming , 2004, EvoWorkshops.

[24]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[25]  Jeroen Eggermont,et al.  Data Mining using Genetic Programming : Classification and Symbolic Regression , 2005 .

[26]  Lalit M. Patnaik,et al.  Application of genetic programming for multicategory pattern classification , 2000, IEEE Trans. Evol. Comput..

[27]  H. Iba,et al.  Depth-dependent crossover for genetic programming , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[28]  B. W.,et al.  Size Fair and Homologous Tree Genetic Programming Crossovers , 1999 .