A survey of modularity in genetic programming

Here, in this paper, we survey work on modularity in Genetic Programming GP. The motivation for modularity was driven by research efforts, as we shall see, to make gp programs smaller and more efficient. In the literature, modularity has commonly used Koza's term, Automatically Defined Functions ADF. But, we shall see, that the modularity concept has undergone many name and design changes. From the early ideas of Koza and Price's Defined Building Blocks DBB to Binard and Felty's work with System F and GP Briggs and O'Neill's work with Combinators in GP. Our goal in this paper is to survey the literature on this evolution. This will include Automatically Defined Functions ADFs, Automatically Defined Macros ADM, Adaptive Representation Through Learning ARL, Module Acquisition MA, Hierarchically Defined Local Modules HGP, Higher Order Functions using λ calculus LC and Combinators. We also include critiques by researchers on the viability these various efforts.

[1]  Forrest Briggs,et al.  Functional genetic programming and exhaustive program search with combinator expressions , 2008, Int. J. Knowl. Based Intell. Eng. Syst..

[2]  John R. Koza,et al.  Automatic Programming of Robots Using Genetic Programming , 1992, AAAI.

[3]  Forrest Briggs,et al.  Functional Genetic Programming with Combinators , 2006 .

[4]  R. Hindley,et al.  History of Lambda-calculus and Combinatory Logic , 2006 .

[5]  Tina Yu,et al.  Performance-Enhanced Genetic Programming , 1997, Evolutionary Programming.

[6]  J. A. Robinson,et al.  A Machine-Oriented Logic Based on the Resolution Principle , 1965, JACM.

[7]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[8]  Christopher D. Clack,et al.  PolyGP: a polymorphic genetic programming system in Haskell , 1997 .

[9]  R. Rosen.  Life Itself: A Comprehensive Inquiry Into the Nature, Origin, and Fabrication of Life , 1991 .

[10]  Walter Alden Tackett,et al.  Recombination, selection, and the genetic construction of computer programs , 1994 .

[11]  John C. Reynolds,et al.  Towards a theory of type structure , 1974, Symposium on Programming.

[12]  Antonina Starita,et al.  An Analysis of Automatic Subroutine Discovery in Genetic Programming , 1999, GECCO.

[13]  C. Clack,et al.  Recursion , Lambda Abstractions and Genetic Programming , 2022 .

[14]  J. K. Kinnear,et al.  Alternatives in automatic function definition: a comparison of performance , 1994 .

[15]  L. Altenberg.  The evolution of evolvability in genetic programming , 1994 .

[16]  J. Pollack,et al.  The Evolutionary Induction of Subroutines , 1997 .

[17]  Tina Yu,et al.  Structure abstraction and genetic programming , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[18]  David Andre,et al.  Evolution of mapmaking: learning, planning, and memory using genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[19]  Cezary Z. Janikow,et al.  Impact of commutative and non-commutative functions on symbolic regression with ACGP , 2013, 2013 IEEE Congress on Evolutionary Computation.

[20]  Justinian P. Rosca,et al.  Discovery of subroutines in genetic programming , 1996 .

[21]  A. Church.  A Set of Postulates for the Foundation of Logic , 1932 .

[22]  Peter J. Angeline,et al.  Evolutionary Module Acquisition , 1993 .

[23]  Hitoshi Iba,et al.  Genetic programming using a minimum description length principle , 1994 .

[24]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[25]  Wolfgang Banzhaf,et al.  Hierarchical Genetic Programming using Local Modules , 2001 .

[26]  John R. Koza,et al.  Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems , 1990 .

[27]  Franck Binard,et al.  Abstraction-based genetic programming , 2009 .

[28]  Dov M. Gabbay,et al.  Logic from Russell to Church , 2009, Handbook of the History of Logic.

[29]  Tina Gwoing Yu,et al.  An analysis of the impact of functional programming techniques on genetic programming , 1999 .

[30]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[31]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[32]  Amy P. Felty,et al.  An abstraction-based genetic programming system , 2007, GECCO '07.

[33]  Amy P. Felty,et al.  Genetic programming with polymorphic types and higher-order functions , 2008, GECCO '08.

[34]  John R. Woodward,et al.  Modularity in Genetic Programming , 2003, EuroGP.

[35]  Lee Spector,et al.  Evolving Control Structures with Automatically Defined Macros , 2001 .

[36]  Tomoya Suzuki,et al.  An Encoding Scheme for Generating lambda-Expressions in Genetic Programming , 2003, GECCO.

[37]  Justinian P. Rosea.  Towards Automatic Discovery of Building Blocks in Genetic Programming , 1995 .