Learning Classification Programs: The Genetic Algorithm Approach

Genetic Algorithms have been proposed by many authors for Machine Learning tasks. In fact, they are appealing for several different reasons, such as the flexibility, the great exploration power, and the possibility of exploiting parallel processing. Nevertheless, it is still controversial whether the genetic approach can really provide effective solutions to learning tasks, in comparison to other algorithms based on classical search strategies. In this paper we try to clarify this point and we overview the work done with respect to the task of learning classification programs from examples. The state of the art emerging from our analysis suggests that the genetic approach can be a valuable alternative to classical approaches, even if further investigation is necessary in order to come to a final conclusion.

[1]  Peter D. Turney,et al.  Evolution, Learning, and Instinct: 100 Years of the Baldwin Effect , 1996, Evolutionary Computation.

[2]  Marco Botta,et al.  SMART+: A Multi-Strategy Learning Tool , 1993, IJCAI.

[3]  Filippo Neri,et al.  An Analysis of the Universal Suffrage Selection Operator , 1996, Evolutionary Computation.

[4]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[5]  Peter Nordin,et al.  The Effect of Extensive Use of the Mutation Operator on Generalization in Genetic Programming Using Sparse Data Sets , 1996, PPSN.

[6]  Nikolay I. Nikolaev,et al.  Inductive Genetic Programming with Decision Trees , 1997, Intell. Data Anal..

[7]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[8]  Lorenza Saitta,et al.  A Coevolutionary Approach to Concept Learning , 1997, ISMIS.

[9]  Peter Ross,et al.  Dynamic Training Subset Selection for Supervised Learning in Genetic Programming , 1994, PPSN.

[10]  Sankar K. Pal,et al.  Genetic Algorithms for Pattern Recognition , 2017 .

[11]  Shumeet Baluja,et al.  The Evolution of Gennetic Algorithms: Towards Massive Parallelism , 1993, ICML.

[12]  Gilles Venturini,et al.  SIA: A Supervised Inductive Algorithm with Genetic Search for Learning Attributes based Concepts , 1993, ECML.

[13]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[14]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[15]  Thomas G. Dietterich,et al.  Learning to Predict Sequences , 1985 .

[16]  Sandip Sen,et al.  Newboole: A Fast GBML System , 1990, ML.

[17]  Hitoshi Iba,et al.  Genetic Programming with Local Hill-Climbing , 1994, PPSN.

[18]  Stan Matwin,et al.  Genetic algorithms approach to a negotiation support system , 1991, IEEE Trans. Syst. Man Cybern..

[19]  Christoph F. Eick,et al.  Deriving Queries from Results Using Genetic Programming , 1996, KDD.

[20]  J. Ross Quinlan,et al.  An Empirical Comparison of Genetic and Decision-Tree Classifiers , 1988, ML.

[21]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[22]  Marco Dorigo,et al.  Genetics-based machine learning and behavior-based robotics: a new synthesis , 1993, IEEE Trans. Syst. Man Cybern..

[23]  John R. Koza,et al.  Concept Formation and Decision Tree Induction Using the Genetic Programming Paradigm , 1990, PPSN.

[24]  Cosimo Anglano,et al.  Coevolutionary, Distributed Search for Inducing Concept Description , 1998, ECML.

[25]  Jukka Hekanaho,et al.  GA-Based Rule Enhancement in Concept Learning , 1997, KDD.

[26]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[27]  Filippo Neri,et al.  Search-Intensive Concept Induction , 1995, Evolutionary Computation.

[28]  Gilles Venturini,et al.  Learning First Order Logic Rules with a Genetic Algorithm , 1995, KDD.

[29]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[30]  Ryszard S. Michalski,et al.  Pattern Recognition as Rule-Guided Inductive Inference , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[32]  Chrisila C. Pettey,et al.  A Theoretical Investigation of a Parallel Genetic Algorithm , 1989, ICGA.

[33]  J. David Schaffer,et al.  Multi-Objective Learning via Genetic Algorithms , 1985, IJCAI.

[34]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[35]  Stephen F. Smith,et al.  Flexible Learning of Problem Solving Heuristics Through Adaptive Search , 1983, IJCAI.

[36]  Jukka Hekanaho.  Background Knowledge in GA-based Concept Learning , 1996, ICML.

[37]  John R. Koza,et al.  Genetic programming II (videotape): the next generation , 1994 .

[38]  Nicholas J. Radcliffe,et al.  A Genetic Algorithm-Based Approach to Data Mining , 1996, KDD.

[39]  Cosimo Anglano,et al.  A Network Genetic Algorithm for Concept Learning , 1997, ICGA.

[40]  Tanja Urbancic,et al.  Genetic algorithms in controller design and tuning , 1993, IEEE Trans. Syst. Man Cybern..

[41]  Jukka Hekanaho,et al.  Symbiosis in Multimodal Concept Learning , 1995, ICML.

[42]  Andrew McCallum,et al.  Using Genetic Algorithms to Learn Disjunctive Rules from Examples , 1990, ML.

[43]  J. R. Quinlan,et al.  Induction over large data bases , 1979 .

[44]  Lorenza Saitta,et al.  Learning Disjunctive Concepts by Means of Genetic Algorithms , 1994, ICML.

[45]  John J. Grefenstette,et al.  A Coevolutionary Approach to Learning Sequential Decision Rules , 1995, ICGA.

[46]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[47]  Donald E. Brown,et al.  A Parallel Genetic Heuristic for the Quadratic Assignment Problem , 1989, ICGA.

[48]  David W. Opitz,et al.  Using Genetic Search to Refine Knowledge-based Neural Networks , 1994, ICML.