A Knowledge-Intensive Genetic Algorithm for Supervised Learning

Supervised learning in attribute-based spaces is one of the most popular machine learning problems studied and, consequently, has attracted considerable attention of the genetic algorithm community. The full-memory approach developed here uses the same high-level descriptive language that is used in rule-based systems. This allows for an easy utilization of inference rules of the well-known inductive learning methodology, which replace the traditional domain-independent operators and make the search task-specific. Moreover, a closer relationship between the underlying task and the processing mechanisms provides a setting for an application of more powerful task-specific heuristics. Initial results obtained with a prototype implementation for the simplest case of single concepts indicate that genetic algorithms can be effectively used to process high-level concepts and incorporate task-specific knowledge. The method of abstracting the genetic algorithm to the problem level, described here for the supervised inductive learning, can be also extended to other domains and tasks, since it provides a framework for combining recently popular genetic algorithm methods with traditional problem-solving methodologies. Moreover, in this particular case, it provides a very powerful tool enabling study of the widely accepted but not so well understood inductive learning methodology.

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  Stephanie Forrest,et al.  Implementing Semantic Network Structures Using the Classifier System , 1985, ICGA.

[3]  David E. Goldberg,et al.  Genetic Algorithms and Rules Learning in Dynamic System Control , 1985, ICGA.

[4]  J. David Schaffer,et al.  Learning Multiclass Pattern Discrimination , 1985, ICGA.

[5]  Larry A. Rendell.  Genetic Plans and the Probabilistic Learning System: Synthesis and Results , 1985, ICGA.

[6]  Kenneth A. De Jong,et al.  Genetic algorithms: A 10 Year Perspective , 1985, ICGA.

[7]  Stephen F. Smith,et al.  A Genetic System for Learning Models of Consumer Choice , 1987, ICGA.

[8]  Peter Clark,et al.  Induction in Noisy Domains , 1987, EWSL.

[9]  H. J. Antonisse,et al.  Genetic Operators for High-Level Knowledge Representations , 1987, ICGA.

[10]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[11]  J. Ross Quinlan,et al.  An Empirical Comparison of Genetic and Decision-Tree Classifiers , 1988, ML.

[12]  Lashon B. Booker,et al.  Triggered Rule Discovery in Classifier Systems , 1989, ICGA.

[13]  Larry A. Rendell,et al.  Improving the design of similarity-based rule-learning systems , 1989 .

[14]  Sholom M. Weiss,et al.  An Empirical Comparison of Pattern Recognition, Neural Nets, and Machine Learning Classification Methods , 1989, IJCAI.

[15]  John R. Koza,et al.  Hierarchical Genetic Algorithms Operating on Populations of Computer Programs , 1989, IJCAI.

[16]  Kenneth A. De Jong,et al.  Using genetic algorithms for supervised concept learning , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[17]  J. R. Quinlan.  Probabilistic decision trees , 1990 .

[18]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[19]  Kenneth de Jong,et al.  Genetic-algorithm-based learning , 1990 .

[20]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[21]  Richard Wright,et al.  Application of a Genetic Classifier for Patient Triage , 1991, ICGA.

[22]  Kenneth A. De Jong,et al.  Learning Concept Classification Rules Using Genetic Algorithms , 1991, IJCAI.

[23]  Classifier System Learning of Boolean Concepts , 1991, ICGA.

[24]  Z. Michalewicz,et al.  Genetic algorithms for numerical optimization , 1991 .

[25]  John J. Grefenstette,et al.  Lamarckian Learning in Multi-Agent Environments , 1991, ICGA.

[26]  C. Janikow.  Inductive learning of decision rules from attribute-based examples: a knowledge-intensive genetic algorithm approach , 1992 .

[27]  Cezary Z. Janikow.  Some Experiments with a Stochastic Production System for Supervised Inductive Learning , 1992, AIMSA.

[28]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[29]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[30]  Stewart W. Wilson.  Classifier systems and the animat problem , 2004, Machine Learning.

[31]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.