A Genetic Prototype Learner

Supervised classification problems have received considerable attention from the machine learning community. We propose a novel genetic algorithm based prototype learning system, PLEASE, for this class of problems. Given a set of prototypes for each of the possible classes, the class of an input instance is determined by the prototype nearest to this instance. We assume ordinal attributes and prototypes are represented as sets of feature-value pairs. A genetic algorithm is used to evolve the number of prototypes per class and their positions on the input space as determined by corresponding feature-value pairs. Comparisons with C4.5 on a set of artificial problems of controlled complexity demonstrate the effectiveness of the proposed system.

[1]  David E. Goldberg,et al.  Real-coded Genetic Algorithms, Virtual Alphabets, and Blocking , 1991, Complex Syst..

[2]  L. Darrell Whitley,et al.  The GENITOR Algorithm and Selection Pressure: Why Rank-Based Allocation of Reproductive Trials is Best , 1989, ICGA.

[3]  Kenneth de Jong,et al.  Genetic-algorithm-based learning , 1990 .

[4]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[5]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[6]  Sandip Sen,et al.  Using real-valued genetic algorithms to evolve rule sets for classification , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[7]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[8]  D. E. Goldberg,et al.  Genetic Algorithms in Search, Optimization & Machine Learning , 1989 .

[9]  R. Shepard.  Representation of structure in similarity data: Problems and prospects , 1974 .

[10]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[11]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[12]  A. Ortony,et al.  Similarity and Analogical Reasoning , 1991 .

[13]  Lance J. Rips,et al.  A psychological approach to concepts: Comments on Rey's “Concepts and stereotypes” , 1984, Cognition.

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[16]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[17]  Sandip Sen,et al.  PLEASE: A Prototype Learning System Using Genetic Algorithms , 1995, ICGA.

[18]  James Kelly,et al.  AutoClass: A Bayesian Classification System , 1993, ML.

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  Lawrence Davis,et al.  A Hybrid Genetic Algorithm for Classification , 1991, IJCAI.

[21]  David L. Waltz,et al.  Toward memory-based reasoning , 1986, CACM.

[22]  Edward E. Smith.  Concepts and induction , 1989 .

[23]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[24]  Dale T. Miller,et al.  Norm theory: Comparing reality to its alternatives , 1986 .

[25]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[26]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .