The Anticipatory Classiier System and Genetic Generalization the Anticipatory Classiier System and Genetic Generalization

The anticipatory classiier system (ACS) combines the learning classi-er system framework with the learning theory of anticipatory behavioral control. The result is an evolutionary system that builds an environmental model and further applies reinforcement learning techniques to form an optimal behavioral policy in the model. After providing some background as well as outlining the objectives of the system, we explain in detail all involved current processes. Furthermore, we analyze the deeciency of over-specialization in the anticipatory learning process (ALP), the main learning mechanism in the ACS. Consequently, we introduce a genetic algorithm (GA) to the ACS that is meant for generalization of over-specialized clas-siiers. We show that it is possible to form a symbiosis between a directed specialization and a genetic generalization mechanism achieving a learning mechanism that evolves a complete, accurate, and compact description of a perceived environment. Results in three diierent environmental settings connrm the usefulness of the genetic algorithm in the ACS. Finally, we discuss future research directions with the ACS and anticipatory systems in general.

[1]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[2]  D. Goldberg,et al.  First Cognitive Capabilities in the Anticipatory Classifier System , 2000 .

[3]  Marco Colombetti,et al.  Robot Shaping: An Experiment in Behavior Engineering , 1997 .

[4]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[5]  John H. Holland,et al.  CONCERNING THE EMERGENCE OF TAG-MEDIATED LOOKAHEAD , 1990 .

[6]  In Schoenauer,et al.  Parallel Problem Solving from Nature , 1990, Lecture Notes in Computer Science.

[7]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  J. Grefenstette.  Credit Assignment in Rule Discovery Systems Based on Genetic Algorithms , 2005, Machine Learning.

[10]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[11]  Larry Bull,et al.  A Corporate XCS , 1999, Learning Classifier Systems.

[12]  A. Zeman.  Attentional Processing. The Brain's Art of Mindfulness , 1996 .

[13]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[14]  J. P. Seward.  An experimental analysis of latent learning. , 1949, Journal of experimental psychology.

[15]  er SystemsTim KovacsOctober.  Evolving Optimal Populations with XCS Classi , 1996 .

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  Richard S. Sutton,et al.  Reinforcement learning architectures for animats , 1991 .

[18]  Dave Cliff,et al.  Adding Temporary Memory to ZCS , 1994, Adapt. Behav..

[19]  Pier Luca Lanzi,et al.  Learning classifier systems from a reinforcement learning perspective , 2002, Soft Comput..

[20]  David E. Goldberg,et al.  Introducing a Genetic Generalization Pressure to the Anticipatory Classiier System Part 2: Performance Analysis Introducing a Genetic Generalization Pressure to the Anticipatory Classiier System Part 2: Performance Analysis , 2007 .

[21]  John H. Holland,et al.  Properties of the bucket brigade algorithm , 1985 .

[22]  Gary L. Drescher,et al.  Made-up minds - a constructivist approach to artificial intelligence , 1991 .

[23]  Stewart W. Wilson.  ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[24]  D. JohnH.HOLLAN.  CONCERNING THE EMERGENCE OF TAG-MEDIATED LOOKAHEAD IN CLASSIFIER SYSTEMS , 2002 .

[25]  Stewart W. Wilson.  Get Real! XCS with Continuous-Valued Inputs , 1999, Learning Classifier Systems.

[26]  Martin V. Butz,et al.  Introducing a Genetic Generalization Pressure to the Anticipatory Classifier System - Part 1: Theoretical approach , 2000, GECCO.

[27]  T. Kovacs.  XCS Classifier System Reliably Evolves Accurate, Complete, and Minimal Representations for Boolean Functions , 1998 .

[28]  F. W. Irwin.  Purposive Behavior in Animals and Men , 1932, The Psychological Clinic.

[29]  Rick L. Riolo,et al.  Lookahead planning and latent learning in a classifier system , 1991 .

[30]  Martin V. Butz,et al.  Latent Learning and Action Planning in Robots with Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[31]  Dana H. Ballard,et al.  Learning to Perceive and Act , 1990 .

[32]  P. Lanzi,et al.  Adaptive Agents with Reinforcement Learning and Internal Memory , 2000 .

[33]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.