On lookahead and latent learning in simple LCS

Learning Classifier Systems use evolutionary algorithms to facilitate rule- discovery, where rule fitness is traditionally payoff based and assigned under a sharing scheme. Most current research has shifted to the use of an accuracy-based scheme where fitness is based on a rule's ability to predict the expected payoff from its use. Learning Classifier Systems which build anticipations of the expected states following their actions are also a focus of current research. This paper presents a simple but effective learning classifier system of this last type, using payoff-based fitness, with the aim of enabling the exploration of their basic principles, i.e., in isolation from the many other mechanisms they usually contain. The system is described and modeled, before being implemented. Comparisons to an equivalent accuracy-based system show similar performance. The use of self-adaptive mutation in such systems in general is then considered.

[1]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[2]  Larry Bull,et al.  ZCS Redux , 2002, Evolutionary Computation.

[3]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[4]  Stewart W. Wilson Classifier Systems and the Animat Problem , 1987, Machine Learning.

[5]  Larry Bull,et al.  On Using Constructivism in Neural Classifier Systems , 2002, PPSN.

[6]  Jan Drugowitsch An Algorithmic Description , 2008 .

[7]  Wolfgang Stolzmann,et al.  An Introduction to Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[8]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[9]  Stewart W. Wilson,et al.  Learning Classifier Systems, From Foundations to Applications , 2000 .

[10]  Larry Bull,et al.  Lookahead and Latent Learning in a Simple Accuracy-Based Classifier System , 2004, PPSN.

[11]  Martin V. Butz,et al.  Analysis and Improvement of Fitness Exploitation in XCS: Bounding Models, Tournament Selection, and Bilateral Accuracy , 2003, Evolutionary Computation.

[12]  Larry Bull,et al.  Lookahead And Latent Learning In ZCS , 2002, GECCO.

[13]  Thomas Bck,et al.  Self-adaptation in genetic algorithms , 1991 .

[14]  Larry Bull,et al.  A Self-Adaptive Classifier System , 2000, IWLCS.

[15]  Larry Bull,et al.  Self-adaptive mutation in classifier system controllers , 2000 .

[16]  Martin V. Butz,et al.  Introducing a Genetic Generalization Pressure to the Anticipatory Classifier System - Part 1: Theoretical approach , 2000, GECCO.

[17]  D. JohnH.HOLLAN CONCERNING THE EMERGENCE OF TAG-MEDIATED LOOKAHEAD IN CLASSIFIER SYSTEMS , 2002 .

[18]  Larry Bull,et al.  A Self-Adaptive XCS , 2001, IWLCS.

[19]  Olivier Sigaud,et al.  YACS: Combining Dynamic Programming with Generalization in Classifier Systems , 2000, IWLCS.

[20]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[21]  黃崇冀,et al.  Machine learning : an artificial intelligence approach , 1988 .

[22]  Martin V. Butz,et al.  Latent Learning and Action Planning in Robots with Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[23]  In Schoenauer,et al.  Parallel Problem Solving from Nature , 1990, Lecture Notes in Computer Science.

[24]  Larry Bull,et al.  Consideration of Multiple Objectives in Neural Learning Classifier Systems , 2002, PPSN.

[25]  H. Crichton-Miller Adaptation , 1926 .

[26]  Larry Bull,et al.  Simple Markov Models of the Genetic Algorithm in Classifier Systems: Multi-step Tasks , 2000, IWLCS.

[27]  Martin V. Butz,et al.  An Algorithmic Description of XCS , 2000, IWLCS.

[28]  Larry Bull,et al.  ZCS: Theory and practice: UWE Learning Classifier Systems Group Technical Report 01 , 2001 .

[29]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[30]  Larry Bull,et al.  Towards predicting spatial complexity: a learning classifier system approach to the identification of cellular automata , 2005, 2005 IEEE Congress on Evolutionary Computation.

[31]  N. Mackintosh The psychology of animal learning , 1974 .

[32]  Larry Bull,et al.  A Memetic Learning Classifier System for Describing Continuous-Valued Problem Spaces , 2005 .

[33]  Larry Bull,et al.  Two simple learning classifier systems , 2005 .

[34]  Lashon B. Booker,et al.  Triggered Rule Discovery in Classifier Systems , 1989, ICGA.

[35]  Rick L. Riolo,et al.  Lookahead planning and latent learning in a classifier system , 1991 .

[36]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[37]  Martin V. Butz,et al.  How XCS evolves accurate classifiers , 2001 .

[38]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[39]  J. P. Seward An experimental analysis of latent learning. , 1949, Journal of experimental psychology.

[40]  Larry Bull,et al.  Building anticipations in an accuracy-based learning classifier system by use of an artificial neural network , 2005, 2005 IEEE Congress on Evolutionary Computation.

[41]  Larry Bull,et al.  A Corporate Classifier System , 1998, PPSN.

[42]  Larry Bull,et al.  A neural learning classifier system with self-adaptive constructivism , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[43]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[44]  John H. Holland,et al.  Properties of the Bucket Brigade , 1985, ICGA.