Anticipation mappings for learning classifier systems

In this paper, we study the use of anticipation mappings in learning classifier systems. At first, we enrich the extended classifier system (XCS) with two types of anticipation mappings: one based on array of perceptrons array, one based on neural networks. We apply XCS with anticipation mappings (XCSAM) to several multistep problems taken from the literature and compare its anticipatory performance with that of the neural classifier system X-NCS which is based on a similar approach. Our results show that, although XCSAM is not a "true" anticipatory classifier system like ACS, MACS, or X-NCS, nevertheless XCSAM can provide accurate anticipatory predictions while requiring smaller populations than those needed by X-NCS.

[1]  Stewart W. Wilson Generalization in the XCS Classifier System , 1998 .

[2]  Dave Cliff,et al.  Adding Temporary Memory to ZCS , 1994, Adapt. Behav..

[3]  Wolfgang Stolzmann,et al.  An Introduction to Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[4]  Michael L. Littman,et al.  An optimization-based categorization of reinforcement learning environments , 1993 .

[5]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[6]  Anthony J. Bagnall,et al.  On the Classification of Maze Problems , 2005 .

[7]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[8]  Stewart W. Wilson,et al.  Toward Optimal Classifier System Performance in Non-Markov Environments , 2000, Evolutionary Computation.

[9]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[10]  Pier Luca Lanzi Estimating Classifier Generalization and Action's Effect: A Minimalist Approach , 2003, GECCO.

[11]  Rick L. Riolo,et al.  Lookahead planning and latent learning in a classifier system , 1991 .

[12]  Stewart W. Wilson Classifiers that approximate functions , 2002, Natural Computing.

[13]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[14]  Martin V. Butz,et al.  Gradient descent methods in learning classifier systems: improving XCS performance in multistep problems , 2005, IEEE Transactions on Evolutionary Computation.

[15]  LanziPier Luca An analysis of generalization in the xcs classifier system , 1999 .

[16]  Martin V. Butz,et al.  Anticipatory Learning Classifier Systems , 2002, Genetic Algorithms and Evolutionary Computation.

[17]  Larry Bull,et al.  Building anticipations in an accuracy-based learning classifier system by use of an artificial neural network , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  Pier Luca Lanzi,et al.  Learning classifier systems from a reinforcement learning perspective , 2002, Soft Comput..

[19]  Larry Bull,et al.  Accuracy-based Neuro And Neuro-fuzzy Classifier Systems , 2002, GECCO.

[20]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[21]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[22]  Daniele Loiacono,et al.  XCS with computed prediction for the learning of Boolean functions , 2005, 2005 IEEE Congress on Evolutionary Computation.

[23]  Daniele Loiacono,et al.  XCS with computed prediction in continuous multistep environments , 2005, 2005 IEEE Congress on Evolutionary Computation.