A new bidding strategy in LCS using a decentralized loaning and bid history

In a strength based learning classifier systems (LCS), auctioning among classifiers that match to an environmental message has been used as a way of identifying winner classifiers. All classifiers participating in an auction issue a bid proportional to their strength and a winner classifier is allowed to fire and receive a reward or punishment from its environment as a consequence of its action. In this kind of bidding strategy, good classifiers with low strength and little experience have to wait until the strength of less useful classifiers has come down through continuous taxation. This slows down the convergence of the learning system to the optimal solution sets. In addition, offspring classifiers that come from weak parents as a result of randomness in the selection process may inherit a small strength as compared to experienced classifiers in the population. A mutation occurring at a point may however make them better match to more environmental inputs. But due to a low initial strength they have to wait for some time till they mature and try their action. This paper introduced a decentralized loaning approach to mitigate the above shortcomings of the bidding strategy in traditional LCS. Loaning among classifiers in the population is allowed. In direct analogy with real auctions, all classifiers matching the current input compare the average bid history with their potential bid based on their current strength. The average bid history parameter gives general information about the bid market (potential of competent classifiers) and determines the amount of loan a classifier should ask. The results obtained show a significant improvement on the performance of the system.

[1]  Martin V. Butz,et al.  Toward a theory of generalization and learning in XCS , 2004, IEEE Transactions on Evolutionary Computation.

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  Marco Colombetti,et al.  What Is a Learning Classifier System? , 1999, Learning Classifier Systems.

[4]  Stewart W. Wilson.  Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[5]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[6]  David E. Goldberg,et al.  Reinforcement learning with classifier systems , 1990, Proceedings [1990]. AI, Simulation and Planning in High Autonomy Systems.

[7]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[8]  Larry Bull,et al.  A zeroth level corporate classifier system , 1999 .

[9]  Stewart W. Wilson.  Knowledge Growth in an Artificial Animal , 1985, ICGA.

[10]  David J. Slate,et al.  Letter Recognition Using Holland-Style Adaptive Classifiers , 1991, Machine Learning.

[11]  Tim Kovacs.  Strength or accuracy: credit assignment in learning classifier systems , 2003 .

[12]  Abdollah Homaifar,et al.  Boolean Function Learning With A Classifier System , 1988, Defense, Security, and Sensing.

[13]  Abdollah Homaifar,et al.  Robust bidding in LCS using loan and bid history , 2010, 2010 IEEE Aerospace Conference.

[14]  G. Robertson,et al.  A Tale of Two Classifier Systems , 2005, Machine Learning.

[15]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[16]  Lashon B. Booker,et al.  Intelligent Behavior as an Adaptation to the Task Environment , 1982 .

[17]  Paul Thagard,et al.  Induction: Processes Of Inference , 1989 .

[18]  W. Marsden.  I and J , 2012 .

[19]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[20]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[21]  John H. Holland,et al.  COGNITIVE SYSTEMS BASED ON ADAPTIVE ALGORITHMS1 , 1978 .

[22]  David E. Goldberg,et al.  A Critical Review of Classifier Systems , 1989, ICGA.

[23]  Gunar E. Liepins,et al.  A Classifier Based System for Discovering Scheduling Heuristics , 1987, ICGA.

[24]  Stewart W. Wilson.  ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.