Creiit Assignment in Genetic Learning Syste

Credit assignment problems arise when long sequences of rules fire between successive external rewards. Two distinct approaches to rule learning with genetic algorithms have been developed, each approach offering a useful solution to a different level of the credit assignment problem. We present a system, called RUDI, that combines features from both approaches. Experimental results are presented that support the hypothesis that multiple levels of credit assignment can improve the performance of rule learning systems based on genetic algorithms.

[1]  John J. Grefenstette,et al.  Csm: a genetic classifier system with memory for learning by analogy , 1987 .

[2]  John R. Anderson,et al.  A Learning System and Its Psychological Implications , 1979, IJCAI.

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Rick L. Riolo,et al.  Bucket Brigade Performance: I. Long Sequences of Classifiers , 1987, ICGA.

[5]  Alan Bundy,et al.  Proceedings of the Eighth International Joint Conference on Artificial Intelligence , 1983 .

[6]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[7]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[8]  John H. Holland,et al.  COGNITIVE SYSTEMS BASED ON ADAPTIVE ALGORITHMS1 , 1978 .

[9]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[10]  Donald A. Waterman,et al.  Pattern-Directed Inference Systems , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Stephen F. Smith,et al.  Flexible Learning of Problem Solving Heuristics Through Adaptive Search , 1983, IJCAI.

[12]  Pat Langley,et al.  Learning Effective Search Heuristics , 1983, IJCAI.

[13]  David E. Goldberg,et al.  Dynamic System Control Using Rule Learning and Genetic Algorithms , 1985, IJCAI.

[14]  Stewart W. Wilson.  Hierarchical Credit Allocation in a Classifier System , 1987, IJCAI.

[15]  Kenneth A. De Jong,et al.  On Using Genetic Algorithms to Search Program Spaces , 1987, ICGA.

[16]  Tom M. Mitchell,et al.  Learning from Solution Paths: An Approach to the Credit Assignment Problem , 1982, AI Mag..

[17]  J. David Schaffer,et al.  Multi-Objective Learning via Genetic Algorithms , 1985, IJCAI.

[18]  Lashon B. Booker,et al.  Intelligent Behavior as an Adaptation to the Task Environment , 1982 .