A hybrid model for learning sequential navigation

To deal with reactive sequential decision tasks, we present a learning model CLARION, which is a hybrid connectionist model consisting of both localist and distributed representations, based on the two-level approach proposed in Sun (1995). The model learns and utilizes procedural and declarative knowledge, tapping into the synergy of the two types of processes. It unifies neural, reinforcement, and symbolic methods to perform online, bottom-up learning. Experiments in various situations are reported that shed light on the working of the model.

[1]  Richard S. Sutton,et al.  Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming , 1990, ML.

[2]  John R. Anderson.  The Architecture of Cognition , 1983 .

[3]  Daniel B. Willingham,et al.  On the development of procedural knowledge. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[5]  Peter Bullemer,et al.  On the development of procedural knowledge. , 1989 .

[6]  G. Tesauro.  Practical Issues in Temporal Difference Learning , 1992 .

[7]  P. Smolensky.  On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[8]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[9]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[10]  TesauroGerald.  Practical Issues in Temporal Difference Learning , 1992 .

[11]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[12]  Ron Sun,et al.  On Variable Binding in Connectionist Networks , 1992 .

[13]  H. Dreyfus.  Mind Over Machine , 1986 .

[14]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[15]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[16]  Allen Newell,et al.  A Preliminary Analysis of the Soar Architecture as a Basis for General Intelligence , 1991, Artif. Intell..

[17]  Ron Sun,et al.  Robust Reasoning: Integrating Rule-Based and Similarity-Based Reasoning , 1995, Artif. Intell..

[18]  F. Keil.  Concepts, Kinds, and Cognitive Development , 1989 .

[19]  J. Shavlik,et al.  Extracting Reened Rules from Knowledge-based Neural Networks Keywords: Theory Reenement Integrated Learning Representational Shift Rule Extraction from Neural Networks , 1992 .

[20]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..