Learning complex combinations of operations in a hybrid architecture

The reasons why machine learning appears limited to the relatively simple control problems are analyzed. A primary issue is that, any condition detected by a learning system acquires multiple behavioural meanings. As the learning continues, the need to preserve these meanings severely constrains the architectural form of the system. A hybrid architecture called the recommendation architecture in which the preservation of such meanings is explicitly managed is compared with a wide range of alternative learning approaches. It is concluded that systems with this recommendation architecture have the capability to learn to solve the complex control problems.

[1]  Tom Gedeon,et al.  Application of the Recommendation Architecture for discovering associative similarities in text , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[2]  L. Andrew Coward The recommendation architecture: lessons from large-scale electronic systems applied to cognition , 2001, Cognitive Systems Research.

[3]  James A. Anderson,et al.  If we compute faster, do we understand better? , 1997 .

[4]  L. Andrew Coward A Functional Architecture Approach to Neural Systems , 2000 .

[5]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[6]  James P. Crutchfield Dynamical Embodiments of Computation in Cognitive Processes , 1998 .

[7]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[8]  Anthony V. Robins,et al.  Catastrophic Forgetting, Rehearsal and Pseudorehearsal , 1995, Connect. Sci..

[9]  Charles W. Anderson,et al.  Reinforcement Learning with Modular Neural Networks for Control , 1994 .

[10]  R. French Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[11]  L. Andrew Coward,et al.  Pattern Thinking , 1990 .

[12]  Bai-ling Zhang,et al.  Results of simulations of a system with the recommendation architecture , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[13]  José Carlos Príncipe,et al.  Information Theoretic Clustering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Tamás D. Gedeon,et al.  Application of the Recommendation Architecture to Telecommunications Network Management , 2001, Int. J. Neural Syst..

[15]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[16]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.