Chapter 16. Insertion of Prior Knowledge

In this chapter we focus on methods for injecting prior knowledge (represented in the form of nite automata) into adaptive recurrent networks. Several algorithms and architectures are described, including rst-order, second-order, and RBF-based recurrent neural nets.

[1]  N. S. Barnett,et al.  Private communication , 1969 .

[2]  Michael, G. Thomason,et al.  Deterministic Acceptors of Regular Fuzzy Languages , 1974, IEEE Trans. Syst. Man Cybern..

[3]  Van Nam Tran,et al.  Syntactic pattern recognition , 1978 .

[4]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[5]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[6]  M. W. Shields.  An Introduction to Automata Theory , 1988 .

[7]  Giovanni Soda,et al.  An unified approach for integrating explicit knowledge and learning by example in recurrent networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[8]  Y. C. Lee,et al.  Turing equivalence of neural networks with second order connection weights , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[9]  Giovanni Soda,et al.  Local Feedback Multilayered Networks , 1992, Neural Computation.

[10]  James C. Bezdek,et al.  Numerical convergence and interpretation of the fuzzy c-shells clustering algorithm , 1992, IEEE Trans. Neural Networks.

[11]  Padhraic Smyth,et al.  Learning Finite State Machines With Self-Clustering Recurrent Networks , 1993, Neural Computation.

[12]  Michael C. Mozer,et al.  A Unified Gradient-Descent/Clustering Architecture for Finite State Machine Induction , 1993, NIPS.

[13]  C. Lee Giles,et al.  Extraction, Insertion and Refinement of Symbolic Rules in Dynamically Driven Recurrent Neural Networks , 1993 .

[14]  John F. Kolen,et al.  Fool's Gold: Extracting Finite State Machines from Recurrent Network Dynamics , 1993, NIPS.

[15]  Emdad Khan,et al.  Recurrent Fuzzy Logic Using Neural Network , 1994, IEEE/Nagoya-University World Wisepersons Workshop.

[16]  J. Grantner,et al.  Synthesis and analysis of fuzzy logic finite state machine models , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[17]  Stefan C. Kremer,et al.  On the computational power of Elman-style recurrent networks , 1995, IEEE Trans. Neural Networks.

[18]  Peter Tiňo,et al.  Finite State Machines and Recurrent Neural Networks -- Automata and Dynamical Systems Approaches , 1995 .

[19]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[20]  Giovanni Soda,et al.  Recurrent neural networks and prior knowledge for sequence processing: a constrained nondeterministic approach , 1995, Knowl. Based Syst..

[21]  Mike Casey,et al.  The Dynamics of Discrete-Time Computation, with Application to Recurrent Neural Networks and Finite State Machine Extraction , 1996, Neural Computation.

[22]  Don R. Hush,et al.  Bounds on the complexity of recurrent neural network implementations of finite state machines , 1993, Neural Networks.

[23]  Alessandro Sperduti,et al.  On the Computational Power of Recurrent Neural Networks for Structures , 1997, Neural Networks.