Recurrent neural networks: A constructive algorithm, and its properties

Abstract In this paper, a constructive algorithm for a general recurrent neural network is proposed based on radial basis functions. It is shown that this algorithm is globally convergent. In addition, we will present two examples to illustrate the proposed method.

[1]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[2]  Ah Chung Tsoi,et al.  Discrete time recurrent neural network architectures: A unifying review , 1997, Neurocomputing.

[3]  Ah Chung Tsoi,et al.  Locally recurrent globally feedforward networks: a critical review of architectures , 1994, IEEE Trans. Neural Networks.

[4]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[5]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[6]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[7]  Gene H. Golub,et al.  Matrix computations , 1983 .

[8]  Giovanni Soda,et al.  Local Feedback Multilayered Networks , 1992, Neural Computation.

[9]  Ah Chung Tsoi,et al.  FIR and IIR Synapses, a New Neural Network Architecture for Time Series Modeling , 1991, Neural Computation.

[10]  Shlomo Geva,et al.  A constructive method for multivariate function approximation by multilayer perceptrons , 1992, IEEE Trans. Neural Networks.

[11]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[12]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[13]  Stephen M. Omohundro,et al.  Bumptrees for Efficient Function, Constraint and Classification Learning , 1990, NIPS.

[14]  Steve Renals.  Speech and neural network dynamics , 1990 .

[15]  Pierre Roussel-Ragot,et al.  Neural Networks and Nonlinear Adaptive Filtering: Unifying Concepts and New Algorithms , 1993, Neural Computation.

[16]  José Carlos Príncipe,et al.  A Theory for Neural Networks with Time Delays , 1990, NIPS.