Dynamic backpropagation algorithm for neural network controlled resonator-bank architecture

An adaptive processing system that consists of a resonator-based digital filter and a neural network is presented. The filter section realizes the dynamics of the adaptive system, while the transfer characteristics are controlled by the neural network. The author focuses on online training algorithms that can create an association between features of the input signal of the neural network and dynamic responses of the digital filter. A dynamic back propagation algorithm is derived for training the network in closed-loop configurations, when a feedback path exists between the output of the digital filter section and inputs to the neural network. Simulation results show that the neural network controlled resonator-bank architecture is computationally feasible and can be used as a general building block in a wide range of identification and control problems. >

[1]  Luís B. Almeida,et al.  A learning rule for asynchronous perceptrons with feedback in a combinatorial environment , 1990 .

[2]  A.M. Peterson,et al.  Frequency domain least-mean-square algorithm , 1981, Proceedings of the IEEE.

[3]  Gunter Stein,et al.  ADAPTIVE FLIGHT CONTROL: A PRAGMATIC VIEW , 1980 .

[4]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[5]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[6]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[7]  B. Widrow,et al.  The truck backer-upper: an example of self-learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[8]  PAUL J. WERBOS,et al.  Generalization of backpropagation with application to a recurrent gas market model , 1988, Neural Networks.

[9]  Bernard Widrow,et al.  Layered neural nets for pattern recognition , 1988, IEEE Trans. Acoust. Speech Signal Process..

[10]  Janos Sztipanovits.  Adaptive processing with neural network controlled resonator-banks , 1990 .

[11]  Bernard Widrow,et al.  On the statistical efficiency of the LMS algorithm with nonstationary inputs , 1984, IEEE Trans. Inf. Theory.

[12]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[13]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[14]  Pineda,et al.  Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.

[15]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[16]  M. Kawato,et al.  Hierarchical neural network model for voluntary movement with application to robotics , 1988, IEEE Control Systems Magazine.

[17]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[18]  Michael I. Jordan.  Supervised learning and systems with excess degrees of freedom , 1988 .

[19]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[20]  C. K. Yuen,et al.  Theory and Application of Digital Signal Processing , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  G. Péceli.  Resonator-based digital filters , 1989 .