Meta-Learning for Adaptive Identification of Non-Linear Dynamical Systems

Adaptive identification of non-linear dynamical systems via recurrent neural networks (RNNs) is presented in this paper. We explore the notion that a fixed-weight RNN needs to change only its internal state to change its behavior policy. This ability is acquired through prior training procedure that enable the learning of adaptive behaviors. Some simulation results are presented

[1]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Lee A. Feldkamp,et al.  Adaptive Behavior from Fixed Weight Networks , 1997, Inf. Sci..

[3]  Amir F. Atiya,et al.  Application of the recurrent multilayer perceptron in modeling complex process dynamics , 1994, IEEE Trans. Neural Networks.

[4]  Herbert Jaeger,et al.  A tutorial on training recurrent neural networks , covering BPPT , RTRL , EKF and the " echo state network " approach - Semantic Scholar , 2005 .

[5]  A. D. Back Multiple and time-varying dynamic modelling capabilities of recurrent neural networks , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[6]  Lee A. Feldkamp,et al.  Adaptation from fixed weight dynamic networks , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[7]  Lee A. Feldkamp,et al.  Fixed-weight controller for multiple systems , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[8]  J. Lo,et al.  Adaptive vs. accommodative neural networks for adaptive system identification , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  James Ting-Ho Lo,et al.  Adaptive vs. accommodative neural networks for adaptive system identification: part II , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[11]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[12]  Amir F. Atiya,et al.  New results on recurrent network training: unifying the algorithms and accelerating convergence , 2000, IEEE Trans. Neural Networks Learn. Syst..

[13]  Kumpati S. Narendra,et al.  Identification and control of a nonlinear discrete-time system based on its linearization: a unified framework , 2004, IEEE Transactions on Neural Networks.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Andrew D. Back,et al.  Universal Approximation of Multiple Nonlinear Operators by Neural Networks , 2002, Neural Computation.

[16]  A. Steven Younger,et al.  Fixed-weight on-line learning , 1999, IEEE Trans. Neural Networks.