State estimation of continuous-time radial basis function networks

This paper presents state estimators for previously trained RBF networks based on a minimax approach. The uncertainty class is characterized in terms of an approximation error vector. Minimizing the objective function over this uncertainty class is used to obtain state estimates. The initial portion of the paper presents the derivation and properties of such a minimax state estimator for RBF networks. In the later portion, this is extended to the problem of minimax adaptive state estimation. This approach is useful in the cases where the pretrained RBF network is to be used in state estimation, since the latest information is used in improving estimates of the RBF weights. A special class of estimators for the appended state estimation problem is also considered where a constant gain estimator matrix can be obtained. This section gives sufficient conditions for the existence of such an observer and follows directly from the structure of the RBF networks. Finally, example applications of the minimax and adaptive minimax estimation for nonlinear problems are presented. The results show the accuracy of state estimation using the proposed minimax estimator.

[1]  I. Rhodes,et al.  Cone-bounded nonlinearities and mean-square bounds--Estimation lower bound , 1973 .

[2]  T. Tarn,et al.  Observers for nonlinear stochastic systems , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[3]  A. K. Mahalanabis,et al.  A second-order method for state estimation of non-linear dynamical systems† , 1971 .

[4]  Christopher Martin,et al.  Robust filtering and prediction for linear systems with uncertain dynamics: A game-theoretic approach , 1983, 1982 21st IEEE Conference on Decision and Control.

[5]  Uri Shaked,et al.  Game theory approach to finite-time horizon optimal estimation , 1993, IEEE Trans. Autom. Control..

[6]  Wolfgang Porod,et al.  Qualitative analysis and synthesis of a class of neural networks , 1988 .

[7]  Terrence P. McGarty.  Stochastic systems and state estimation , 1974 .

[8]  H. Poor,et al.  Minimax state estimation for linear stochastic systems with noise uncertainty , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[9]  Max Mintz,et al.  On the solution of a minimax terminal state estimation problem-A Hilbert space approach , 1973, CDC 1973.

[10]  Bernard Widrow,et al.  Neural nets for adaptive filtering and adaptive pattern recognition , 1988, Computer.

[11]  J. D'appolito,et al.  A minimax approach to the design of low sensitivity state estimators , 1972 .

[12]  S. Verdú,et al.  Minimax linear observers and regulators for stochastic systems with uncertain second-order statistics , 1984 .

[13]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[14]  Sheng Chen,et al.  Non-linear systems identification using radial basis functions , 1990 .

[15]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaption , 1971 .

[16]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[17]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaptation , 1970 .

[18]  Pineda,et al.  Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.

[19]  E. Rogers,et al.  Utilising fuzzy models in the design of estimators and predictors: an agile target tracking example , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[20]  Rahmat Shoureshi,et al.  A Neural Network Approach for Identification of Continuous-Time Nonlinear Dynamic Systems , 1991, 1991 American Control Conference.

[21]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[22]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[23]  Fathi M. A. Salam,et al.  On the analysis of dynamic feedback neural nets , 1991 .

[24]  Barak A. Pearlmutter.  Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.