Robust nonlinear system identification using neural-network models

We study the problem of identification for nonlinear systems in the presence of unknown driving noise, using both feedforward multilayer neural network and radial basis function network models. Our objective is to resolve the difficulty associated with the persistency of excitation condition inherent to the standard schemes in the neural identification literature. This difficulty is circumvented here by a novel formulation and by using a new class of identification algorithms recently obtained by Didinsky et al. We show how these algorithms can be exploited to successfully identify the nonlinearity in the system using neural-network models. By embedding the original problem in one with noise-perturbed state measurements, we present a class of identifiers (under L1 and L2 cost criteria) which secure a good approximant for the system nonlinearity provided that some global optimization technique is used. In this respect, many available learning algorithms in the current neural-network literature, e.g., the backpropagation scheme and the genetic algorithms-based scheme, with slight modifications, can ensure the identification of the system nonlinearity. Subsequently, we address the same problem under a third, worst case L(infinity) criterion for an RBF modeling. We present a neural-network version of an H(infinity)-based identification algorithm from Didinsky et al and show how, along with an appropriate choice of control input to enhance excitation, under both full-state-derivative information (FSDI) and noise-perturbed full-state-information (NPFSI), it leads to satisfaction of a relevant persistency of excitation condition, and thereby to robust identification of the nonlinearity. Results from several simulation studies have been included to demonstrate the effectiveness of these algorithms.

[1]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[2]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[3]  T. Başar,et al.  Parameter identification for uncertain linear systems with partial state measurements under an H∞ criterion , 1996, IEEE Trans. Autom. Control..

[4]  Petros A. Ioannou,et al.  Robust adaptive control: Design, analysis and robustness bounds , 1991 .

[5]  C. R. Johnson,et al.  Lectures on adaptive parameter estimation , 1988 .

[6]  T. Başar,et al.  Adaptive controller design for tracking and disturbance attenuation in parametric strict-feedback nonlinear systems , 1998, IEEE Trans. Autom. Control..

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  Tamer Basar,et al.  Genetic algorithms-based identification , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[9]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[10]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[11]  William A. Sethares,et al.  Nonlinear parameter estimation via the genetic algorithm , 1994, IEEE Trans. Signal Process..

[12]  Arjan van der Schaft,et al.  Non-linear dynamical control systems , 1990 .

[13]  AnalysisbyMarios M. Polycarpou,et al.  Identiication and Control of Nonlinear Systems Using Neural Network Models: Design and Stability Analysis Identiication and Control of Nonlinear Systems Using Neural Network Models: Design and Stability Analysis , 1991 .

[14]  Sheng Chen,et al.  Non-linear systems identification using radial basis functions , 1990 .

[15]  Dimitry Gorinevsky On the persistency of excitation in RBF network identification , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[16]  Tamer Basar,et al.  Parameter identification for uncertain plants using H∞ methods , 1995, Autom..

[17]  R. Sanner,et al.  Irregular sampling theory and scattered-center radial Gaussian networks , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[18]  Robert M. Sanner,et al.  Stable Recursive Identification Using Radial Basis Function Networks , 1992, 1992 American Control Conference.

[19]  I. Kanellakopoulos,et al.  Systematic Design of Adaptive Controllers for Feedback Linearizable Systems , 1991, 1991 American Control Conference.

[20]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[21]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[22]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[23]  Kumpati S. Narendra,et al.  Gradient methods for the optimization of dynamical systems containing neural networks , 1991, IEEE Trans. Neural Networks.

[24]  Harpreet Singh,et al.  Single layer neural networks for linear system identification using gradient descent technique , 1993, IEEE Trans. Neural Networks.

[25]  Robert M. Sanner,et al.  Gaussian Networks for Direct Adaptive Control , 1991, 1991 American Control Conference.

[26]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[27]  A. Arapostathis,et al.  The effect sampling on linear equivalence and feedback linearization , 1990 .