Neural Networks for Nonlinear Dynamic System Modelling and Identification

Many real-world systems exhibit complex nonlinear characteristics and cannot be treated satisfactorily using linear systems theory. A neural network which has the ability to learn sophisticated nonlinear relationships provides an ideal means of modelling complicated nonlinear systems. This paper addresses the issues related to the identification of nonlinear discrete-time dynamic systems using neural networks. Three network architectures, namely the multi-layer perceptron, the radial basis function network and the functional-link network, are presented and several learning or identification algorithms are derived. Advantages and disadvantages of these structures are discussed and illustrated using simulated and real data. Particular attention is given to the connections between existing techniques for nonlinear systems identification and some aspects of neural network methodology, and this demonstrates that certain techniques employed in the neural network context have long been developed by the control e...

[1]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[2]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[3]  Peter Grant,et al.  Orthogonal least squares algorithms for training multi-output radial basis function networks , 1991 .

[4]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[5]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[6]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[7]  Sheng Chen,et al.  Practical identification of NARMAX models using radial basis functions , 1990 .

[8]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[9]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[10]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..

[11]  Thomas Jackson,et al.  Neural Computing - An Introduction , 1990 .

[12]  Sheng Chen,et al.  Parallel recursive prediction error algorithm for training layered neural networks , 1990 .

[13]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[14]  Sheng Chen,et al.  Extended model set, global data and threshold model identification of severely non-linear systems , 1989 .

[15]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[16]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[17]  Sheng Chen,et al.  Identification of MIMO non-linear systems using a forward-regression orthogonal estimator , 1989 .

[18]  J. D. Powell,et al.  Radial basis function approximations to polynomials , 1989 .

[19]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[20]  S. A. Billings,et al.  Non-Linear Systems Identification Using Neural Networks , 1989 .

[21]  Sheng Chen,et al.  Identification of non-linear rational systems using a prediction-error estimation algorithm , 1989 .

[22]  Sheng Chen,et al.  Recursive prediction error parameter estimator for non-linear models , 1989 .

[23]  Sheng Chen,et al.  Recursive prediction error estimator for non-linear models , 1989 .

[24]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[25]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[26]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[27]  G. Goodwin,et al.  Modified least squares algorithm incorporating exponential resetting and forgetting , 1988 .

[28]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[29]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[30]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[31]  D. G. Fisher,et al.  Improved least squares identification , 1987 .

[32]  L. Haugh.  Handbook of Statistics 5: Time Series in the Time Domain , 1987 .

[33]  Robert M. Farber,et al.  How Neural Nets Work , 1987, NIPS.

[34]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[35]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[36]  D. Rumelhart.  Learning Internal Representations by Error Propagation, Parallel Distributed Processing , 1986 .

[37]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[38]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[39]  T. Ozaki.  2 Non-linear time series models and dynamical systems , 1985 .

[40]  P. A. Cook.  Nonlinear System Design , 1984 .

[41]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[42]  Stephen A. Billings,et al.  Identi cation of nonlinear systems-A survey , 1980 .

[43]  M. Priestley.  STATE‐DEPENDENT MODELS: A GENERAL APPROACH TO NON‐LINEAR TIME SERIES ANALYSIS , 1980 .

[44]  D.G. Dudley,et al.  Dynamic system identification experiment design and data analysis , 1979, Proceedings of the IEEE.

[45]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[46]  Å. Björck.  Solving linear least squares problems by Gram-Schmidt orthogonalization , 1967 .

[47]  George Finlay Simmons,et al.  Introduction to Topology and Modern Analysis , 1963 .