Calculation of the Volterra kernels of non-linear dynamic systems using an artificial neural network

The Volterra series is a well-known method of describing non-linear dynamic systems. A major limitation of this technique is the difficulty involved in the calculation of the kernels. More recently, artificial neural networks have been used to produce black box models of non-linear dynamic systems. In this paper we show how a certain class of artificial neural networks are equivalent to Volterra series and give the equation for the nth order Volterra kernel in terms of the internal parameters of the network. The technique is then illustrated using a specific non-linear system. The kernels obtained by the method described in the paper are compared with those obtained by a Toeplitz matrix inversion technique.

[1]  P. G. Hearne,et al.  Solutions to Hodgkin-Huxley Equations: Functional Analysis of a Molluscan Neurone , 1994 .

[2]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[3]  Y. W. Lee,et al.  Measurement of the Wiener Kernels of a Non-linear System by Cross-correlation† , 1965 .

[4]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[5]  G Palm,et al.  Volterra representation and Wiener-like identification of nonlinear systems: scope and limitations , 1985, Quarterly Reviews of Biophysics.

[6]  J. G. Taylor,et al.  Theory and Applications of Neural Networks , 1992, Perspectives in Neural Computing.

[7]  Lawrence S. Kroll.  Mathematica--A System for Doing Mathematics by Computer. , 1989 .

[8]  Kishan G. Mehrotra,et al.  Forecasting the behavior of multivariate time series using neural networks , 1992, Neural Networks.

[9]  N. Wiener,et al.  Nonlinear Problems in Random Theory , 1964 .

[10]  Ian W. Hunter,et al.  The identification of nonlinear biological systems: Wiener kernel approaches , 2006, Annals of Biomedical Engineering.

[11]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[12]  A. Aertsen,et al.  The Spectro-Temporal Receptive Field , 1981, Biological Cybernetics.

[13]  Michael J. Korenberg,et al.  Identification of complex-cell intensive nonlinearities in a cascade model of cat visual cortex , 1992, Biological Cybernetics.

[14]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[15]  R. Hecht-Nielsen,et al.  Application of feedforward and recurrent neural networks to chemical plant predictive modeling , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  Françoise Lamnabhi-Lagarrigue,et al.  An algebraic approach to nonlinear functional expansions , 1983 .

[17]  P Kuyper,et al.  Triggered correlation. , 1968, IEEE transactions on bio-medical engineering.

[18]  Gary G. R. Green,et al.  Analysis of networks that have learnt control problems , 1991 .

[19]  T. Poggio,et al.  The Volterra Representation and the Wiener Expansion: Validity and Pitfalls , 1977 .

[20]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[21]  James D. Keeler,et al.  Predicting the Future: Advantages of Semilocal Units , 1991, Neural Computation.

[22]  K Naka,et al.  Dynamics of cockroach ocellar neurons , 1986, The Journal of general physiology.

[23]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[24]  E. Cheney.  Introduction to approximation theory , 1966 .

[25]  M. Schetzen.  The Volterra and Wiener Theories of Nonlinear Systems , 1980 .

[26]  T. Poggio,et al.  Considerations on models of movement detection , 1973, Kybernetik.

[27]  Gary G. R. Green,et al.  The Neurone as a Nonlinear System: A Single Compartment Study , 1993 .

[28]  R. B. Pinter,et al.  Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks , 1992 .

[29]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[30]  Ioannis G. Kevrekidis,et al.  Nonlinear signal processing and system identification: applications to time series from electrochemical reactions , 1990 .

[31]  W. Rugh.  Nonlinear System Theory: The Volterra / Wiener Approach , 1981 .

[32]  Vito Volterra,et al.  Theory of Functionals and of Integral and Integro-Differential Equations , 2005 .

[33]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[34]  K. Naka,et al.  White-Noise Analysis of a Neuron Chain: An Application of the Wiener Theory , 1972, Science.

[35]  M. Schetzen.  Measurement of the Kernels of a Non-linear System of Finite Order† , 1965 .

[36]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..