Recurrent and Feedforward Polynomial Modeling of Coupled Time Series

We present two methods for the prediction of coupled time series. The first one is based on modeling the series by a dynamic system with a polynomial format. This method can be formulated in terms of learning in a recurrent network, for which we give a computationally effective algorithm. The second method is a purely feedforward - network procedure whose architecture derives from the recurrence relations for the derivatives of the trajectories of a Ricatti format dynamic system. It can also be used for the modeling of discrete series in terms of nonlinear mappings. Both methods have been tested successfully against chaotic series.

[1]  Dennis Gabor,et al.  Non-linear filter, predictor and simulator , 1961 .

[2]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[3]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[4]  Samuel D. Conte,et al.  Elementary Numerical Analysis: An Algorithmic Approach , 1975 .

[5]  S. Orszag,et al.  Advanced Mathematical Methods For Scientists And Engineers , 1979 .

[6]  Samuel D. Conte,et al.  Elementary Numerical Analysis , 1980 .

[7]  E. H. Kerner.  Universal formats for nonlinear ordinary differential systems , 1981 .

[8]  A. Lichtenberg,et al.  Regular and Stochastic Motion , 1982 .

[9]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[11]  James P. Crutchfield,et al.  Equations of Motion from a Data Series , 1987, Complex Syst..

[12]  J. Cremers,et al.  Construction of Differential Equations from Experimental Data , 1987 .

[13]  Fernando J. Pineda,et al.  Generalization of Back propagation to Recurrent and Higher Order Neural Networks , 1987, NIPS.

[14]  Barak A. Pearlmutter.  Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[15]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[16]  José R. Dorronsoro,et al.  Formal integrators and neural networks , 1990 .

[17]  Jacob Barhen,et al.  Adjoint-Functions and Temporal Learning Algorithms in Neural Networks , 1990, NIPS.

[18]  William H. Press,et al.  Numerical Recipes in Fortran 77 , 1992 .

[19]  R. C. Pickett,et al.  Power series approximation to solutions of nonlinear systems of differential equations , 1993 .