Modelling the dynamics of nonlinear time series using canonical variate analysis

We report on a novel prediction method of nonlinear time series based on canonical variate analysis (CVA) and radial basis modelling. Nonlinear models of possibly chaotic and noisy systems are constructed from data via a nonlinear CVA of the past and future of the process. The canonical variables give an optimal linear combination of nonlinear coordinates of the past for describing the future. We show how our method can be used for prediction, give a comparison with other methods, and apply our prediction algorithm to simulated data from the Lorenz system and the Logistic map, to a laser experimental time series, and to sunspot data. The focus of this work is to obtain models that accurately reflect the dynamics of the system: A model should not only fit data and predict it well, but should also have a dynamical behaviour similar to that of the measured system. The results indicate that the algorithm presented is able to capture the dynamics of complex systems and gives reliable predictions when using only short data sets.

[1]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[2]  Kevin Judd,et al.  Embedding as a modeling problem , 1998 .

[3]  Thomas Kailath,et al.  A view of three decades of linear filtering theory , 1974, IEEE Trans. Inf. Theory.

[4]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[5]  F. Takens Detecting strange attractors in turbulence , 1981 .

[6]  A. N. Sharkovskiĭ Dynamic systems and turbulence , 1989 .

[7]  Hübner,et al.  Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser. , 1989, Physical review. A, General physics.

[8]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[9]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[10]  Robert G. Harrison,et al.  Phase-space prediction of chaotic time series , 1998 .

[11]  J. Baillieul,et al.  Identification and filtering of nonlinear systems using canonical variate analysis , 1990, 29th IEEE Conference on Decision and Control.

[12]  A. Yaglom Outline of some topics in linear extrapolation of stationary random processes , 1967 .

[13]  Wallace E. Larimore,et al.  Optimal Reduced Rank Modeling, Prediction, Monitoring and Control using Canonical Variate Analysis , 1997 .

[14]  A. Mees,et al.  On selecting models for nonlinear time series , 1995 .

[15]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[16]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .