Iterative time series prediction and analysis by embedding and multiple time-scale decomposition networks

In this work we describe a method of estimating and characterizing appropriate data and model complexity in the context of long term iterated time series forecasting using embeddings and multiple time-scale decomposition techniques. An embedding of a signal is obtained which decouples multiple time scale effects such as seasonality and trend. The complexity and stability of networks are estimated and the performance of long term iteration is examined. The performance of the technique is tested using the real world time series problems of electricity load forecasting, and financial futures contracts.

[1]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[2]  Ted Jaditz Time series prediction: Forecasting the future and understanding the past : Andreas S. Weigend and Neil A. Gershenfeld, eds., (Reading, MA: Addison-Wesley Publishing Co., 1949) pp. xvii + 643, $29.95 , 1995 .

[3]  Y. Meyer,et al.  Ondelettes et bases hilbertiennes. , 1986 .

[4]  G. Dunteman Principal Components Analysis , 1989 .

[5]  Halbert White,et al.  On learning the derivatives of an unknown mapping with multilayer feedforward networks , 1992, Neural Networks.

[6]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[7]  Hecht-Nielsen Theory of the backpropagation neural network , 1989 .

[8]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[9]  A. Barron Approximation and Estimation Bounds for Artificial Neural Networks , 1991, COLT '91.

[10]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[11]  D. Lowe,et al.  Time series prediction by adaptive networks: a dynamical systems perspective , 1991 .

[12]  D. Esteban,et al.  Application of quadrature mirror filters to split band voice coding schemes , 1977 .

[13]  R. Hecht-Nielsen,et al.  Theory of the Back Propagation Neural Network , 1989 .

[14]  Martin Casdagli,et al.  Nonlinear Modeling And Forecasting , 1992 .

[15]  A. Cohen Ten Lectures on Wavelets, CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 61, I. Daubechies, SIAM, 1992, xix + 357 pp. , 1994 .

[16]  Gilbert Strang,et al.  Wavelets and Dilation Equations: A Brief Introduction , 1989, SIAM Rev..

[17]  F. Takens Detecting strange attractors in turbulence , 1981 .

[18]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[19]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[21]  James L. Flanagan,et al.  Digital coding of speech in sub-bands , 1976, The Bell System Technical Journal.