RESIDUAL ANALYSIS AND COMBINATION OF EMBEDDING THEOREM AND ARTIFICIAL INTELLIGENCE IN CHAOTIC TIME SERIES FORECASTING

A combination of embedding theorem and artificial intelligence along with residual analysis is used to analyze and forecast chaotic time series. Based on embedding theorem, the time series is reconstructed into proper phase space points and fed into a neural network whose weights and biases are improved using genetic algorithms. As the residuals of predicted time series demonstrated chaotic behavior, they are reconstructed as a new chaotic time series. A new neural network is trained to forecast future values of residual time series. The residual analysis is repeated several times. Finally, a neural network is trained to capture the relationship among the predicted value of the original time series, residuals, and the original time series. The method is applied to two chaotic time series, Mackey-Glass and Lorenz, for validation, and it is concluded that the proposed method can forecast the chaotic time series more effectively and accurately than existing methods.

[1]  C. Darwin.  The Origin of Species by Means of Natural Selection, Or, The Preservation of Favoured Races in the Struggle for Life , 1859 .

[2]  Brynn Hibbert,et al.  Chaos theory and the dynamics of marketing systems , 1994 .

[3]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[4]  John M. Danskin,et al.  Entropy-based pattern matching for document image compression , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[5]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[6]  Shoji Suzuki,et al.  Short-Term Prediction of Chaotic Time Series by Local Fuzzy Reconstruction Method , 1997, J. Intell. Fuzzy Syst..

[7]  Douglas B. Kell,et al.  Dielectric permittivity of microbial suspensions at radio frequencies: a novel method for the real-time estimation of microbial biomass , 1987 .

[8]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[9]  Hiroshi Sasaki,et al.  Development of very‐short‐term load forecasting based on chaos theory , 2004 .

[10]  J. Sprott.  Chaos and time-series analysis , 2001 .

[11]  H. Engel.  Chemical Chaos , 1995 .

[12]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[13]  M. Ogorzalek,et al.  Time series prediction with ensemble models , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[14]  Nadine Aubry,et al.  The dynamics of coherent structures in the wall region of a turbulent boundary layer , 1988, Journal of Fluid Mechanics.

[15]  Kennel,et al.  Method to distinguish possible chaos from colored noise and to determine embedding parameters. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[16]  Ashok Erramilli,et al.  Oscillations and Chaos in a Flow Model of a Switching System , 1991, IEEE J. Sel. Areas Commun..

[17]  Robert C. Hilborn,et al.  Chaos And Nonlinear Dynamics: An Introduction for Scientists and Engineers , 1994 .

[18]  Max L. Warshauer,et al.  Lecture Notes in Mathematics , 2001 .

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  Atin Das,et al.  Chaotic analysis of the foreign exchange rates , 2007, Appl. Math. Comput..

[21]  Les Atlas,et al.  Recurrent neural networks and time series prediction , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[22]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[23]  M Yamaguti.  SOME THOUGHTS ON CHAOS IN ENGINEERING , 1994 .

[24]  Laurence R. Rilett,et al.  Non-linear analysis of traffic flow , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[25]  A. Gray,et al.  I. THE ORIGIN OF SPECIES BY MEANS OF NATURAL SELECTION , 1963 .

[26]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[27]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[28]  Héctor Pomares,et al.  Soft-computing techniques and ARMA model for time series prediction , 2008, Neurocomputing.

[29]  Paolo Tenti,et al.  Forecasting Foreign Exchange Rates Using Recurrent Neural Networks , 1996, Appl. Artif. Intell..

[30]  M. Pascual.  Understanding nonlinear dynamics , 1996 .

[31]  Ashish Sharma,et al.  A study of optimal model lag and spatial inputs to artificial neural network for rainfall forecasting , 2000 .

[32]  Simon Parsons,et al.  Soft computing: fuzzy logic, neural networks and distributed artificial intelligence by F. Aminzadeh and M. Jamshidi (Eds.), PTR Prentice Hall, Englewood Cliffs, NJ, pp 301, ISBN 0-13-146234-2 , 1996, Knowl. Eng. Rev..

[33]  E. Lorenz,et al.  The essence of chaos , 1993 .

[34]  Jun Zhang,et al.  Time Series Prediction Using Lyapunov Exponents In Embedding Phase Space , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[35]  C. E. Puente,et al.  The Essence of Chaos , 1995 .

[36]  Richard Wilding,et al.  Chaos Theory: Implications for Supply Chain Management , 1998 .

[37]  James McNames,et al.  A Nearest Trajectory Strategy for Time Series Prediction , 2000 .

[38]  V. Uzunoglu,et al.  The synchronous oscillator: a synchronization and tracking network , 1985, IEEE Journal of Solid-State Circuits.

[39]  Paul S. Addison,et al.  Fractals and Chaos: An Illustrated Course , 1997 .

[40]  Khaled Rasheed,et al.  Stock market prediction with multiple classifiers , 2007, Applied Intelligence.

[41]  C. J. Kim,et al.  An algorithmic approach for fuzzy inference , 1997, IEEE Trans. Fuzzy Syst..

[42]  H. Aref.  Stirring by chaotic advection , 1984, Journal of Fluid Mechanics.

[43]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[44]  Vassilis S. Kodogiannis,et al.  Forecasting Financial Time Series using Neural Network and Fuzzy System-based Techniques , 2002, Neural Computing & Applications.