Long-term prediction of chaotic time series with multi-step prediction horizons by a neural network with Levenberg–Marquardt learning algorithm

Abstract The Levenberg–Marquardt learning algorithm is applied for training a multilayer perception with three hidden layer each with ten neurons in order to carefully map the structure of chaotic time series such as Mackey–Glass time series. First the MLP network is trained with 1000 data, and then it is tested with next 500 data. After that the trained and tested network is applied for long-term prediction of next 120 data which come after test data. The prediction is such a way that, the first inputs to network for prediction are the four last data of test data, then the predicted value is shifted to the regression vector which is the input to the network, then after first four-step of prediction, the input regression vector to network is fully predicted values and in continue, each predicted data is shifted to input vector for subsequent prediction.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Abbas Erfanian Omidvar.  Configuring radial basis function network using fractal scaling process with application to chaotic time series prediction , 2004 .

[3]  Luiz Paulo Luna de Oliveira,et al.  Optimizing Markovian modeling of chaotic systems with recurrent neural networks , 2008 .

[4]  Shing-Tai Pan,et al.  Identification of Chaotic Systems by Neural Network with Hybrid Learning Algorithm , 2008, IMECS.

[5]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[6]  Henry Leung,et al.  Prediction of noisy chaotic time series using an optimal radial basis function neural network , 2001, IEEE Trans. Neural Networks.

[7]  Kevin Martin Bossley,et al.  Neurofuzzy modelling approaches in system identification , 1997 .

[8]  Babak Nadjar Araabi,et al.  Multi-step prediction of Dst index using singular spectrum analysis and locally linear neurofuzzy modeling , 2006 .

[9]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[10]  Martin T. Hagan,et al.  Neural network design , 1995 .

[11]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[12]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[13]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[14]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[15]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[16]  O. Nelles.  Nonlinear System Identification , 2001 .

[17]  Silvano Cincotti,et al.  Neural reconstruction of Lorenz attractors by an observable , 2002 .

[18]  Babak Nadjar Araabi,et al.  Locally linear neurofuzzy modeling and prediction of geomagnetic disturbances based on solar wind conditions , 2006 .