Ensembles of echo state networks for time series prediction

In time series prediction tasks, dynamic models are less popular than static models, while they are more suitable for modeling the underlying dynamics of time series. In this paper, a novel architecture and supervised learning principle for recurrent neural networks, namely echo state networks, are adopted to build dynamic time series predictors. Ensemble techniques are employed to overcome the randomness and instability of echo state predictors, and a dynamic ensemble predictor is therefore established. The proposed predictor is tested in numerical experiments and different strategies for training the predictor are also comparatively studied. A case study is then conducted to test the predictor's performance in realistic prediction tasks.

[1]  Amir F. Atiya,et al.  Forecast combinations of computational intelligence and linear models for the NN5 time series forecasting competition , 2011 .

[2]  Kwok-Wing Chau,et al.  Data-driven models for monthly streamflow time series prediction , 2010, Eng. Appl. Artif. Intell..

[3]  Durdu Ömer Faruk.  A hybrid neural network and ARIMA model for water quality time series prediction , 2010, Eng. Appl. Artif. Intell..

[4]  Henry Leung,et al.  Prediction Intervals for a Noisy Nonlinear Time Series Based on a Bootstrapping Reservoir Computing Network Ensemble , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[6]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[7]  Amaury Lendasse,et al.  Adaptive Ensemble Models of Extreme Learning Machines for Time Series Prediction , 2009, ICANN.

[8]  Krzysztof Siwek,et al.  Improving the accuracy of prediction of PM10 pollution by the wavelet transformation and an ensemble of neural predictors , 2012, Eng. Appl. Artif. Intell..

[9]  Amaury Lendasse,et al.  Autoregressive time series prediction by means of fuzzy inference systems using nonparametric residual variance estimation , 2010, Fuzzy Sets Syst..

[10]  Simon Haykin,et al.  A dynamic regularized radial basis function network for nonlinear, nonstationary time series prediction , 1999, IEEE Trans. Signal Process..

[11]  Okyay Kaynak,et al.  Grey system theory-based models in time series prediction , 2010, Expert Syst. Appl..

[12]  Xin Yao,et al.  Short-Term Load Forecasting with Neural Network Ensembles: A Comparative Study [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[13]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[14]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[15]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[17]  Richard J. Povinelli,et al.  A New Temporal Pattern Identification Method for Characterization and Prediction of Complex Time Series Events , 2003, IEEE Trans. Knowl. Data Eng..

[18]  Hui Li,et al.  Financial distress prediction using support vector machines: Ensemble vs. individual , 2012, Appl. Soft Comput..