A hybrid evolutionary decomposition system for time series forecasting

In the field of time series forecasting, the combination of linear and nonlinear models has been explored to improve the accuracy of predictions when compared with the performance of individual models. Traditional forecasting methods such as the autoregressive integrated moving average (ARIMA) and exponential smoothing (ETS) are employed to map linear patterns in a time series while neural networks (ANNs) and support vector machines (SVMs) map nonlinear patterns. A traditional hybrid ARIMA-ANN system works by performing linear relationships in the data, considering the residual error a nonlinear component which is mapped by the ANN. The nature of a time series can be taken into consideration before applying a model. This work employs both linear and nonlinear patterns of a time series based on its volatility. This is explored using a hybrid evolutionary system composed by a simple exponential smoothing filter, ARIMA and autoregressive (AR) linear models and a SVR model. Particle swarm optimization is employed to optimize the order of the AR model, SVR parameters and number of lags of the time series. Experimental results show that the evolutionary hybrid system presented promising results in the forecasting domain.

[1]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[2]  Mehdi Khashei,et al.  A novel hybridization of artificial neural networks and ARIMA models for time series forecasting , 2011, Appl. Soft Comput..

[3]  Meie Shen,et al.  Optimal Selection of Parameters for Nonuniform Embedding of Chaotic Time Series Using Ant Colony Optimization , 2013, IEEE Transactions on Cybernetics.

[4]  Frequency independent automatic input variable selection for Neural Networks for forecasting , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[5]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[6]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Ratnadip Adhikari,et al.  A neural network based linear ensemble framework for time series forecasting , 2015, Neurocomputing.

[8]  Li Lanlan,et al.  Hybrid support vector machine and ARIMA model in building cooling prediction , 2010, 2010 International Symposium on Computer, Communication, Control and Automation (3CA).

[9]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[10]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[11]  Cheng-Lung Huang,et al.  A distributed PSO-SVM hybrid system with feature selection and parameter optimization , 2008, Appl. Soft Comput..

[12]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[13]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[14]  J. Alexander,et al.  Theory and Methods: Critical Essays in Human Geography , 2008 .

[15]  Paulo Cortez,et al.  Sensitivity analysis for time lag selection to forecast seasonal time series using Neural Networks and Support Vector Machines , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[16]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms: The Computer Science Perspective , 2012 .

[17]  Yi-Ming Wei,et al.  Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology , 2013 .

[18]  Guoqiang Peter Zhang,et al.  An empirical investigation of bias and variance in time series forecasting: modeling considerations and error evaluation , 2003, IEEE Trans. Neural Networks.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[21]  Murray Rosenblatt,et al.  Gaussian and Non-Gaussian Linear Time Series and Random Fields , 1999 .

[22]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[23]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[24]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[25]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[26]  Tian-Shyug Lee,et al.  A Hybrid Particle Swarm Optimization and Support Vector Regression Model for Financial Time Series Forecasting , 2011 .

[27]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[28]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[29]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms , 2015, Natural Computing Series.

[30]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[31]  Teresa Bernarda Ludermir,et al.  A Hybrid Evolutionary System for Parameter Optimization and Lag Selection in Time Series Forecasting , 2014, 2014 Brazilian Conference on Intelligent Systems.

[32]  George D. C. Cavalcanti,et al.  Lag selection for time series forecasting using Particle Swarm Optimization , 2011, The 2011 International Joint Conference on Neural Networks.

[33]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[34]  L. BerardiV.,et al.  An empirical investigation of bias and variance in time series forecasting , 2003 .

[35]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[36]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Rob J Hyndman,et al.  Theory & Methods: Non‐Gaussian Conditional Linear AR(1) Models , 2000 .

[39]  Roselina Sallehuddin,et al.  Hybrid Support Vector Regression and Autoregressive Integrated Moving Average Models Improved by Particle Swarm Optimization for Property Crime Rates Forecasting with Economic Indicators , 2013, TheScientificWorldJournal.