Global and decomposition evolutionary support vector machine approaches for time series forecasting

Multi-step ahead time series forecasting (TSF) is a key tool for supporting tactical decisions (e.g., planning resources). Recently, the support vector machine (SVM) emerged as a natural solution for TSF due to its nonlinear learning capabilities. This paper presents two novel evolutionary SVM (ESVM) methods for multi-step TSF. Both methods are based on an estimation distribution algorithm search engine that automatically performs a simultaneous variable (number of inputs) and model (hyperparameters) selection. The global ESVM (GESVM) uses all past patterns to fit the SVM, while the decomposition ESVM (DESVM) separates the series into trended and stationary effects, using a distinct ESVM to forecast each effect and then summing both predictions into a single response. Several experiments were held, using six time series. The proposed approaches were analyzed under two criteria and compared against a recent evolutionary artificial neural network (EANN) and two classical forecasting methods, Holt–Winters and autoregressive integrated moving average. Overall, the DESVM and GESVM obtained competitive and high-quality results. Furthermore, both ESVM approaches consume much less computational effort when compared with EANN.

[1]  Andreas Zell,et al.  SNNS: An Efficient Simulator for Neural Nets , 1993, MASCOTS.

[2]  Zbigniew Michalewicz,et al.  Adaptive Business Intelligence , 2009, Encyclopedia of Artificial Intelligence.

[3]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[4]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[5]  Gunnar Rätsch,et al.  Predicting Time Series with Support Vector Machines , 1997, ICANN.

[6]  María José del Jesús,et al.  Coevolution of lags and RBFNs for time series forecasting: L-Co-R algorithm , 2011, Soft Computing.

[7]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[8]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[9]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[10]  Xiaodong Li,et al.  Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm , 2011, Neural Computing and Applications.

[11]  Michael Y. Hu,et al.  Modeling consumer situational choice of long distance communication with neural networks , 2008, Decis. Support Syst..

[12]  Maurizio Filippone,et al.  A comparative evaluation of nonlinear dynamics methods for time series prediction , 2009, Neural Computing and Applications.

[13]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1990 .

[16]  Xiaodong Li,et al.  Time series forecasting by evolving artificial neural networks using genetic algorithms, differential evolution and estimation of distribution algorithm , 2011 .

[17]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[18]  Marcel Abendroth,et al.  Data Mining Practical Machine Learning Tools And Techniques With Java Implementations , 2016 .

[19]  Pedro Sousa,et al.  Multi‐scale Internet traffic forecasting using neural networks and time series methods , 2010, Expert Syst. J. Knowl. Eng..

[20]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[21]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[22]  Robert L. Goodrich,et al.  The Forecast Pro methodology , 2000 .

[23]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[24]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[25]  L Rizzo,et al.  Earthquake injuries related to housing in a guatemalan village. , 1977, Science.

[26]  Chih-Ming Hsu A hybrid procedure with feature selection for resolving stock/futures price forecasting problems , 2011, Neural Computing and Applications.

[27]  Hongbo Zhao,et al.  Modeling non-linear displacement time series of geo-materials using evolutionary support vector machines , 2004 .

[28]  José Neves,et al.  Evolution of neural networks for classification and regression , 2007, Neurocomputing.

[29]  P. A. Blight The Analysis of Time Series: An Introduction , 1991 .

[30]  Amir F. Atiya,et al.  A new Bayesian formulation for Holt's exponential smoothing , 2009 .

[31]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[32]  Peter R. Winters,et al.  Forecasting Sales by Exponentially Weighted Moving Averages , 1960 .

[33]  Hui-Ling Huang,et al.  ESVM: Evolutionary support vector machine for automatic feature selection and classification of microarray data , 2007, Biosyst..

[34]  Paulo Cortez,et al.  Sensitivity analysis for time lag selection to forecast seasonal time series using Neural Networks and Support Vector Machines , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[35]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[36]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[37]  María José del Jesús,et al.  Short, medium and long term forecasting of time series using the L-Co-R algorithm , 2014, Neurocomputing.

[38]  Sven F. Crone A Business Forecasting Competition Approach to Modeling Artificial Neural Networks for Time Series Prediction , 2004, IC-AI.