A novel method for time series prediction based on error decomposition and nonlinear combination of forecasters

Abstract For time series prediction, hybrid systems that combine linear and nonlinear models can provide more accurate performance than a single model. However, the irregularity of the error series and the unknown nature of combinations of different forecasters may strongly impact the performance of hybrid systems. Therefore, in this paper, we propose a novel method for time series prediction, in which error decomposition and a nonlinear combination of forecasters are introduced. The proposed method performs the following: (i) linear modeling to obtain the error series, (ii) error decomposition by using variational mode decomposition (VMD), (iii) nonlinear modeling and a phase fix procedure for the error subseries, and (iv) a combination of forecasters through an appropriate combination function generated by a nonlinear model. By using the proposed method, this paper constructs two hybrid systems, in which the autoregressive integrated moving average (ARIMA) is used for linear modeling, and two artificial intelligence (AI) models, namely, the multilayer perceptron (MLP) and support vector regression (SVR), are used for nonlinear modeling and combination, respectively. Finally, four time series data sets, six evaluation metrics, two single models and thirteen hybrid systems are used to assess the effectiveness of the proposed method. The empirical results show that hybrid systems based on error decomposition and a nonlinear combination of forecasters can achieve better performance than some existing systems and models.

[1]  Zahra Hajirahimi,et al.  Hybrid structures in time series modeling and forecasting: A review , 2019, Eng. Appl. Artif. Intell..

[2]  Ignacio J. Turias,et al.  Hybrid approaches based on SARIMA and artificial neural networks for inspection time series forecasting , 2014 .

[3]  Himansu Sekhar Behera,et al.  A hybrid ETS-ANN model for time series forecasting , 2017, Eng. Appl. Artif. Intell..

[4]  Indrajit Ghosh,et al.  Forecasting dengue epidemics using a hybrid methodology , 2019 .

[5]  George D. C. Cavalcanti,et al.  Nonlinear combination method of forecasters applied to PM time series , 2017, Pattern Recognit. Lett..

[6]  Yi-Ming Wei,et al.  Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology , 2013 .

[7]  Mehdi Khashei,et al.  An artificial neural network (p, d, q) model for timeseries forecasting , 2010, Expert Syst. Appl..

[8]  Weihua Gui,et al.  Non-ferrous metals price forecasting based on variational mode decomposition and LSTM network , 2020, Knowl. Based Syst..

[9]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[10]  Jimin Ye,et al.  Crude oil price analysis and forecasting based on variational mode decomposition and independent component analysis , 2017 .

[11]  Kota Solomon Raju,et al.  Hurst based vibro-acoustic feature extraction of bearing using EMD and VMD , 2018 .

[12]  Sean T. Green,et al.  Random forests for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standards , 2011, Population health metrics.

[13]  James W. Taylor A Quantile Regression Neural Network Approach to Estimating the Conditional Density of Multiperiod Returns , 2000 .

[14]  Mehdi Khashei,et al.  A novel hybridization of artificial neural networks and ARIMA models for time series forecasting , 2011, Appl. Soft Comput..

[15]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[16]  Paulo S. G. de Mattos Neto,et al.  Correcting and combining time series forecasters , 2014, Neural Networks.

[17]  Kunikazu Kobayashi,et al.  Time series forecasting using a deep belief network with restricted Boltzmann machines , 2014, Neurocomputing.

[18]  Lutgarde M. C. Buydens,et al.  Using support vector machines for time series prediction , 2003 .

[19]  Nikolay I. Nikolaev,et al.  Recursive Bayesian Recurrent Neural Networks for Time-Series Modeling , 2010, IEEE Transactions on Neural Networks.

[20]  Erasmo Cadenas,et al.  Wind speed forecasting in three different regions of Mexico, using a hybrid ARIMA–ANN model , 2010 .

[21]  A. Prasad,et al.  Newer Classification and Regression Tree Techniques: Bagging and Random Forests for Ecological Prediction , 2006, Ecosystems.

[22]  Tugba Taskaya-Temizel,et al.  2005 Special Issue: A comparative study of autoregressive neural network hybrids , 2005 .

[23]  V. Gholami,et al.  Simulation of precipitation time series using tree-rings, earlywood vessel features, and artificial neural network , 2018, Theoretical and Applied Climatology.

[24]  Konstantinos Ioannou,et al.  Predicting fuelwood prices in Greece with the use of ARIMA models, artificial neural networks and a hybrid ARIMA–ANN model , 2009 .

[25]  Nicolau Santos,et al.  Performance of state space and ARIMA models for consumer retail sales forecasting , 2015 .

[26]  Ali Safari,et al.  Oil price forecasting using a hybrid model , 2018 .

[27]  Michael Y. Hu,et al.  A simulation study of artificial neural networks for nonlinear time-series forecasting , 2001, Comput. Oper. Res..

[28]  Çagdas Hakan Aladag,et al.  Forecasting nonlinear time series with a hybrid methodology , 2009, Appl. Math. Lett..

[29]  Teresa Bernarda Ludermir,et al.  A hybrid evolutionary decomposition system for time series forecasting , 2016, Neurocomputing.

[30]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[31]  Tiago Alessandro Espínola Ferreira,et al.  A New Intelligent System Methodology for Time Series Forecasting with Artificial Neural Networks , 2008, Neural Processing Letters.

[32]  Kuan-Yu Chen,et al.  A hybrid SARIMA and support vector machines in forecasting the production values of the machinery industry in Taiwan , 2007, Expert Syst. Appl..

[33]  Guowei Cai,et al.  Mechanical Fault Diagnosis of High Voltage Circuit Breakers Based on Variational Mode Decomposition and Multi-Layer Classifier , 2016, Sensors.

[34]  Salim Lahmiri,et al.  A variational mode decompoisition approach for analysis and forecasting of economic and financial time series , 2016, Expert Syst. Appl..

[35]  Nasreen Islam Khan,et al.  Simulating and predicting river discharge time series using a wavelet‐neural network hybrid modelling approach , 2012 .

[36]  Zahra Hajirahimi,et al.  Weighted sequential hybrid approaches for time series forecasting , 2019, Physica A: Statistical Mechanics and its Applications.

[37]  Zhenhong Du,et al.  Red tide time series forecasting by combining ARIMA and deep belief network , 2017, Knowl. Based Syst..

[38]  Kunikazu Kobayashi,et al.  Time Series Forecasting Using Restricted Boltzmann Machine , 2012, ICIC.

[39]  Pedro Sousa,et al.  Multi‐scale Internet traffic forecasting using neural networks and time series methods , 2010, Expert Syst. J. Knowl. Eng..

[40]  Rati Wongsathan,et al.  A Hybrid ARIMA and Neural Networks Model for PM-10 Pollution Estimation: The Case of Chiang Mai City Moat Area , 2016 .

[41]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[42]  Dominique Zosso,et al.  Variational Mode Decomposition , 2014, IEEE Transactions on Signal Processing.

[43]  Ashu Jain,et al.  Hybrid neural network models for hydrologic time series forecasting , 2007, Appl. Soft Comput..

[44]  Jianzhou Wang,et al.  Stock index forecasting based on a hybrid model , 2012 .

[45]  A. Harvey Dynamic Models for Volatility and Heavy Tails: With Applications to Financial and Economic Time Series , 2013 .

[46]  Lara Khansa,et al.  Predicting stock market returns from malicious attacks: A comparative analysis of vector autoregression and time-delayed neural networks , 2011, Decis. Support Syst..

[47]  Mehdi Khashei,et al.  A new class of hybrid models for time series forecasting , 2012, Expert Syst. Appl..