Optimal selection of heterogeneous ensemble strategies of time series forecasting with multi-objective programming

Abstract The excellent generalization performance of time series ensemble forecasting depends on the accuracy and diversity of the individual models. In this paper, a heterogeneous ensemble forecasting model with multi-objective programming for nonlinear time series is proposed. Accordingly, an improved multi-objective particle swarm optimization (MOPSO) algorithm integrated with a dynamic heterogeneous mutation operator is designed. The nonlinear time series of the Baltic Dry Index (BDI) is selected as the forecasting object to train, validate and test the ensemble forecasting model established in this paper. To verify the superior forecasting performance of the proposed model, 20 forecasting models including statistical models, machine learning models, and optimization algorithm–based ensemble models are utilized and compared. The experimental results under different lead times revealed that: 1) the forecasting approach with multi-objective programming has excellent robustness and can effectively exert out-of-sample prediction under different lead times for nonlinear time series; 2) with the increase of lead time, the out-of-sample forecasting performance would gradually decrease for all models, and the precision of the ensemble forecasting model is better than that of the individual forecasting model; 3) the forecasting performance of the MOPSO with crowding distance (MOPSOCD)-based ensemble forecasting model is better than that of benchmark machine learning models and other optimal ensemble forecasting models in terms of the prediction accuracy and statistical test results.

[1]  Yong Wang,et al.  Design optimization of resource combination for collaborative logistics network under uncertainty , 2017, Appl. Soft Comput..

[2]  Kin Keung Lai,et al.  Ensemble forecasting of Value at Risk via Multi Resolution Analysis based methodology in metals markets , 2012, Expert Syst. Appl..

[3]  Sebastian Lerch,et al.  Combining predictive distributions for the statistical post-processing of ensemble forecasts , 2016, International Journal of Forecasting.

[4]  Xiaolei Sun,et al.  A Novel Ensemble Approach for the Forecasting of Energy Demand Based on the Artificial Bee Colony Algorithm , 2020 .

[5]  Gabriel Trierweiler Ribeiro,et al.  Agribusiness time series forecasting using Wavelet neural networks and metaheuristic optimization: An analysis of the soybean sack price and perishable products demand , 2018, International Journal of Production Economics.

[6]  Chi Xie,et al.  Forecasting SMEs' credit risk in supply chain finance with an enhanced hybrid ensemble machine learning approach , 2019, International Journal of Production Economics.

[7]  Feng Yu,et al.  A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network , 2014 .

[8]  Ling Tang,et al.  Ensemble Forecasting for Complex Time Series Using Sparse Representation and Neural Networks , 2017 .

[9]  Okan Duru,et al.  A multivariate model of fuzzy integrated logical forecasting method (M-FILF) and multiplicative time series clustering: A model of time-varying volatility for dry cargo freight market , 2012, Expert Syst. Appl..

[10]  P. Luukka,et al.  Classification of intraday S&P500 returns with a Random Forest , 2019, International Journal of Forecasting.

[11]  Yael Grushka-Cockayne,et al.  Ensembles of Overfit and Overconfident Forecasts , 2015, Management Sciences.

[12]  Wang Jun,et al.  A weighted EMD-based prediction model based on TOPSIS and feed forward neural network for noised time series , 2017, Knowl. Based Syst..

[13]  Okan Duru,et al.  Judgmental Forecasting in the Dry Bulk Shipping Business: Statistical vs. Judgmental Approach , 2009 .

[14]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[15]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[16]  Devon Sigler,et al.  Pareto solutions in multicriteria optimization under uncertainty , 2020, Eur. J. Oper. Res..

[17]  Yi-Ming Wei,et al.  Carbon price forecasting with a novel hybrid ARIMA and least squares support vector machines methodology , 2013 .

[18]  Robert Fildes,et al.  Forecasting retailer product sales in the presence of structural change , 2019, Eur. J. Oper. Res..

[19]  Okan Duru,et al.  A fuzzy integrated logical forecasting model for dry bulk shipping index forecasting: An improved fuzzy time series approach , 2010, Expert Syst. Appl..

[20]  Arthur J. Lin,et al.  Does the Baltic Dry Index drive volatility spillovers in the commodities, currency, or stock markets? , 2019, Transportation Research Part E: Logistics and Transportation Review.

[21]  Jianping Li,et al.  A deep learning ensemble approach for crude oil price forecasting , 2017 .

[22]  Seoung Bum Kim,et al.  Time series forecasting based on wavelet filtering , 2015, Expert Syst. Appl..

[23]  Zebin Yang,et al.  Online big data-driven oil consumption forecasting with Google trends , 2019, International Journal of Forecasting.

[24]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[25]  Shuang Wang,et al.  A robust semi-supervised SVM via ensemble learning , 2018, Appl. Soft Comput..

[26]  Jack T. Dennerlein,et al.  Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting , 2017 .

[27]  Xin Zhang,et al.  A novel hybrid approach to Baltic Dry Index forecasting based on a combined dynamic fluctuation network and artificial intelligence method , 2019, Appl. Math. Comput..

[28]  Mario Vanhoucke,et al.  A Nearest Neighbour extension to project duration forecasting with Artificial Intelligence , 2017, Eur. J. Oper. Res..

[29]  Stratos Papadimitriou,et al.  A Novel Approach to Forecasting the Bulk Freight Market , 2017 .

[30]  Katie McConky,et al.  A hybrid machine learning model for forecasting a billing period’s peak electric load days , 2019, International Journal of Forecasting.

[31]  Jianping Li,et al.  Multi-objective optimization of crude oil-supply portfolio based on interval prediction data , 2020, Annals of Operations Research.

[32]  Alain Yee-Loong Chong,et al.  Predicting customer demand for remanufactured products: A data-mining approach , 2020, Eur. J. Oper. Res..

[33]  Huanhuan Chen,et al.  Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[34]  Ping Jiang,et al.  Displacement prediction of landslide based on generalized regression neural networks with K-fold cross-validation , 2016, Neurocomputing.

[35]  Xiaofeng Xu,et al.  Multi-objective artificial bee colony algorithm for multi-stage resource leveling problem in sharing logistics network , 2020, Comput. Ind. Eng..

[36]  S. Disney,et al.  The impact of stochastic lead times on the bullwhip effect under correlated demand and moving average forecasts , 2014, Omega.

[37]  Chao Chen,et al.  Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction , 2019, Applied Energy.

[38]  John E. Boylan,et al.  Forecast horizon aggregation in integer autoregressive moving average (INARMA) models , 2012 .

[39]  Lilian M. de Menezes,et al.  Structural combination of seasonal exponential smoothing forecasts applied to load forecasting , 2019, Eur. J. Oper. Res..

[40]  Haiyan Lu,et al.  Combining forecasts of electricity consumption in China with time-varying weights updated by a high-order Markov chain model , 2014 .

[41]  Jianzhou Wang,et al.  Stock index forecasting based on a hybrid model , 2012 .

[42]  James W. Taylor,et al.  Probabilistic forecasting of wind power ramp events using autoregressive logit models , 2017, Eur. J. Oper. Res..

[43]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[44]  Jianping Li,et al.  Assessing the extreme risk spillovers of international commodities on maritime markets: A GARCH-Copula-CoVaR approach , 2020 .

[45]  Mingxi Liu,et al.  A novel cryptocurrency price trend forecasting model based on LightGBM , 2020 .

[46]  A. Koehler,et al.  Exponential Smoothing Model Selection for Forecasting , 2006 .

[47]  Irena Koprinska,et al.  Multi-step forecasting for big data time series based on ensemble learning , 2019, Knowl. Based Syst..

[48]  Cheng Liu,et al.  Research and application of ensemble forecasting based on a novel multi-objective optimization algorithm for wind-speed forecasting , 2017 .

[49]  Xiang Li,et al.  Artificial bee colony-based combination approach to forecasting agricultural commodity prices , 2019 .

[50]  Salim Lahmiri,et al.  A variational mode decompoisition approach for analysis and forecasting of economic and financial time series , 2016, Expert Syst. Appl..

[51]  Vivien Mallet,et al.  Ensemble forecast of photovoltaic power with online CRPS learning , 2018, International Journal of Forecasting.

[52]  Kin Keung Lai,et al.  Predicting monthly biofuel production using a hybrid ensemble forecasting methodology , 2019 .

[53]  Rob J. Hyndman,et al.  Crude oil price forecasting based on internet concern using an extreme learning machine , 2018, International Journal of Forecasting.

[54]  Qingcheng Zeng,et al.  A new approach for Baltic Dry Index forecasting based on empirical mode decomposition and neural networks , 2016 .

[55]  Mike G. Tsionas,et al.  A novel forecasting model for the Baltic dry index utilizing optimal squeezing , 2019, Journal of Forecasting.

[56]  Li Li,et al.  An effective and robust decomposition-ensemble energy price forecasting paradigm with local linear prediction , 2019, Energy Economics.

[57]  Chien-Chang Chou,et al.  A fuzzy neural network combined with technical indicators and its application to Baltic Dry Index forecasting , 2018, Journal of Marine Engineering & Technology.

[58]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[59]  A. P. Quimbaya,et al.  Stock market movement forecast: A Systematic review , 2020, Expert Syst. Appl..

[60]  Zishu Cheng,et al.  A new combined model based on multi-objective salp swarm optimization for wind speed forecasting , 2020, Appl. Soft Comput..

[61]  Lu Wei,et al.  A novel text-based framework for forecasting agricultural futures using massive online news headlines , 2020, International Journal of Forecasting.

[62]  Ralph D. Snyder,et al.  Forecasting intraday time series with multiple seasonal cycles using parsimonious seasonal exponential smoothing , 2009 .

[63]  Markus Haltmeier,et al.  A machine learning framework for customer purchase prediction in the non-contractual setting , 2020, Eur. J. Oper. Res..

[64]  Jianping Li,et al.  Predictability dynamics of multifactor-influenced installed capacity: A perspective of country clustering , 2021 .

[65]  Ahmet Murat Ozbayoglu,et al.  Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019 , 2019, Appl. Soft Comput..

[66]  Jacob M. Montgomery,et al.  Calibrating ensemble forecasting models with sparse data in the social sciences , 2015 .

[67]  J. R. Trapero,et al.  Empirical safety stock estimation based on kernel and GARCH models , 2019, Omega.

[68]  Jianping Li,et al.  Portfolio optimisation of material purchase considering supply risk – A multi-objective programming model , 2020 .

[69]  Abdolrahman Peimankar,et al.  Multi-objective ensemble forecasting with an application to power transformers , 2018, Appl. Soft Comput..