A New Hybrid Forecasting Model Based on SW-LSTM and Wavelet Packet Decomposition: A Case Study of Oil Futures Prices

The crude oil futures prices forecasting is a significant research topic for the management of the energy futures market. In order to optimize the accuracy of energy futures prices prediction, a new hybrid model is established in this paper which combines wavelet packet decomposition (WPD) based on long short-term memory network (LSTM) with stochastic time effective weight (SW) function method (WPD-SW-LSTM). In the proposed framework, WPD is a signal processing method employed to decompose the original series into subseries with different frequencies and the SW-LSTM model is constructed based on random theory and the principle of LSTM network. To investigate the prediction performance of the new forecasting approach, SVM, BPNN, LSTM, WPD-BPNN, WPD-LSTM, CEEMDAN-LSTM, VMD-LSTM, and ST-GRU are considered as comparison models. Moreover, a new error measurement method (multiorder multiscale complexity invariant distance, MMCID) is improved to evaluate the forecasting results from different models, and the numerical results demonstrate that the high-accuracy forecast of oil futures prices is realized.

[1]  Hui Liu,et al.  A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting , 2020 .

[2]  Spyros Makridakis,et al.  Accuracy measures: theoretical and practical concerns☆ , 1993 .

[3]  Jinchao Li,et al.  Monthly crude oil spot price forecasting using variational mode decomposition , 2019, Energy Economics.

[4]  Hui Liu,et al.  Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction , 2012 .

[5]  Mohammad Reza Meybodi,et al.  Brownian Motion Optimization : an Algorithm for Optimization ( GBMO ) , 2012 .

[6]  Wei-Chiang Hong,et al.  Electric Load Forecasting Based on a Least Squares Support Vector Machine with Fuzzy Time Series and Global Harmony Search Algorithm , 2016 .

[7]  James A. Rodger,et al.  A fuzzy nearest neighbor neural network statistical model for predicting demand for natural gas and energy cost savings in public buildings , 2014, Expert Syst. Appl..

[8]  John F. Kolen,et al.  Evaluating Benchmark Problems by Random Guessing , 2001 .

[9]  Alaa El. Sagheer,et al.  Time series forecasting of petroleum production using deep LSTM recurrent networks , 2019, Neurocomputing.

[10]  Liu Xiao-tong.  Study on Data Normalization in BP Neural Network , 2010 .

[11]  Zhong-kai Feng,et al.  A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm , 2019, Applied Energy.

[12]  Wei‐Chiang Hong,et al.  Chaos cloud quantum bat hybrid optimization algorithm , 2021 .

[13]  Daniel Dufresne.  The integral of geometric Brownian motion , 2001 .

[14]  Hui Liu,et al.  Smart deep learning based wind speed prediction model using wavelet packet decomposition, convolutional neural network and convolutional long short term memory network , 2018 .

[15]  B. Auer,et al.  The economic and financial properties of crude oil: A review , 2020 .

[16]  Sarma Vrudhula,et al.  An Energy-Efficient Reconfigurable LSTM Accelerator for Natural Language Processing , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[17]  Bin Wang,et al.  Deep multi-hybrid forecasting system with random EWT extraction and variational learning rate algorithm for crude oil futures , 2020, Expert Syst. Appl..

[18]  M. Schroder.  On the integral of geometric Brownian motion , 2002, math/0205063.

[19]  Olivier Grunder,et al.  Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm , 2017 .

[20]  Jun Wang,et al.  Prediction model of energy market by long short term memory with random system and complexity evaluation , 2020, Appl. Soft Comput..

[21]  Hualing Lin,et al.  Reducing Exchange Rate Risks in International Trade: A Hybrid Forecasting Approach of CEEMDAN and Multilayer LSTM , 2020, Sustainability.

[22]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Enrico Zio,et al.  A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model , 2019, Energy.

[24]  Jim Gatheral,et al.  Optimal Trade Execution under Geometric Brownian Motion in the Almgren and Chriss Framework , 2011 .

[25]  Grzegorz Dudek,et al.  A Method of Generating Random Weights and Biases in Feedforward Neural Networks with Random Hidden Nodes , 2017, Inf. Sci..

[26]  Lei Wang,et al.  Rolling Bearing Fault Diagnosis Based on Wavelet Packet Decomposition and Multi-Scale Permutation Entropy , 2015, Entropy.

[27]  Jun Wang,et al.  Forecasting stochastic neural network based on financial empirical mode decomposition , 2017, Neural Networks.

[28]  Jingmiao Li,et al.  Forcasting of energy futures market and synchronization based on stochastic gated recurrent unit model , 2020 .

[29]  Jun Wang,et al.  Forecasting stock market indexes using principle component analysis and stochastic time effective neural networks , 2015, Neurocomputing.

[30]  K. Lai,et al.  Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm , 2008 .

[31]  Jian Wang,et al.  A hybrid forecasting approach applied in wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm , 2018, Energy.

[32]  Eamonn J. Keogh,et al.  CID: an efficient complexity-invariant distance for time series , 2013, Data Mining and Knowledge Discovery.

[33]  Javad Poshtan,et al.  Bearing fault detection using wavelet packet transform of induction motor stator current , 2007 .

[34]  Farshid Keynia,et al.  Short-term load forecasting of power systems by combination of wavelet transform and neuro-evolutionary algorithm , 2009 .

[35]  Ali Akbar Abdoos,et al.  A new intelligent method based on combination of VMD and ELM for short term wind power forecasting , 2016, Neurocomputing.

[36]  Gang Liu,et al.  Bidirectional LSTM with attention mechanism and convolutional layer for text classification , 2019, Neurocomputing.

[37]  Jun Wang,et al.  Forecasting energy market indices with recurrent neural networks: Case study of crude oil price fluctuations , 2016 .

[38]  Jun Wang,et al.  Forecasting model of global stock index by stochastic time effective neural network , 2008, Expert Syst. Appl..

[39]  Durdu Ömer Faruk.  A hybrid neural network and ARIMA model for water quality time series prediction , 2010, Eng. Appl. Artif. Intell..

[40]  Ronald R. Coifman,et al.  Wavelet analysis and signal processing , 1990 .

[41]  Seyed Babak Ebrahimi,et al.  A new hybrid model for forecasting Brent crude oil price , 2020, Energy.

[42]  Antonio F. Skarmeta,et al.  A hybrid neuro-fuzzy inference system-based algorithm for time series forecasting applied to energy consumption prediction , 2020, Applied Energy.

[43]  Jianzhou Wang,et al.  A novel hybrid model for short-term wind power forecasting , 2019, Appl. Soft Comput..

[44]  Sung Wook Baik,et al.  Cloud-Assisted Multiview Video Summarization Using CNN and Bidirectional LSTM , 2020, IEEE Transactions on Industrial Informatics.

[45]  Lahmiri Salim,et al.  A Comparison of PNN and SVM for Stock Market Trend Prediction using Economic and Technical Information , 2011 .

[46]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[47]  David de la Fuente,et al.  Stock Market Simulation Using Support Vector Machines , 2014 .

[48]  Mohamed Lazaar,et al.  Integration of Principal Component Analysis and Recurrent Neural Network to Forecast the Stock Price of Casablanca Stock Exchange , 2019, Procedia Computer Science.

[49]  Ioannis E. Livieris,et al.  A CNN–LSTM model for gold price time-series forecasting , 2020, Neural Computing and Applications.

[50]  Hamed H. H. Aly,et al.  A proposed intelligent short-term load forecasting hybrid models of ANN, WNN and KF based on clustering techniques for smart grid , 2020 .

[51]  David Zimbra,et al.  A dynamic artificial neural network model for forecasting time series events , 2005 .

[52]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[53]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[54]  Hui Liu,et al.  Data processing strategies in wind energy forecasting models and applications: A comprehensive review , 2019, Applied Energy.

[55]  Jian-Da Wu,et al.  An expert system for fault diagnosis in internal combustion engines using wavelet packet transform and neural network , 2009, Expert Syst. Appl..

[56]  Ha Young Kim,et al.  Forecasting the volatility of stock price index: A hybrid model integrating LSTM with multiple GARCH-type models , 2018, Expert Syst. Appl..

[57]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[58]  Rahib Hidayat Abiyev,et al.  Fuzzy wavelet neural network based on fuzzy clustering and gradient techniques for time series prediction , 2011, Neural Computing and Applications.

[59]  Wei-Chiang Hong,et al.  Support Vector Regression Model Based on Empirical Mode Decomposition and Auto Regression for Electric Load Forecasting , 2013 .

[60]  Kunliang Xu,et al.  A hybrid stock price index forecasting model based on variational mode decomposition and LSTM network , 2020, Applied Intelligence.

[61]  Periklis Gogas,et al.  Forecasting energy markets using support vector machines , 2014 .

[62]  Ali Safari,et al.  Oil price forecasting using a hybrid model , 2018 .