A CEEMDAN and XGBOOST-Based Approach to Forecast Crude Oil Prices

Crude oil is one of the most important types of energy for the global economy, and hence it is very attractive to understand the movement of crude oil prices. However, the sequences of crude oil prices usually show some characteristics of nonstationarity and nonlinearity, making it very challenging for accurate forecasting crude oil prices. To cope with this issue, in this paper, we propose a novel approach that integrates complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and extreme gradient boosting (XGBOOST), so-called CEEMDAN-XGBOOST, for forecasting crude oil prices. Firstly, we use CEEMDAN to decompose the nonstationary and nonlinear sequences of crude oil prices into several intrinsic mode functions (IMFs) and one residue. Secondly, XGBOOST is used to predict each IMF and the residue individually. Finally, the corresponding prediction results of each IMF and the residue are aggregated as the final forecasting results. To demonstrate the performance of the proposed approach, we conduct extensive experiments on the West Texas Intermediate (WTI) crude oil prices. The experimental results show that the proposed CEEMDAN-XGBOOST outperforms some state-of-the-art models in terms of several evaluation metrics.

[1]  Yan Li,et al.  Daily Peak Load Forecasting Based on Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and Support Vector Machine Optimized by Modified Grey Wolf Optimization Algorithm , 2018 .

[2]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[3]  Ling Tang,et al.  A compressed sensing based AI learning paradigm for crude oil price forecasting , 2014 .

[4]  Min Zhou,et al.  ECG Classification Using Wavelet Packet Entropy and Random Forests , 2016, Entropy.

[5]  Manuel Blanco-Velasco,et al.  ECG signal denoising and baseline wander correction based on the empirical mode decomposition , 2008, Comput. Biol. Medicine.

[6]  Jiang Wu,et al.  Forecasting Crude Oil Prices Using Ensemble Empirical Mode Decomposition and Sparse Bayesian Learning , 2018, Energies.

[7]  Min Luo,et al.  Forecasting Crude Oil Price Using EEMD and RVM with Adaptive PSO-Based Kernels , 2016 .

[8]  Xu Gong,et al.  Forecasting the volatility of crude oil futures using HAR-type models with structural breaks , 2016 .

[9]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[10]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[11]  Ling Tang,et al.  A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting , 2015, Int. J. Inf. Technol. Decis. Mak..

[12]  Ki H. Chon,et al.  Automatic Motion and Noise Artifact Detection in Holter ECG Data Using Empirical Mode Decomposition and Statistical Approaches , 2012, IEEE Transactions on Biomedical Engineering.

[13]  Ling Tang,et al.  LSSVR ensemble learning with uncertain parameters for crude oil price forecasting , 2017, Appl. Soft Comput..

[14]  Tianyang Wang,et al.  Influential factors in crude oil price forecasting , 2017 .

[15]  Chu Zhang,et al.  Multi-step ahead wind speed forecasting using a hybrid model based on two-stage decomposition technique and AdaBoost-extreme learning machine , 2017 .

[16]  Wei-jun Zhang,et al.  The Improved SVM Method for Forecasting the Fluctuation of International Crude Oil Price , 2009, 2009 International Conference on Electronic Commerce and Business Intelligence.

[17]  Fariba Khodayar,et al.  A hybrid optimized artificial intelligent model to forecast crude oil using genetic algorithm , 2011 .

[18]  Mohanad S. Al-Musaylh,et al.  Two-phase particle swarm optimized-support vector regression hybrid model integrated with improved empirical mode decomposition with adaptive noise for multiple-horizon electricity demand forecasting , 2018 .

[19]  Yanhui Chen,et al.  Forecasting Crude Oil Prices: a Deep Learning based Model , 2017, ITQM.

[20]  Jun Wang,et al.  Forecasting energy fluctuation model by wavelet decomposition and stochastic recurrent wavelet neural network , 2018, Neurocomputing.

[21]  Meng Sun,et al.  A New Feature Extraction Method Based on EEMD and Multi-Scale Fuzzy Entropy for Motor Bearing , 2016, Entropy.

[22]  Wu Deng,et al.  A Novel Fault Diagnosis Method Based on Integrating Empirical Wavelet Transform and Fuzzy Entropy for Motor Bearing , 2018, IEEE Access.

[23]  Xu Gong,et al.  Forecasting the good and bad uncertainties of crude oil prices using a HAR framework , 2017 .

[24]  Ling Tang,et al.  A hybrid grid-GA-based LSSVR learning paradigm for crude oil price forecasting , 2016, Neural Computing and Applications.

[25]  Xiqun Chen,et al.  Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach , 2017, ArXiv.

[26]  Michael Ye,et al.  A Short-Run Crude Oil Price Forecast Model with Ratchet Effect , 2009 .

[27]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[28]  Yaguo Lei,et al.  A fault diagnosis method of rolling element bearings based on CEEMDAN , 2017 .

[29]  Kin Keung Lai,et al.  A Novel Hybrid AI System Framework for Crude Oil Price Forecasting , 2004, CASDMKM.

[30]  Haruna Chiroma,et al.  A Review on Artificial Intelligence Methodologies for the Forecasting of Crude Oil Price , 2016, Intell. Autom. Soft Comput..

[31]  Jean Dickinson Gibbons,et al.  Nonparametric Statistical Inference , 1972, International Encyclopedia of Statistical Science.

[32]  Patrick Flandrin,et al.  A complete ensemble empirical mode decomposition with adaptive noise , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Hui Liu,et al.  Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction , 2012 .

[34]  K. Lai,et al.  Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm , 2008 .

[35]  Claudio Morana,et al.  A semiparametric approach to short-term oil price forecasting , 2001 .

[36]  Gangbing Song,et al.  Health Degradation Monitoring and Early Fault Diagnosis of a Rolling Bearing Based on CEEMDAN and Improved MMSE , 2018, Materials.

[37]  Yun Wang,et al.  Fault Feature Selection and Diagnosis of Rolling Bearings Based on EEMD and Optimized Elman_AdaBoost Algorithm , 2018, IEEE Sensors Journal.

[38]  Liwei Fan,et al.  An ICA-based support vector regression scheme for forecasting crude oil prices , 2016 .

[39]  Rabah Abdelkader,et al.  Rolling Bearing Fault Diagnosis Based on an Improved Denoising Method Using the Complete Ensemble Empirical Mode Decomposition and the Optimized Thresholding Operation , 2018, IEEE Sensors Journal.

[40]  Hanan Naser,et al.  Estimating and forecasting the real prices of crude oil: A data rich model using a dynamic model averaging (DMA) approach , 2016 .

[41]  María Eugenia Torres,et al.  Improved complete ensemble EMD: A suitable tool for biomedical signal processing , 2014, Biomed. Signal Process. Control..

[42]  Jozef Baruník,et al.  Forecasting the Term Structure of Crude Oil Futures Prices with Neural Networks , 2015, 1504.04819.

[43]  Jimin Ye,et al.  Crude oil price analysis and forecasting based on variational mode decomposition and independent component analysis , 2017 .

[44]  Binxu Zhai,et al.  Development of a stacked ensemble model for forecasting and analyzing daily average PM2.5 concentrations in Beijing, China. , 2018, The Science of the total environment.

[45]  Sotirios Chatzis,et al.  Forecasting stock market crisis events using deep and statistical machine learning techniques , 2018, Expert Syst. Appl..