Forecasting Crude Oil Price Using EEMD and RVM with Adaptive PSO-Based Kernels

Crude oil, as one of the most important energy sources in the world, plays a crucial role in global economic events. An accurate prediction for crude oil price is an interesting and challenging task for enterprises, governments, investors, and researchers. To cope with this issue, in this paper, we proposed a method integrating ensemble empirical mode decomposition (EEMD), adaptive particle swarm optimization (APSO), and relevance vector machine (RVM)—namely, EEMD-APSO-RVM—to predict crude oil price based on the “decomposition and ensemble” framework. Specifically, the raw time series of crude oil price were firstly decomposed into several intrinsic mode functions (IMFs) and one residue by EEMD. Then, RVM with combined kernels was applied to predict target value for the residue and each IMF individually. To improve the prediction performance of each component, an extended particle swarm optimization (PSO) was utilized to simultaneously optimize the weights and parameters of single kernels for the combined kernel of RVM. Finally, simple addition was used to aggregate all the predicted results of components into an ensemble result as the final result. Extensive experiments were conducted on the crude oil spot price of the West Texas Intermediate (WTI) to illustrate and evaluate the proposed method. The experimental results are superior to those by several state-of-the-art benchmark methods in terms of root mean squared error (RMSE), mean absolute percent error (MAPE), and directional statistic (Dstat), showing that the proposed EEMD-APSO-RVM is promising for forecasting crude oil price.

[1]  José Luis Rojo-Álvarez,et al.  Nonlinear System Identification With Composite Relevance Vector Machines , 2007, IEEE Signal Processing Letters.

[2]  Tao Yu,et al.  Integrating relevance vector machines and genetic algorithms for optimization of seed-separating process , 2007, Eng. Appl. Artif. Intell..

[3]  Theodoros Damoulas,et al.  Multiclass Relevance Vector Machines: Sparsity and Accuracy , 2010, IEEE Transactions on Neural Networks.

[4]  Zhang Jinliang,et al.  A multiple adaptive wavelet recurrent neural network model to analyze crude oil prices , 2012 .

[5]  Haruna Chiroma,et al.  Kernel Functions for the Support Vector Machine: Comparing Performances on Crude Oil Price Data , 2014, SCDM.

[6]  Liwei Fan,et al.  An ICA-based support vector regression scheme for forecasting crude oil prices , 2016 .

[7]  Prem Kumar Kalra,et al.  Relevance vector machine with adaptive wavelet kernels for efficient image coding , 2010, Neurocomputing.

[8]  Yitao Liang,et al.  A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM , 2015 .

[9]  K. Lai,et al.  Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm , 2008 .

[10]  Nikolaos G. Bourbakis,et al.  Genetic Optimal Regression of Relevance Vector Machines for Electricity Pricing Signal Forecasting in Smart Grids , 2015, IEEE Transactions on Smart Grid.

[11]  Ling Tang,et al.  A decomposition–ensemble model with data-characteristic-driven reconstruction for crude oil price forecasting , 2015 .

[12]  Hui Liu,et al.  Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction , 2012 .

[13]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[14]  Y. Xiang,et al.  Application of ARIMA Model in Short-Term Prediction of International Crude Oil Price , 2013 .

[15]  H. Mohammadi,et al.  International evidence on crude oil price dynamics: Applications of ARIMA-GARCH models , 2010 .

[16]  Sheng Chen,et al.  Errata to "The relevance vector machine technique for channel equalization application" , 2002, IEEE Trans. Neural Networks.

[17]  Ling Tang,et al.  A Novel CEEMD-Based EELM Ensemble Learning Paradigm for Crude Oil Price Forecasting , 2015, Int. J. Inf. Technol. Decis. Mak..

[18]  Weidong Zhou,et al.  Multifractal Analysis and Relevance Vector Machine-Based Automatic Seizure Detection in Intracranial EEG , 2015, Int. J. Neural Syst..

[19]  Ling Tang,et al.  A compressed sensing based AI learning paradigm for crude oil price forecasting , 2014 .

[20]  K. Lai,et al.  Crude oil price analysis and forecasting using wavelet decomposed ensemble model , 2012 .

[21]  Ekin Tokat,et al.  Forecasting oil price movements with crack spread futures , 2009 .

[22]  R. Rossiter,et al.  Are there exploitable inefficiencies in the futures market for oil , 2007 .

[23]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[24]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[25]  Datong Liu,et al.  Lithium-ion battery remaining useful life estimation with an optimized Relevance Vector Machine algorithm with incremental learning , 2015 .

[26]  Xiaopeng Guo,et al.  Improved Support Vector Machine Oil Price Forecast Model Based on Genetic Algorithm Optimization Parameters , 2012 .

[27]  Yong He,et al.  Wind speed prediction using the hybrid model of wavelet decomposition and artificial bee colony algorithm-based relevance vector machine , 2015 .

[28]  Ling Tang,et al.  A novel decomposition ensemble model with extended extreme learning machine for crude oil price forecasting , 2016, Eng. Appl. Artif. Intell..

[29]  Duc Khuong Nguyen,et al.  Forecasting the conditional volatility of oil spot and futures prices with structural breaks and long memory models , 2012 .

[30]  Claudio Morana,et al.  A semiparametric approach to short-term oil price forecasting , 2001 .

[31]  Lean Yu,et al.  A New Method for Crude Oil Price Forecasting Based on Support Vector Machines , 2006, International Conference on Computational Science.

[32]  Alan T. K. Wan,et al.  An empirical model of daily highs and lows of West Texas Intermediate crude oil prices , 2010 .

[33]  Shian-Chang Huang,et al.  WAVELET-BASED RELEVANCE VECTOR REGRESSION MODEL COUPLED WITH PHASE SPACE RECONSTRUCTION FOR EXCHANGE RATE FORECASTING , 2011 .

[34]  Hamid Sheikhzadeh,et al.  Relevance Vector Machine for Survival Analysis , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Sam Mirmirani,et al.  A Comparison of VAR and Neural Networks with Genetic Algorithm in Forecasting Price of Oil , 2003, IC-AI.

[36]  Li Shurong,et al.  Crude Oil Price Prediction Based on a Dynamic Correcting Support Vector Regression Machine , 2013 .

[37]  Richa Singh,et al.  Incremental granular relevance vector machine: A case study in multimodal biometrics , 2016, Pattern Recognit..

[38]  Yudong Wang,et al.  Detrended fluctuation analysis on spot and futures markets of West Texas Intermediate crude oil , 2011 .

[39]  Shian-Chang Huang,et al.  Combining wavelet‐based feature extractions with relevance vector machines for stock index forecasting , 2008, Expert Syst. J. Knowl. Eng..

[40]  Fan Wang,et al.  Modeling tunneling-induced ground surface settlement development using a wavelet smooth relevance vector machine , 2013 .

[41]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[42]  Tiago H. Falk,et al.  Relevance vector classifier decision fusion and EEG graph-theoretic features for automatic affective state characterization , 2016, Neurocomputing.

[43]  Rainer Goebel,et al.  Predicting EEG single trial responses with simultaneous fMRI and Relevance Vector Machine regression , 2011, NeuroImage.

[44]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[45]  Ali Azadeh,et al.  A flexible neural network-fuzzy mathematical programming algorithm for improvement of oil price estimation and forecasting , 2012, Comput. Ind. Eng..

[46]  Lutz Kilian,et al.  Real-Time Forecasts of the Real Price of Oil , 2011 .

[47]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[48]  N. Huang,et al.  A new view of nonlinear water waves: the Hilbert spectrum , 1999 .

[49]  Yang Jianhong,et al.  Product quality modelling and prediction based on wavelet relevance vector machines , 2013 .

[50]  Heping Pan,et al.  Forecasting model for crude oil prices based on artificial neural networks , 2008, 2008 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[51]  Sheng Chen,et al.  The relevance vector machine technique for channel equalization application , 2001, IEEE Trans. Neural Networks.

[52]  Kin Keung Lai,et al.  Multivariate EMD-Based Modeling and Forecasting of Crude Oil Price , 2016 .

[53]  Sheng-wei Fei,et al.  A Multiple-Kernel Relevance Vector Machine with Nonlinear Decreasing Inertia Weight PSO for State Prediction of Bearing , 2015 .

[54]  Yue Chen,et al.  Day-Ahead Wind Speed Forecasting Using Relevance Vector Machine , 2014, J. Appl. Math..

[55]  Li Liu,et al.  Nonlinear Hydrological Time Series Forecasting Based on the Relevance Vector Regression , 2006, ICONIP.

[56]  Sangchul Won,et al.  A new approach to fuzzy modeling of nonlinear dynamic systems with noise: relevance vector learning mechanism , 2006, IEEE Transactions on Fuzzy Systems.

[57]  Wei Li,et al.  A novel sensor fault diagnosis method based on Modified Ensemble Empirical Mode Decomposition and Probabilistic Neural Network , 2015 .

[58]  K. Lai,et al.  A new approach for crude oil price analysis based on Empirical Mode Decomposition , 2008 .

[59]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[60]  Zhilin Zhang,et al.  Combining ensemble empirical mode decomposition with spectrum subtraction technique for heart rate monitoring using wrist-type photoplethysmography , 2015, Biomed. Signal Process. Control..

[61]  J. J. Reeves,et al.  Quarterly beta forecasting: An evaluation , 2008 .