Automatic optimized support vector regression for financial data prediction

The aim of this article is to introduce a hybrid approach, namely optimal multiple kernel–support vector regression (OMK–SVR) for time series data prediction and to analyze and compare its performances against those of support vector regression with a single RBF kernel (RBF-SVR), gene expression programming (GEP) and extreme learning machine (ELM) on the financial series formed by the monthly and weekly values of Bursa Malaysia KLCI Index, monthly values of Dow Jones Industrial Average Index (DJIA) and New York Stock Exchange. Our method provides an optimal multiple kernel and optimal parameters in Support Vector Regression, improving the accuracy of prediction. The proposed approach is structured on two levels. The macro-level uses a breeder genetic algorithm for choosing the optimal multiple kernel and the SVR optimal parameters. The fitness function of each chromosome is computed in the micro-level using a SVR algorithm. The regression model based on the optimal multiple kernel and optimal parameters is then validated and used for forecasting. The experimental results prove that OMK–SVR performs better than GEP, RBF-SVR and ELM for predicting the future behavior of the study series. A sensitivity study with respect to the number of kernels from the multiple kernel used by OMK–SVR and with respect to the ratio between training and testing data sets was conducted.

[1]  Sven F. Crone,et al.  Parameter Sensitivity of Support Vector Regression and Neural Networks for Forecasting , 2006, DMIN.

[2]  Michael McAleer,et al.  Machine News and Volatility: The Dow Jones Industrial Average and the TRNA Real-Time High-Frequency Sentiment Series , 2014 .

[3]  Kamal Raj Pardasani,et al.  A COMPARISON BETWEEN HYBRID APPROACHES OF ANN AND ARIMA FOR INDIAN STOCK TREND FORECASTING , 2010 .

[4]  A. Bărbulescu,et al.  Forecasting meteorological time series using soft computing methods: an empirical study , 2013 .

[5]  Alina Bărbulescu,et al.  Mathematical models of climate evolution in Dobrudja , 2010 .

[6]  M. Kosaka,et al.  Application Of Neural Network To Technical Analysis Of Stock Market Prediction , 2001 .

[7]  Alina Barbulescu,et al.  A hybrid approach for modeling financial time series , 2012, Int. Arab J. Inf. Technol..

[8]  Mona R. El Shazly,et al.  Forecasting currency prices using a genetically evolved neural network architecture , 1999 .

[9]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[10]  Dana Simian,et al.  A General Frame for Building Optimal Multiple SVM Kernels , 2011, LSSC.

[11]  Junjie Li,et al.  Slope reliability analysis using surrogate models via new support vector machines with swarm intelligence , 2016 .

[12]  Cândida Ferreira,et al.  The Entities of Gene Expression Programming , 2006 .

[13]  Rohit Choudhry,et al.  A Hybrid Machine Learning System for Stock Market Forecasting , 2008 .

[14]  Manminder Singh Saluja,et al.  Stock Direction Forecasting Techniques: An Empirical Study Combining Machine Learning System with Market Indicators in the Indian Context , 2014 .

[15]  Teresa Bernarda Ludermir,et al.  Iterative ARIMA-multiple support vector regression models for long term time series prediction , 2014, ESANN.

[16]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[17]  L. Pazvakawambwa,et al.  Forecasting methods and applications. , 2013 .

[18]  D. Basak,et al.  Support Vector Regression , 2008 .

[19]  JingTao Yao,et al.  Forecasting the KLSE index using neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[20]  Roland Schwaiger,et al.  Evolutionary and coevolutionary approaches to time series prediction using generalized multi-layer perceptrons , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[21]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[22]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[23]  Syed Saad Azhar Ali,et al.  Stock market prediction using machine learning techniques , 2016, 2016 3rd International Conference on Computer and Information Sciences (ICCOINS).

[24]  Anupam Shukla,et al.  Analysis of Artificial Neural Network for Financial Time Series Forecasting , 2010 .

[25]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[26]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[27]  Han Meng,et al.  Parameter selection in SVM with RBF kernel function , 2012, World Automation Congress 2012.

[28]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence , 2014, Studies in Computational Intelligence.

[29]  Yuan Yao,et al.  Mercer's Theorem, Feature Maps, and Smoothing , 2006, COLT.

[30]  Ganapati Panda,et al.  Prediction of S&P 500 and DJIA stock indices using Particle Swarm Optimization technique , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[31]  Qiujun Huang,et al.  An improved grid search algorithm of SVR parameters optimization , 2012, 2012 IEEE 14th International Conference on Communication Technology.

[32]  UAN,et al.  1 FINANCIAL TIME SERIES FORECASTING USING A HYBRID NEURAL-EVOLUTIVE APPROACH , 2009 .

[33]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[34]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[35]  Florin Stoica,et al.  Using the Breeder genetic algorithm to optimize a multiple regression analysis model used in prediction of the mesiodistal width of unerupted teeth , 2014, Int. J. Comput. Commun. Control.

[36]  Lijuan Cao,et al.  Support vector machines experts for time series forecasting , 2003, Neurocomputing.

[37]  Jia Liu,et al.  Concrete dam deformation prediction model for health monitoring based on extreme learning machine , 2017 .

[38]  Li Zhu,et al.  Gene expression programming in prediction , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[39]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[40]  Ratnadip Adhikari,et al.  Time Series Forecasting Using Hybrid ARIMA and ANN Models Based on DWT Decomposition , 2015 .

[41]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[42]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[43]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[44]  Mihai Oltean,et al.  Improving SVM Performance Using a Linear Combination of Kernels , 2007, ICANNGA.

[45]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[46]  Soushan Wu,et al.  Comparison of support-vector machines and back propagation neural networks in forecasting the six major Asian stock markets , 2006 .

[47]  Laura Florentina Cacovean,et al.  Using genetic algorithms and simulation as decision support in marketing strategies and long-term production planning , 2009 .

[48]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.