A multiple-kernel support vector regression approach for stock market price forecasting

Support vector regression has been applied to stock market forecasting problems. However, it is usually needed to tune manually the hyperparameters of the kernel functions. Multiple-kernel learning was developed to deal with this problem, by which the kernel matrix weights and Lagrange multipliers can be simultaneously derived through semidefinite programming. However, the amount of time and space required is very demanding. We develop a two-stage multiple-kernel learning algorithm by incorporating sequential minimal optimization and the gradient projection method. By this algorithm, advantages from different hyperparameter settings can be combined and overall system performance can be improved. Besides, the user need not specify the hyperparameter settings in advance, and trial-and-error for determining appropriate hyperparameter settings can then be avoided. Experimental results, obtained by running on datasets taken from Taiwan Capitalization Weighted Stock Index, show that our method performs better than other methods.

[1]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[2]  Byung Ro Moon,et al.  A Hybrid Neurogenetic Approach for Stock Forecasting , 2007, IEEE Transactions on Neural Networks.

[3]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[4]  Yves Grandvalet,et al.  More efficiency in multiple kernel learning , 2007, ICML '07.

[5]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[6]  F. Pérez-Cruz,et al.  Estimating GARCH models using support vector machines , 2003 .

[7]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[8]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[9]  Guoqiang Peter Zhang,et al.  Trend Time–Series Modeling and Forecasting With Neural Networks , 2008, IEEE Transactions on Neural Networks.

[10]  Alexander J. Smola,et al.  Learning the Kernel with Hyperkernels , 2005, J. Mach. Learn. Res..

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[13]  Johan A. K. Suykens,et al.  Financial time series prediction using least squares support vector machines within the evidence framework , 2001, IEEE Trans. Neural Networks.

[14]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[15]  James T. Kwok,et al.  The evidence framework applied to support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[16]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[17]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[18]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[19]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[20]  Koby Crammer,et al.  Kernel Design Using Boosting , 2002, NIPS.

[21]  Kristin P. Bennett,et al.  MARK: a boosting algorithm for heterogeneous kernel models , 2002, KDD.

[22]  Songcan Chen,et al.  MultiK-MHKS: A Novel Multiple Kernel Learning Algorithm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ping-Feng Pai,et al.  A hybrid ARIMA and support vector machines model in stock price forecasting , 2005 .

[24]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[25]  Ivor W. Tsang,et al.  Efficient hyperkernel learning using second-order cone programming , 2004, IEEE Transactions on Neural Networks.

[27]  Pei-Chann Chang,et al.  A TSK type fuzzy rule based system for stock price prediction , 2008, Expert Syst. Appl..

[28]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[29]  Mohammad Hossein Fazel Zarandi,et al.  A type-2 fuzzy rule-based expert system model for stock price analysis , 2009, Expert Syst. Appl..

[30]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[31]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[32]  T. Ouarda,et al.  Generalized autoregressive conditional heteroscedasticity modelling of hydrologic time series , 2012 .

[33]  James V. Hansen,et al.  Neural networks and traditional time series methods: a synergistic combination in state economic forecasts , 1997, IEEE Trans. Neural Networks.

[34]  Valeriy V. Gavrishchaka,et al.  Support Vector Machine as an Efficient Framework for Stock Market Volatility Forecasting , 2006, Comput. Manag. Sci..

[35]  Dongsong Zhang,et al.  Discovering golden nuggets: data mining in financial application , 2004, IEEE Trans. Syst. Man Cybern. Part C.

[36]  Lai-Wan Chan,et al.  Support Vector Machine Regression for Volatile Stock Market Prediction , 2002, IDEAL.

[37]  Sung-Kwun Oh,et al.  Genetically optimized fuzzy polynomial neural networks , 2006, IEEE Transactions on Fuzzy Systems.

[38]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[39]  Yves Grandvalet,et al.  Composite kernel learning , 2008, ICML '08.

[40]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[41]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[42]  D. G. Champernowne,et al.  Sampling Theory Applied to Autoregressive Sequences , 1948 .