Proximal support vector machine based hybrid prediction models for trend forecasting in financial markets

Abstract In the recent years, various financial forecasting systems have been developed using machine learning techniques. Deciding the relevant input variables for these systems is a crucial factor and their performances depend a lot on the choice of input variables. In this work, a set of fifty-five technical indicators has been considered based on their application in technical analysis as input feature to predict the future (one-day-ahead) direction of stock indices. This study proposes four hybrid prediction models that are combinations of four different feature selection techniques (Linear Correlation (LC), Rank Correlation (RC), Regression Relief (RR) and Random Forest (RF)), with proximal support vector machine (PSVM) classifier. The performance of these models has been evaluated for twelve different stock indices, on the basis of several performance metrics used in literature. A new performance measuring criteria, called joint prediction error (JPE) is also proposed for comparing the results. The empirical results obtained over a set of stock market indices from different international markets show that all hybrid models perform better than the individual PSVM prediction model. The comparison between the proposed models demonstrates superiority of RF-PSVM over all other prediction models. Empirical findings also suggest the superiority of a certain set of indicators over other indicators in achieving better results.

[1]  Jean-Michel Poggi,et al.  Variable selection using random forests , 2010, Pattern Recognit. Lett..

[2]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[3]  Cheng-Lung Huang,et al.  A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting , 2009, Expert Syst. Appl..

[4]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[5]  Francis Eng Hock Tay,et al.  Financial Forecasting Using Support Vector Machines , 2001, Neural Computing & Applications.

[6]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[7]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[8]  Russell L. Purvis,et al.  Forecasting the NYSE composite index with technical analysis, pattern recognizer, neural network, and genetic algorithm: a case study in romantic decision support , 2002, Decis. Support Syst..

[9]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[10]  B. Parlett.  The Symmetric Eigenvalue Problem , 1981 .

[11]  Steven c. Blank.  "Chaos" In Futures Markets? A Nonlinear Dynamical Analysis , 1991 .

[12]  G. Grudnitski,et al.  Forecasting S&P and gold futures prices: An application of neural networks , 1993 .

[13]  A. Boulesteix,et al.  Bias in random forest variable importance measures: Illustrations, sources and a solution , 2007, BMC Bioinformatics.

[14]  Achim Zeileis,et al.  Bias in random forest variable importance measures: Illustrations, sources and a solution , 2007, BMC Bioinformatics.

[15]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[16]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[17]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[18]  Guido Deboeck,et al.  Trading on the Edge: Neural, Genetic, and Fuzzy Systems for Chaotic Financial Markets , 1994 .

[19]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[20]  Kimon P. Valavanis,et al.  Surveying stock market forecasting techniques - Part II: Soft computing methods , 2009, Expert Syst. Appl..

[21]  Huanhuan Chen,et al.  Evolving Least Squares Support Vector Machines for Stock Market Trend Mining , 2009, IEEE Trans. Evol. Comput..

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[24]  Richard Lippmann,et al.  Book Review: Neural Networks, a Comprehensive Foundation, by Simon Haykin , 1994, Int. J. Neural Syst..

[25]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[26]  Robin Genuer,et al.  Random Forests: some methodological insights , 2008, 0811.3619.

[27]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[28]  Guoqiang Peter Zhang,et al.  An investigation of neural networks for linear time-series forecasting , 2001, Comput. Oper. Res..

[29]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[30]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[31]  Zhi-Wei Ni,et al.  Stock trend prediction based on fractal feature selection and support vector machine , 2011, Expert Syst. Appl..

[32]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[33]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[34]  Lijuan Cao,et al.  Support vector machines experts for time series forecasting , 2003, Neurocomputing.

[35]  Chih-Fong Tsai,et al.  Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches , 2010, Decis. Support Syst..

[36]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[37]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[38]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[39]  Marko Robnik-Sikonja,et al.  An adaptation of Relief for attribute estimation in regression , 1997, ICML.

[40]  Lukas Menkhoff,et al.  Examining the Use of Technical Currency Analysis , 1997 .

[41]  Ming-Chi Lee,et al.  Using support vector machine with a hybrid feature selection method to the stock trend prediction , 2009, Expert Syst. Appl..

[42]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[43]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..