Forecasting Stock Index Movement: A Comparison of Support Vector Machines and Random Forest

There exists vast research articles which predict the stock market as well pricing of stock index financial instruments but most of the proposed models focus on the accurate forecasting of the levels (i.e. value) of the underlying stock index. There is a lack of studies examining the predictability of the direction/sign of stock index movement. Given the notion that a prediction with little forecast error does not necessarily translate into capital gain, this study is an attempt to predict the direction of S&P CNX NIFTY Market Index of the National Stock Exchange, one of the fastest growing financial exchanges in developing Asian countries. Random forest and Support Vector Machines (SVM) are very specific type of machine learning method, and are promising tools for the prediction of financial time series. The tested classification models, which predict direction, include linear discriminant analysis, logit, artificial neural network, random forest and SVM. Empirical experimentation suggests that the SVM outperforms the other classification methods in terms of predicting the direction of the stock market movement and random forest method outperforms neural network, discriminant analysis and logit model used in this study.

[1]  T. Day.  Asset returns and inflation , 1981 .

[2]  Michael S. Rozeff.  Dividend yields are equity risk premiums , 1984 .

[3]  J. Campbell.  Stock Returns and the Term Structure , 1985 .

[4]  Randolph Westerfield,et al.  Patterns in Japanese Common Stock Returns: Day of the Week and Turn of the Year Effects , 1985, Journal of Financial and Quantitative Analysis.

[5]  Donald B. Keim,et al.  Predicting returns in the stock and bond markets , 1986 .

[6]  Edwin D. Maverly.  The informational content of the interday price change with respect to stock index futures , 1986 .

[7]  W. Breen,et al.  Sample‐Dependent Results Using Accounting and Market Data: Some Evidence , 1986 .

[8]  E. Fama,et al.  The Information in Long-Maturity Forward Rates , 1987 .

[9]  E. Fama,et al.  Dividend yields and expected stock returns , 1988 .

[10]  E. Fama,et al.  Permanent and Temporary Components of Stock Prices , 1988, Journal of Political Economy.

[11]  Donald B. Keim,et al.  Earnings Yields, Market Values, and Stock Returns , 1989 .

[12]  E. Fama,et al.  BUSINESS CONDITIONS AND EXPECTED RETURNS ON STOCKS AND BONDS , 1989 .

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  Kazuo Asakawa,et al.  Stock market prediction system with modular neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[15]  Allan Hodgson,et al.  The Impact of Index Futures Markets On Australian Sharemarket Volatility , 1991 .

[16]  Ramesh Sharda,et al.  Connectionist approach to time series prediction: an empirical test , 1992, J. Intell. Manuf..

[17]  Youngohc Yoon,et al.  A Comparison of Discriminant Analysis versus Artificial Neural Networks , 1993 .

[18]  G. Grudnitski,et al.  Forecasting S&P and gold futures prices: An application of neural networks , 1993 .

[19]  Campbell R. Harvey,et al.  The Risk and Predictability of International Equity Returns , 1993 .

[20]  S. Viswanathan,et al.  No Arbitrage and Arbitrage Pricing: A New Approach , 1993 .

[21]  Achilleas Zapranis,et al.  Stock performance modeling using neural networks: A comparative study with regression models , 1994, Neural Networks.

[22]  Campbell R. Harvey,et al.  PREDICTABLE RISK AND RETURNS IN EMERGING MARKETS , 1999 .

[23]  R. Boyd,et al.  Forecasting UK stock prices , 1996 .

[24]  R. Donaldson,et al.  A New Dividend Forecasting Procedure That Rejects Bubbles in Asset Prices: The Case of 1929's Stock Crash , 1996 .

[25]  Hua Zhang,et al.  Forward premiums as unbiased predictors of future currency depreciation: a non-parametric analysis , 1997 .

[26]  William Remus,et al.  Going Up–Going Down: How Good Are People at Forecasting Trends and Changes in Trends? , 1997 .

[27]  F. Girosi,et al.  Nonlinear prediction of chaotic time series using support vector machines , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[28]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[29]  C. Tan,et al.  NEURAL NETWORKS FOR TECHNICAL ANALYSIS: A STUDY ON KLCI , 1999 .

[30]  M. Leung,et al.  Forecasting Stock Indices: A Comparison of Classification and Level Estimation Models , 1999 .

[31]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[32]  Wei-Guo Cheng,et al.  "Forecasting the 30-year U.S. Treasury Bond with a System of Neural Networks" , 2000 .

[33]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[34]  Adam Fadlalla,et al.  An Analysis of the Applications of Neural Networks in Finance , 2001, Interfaces.

[35]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[36]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[37]  Joarder Kamruzzaman,et al.  ANN-Based Forecasting of Foreign Currency Exchange Rates , 2004 .

[38]  Apostolos Nikolaos Refenes,et al.  Currency exchange rate prediction and neural network design strategies , 1993, Neural Computing & Applications.

[39]  Dirk Van den Poel,et al.  Predicting customer retention and profitability by using random forests and regression forests techniques , 2005, Expert Syst. Appl..

[40]  Wu Meng,et al.  Application of Support Vector Machines in Financial Time Series Forecasting , 2007 .