Combining Technical Analysis with Sentiment Analysis for Stock Price Prediction

This paper proposes a stock price prediction model, which extracts features from time series data and social networks for prediction of stock prices and evaluates its performance. In this research, we use the features such as numerical dynamics (frequency) of news and comments, overall sentiment analysis of news and comments, as well as technical analysis of historic price and volume. We model the stock price movements as a function of these input features and solve it as a regression problem in a Multiple Kernel Learning regression framework. Experimental results show that our proposed method outperforms other baseline methods in terms of magnitude prediction measures such as RMSE, MAE and MAPE for three famous Japan companies' stocks in US stock market. The results indicate that features other than mining from stock prices themselves improved the performance.

[1]  Franklin Allen,et al.  Using genetic algorithms to find technical trading rules , 1999 .

[2]  John Shawe-Taylor,et al.  Multiple Kernel Learning on the Limit Order Book , 2010, WAPA.

[3]  Application of financial analysis techniques to vital sign data : A novel method of trend interpretation in the intensive care unit , 2007 .

[4]  Xiaotian Zhu,et al.  Forecasting stock index increments using neural networks with trust region methods , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[5]  Christopher J. Neely Technical analysis and the profitability of U.S. foreign exchange intervention , 1998 .

[6]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[7]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[8]  Alex Edmans,et al.  Sports Sentiment and Stock Returns , 2006 .

[9]  Shangkun Deng,et al.  Combining Multiple Kernel Learning and Genetic Algorithm for forecasting short time foreign exchange rate , 2011 .

[10]  Alexandre d'Aspremont,et al.  Predicting abnormal returns from news using text classification , 2008, 0809.2792.

[11]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[12]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[13]  Alan F. Smeaton,et al.  Combining Social Network Analysis and Sentiment Analysis to Explore the Potential for Online Radicalisation , 2009, 2009 International Conference on Advances in Social Network Analysis and Mining.

[14]  Shie-Jue Lee,et al.  A multiple-kernel support vector regression approach for stock market price forecasting , 2011, Expert Syst. Appl..

[15]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[16]  Wolfgang Nejdl,et al.  How useful are your comments?: analyzing and predicting youtube comments and comment ratings , 2010, WWW '10.

[17]  Gerwin A. W. Griffioen Technical Analysis in Financial Markets , 2003 .