Predicting Stock Market Behavior using Data Mining Technique and News Sentiment Analysis

Stock market prediction has become an attractive investigation topic due to its important role in economy and beneficial offers. There is an imminent need to uncover the stock market future behavior in order to avoid investment risks. The large amount of data generated by the stock market is considered a treasure of knowledge for investors. This study aims at constructing an effective model to predict stock market future trends with small error ratio and improve the accuracy of prediction. This prediction model is based on sentiment analysis of financial news and historical stock market prices. This model provides better accuracy results than all previous studies by considering multiple types of news related to market and company with historical stock prices. A dataset containing stock prices from three companies is used. The first step is to analyze news sentiment to get the text polarity using naïve Bayes algorithm. This step achieved prediction accuracy results ranging from 72.73% to 86.21%. The second step combines news polarities and historical stock prices together to predict future stock prices. This improved the prediction accuracy up to 89.80%.

[1]  Li Bing,et al.  Public Sentiment Analysis in Twitter Data for Prediction of a Company's Stock Price Movements , 2014, 2014 IEEE 11th International Conference on e-Business Engineering.

[2]  Ammar Belatreche,et al.  Stock price prediction based on stock-specific and sub-industry-specific news articles , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[3]  Krzysztof J. Cios,et al.  Extracting News Sentiment and Establishing Its Relationship with the S&P 500 Index , 2015, 2015 48th Hawaii International Conference on System Sciences.

[4]  S. Nandgaonkar,et al.  Using Association Rule Mining : Stock Market Events Prediction from Financial News , 2015 .

[5]  N. Desai,et al.  Stock Market Prediction Using Data Mining , 2014 .

[6]  B. O'Neill Wyss.  Fundamentals of the stock market , 2000 .

[7]  Marc-André Mittermayer,et al.  Forecasting Intraday stock price trends with text mining techniques , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[8]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[9]  Imran Ghani,et al.  Text Opinion Mining to Analyze News for Stock Market Prediction , 2014 .

[10]  Bing Liu.  Sentiment Analysis and Opinion Mining Opinion Mining , 2011 .

[11]  Wen Li,et al.  N-grams based feature selection and text representation for Chinese Text Classification , 2009, Int. J. Comput. Intell. Syst..

[12]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[13]  Kunal Jadhav,et al.  Prediction of Stock Market using Data Mining and Artificial Intelligence , 2016 .

[14]  Vijay Kotu,et al.  Predictive Analytics and Data Mining: Concepts and Practice with RapidMiner , 2014 .

[15]  Phayung Meesad,et al.  Stock Market Trend Prediction Based on Text Mining of Corporate Web and Time Series Data , 2014, J. Adv. Comput. Intell. Intell. Informatics.

[16]  G. Rajesh,et al.  Sentiment Analysis on Movie Reviews: A Comparative Study of Machine Learning Algorithms and Open Source Technologies , 2016 .

[17]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[18]  Wai-Man Liu,et al.  The relation between news events and stock price jump : an analysis based on neural network , 2013 .

[19]  Hasan Davulcu,et al.  Directional Prediction of Stock Prices Using Breaking News on Twitter , 2015, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT).

[20]  S. Vijayarani,et al.  Preprocessing Techniques for Text Mining-An Overview Dr , 2015 .