Stock market prediction: A big data approach

The Stock market process is full of uncertainty and is affected by many factors. Hence the Stock market prediction is one of the important exertions in finance and business. There are two types of analysis possible for prediction, technical and fundamental. In this paper both technical and fundamental analysis are considered. Technical analysis is done using historical data of stock prices by applying machine learning and fundamental analysis is done using social media data by applying sentiment analysis. Social media data has high impact today than ever, it can aide in predicting the trend of the stock market. The method involves collecting news and social media data and extracting sentiments expressed by individual. Then the correlation between the sentiments and the stock values is analyzed. The learned model can then be used to make future predictions about stock values. It can be shown that this method is able to predict the sentiment and the stock performance and its recent news and social data are also closely correlated.

[1]  Li Bing,et al.  Public Sentiment Analysis in Twitter Data for Prediction of a Company's Stock Price Movements , 2014, 2014 IEEE 11th International Conference on e-Business Engineering.

[2]  Peter Kulchyski.  and , 2015 .

[3]  Michifumi Yoshioka,et al.  Sentiment Analysis of Stock Market News with Semi-supervised Learning , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[4]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[5]  László Gerencsér,et al.  Fundamental Modelling of Financial Markets , 2009, ERCIM News.

[6]  Thomas Hellström,et al.  A random walk through the stock market , 1998 .

[7]  Rohit Choudhry,et al.  A Hybrid Machine Learning System for Stock Market Forecasting , 2008 .

[8]  Jure Leskovec,et al.  The dynamics of viral marketing , 2005, EC '06.

[9]  Wei Xu,et al.  How Web News Media Impact Futures Market Price Linkage? , 2013, 2013 Sixth International Conference on Business Intelligence and Financial Engineering.

[10]  Marko Brakus,et al.  Using Big Data and sentiment analysis in product evaluation , 2013, 2013 36th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[11]  B. Malkiel.  The Efficient Market Hypothesis and Its Critics , 2003 .

[12]  Shengtao Sun,et al.  A New Approach of Stock Price Prediction Based on Logistic Regression Model , 2009, 2009 International Conference on New Trends in Information and Service Science.

[13]  Arthur J. O’Connor,et al.  The Power of Popularity , 2013 .

[14]  Ken Tse,et al.  Stocks market prediction using Support Vector Machine , 2013, 2013 6th International Conference on Information Management, Innovation Management and Industrial Engineering.

[15]  Md. Jan Nordin,et al.  Regression techniques for the prediction of stock price trend , 2012, 2012 International Conference on Statistics in Science, Business and Engineering (ICSSBE).

[16]  Lawrence A. Shepp,et al.  A model for stock price fluctuations based on information , 2002, IEEE Trans. Inf. Theory.

[17]  Iman Saleh,et al.  Social-Network-Sourced Big Data Analytics , 2013, IEEE Internet Computing.

[18]  Jian Zhang,et al.  Daily stock market forecast from textual web data , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).