Stock Market Prediction Analysis by Incorporating Social and News Opinion and Sentiment

The price of the stocks is an important indicator for a company and many factors can affect their values. Different events may affect public sentiments and emotions differently, which may have an effect on the trend of stock market prices. Because of dependency on various factors, the stock prices are not static, but are instead dynamic, highly noisy and nonlinear time series data. Due to its great learning capability for solving the nonlinear time series prediction problems, machine learning has been applied to this research area. Learning-based methods for stock price prediction are very popular and a lot of enhanced strategies have been used to improve the performance of the learning based predictors. However, performing successful stock market prediction is still a challenge. News articles and social media data are also very useful and important in financial prediction, but currently no good method exists that can take these social media into consideration to provide better analysis of the financial market. This paper aims to successfully predict stock price through analyzing the relationship between the stock price and the news sentiments. A novel enhanced learning-based method for stock price prediction is proposed that considers the effect of news sentiments. Compared with existing learning-based methods, the effectiveness of this new enhanced learning-based method is demonstrated by using the real stock price data set with an improvement of performance in terms of reducing the Mean Square Error (MSE). The research work and findings of this paper not only demonstrate the merits of the proposed method, but also points out the correct direction for future work in this area.

[1]  S. Bharathi,et al.  Sentiment Analysis for Effective Stock Market Prediction , 2017 .

[2]  Tanner A. Bohn.  Improving Long Term Stock Market Prediction with Text Analysis , 2017 .

[3]  N. Desai,et al.  Stock Market Prediction Using Data Mining , 2014 .

[4]  Chao Wang,et al.  Improving Stock Market Prediction by Integrating Both Market News and Stock Prices , 2011, DEXA.

[5]  Derya Avci,et al.  An Adaptive Network-Based Fuzzy Inference System (ANFIS) for the prediction of stock market return: The case of the Istanbul Stock Exchange , 2010, Expert Syst. Appl..

[6]  Hassan M. Najadat,et al.  Stock Price Prediction Using K-Nearest Neighbor (kNN) Algorithm , 2013 .

[7]  Sahil Shah,et al.  Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques , 2015, Expert Syst. Appl..

[8]  S. Prakash,et al.  A stock market prediction model using Artificial Neural Network , 2012, 2012 Third International Conference on Computing, Communication and Networking Technologies (ICCCNT'12).

[9]  Ingoo Han,et al.  Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index , 2000 .

[10]  Marcus O'Connor,et al.  Artificial neural network models for forecasting and decision making , 1994 .

[11]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[12]  Sudhir Kumar Mohapatra,et al.  A HYBRID FORECASTING MODEL FOR STOCK VALUE PREDICTION USING SOFT COMPUTING TECHNIQUE , 2017 .

[13]  S. Agrawal,et al.  Momentum Analysis based Stock Market Prediction using Adaptive Neuro-Fuzzy Inference System ( ANFIS ) , 2022 .

[14]  Marcelo Portes Albuquerque,et al.  Predicting the Brazilian stock market through neural networks and adaptive exponential smoothing methods , 2009, Expert Syst. Appl..

[15]  Sajjad Waheed,et al.  Stock market prediction using an improved training algorithm of neural network , 2016, 2016 2nd International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE).

[16]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[17]  Erik Cambria,et al.  Intelligent Asset Allocation via Market Sentiment Views , 2018, IEEE Computational Intelligence Magazine.

[18]  Wichian Premchaiswadi,et al.  Stock Exchange of Thailand Index Prediction Using Back Propagation Neural Networks , 2010, 2010 Second International Conference on Computer and Network Technology.

[19]  Binoy B. Nair,et al.  A Genetic Algorithm Optimized Decision Tree- SVM based Stock Market Trend Prediction System , 2010 .

[20]  Shouyang Wang,et al.  Forecasting stock market movement direction with support vector machine , 2005, Comput. Oper. Res..

[21]  Hsinchun Chen,et al.  Textual Analysis of Stock Market Prediction Using Financial News Articles , 2006, AMCIS.

[22]  Zhu-Zhi Yuan,et al.  Predicting nonlinear network traffic using fuzzy neural network , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[23]  Zhang Yonggang,et al.  Levenberg-Marquardt Optimization Based Iterative Divided Difference Filtering for Multi-AUV Cooperative Localization , 2018, 2018 37th Chinese Control Conference (CCC).

[24]  Mahdi Pakdaman Naeini,et al.  Stock market value prediction using neural networks , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[25]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[26]  Erik Cambria,et al.  Natural language based financial forecasting: a survey , 2017, Artificial Intelligence Review.

[27]  Azadeh Nikfarjam,et al.  Text mining approaches for stock market prediction , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[28]  Liang-Ying Wei,et al.  A hybrid model based on ANFIS and adaptive expectation genetic algorithm to forecast TAIEX , 2013 .

[29]  Liang-Ying Wei,et al.  A GA-weighted ANFIS model based on multiple stock market volatility causality for TAIEX forecasting , 2013, Appl. Soft Comput..