Combining News Sentiment and Technical Analysis to Predict Stock Trend Reversal

The use of machine learning techniques to predict the next-day stock direction is established. To make prediction models more robust, a common approach is to combine historical time series and news sentiment analysis. Most of the trading simulations performed in this field rely on trend following strategies, which are aimed at identifying and following an ongoing price trend that is likely to persist in the next days. Conversely, a more limited effort has been devoted to applying machine learning techniques to predict trend reversal, i.e., changes in price directions. This paper investigates the relevance of news information and time series descriptors derived from technical analysis to predict trend reversal in the next days. It compares the performance of various classification models trained on (i) technical indicators, which indicate short-term overbought or oversold conditions, (ii) news sentiment descriptors, which express the opinion of the financial community, (iii) the historical time series, to highlight recurrences in price trends, and (iv) a combination of the above. The results achieved on an 11-year dataset related to the stocks of the U.S. S&P 500 index show that the strategies combining the historical values of news sentiment and stock price indicators averagely perform better than all the other tested combinations. Hence, news information is worth considering by trend reversal strategies.

[1]  J. Murphy Technical Analysis of the Financial Markets , 1999 .

[2]  Haigang Zhou,et al.  Intraday momentum and reversal in Chinese stock market , 2019, Finance Research Letters.

[3]  Hsinchun Chen,et al.  Evaluating sentiment in financial news articles , 2012, Decis. Support Syst..

[4]  Kyungjik Lee,et al.  Expert system for predicting stock market timing using a candlestick chart , 1999 .

[5]  Trevor J Williams,et al.  Trading Economics: A Guide to Economic Statistics for Practitioners and Students , 2014 .

[6]  Jan Muntermann,et al.  An intraday market risk management approach based on textual analysis , 2011, Decis. Support Syst..

[7]  David Enke,et al.  The use of data mining and neural networks for forecasting stock market returns , 2005, Expert Syst. Appl..

[8]  Adriano Lorena Inácio de Oliveira,et al.  A method for automatic stock trading combining technical analysis and nearest neighbor classification , 2010, Expert Syst. Appl..

[9]  Luca Oneto,et al.  Technical analysis and sentiment embeddings for market trend prediction , 2019, Expert Syst. Appl..

[10]  J. Murphy Technical Analysis of the Futures Markets: A Comprehensive Guide to Trading Methods and Applications , 1986 .

[11]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[12]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[13]  Aristides Gionis,et al.  Correlating financial time series with micro-blogging activity , 2012, WSDM '12.

[14]  Amiya Kumar Rath,et al.  A Naïve SVM-KNN based stock market trend reversal analysis for Indian benchmark indices , 2015, Appl. Soft Comput..

[15]  Keith C. C. Chan,et al.  Discovering public sentiment in social media for predicting stock movement of publicly listed companies , 2017, Inf. Syst..

[16]  Zhaoxia Wang,et al.  Stock Market Prediction Analysis by Incorporating Social and News Opinion and Sentiment , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[17]  Ngo Tung Son,et al.  An analyze on effectiveness of candlestick reversal patterns for Vietnamese stock market , 2018, IMMS '18.

[18]  Tahir M. Nisar,et al.  Twitter as a tool for forecasting stock market movements: A short-window event study , 2018, The Journal of Finance and Data Science.

[19]  Paul C. Tetlock Does Public Financial News Resolve Asymmetric Information? , 2010 .

[20]  Adriano Lorena Inácio de Oliveira,et al.  Expert Systems With Applications , 2022 .

[21]  Azadeh Nikfarjam,et al.  Text mining approaches for stock market prediction , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[22]  D. Heyman,et al.  Investor attention and short-term return reversals , 2019, Finance Research Letters.

[23]  Ernie Chan Algorithmic Trading: Winning Strategies and Their Rationale , 2013 .