Deep Attentive Learning for Stock Movement Prediction from Social Media Text and Company Correlations

In the financial domain, risk modeling and profit generation heavily rely on the sophisticated and intricate stock movement prediction task. Stock forecasting is complex, given the stochastic dynamics and non-stationary behavior of the market. Stock movements are influenced by varied factors beyond the conventionally studied historical prices, such as social media and correlations among stocks. The rising ubiquity of online content and knowledge mandates an exploration of models that factor in such multimodal signals for accurate stock forecasting. We introduce an architecture that achieves a potent blend of chaotic temporal signals from financial data, social media, and inter-stock relationships via a graph neural network in a hierarchical temporal fashion. Through experiments on real-world S&P 500 index data and English tweets, we show the practical applicability of our model as a tool for investment decision making and trading.

[1]  Barry Smyth,et al.  HTML: Hierarchical Transformer-based Multi-task Learning for Volatility Prediction , 2020, WWW.

[2]  W. Sharpe.  The Sharpe Ratio , 1994 .

[3]  Ruonan Rao,et al.  Time-Weighted LSTM Model with Redefined Labeling for Stock Trend Prediction , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[4]  Wai Lam,et al.  News Sensitive Stock Trend Prediction , 2002, PAKDD.

[5]  K. Ramesh,et al.  Association between accounting performance measures and stock prices: A test of the life cycle hypothesis , 1992 .

[6]  Yue Zhang,et al.  Using Structured Events to Predict Stock Price Movement: An Empirical Investigation , 2014, EMNLP.

[7]  Nan Hua,et al.  Universal Sentence Encoder for English , 2018, EMNLP.

[8]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[9]  Saman Haratizadeh,et al.  U-CNNpred: A Universal CNN-based Predictor for Stock Markets , 2019, ArXiv.

[10]  Campbell R. Harvey,et al.  Forecasting International Equity Correlations , 1994 .

[11]  Roger Zimmermann,et al.  Multimodal Multi-Task Financial Risk Forecasting , 2020, ACM Multimedia.

[12]  Kiyoaki Shirai,et al.  Topic Modeling based Sentiment Analysis on Social Media for Stock Market Prediction , 2015, ACL.

[13]  Weiwei Jiang,et al.  Applications of deep learning in stock market prediction: recent progress , 2020, Expert Syst. Appl..

[14]  Vu Nguyen,et al.  Predicting Stock Prices Using Dynamic LSTM Models , 2019, ICAI.

[15]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[16]  Tomas Mikolov,et al.  Bag of Tricks for Efficient Text Classification , 2016, EACL.

[17]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[18]  Xiaotie Deng,et al.  Enhancing quantitative intra-day stock return prediction by integrating both market news and stock prices information , 2014, Neurocomputing.

[19]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[20]  Barbara Pfeffer,et al.  Smoothing Forecasting And Prediction Of Discrete Time Series , 2016 .

[21]  Leif Andersen.  Efficient Simulation of the Heston Stochastic Volatility Model , 2007 .

[22]  Yanmin Zhu,et al.  Stock Price Prediction Using Attention-based Multi-Input LSTM , 2018, ACML.

[23]  Tie-Yan Liu,et al.  Listening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Prediction , 2017, WSDM.

[24]  Herbert Kimura,et al.  Examination of the profitability of technical analysis based on moving average strategies in BRICS , 2018 .

[25]  Yoshimi Fukuhara,et al.  Stock Price Prediction Using Prior Knowledge and Neural Networks , 1997, Intell. Syst. Account. Finance Manag..

[26]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[27]  Xiaotie Deng,et al.  Empirical analysis: stock market prediction via extreme learning machine , 2014, Neural Computing and Applications.

[28]  Nicolas Papageorgiou,et al.  A Constant-Volatility Framework for Managing Tail Risk , 2013, The Journal of Portfolio Management.

[29]  Maosong Sun,et al.  Enhancing Stock Movement Prediction with Adversarial Training , 2018, IJCAI.

[30]  Ganapati Panda,et al.  Sentiment analysis of Twitter data for predicting stock market movements , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[31]  F. Diebold,et al.  UNIVERSITY OF SOUTHERN CALIFORNIA Center for Applied Financial Economics (CAFE) On the Network Topology of Variance Decompositions: Measuring the Connectedness of Financial Firms , 2011 .

[32]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[33]  P Alli,et al.  An Effective Time Series Analysis for Stock Trend Prediction Using ARIMA Model for Nifty Midcap-50 , 2013 .

[34]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[35]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[36]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[37]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[38]  M. Yor,et al.  Mathematical Methods for Financial Markets , 2009 .

[39]  R. Neal,et al.  Do Measures of Investor Sentiment Predict Returns? , 1998, Journal of Financial and Quantitative Analysis.

[40]  Yiqun Liu,et al.  Temporal Relational Ranking for Stock Prediction , 2018, ACM Trans. Inf. Syst..

[41]  Albert Marcet,et al.  Stock Market Volatility and Learning , 2008, SSRN Electronic Journal.

[42]  Jamshid Bagherzadeh,et al.  Stock price prediction using DEEP learning algorithm and its comparison with machine learning algorithms , 2019, Intell. Syst. Account. Finance Manag..

[43]  Paul C. Tetlock.  Giving Content to Investor Sentiment: The Role of Media in the Stock Market , 2005, The Journal of Finance.

[44]  Seokhoon Yoon,et al.  A Novel Approach to Short-Term Stock Price Movement Prediction using Transfer Learning , 2019, Applied Sciences.

[45]  Hamutal Kreiner,et al.  What You Say and How You Say It , 2016 .

[46]  Jue Liu.  Combining Enterprise Knowledge Graph and News Sentiment Analysis for Stock Price Volatility Prediction , 2018 .

[47]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[48]  Hsinchun Chen,et al.  Textual analysis of stock market prediction using breaking financial news: The AZFin text system , 2009, TOIS.

[49]  Stephen F. LeRoy,et al.  Efficient Market Hypothesis , 1991 .

[50]  Huajun Chen,et al.  Knowledge-Driven Stock Trend Prediction and Explanation via Temporal Convolutional Network , 2019, WWW.

[51]  E. Elton.  Modern portfolio theory and investment analysis , 1981 .

[52]  Toyotaro Suzumura,et al.  Exploring Graph Neural Networks for Stock Market Predictions with Rolling Window Analysis , 2019, ArXiv.

[53]  Zhou Yu,et al.  Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[54]  David C. Blitz,et al.  The Volatility Effect , 2007 .

[55]  Ilia D. Dichev,et al.  Earnings Volatility and Earnings Predictability , 2009 .

[56]  Jaewoo Kang,et al.  HATS: A Hierarchical Graph Attention Network for Stock Movement Prediction , 2019, ArXiv.

[57]  Amir F. Atiya,et al.  Introduction to financial forecasting , 1996, Applied Intelligence.

[58]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[59]  Shay B. Cohen,et al.  Stock Movement Prediction from Tweets and Historical Prices , 2018, ACL.

[60]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[61]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[62]  Guangyu Ding,et al.  Study on the prediction of stock price based on the associated network model of LSTM , 2019, International Journal of Machine Learning and Cybernetics.

[63]  Xuanjing Huang,et al.  Incorporating Corporation Relationship via Graph Convolutional Neural Networks for Stock Price Prediction , 2018, CIKM.