Attention-Based Event Relevance Model for Stock Price Movement Prediction

Stock prices, in general, can be affected by world events such as wars, natural disasters, government policies, etc. However, the correlations between events and stock prices are often implicit and the influences of events on stock prices can be in indirect ways and act in chain reactions, which brings essential difficulties for precise market prediction. In this paper, we propose an attention-based event relevance model (ATT-ERNN) to explicitly model event relevance for predicting stock price movement. Specifically, in our model, we use long short-term memory neural network (LSTM) and convolution neural network (CNN) to encode event information and stock information to distributional representations. After that, we employ attention mechanism to find related events for each stock to do price movement prediction. Attention weights in our model have a quantitative interpretation as the relevance degree of events affecting the price of a specific stock. We have conduct extensive experiments on a manually collected real-world dataset. Experimental results show the superiority of our model over many baselines, which proves the effectiveness of our model in this prediction problem.

[1]  Sofus A. Macskassy,et al.  More than Words: Quantifying Language to Measure Firms' Fundamentals the Authors Are Grateful for Assiduous Research Assistance from Jie Cao and Shuming Liu. We Appreciate Helpful Comments From , 2007 .

[2]  Peter Sarlin,et al.  Bank distress in the news: Describing events through deep learning , 2017, Neurocomputing.

[3]  Jason Weston,et al.  A Neural Attention Model for Abstractive Sentence Summarization , 2015, EMNLP.

[4]  B. Malkiel The Efficient Market Hypothesis and Its Critics , 2003 .

[5]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[6]  T. Bollerslev,et al.  Intraday periodicity and volatility persistence in financial markets , 1997 .

[7]  Yue Zhang,et al.  Deep Learning for Event-Driven Stock Prediction , 2015, IJCAI.

[8]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Chenchuramaiah T. Bathala Giving Content to Investor Sentiment: The Role of Media in the Stock Market , 2007 .

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Yue Zhang,et al.  Using Structured Events to Predict Stock Price Movement: An Empirical Investigation , 2014, EMNLP.

[13]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  A. Coughlan,et al.  An Empirical Investigation * , 2002 .

[16]  Mike Y. Chen,et al.  Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web , 2001 .

[17]  Stephen L Taylor,et al.  The incremental volatility information in one million foreign exchange quotations , 1997 .

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Lawrence Takeuchi,et al.  Applying Deep Learning to Enhance Momentum Trading Strategies in Stocks , 2013 .

[20]  L Monnier,et al.  An overview of the rationale for pharmacological strategies in type 2 diabetes: from the evidence to new perspectives. , 2005, Diabetes & metabolism.

[21]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[22]  Bilberto Batres-Estrada,et al.  Deep learning for multivariate financial time series , 2015 .

[23]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[24]  E. Fama The Behavior of Stock-Market Prices , 1965 .

[25]  Stefan Feuerriegel,et al.  Improving Decision Analytics with Deep Learning: the Case of Financial Disclosures , 2015, ECIS.

[26]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..