Decision support from financial disclosures with deep neural networks and transfer learning

Company disclosures greatly aid in the process of financial decision-making; therefore, they are consulted by financial investors and automated traders before exercising ownership in stocks. While humans are usually able to correctly interpret the content, the same is rarely true of computerized decision support systems, which struggle with the complexity and ambiguity of natural language. A possible remedy is represented by deep learning, which overcomes several shortcomings of traditional methods of text mining. For instance, recurrent neural networks, such as long short-term memories, employ hierarchical structures, together with a large number of hidden layers, to automatically extract features from ordered sequences of words and capture highly non-linear relationships such as context-dependent meanings. However, deep learning has only recently started to receive traction, possibly because its performance is largely untested. Hence, this paper studies the use of deep neural networks for financial decision support. We additionally experiment with transfer learning, in which we pre-train the network on a different corpus with a length of 139.1 million words. Our results reveal a higher directional accuracy as compared to traditional machine learning when predicting stock price movements in response to financial disclosures. Our work thereby helps to highlight the business value of deep learning and provides recommendations to practitioners and executives. We apply deep learning for sentiment analysis of financial news.This yields considerable improvements in forecasting the stock price movements.Additional gains stem from applying transfer learning.Long short-term memory performs overall best.Demonstrates the potential for future applications of deep learning in finance

[1]  Colm Kearney,et al.  Textual Sentiment in Finance: A Survey of Methods and Models , 2013 .

[2]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[3]  Feng Li Textual Analysis of Corporate Disclosures: A Survey of the Literature , 2011 .

[4]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[5]  Jan Muntermann,et al.  An intraday market risk management approach based on textual analysis , 2011, Decis. Support Syst..

[6]  Carlos Serrano-Cinca,et al.  Determinants of Default in P2P Lending , 2015, PloS one.

[7]  Hsinchun Chen,et al.  Evaluating sentiment in financial news articles , 2012, Decis. Support Syst..

[8]  Stefan Feuerriegel,et al.  Improving Sentiment Analysis with Document-Level Semantic Relationships from Rhetoric Discourse Structures , 2017, HICSS.

[9]  Yue Zhang,et al.  Deep Learning for Event-Driven Stock Prediction , 2015, IJCAI.

[10]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[11]  André Freitas,et al.  SemEval-2017 Task 5: Fine-Grained Sentiment Analysis on Financial Microblogs and News , 2017, *SEMEVAL.

[12]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[13]  Hsinchun Chen,et al.  A quantitative stock prediction system based on financial news , 2009, Inf. Process. Manag..

[14]  MartensDavid,et al.  Evaluating and understanding text-based stock price prediction models , 2014 .

[15]  Chenchuramaiah T. Bathala Giving Content to Investor Sentiment: The Role of Media in the Stock Market , 2007 .

[16]  Dirk Neumann,et al.  Automated news reading: Stock price prediction based on financial news using context-capturing features , 2013, Decis. Support Syst..

[17]  Tomer Geva,et al.  Empirical evaluation of an automated intraday stock recommendation system incorporating both market data and textual news , 2014, Decis. Support Syst..

[18]  Chenn-Jung Huang,et al.  Realization of a news dissemination agent based on weighted association rules and text mining techniques , 2010, Expert Syst. Appl..

[19]  Tim Loughran,et al.  Textual Analysis in Accounting and Finance: A Survey: TEXTUAL ANALYSIS IN ACCOUNTING AND FINANCE , 2016 .

[20]  Nicholas G. Polson,et al.  Deep Learning in Finance , 2016, ArXiv.

[21]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[22]  Stefan Feuerriegel,et al.  Negation scope detection in sentiment analysis: Decision support for news-driven trading , 2016, Decis. Support Syst..

[23]  Lawrence Takeuchi,et al.  Applying Deep Learning to Enhance Momentum Trading Strategies in Stocks , 2013 .

[24]  Stefan Feuerriegel,et al.  Improving Decision Analytics with Deep Learning: the Case of Financial Disclosures , 2015, ECIS.

[25]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[26]  David Martens,et al.  Evaluating and understanding text-based stock price prediction models , 2014, Inf. Process. Manag..

[27]  Vadlamani Ravi,et al.  A survey on opinion mining and sentiment analysis: Tasks, approaches and applications , 2015, Knowl. Based Syst..

[28]  Hsinchun Chen,et al.  Textual analysis of stock market prediction using breaking financial news: The AZFin text system , 2009, TOIS.

[29]  Jana-Rebecca Rehse,et al.  Predicting process behaviour using deep learning , 2016, Decis. Support Syst..

[30]  Li Chen,et al.  News impact on stock price return via sentiment analysis , 2014, Knowl. Based Syst..

[31]  Samuel W. K. Chan,et al.  Sentiment analysis in financial texts , 2017, Decis. Support Syst..

[32]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[33]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[34]  A. Lau A 5-State Financial Distress Prediction Model , 1987 .

[35]  Julian J. Faraway,et al.  Does data splitting improve prediction? , 2013, Stat. Comput..

[36]  Yoav Goldberg,et al.  A Primer on Neural Network Models for Natural Language Processing , 2015, J. Artif. Intell. Res..

[37]  Xiaotie Deng,et al.  Enhancing quantitative intra-day stock return prediction by integrating both market news and stock prices information , 2014, Neurocomputing.

[38]  Margaret R. Garnsey,et al.  Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research , 2016, Intell. Syst. Account. Finance Manag..

[39]  Ying Wah Teh,et al.  Text mining for market prediction: A systematic review , 2014, Expert Syst. Appl..

[40]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[41]  Stefan Feuerriegel,et al.  News-based trading strategies , 2016, Decis. Support Syst..

[42]  E. Fama The Behavior of Stock-Market Prices , 1965 .

[43]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[44]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[45]  Jian Zhang,et al.  Daily Prediction of Major Stock Indices from Textual WWW Data , 1998, KDD.

[46]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[47]  Christopher D. Manning,et al.  Baselines and Bigrams: Simple, Good Sentiment and Topic Classification , 2012, ACL.

[48]  Bill McDonald,et al.  Textual Analysis in Accounting and Finance: A Survey , 2016 .

[49]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.