Twitter mood predicts the stock market

Behavioral economics tells us that emotions can profoundly affect individual behavior and decision-making. Does this also apply to societies at large, i.e. can societies experience mood states that affect their collective decision making? By extension is the public mood correlated or even predictive of economic indicators? Here we investigate whether measurements of collective mood states derived from large-scale Twitter feeds are correlated to the value of the Dow Jones Industrial Average (DJIA) over time. We analyze the text content of daily Twitter feeds by two mood tracking tools, namely OpinionFinder that measures positive vs. negative mood and Google-Profile of Mood States (GPOMS) that measures mood in terms of 6 dimensions (Calm, Alert, Sure, Vital, Kind, and Happy). We cross-validate the resulting mood time series by comparing their ability to detect the public's response to the presidential election and Thanksgiving day in 2008. A Granger causality analysis and a Self-Organizing Fuzzy Neural Network are then used to investigate the hypothesis that public mood states, as measured by the OpinionFinder and GPOMS mood time series, are predictive of changes in DJIA closing values. Our results indicate that the accuracy of DJIA predictions can be significantly improved by the inclusion of specific public mood dimensions but not others. We find an accuracy of 87.6% in predicting the daily up and down changes in the closing values of the DJIA and a reduction of the Mean Average Percentage Error by more than 6%. Index Terms—stock market prediction — twitter — mood analysis.

[1]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[2]  A. Pentland,et al.  Computational Social Science , 2009, Science.

[3]  H. Varian,et al.  Predicting the Present with Google Trends , 2009 .

[4]  Hiroaki Kitano,et al.  Proceedings of the 21st international jont conference on Artifical intelligence , 2009 .

[5]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[6]  W. Parker,et al.  The Financial/Economic Dichotomy in Social Behavioral Dynamics: The Socionomic Perspective , 2007 .

[7]  M. Lorr,et al.  Profile of mood states , 1971 .

[8]  V. Smith.  Constructivist and Ecological Rationality in Economics , 2003 .

[9]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .

[10]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[11]  Ramanathan V. Guha,et al.  The predictive power of online chatter , 2005, KDD '05.

[12]  Brendan T. O'Connor,et al.  From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series , 2010, ICWSM.

[13]  Barbara Plank,et al.  Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) , 2010 .

[14]  Walter Daelemans,et al.  Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4 , 2003 .

[15]  Manolis G. Kavussanos,et al.  A multivariate test for stock market efficiency: the case of ASE , 2001 .

[16]  Patrick Paroubek,et al.  Twitter as a Corpus for Sentiment Analysis and Opinion Mining , 2010, LREC.

[17]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[18]  Xiaohui Yu,et al.  ARSA: a sentiment-aware model for predicting sales performance using blogs , 2007, SIGIR.

[19]  Bernardo A. Huberman,et al.  Predicting the Future with Social Media , 2010, Web Intelligence.

[20]  Xiao-Jun Zeng,et al.  Short-Term and Midterm Load Forecasting Using a Bilevel Optimization Model , 2009, IEEE Transactions on Power Systems.

[21]  Mirella Lapata,et al.  Discourse Chunking and its Application to Sentence Compression , 2005, HLT.

[22]  H. Markowitz,et al.  The Random Character of Stock Market Prices. , 1965 .

[23]  Claire Cardie,et al.  OpinionFinder: A System for Subjectivity Analysis , 2005, HLT.

[24]  John R. Nofsinger.  Social Mood and Financial Economics , 2005 .

[25]  Ellen Riloff,et al.  Learning subjective nouns using extraction pattern bootstrapping , 2003, CoNLL.

[26]  E. Fama,et al.  The Adjustment of Stock Prices to New Information , 1969 .

[27]  D. Hirshleifer,et al.  Good Day Sunshine: Stock Returns and the Weather , 2001 .

[28]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[29]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[30]  Khaled Rasheed,et al.  Stock market prediction with multiple classifiers , 2007, Applied Intelligence.

[31]  T. Martin McGinnity,et al.  An on-line algorithm for creating self-organizing fuzzy neural networks , 2004, Neural Networks.

[32]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[33]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[34]  Andrew Trotman,et al.  Sound and complete relevance assessment for XML retrieval , 2008, TOIS.

[35]  Kirt C. Butler,et al.  Efficiency and inefficiency in thinly traded stock markets: Kuwait and Saudi Arabia , 1992 .

[36]  Meng Joo Er,et al.  A fast learning algorithm for parsimonious fuzzy neural systems , 1999 .

[37]  Johan Bollen,et al.  Happiness Is Assortative in Online Social Networks , 2011, Artificial Life.

[38]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[39]  ChenHsinchun,et al.  Textual analysis of stock market prediction using breaking financial news , 2009 .

[40]  Gilad Mishne,et al.  Capturing Global Mood Levels using Blog Posts , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[41]  Bernardo A. Huberman,et al.  Predicting the Future with Social Media , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[42]  Ellen Riloff,et al.  Learning Extraction Patterns for Subjective Expressions , 2003, EMNLP.

[43]  E. Fama,et al.  Efficient Capital Markets : II , 2007 .

[44]  J O Prochaska,et al.  Factor structure of the Profile of Mood States (POMS): two partial replications. , 1984, Journal of clinical psychology.

[45]  Alex Edmans,et al.  Sports Sentiment and Stock Returns , 2006 .

[46]  Xiao-Jun Zeng,et al.  A hybrid learning algorithm with a similarity-based pruning strategy for self-adaptive neuro-fuzzy systems , 2009, Appl. Soft Comput..

[47]  P. Gloor,et al.  Predicting Stock Market Indicators Through Twitter “I hope it is not as bad as I fear” , 2011 .

[48]  Kazuo Asakawa,et al.  Stock market prediction system with modular neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[49]  E. Fama.  The Behavior of Stock-Market Prices , 1965 .

[50]  Albert Nigrin,et al.  Neural networks for pattern recognition , 1993 .

[51]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[52]  Randy Goebel,et al.  Web-Scale N-gram Models for Lexical Disambiguation , 2009, IJCAI.

[53]  Hsinchun Chen,et al.  Textual analysis of stock market prediction using breaking financial news: The AZFin text system , 2009, TOIS.

[54]  B. Malkiel.  The Efficient Market Hypothesis and Its Critics , 2003 .

[55]  Hong Wang,et al.  Predicting stock index increments by neural networks: The role of trading volume under different horizons , 2008, Expert Syst. Appl..

[56]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[57]  Eric Gilbert,et al.  Widespread Worry and the Stock Market , 2010, ICWSM.

[58]  Mark P. Taylor,et al.  Permanent and Temporary Components of Stock Prices: Evidence from Assessing Macroeconomic Shocks , 2002 .

[59]  T. Martin McGinnity,et al.  Erratum to "An on-line algorithm for creating self-organizing fuzzy neural networks" [Neural Networks 17(10)(2004)1477-1493] , 2006, Neural Networks.

[60]  Johan Bollen,et al.  Between Conjecture and Memento: Shaping A Collective Emotional Perception of the Future , 2008, AAAI Spring Symposium: Emotion, Personality, and Social Behavior.

[61]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[62]  Gilad Mishne,et al.  Predicting Movie Sales from Blogger Sentiment , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[63]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[64]  E. Diener,et al.  Factors predicting the subjective well-being of nations. , 1995, Journal of personality and social psychology.

[65]  Johan Bollen,et al.  Modeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena , 2009, ICWSM.

[66]  ErMeng Joo,et al.  A fast learning algorithm for parismonious fuzzy neural systems , 2002 .

[67]  Simon,et al.  Happiness: A Revolution in Economics , 2008 .

[68]  Meng Joo Er,et al.  A fast learning algorithm for parsimonious fuzzy neural systems , 1999, 1999 European Control Conference (ECC).