Crowds on Wall Street: Extracting Value from Social Investing Platforms

For decades, the world of financial advisors has been dom- inated by large investment banks such as Goldman Sachs. In recent years, user-contributed investment services suc h as SeekingAlpha and StockTwits have grown to millions of users. In this paper, we seek to understand the quality and impact of content on social investment platforms, by empiri- cally analyzing complete datasets of SeekingAlpha articles (9 years) and StockTwits messages (4 years). We develop sen- timent analysis tools and correlate contributed content to the historical performance of relevant stocks. While SeekingAl- pha articles and StockTwits messages provide minimal corre- lation to stock performance in aggregate, a subset of authors contribute more valuable (predictive) content. We show that these authors can be identified via both empirical methods or by user interactions, and investments using their analysis sig- nificantly outperform broader markets. Finally, we conduct a user survey that sheds light on users views of SeekingAlpha content and stock manipulation. In this paper, we seek to understand the quality and impact of opinions and analysis shared on social investment platforms. We target the two primary yet quite different social invest- ment platforms, SeekingAlpha and StockTwits, and analyze the potential for investment returns following their recom - mendations versus the market baseline, the S&P 500 stock market index. We seek to understand how expertise of con- tributors can affect the quality and utility of contributed con- tent, using SeekingAlpha as an "expert" model (all content is contributed by less than 0.27% of users) and StockTwits as a "peer" model (any user can contribute). Our work makes four key contributions. First, we gather longitudinal datasets from both platforms since their inception (9 years of data for SeekingAlpha, 4 years for StockTwits). We develop sentiment analyzers on each dataset, using a mixture of keyword processing and machine learning classifiers. Validation shows our methods achieve high accuracy in extracting sentiments towards in- dividual stocks (85.5% for SeekingAlpha, 76.2% for Stock- Twits). Second, we analyze correlation between content sentiment from both services with stock returns at different time scal es. We show that content from both SeekingAlpha and Stock- Twits provide minimal forward correlation with stock perfor- mance. While the average article provides little value, we find that a subset of "top authors" in SeekingAlpha contribut e content that shows significantly higher correlation with fu ture stock performance. Third, we evaluate the hypothetical performance of simple investment strategies following top authors from both plat- forms. We show that investment strategies based on stock sentiment from top SeekingAlpha authors perform exception- ally well and significantly outperform broader markets. In contrast, strategies relying on StockTwits generally unde rper- form relative to broader markets. In addition, we show that we can identify top authors without historical stock market data, using only user interactions with their articles as a g uide. Fourth, we conduct a large scale survey of SeekingAlpha users and contributors to understand their usage, reliance , and trust in the SeekingAlpha service. Results show that despite seeing potentially intentionally misleading or manipulat ive articles, most users still rely heavily on the site content f or investment advice. Most consider SeekingAlpha unique, and

[1]  Yigitcan Karabulut Can Facebook Predict Stock Market Activity? , 2013 .

[2]  T. Rao,et al.  Analyzing Stock Market Movements Using Twitter Sentiment Analysis , 2012, ASONAM 2012.

[3]  Eric Gilbert,et al.  Widespread Worry and the Stock Market , 2010, ICWSM.

[4]  H. Stanley,et al.  Quantifying Trading Behavior in Financial Markets Using Google Trends , 2013, Scientific Reports.

[5]  Fabrício Benevenuto,et al.  Comparing and combining sentiment analysis methods , 2013, COSN '13.

[6]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[7]  Olivia Sheng,et al.  Investigating Predictive Power of Stock Micro Blog Sentiment in Forecasting Future Stock Price Directional Movement , 2011, ICIS.

[8]  H. Eugene Stanley,et al.  Quantifying Wikipedia Usage Patterns Before Stock Market Moves , 2013, Scientific Reports.

[9]  S. Pokharel Wisdom of Crowds: The Value of Stock Opinions Transmitted through Social Media , 2014 .

[10]  Andrea Esuli,et al.  PageRanking WordNet Synsets: An Application to Opinion Mining , 2007, ACL.

[11]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[12]  Isabell M. Welpe,et al.  Tweets and Trades: The Information Content of Stock Microblogs , 2010 .

[13]  Sameena Shah,et al.  Stock Prediction Using Event-Based Sentiment Analysis , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[14]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[15]  Munmun De Choudhury,et al.  Can blog communication dynamics be correlated with stock market activity? , 2008, Hypertext.

[16]  Tim Loughran,et al.  When is a Liability not a Liability? Textual Analysis, Dictionaries, and 10-Ks , 2010 .

[17]  LeeLillian,et al.  Opinion Mining and Sentiment Analysis , 2008 .

[18]  Philipp Koehn,et al.  Synthesis Lectures on Human Language Technologies , 2016 .

[19]  K. Pearson Contributions to the Mathematical Theory of Evolution , 1894 .

[20]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[21]  Junlan Feng,et al.  Robust Sentiment Detection on Twitter from Biased and Noisy Data , 2010, COLING.

[22]  Wai Lam,et al.  Stock prediction: Integrating text mining approach using real-time news , 2003, 2003 IEEE International Conference on Computational Intelligence for Financial Engineering, 2003. Proceedings..

[23]  Ronen Feldman,et al.  Identifying and Following Expert Investors in Stock Microblogs , 2011, EMNLP.

[24]  P. De,et al.  Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media , 2013 .

[25]  Sameena Shah,et al.  Winning by Following the Winners: Mining the Behaviour of Stock Market Experts in Social Media , 2014, SBP.

[26]  Paulo Cortez,et al.  On the Predictability of Stock Market Behavior Using StockTwits Sentiment and Posting Volume , 2013, EPIA.

[27]  Eric D. Brown Will Twitter Make You a Better Investor? A Look at Sentiment, User Reputation and Their Effect on the Stock Market , 2012 .

[28]  K. Pearson Contributions to the Mathematical Theory of Evolution. II. Skew Variation in Homogeneous Material , 1895 .

[29]  Ben Y. Zhao,et al.  User interactions in social networks and their implications , 2009, EuroSys '09.

[30]  Steven Skiena,et al.  Large-Scale Sentiment Analysis for News and Blogs (system demonstration) , 2007, ICWSM.

[31]  Hsinchun Chen,et al.  Textual analysis of stock market prediction using breaking financial news: The AZFin text system , 2009, TOIS.