Understanding Voluntary Knowledge Provision and Content Contribution Through a Social-Media-Based Prediction Market: A Field Experiment

The performance of prediction markets depends crucially on the quality of user contribution. A social media-based prediction market can utilize aspects of social effects to improve users’ contribution quality. Drawing upon literature from diverse areas such as prediction markets, knowledge contribution, public goods provision, and user generated content, we examine the causal effect of social audience size and online endorsement on prediction market participants’ prediction accuracy through a randomized field experiment. By conducting a comprehensive treatment effect analysis, we estimate both the average treatment effect (ATE) and quantile treatment effect (QTE) using the difference-in-differences method. Our empirical results on ATE show that an increase in audience size leads to an increase in prediction accuracy, and that an increase in online endorsement also leads to prediction improvements. Interestingly, we find that quantile treatment effects are heterogeneous: users of intermediate prediction ability respond most positively to an increase in social audience size and online endorsement. These findings suggest that corporate prediction markets can target people of intermediate abilities to obtain the most significant prediction improvement.

[1]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[2]  Ravi Bapna,et al.  Do Your Online Friends Make You Pay? A Randomized Field Experiment on Peer Influence in Online Social Networks - Online E-Companion Appendix , 2014, Manag. Sci..

[3]  Joel L. Horowitz,et al.  Binary Response Models: Logits, Probits and Semiparametrics , 2001 .

[4]  R. Preston McAfee,et al.  Incentivizing high-quality user-generated content , 2011, WWW.

[5]  Alberto Abadie Semiparametric Difference-in-Differences Estimators , 2005 .

[6]  Jure Leskovec,et al.  Steering user behavior with badges , 2013, WWW.

[7]  Thomas A. Rietz,et al.  Results from a Dozen Years of Election Futures Markets Research , 2008 .

[8]  Patrick Hummel,et al.  A game-theoretic analysis of rank-order mechanisms for user-generated content , 2011, EC '11.

[9]  C. Manski Identification of Endogenous Social Effects: The Reflection Problem , 1993 .

[10]  T. Kornienko,et al.  Journal of Economic Behavior & Organization , 2022 .

[11]  Chong Wang,et al.  Network Positions and Contributions to Online Public Goods: The Case of Chinese Wikipedia , 2012, J. Manag. Inf. Syst..

[12]  David I. Laibson,et al.  Costly Information Acquisition: Experimental Analysis of a Boundedly Rational Model , 2006 .

[13]  Andrew B. Whinston,et al.  The Impact of Social Network Structures on Prediction Market Accuracy in the Presence of Insider Information , 2014, J. Manag. Inf. Syst..

[14]  Thomas A. Montgomery,et al.  Experience from hosting a corporate prediction market: benefits beyond the forecasts , 2013, KDD.

[15]  T. Postmes,et al.  Toward an integrative social identity model of collective action: a quantitative research synthesis of three socio-psychological perspectives. , 2008, Psychological bulletin.

[16]  Jonah Berger,et al.  Broadcasting and Narrowcasting: How Audience Size Affects What People Share , 2013 .

[17]  B. Frey,et al.  Motivation, Knowledge Transfer, and Organizational Forms , 2000 .

[18]  Arpita Ghosh Social computing and user-generated content: a game-theoretic approach , 2012, SECO.

[19]  Eric Zitzewitz,et al.  Corporate Prediction Markets: Evidence from Google, Ford, and Firm X , 2015 .

[20]  Andrew B. Whinston,et al.  Proper scoring rules with arbitrary value functions , 2010 .

[21]  D. Ariely,et al.  Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially , 2007, SSRN Electronic Journal.

[22]  E. Fehr,et al.  Psychological Foundations of Incentives , 2002 .

[23]  Sandra Slaughter,et al.  Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects , 2006, Manag. Sci..

[24]  Bryan R. Routledge,et al.  Prediction Markets: Alternative Mechanisms for Complex Environments with Few Traders , 2010, Manag. Sci..

[25]  E. Fehr,et al.  Collective action as a social exchange , 1999 .

[26]  Kjetil Telle,et al.  The impact of social approval and framing on cooperation in public good situations , 2004 .

[27]  B. Frey,et al.  Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment , 2004 .

[28]  Olivier Toubia,et al.  Intrinsic vs. Image-Related Utility in Social Media: Why Do People Contribute Content to Twitter? , 2013, Mark. Sci..

[29]  X. Zhang,et al.  Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia , 2010 .

[30]  Ritu Agarwal,et al.  Through a Glass Darkly: Information Technology Design, Identity Verification, and Knowledge Contribution in Online Communities , 2007, Inf. Syst. Res..

[31]  Martin Spann,et al.  Internet-Based Virtual Stock Markets for Business Forecasting , 2003, Manag. Sci..

[32]  H. Varian,et al.  On the private provision of public goods , 1986 .

[33]  Thomas Mussweiler,et al.  New directions in social comparison research , 2001 .

[34]  F. Maxwell Harper,et al.  Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens , 2010, Computational Social Systems and the Internet.

[35]  Kent D. Daniel,et al.  Presentation Slides for 'Investor Psychology and Security Market Under and Overreactions' , 1998 .

[36]  S. Kiesler,et al.  Applying Common Identity and Bond Theory to Design of Online Communities , 2007 .

[37]  Ching-man Au Yeung,et al.  "Popularity Effect" in User-Generated Content: Evidence from Online Product Reviews , 2014, Inf. Syst. Res..

[38]  David M. Pennock,et al.  Prediction Markets: Does Money Matter? , 2004, Electron. Mark..

[39]  Wei Xiong,et al.  Overconfidence and Speculative Bubbles , 2003, Journal of Political Economy.

[40]  Andrew B. Whinston,et al.  Supply chain information sharing in a macro prediction market , 2006, Decis. Support Syst..

[41]  Sanford J. Grossman ON THE EFFICIENCY OF COMPETITIVE STOCK MARKETS WHERE TRADES HAVE DIVERSE INFORMATION , 1976 .

[42]  Charles R. Plott,et al.  Information Aggregation Mechanisms: Concept, Design and Implementation for a Sales Forecasting Problem , 2002 .

[43]  Andrew B. Whinston,et al.  Research Note - To Continue Sharing or Not to Continue Sharing? An Empirical Analysis of User Decision in Peer-to-Peer Sharing Networks , 2012, Inf. Syst. Res..

[44]  Dylan Walker,et al.  Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks , 2010, ICIS.

[45]  Xavier Vives,et al.  Social learning and costly information acquisition , 2000 .