Effect of Crowd Voting on Participation in Crowdsourcing Contests

ABSTRACT While expert rating is still a dominant approach for selecting winners in contests for creative works, a few crowdsourcing platforms have recently used “crowd voting” for winner selection – that is, let users of the crowdsourcing community publicly vote for contest winners. We investigate how a contest’s reliance on crowd voting for winner selection, defined as the percentage of crowd-voted prizes to the total prize sum (in dollar amounts), affects contest participation. Drawing upon expectancy theory and tournament theory, we develop a theoretical understanding of this relationship. Using a novel dataset of contests employing both crowd voting and expert rating, we find that a contest’s reliance on crowd voting is positively associated with participation. Specifically, every 10% increase in the crowd-voting reliance can boost users’ odds of participation by about 7%. Moreover, crowd voting is more appealing to users whose expertise is not high and whose status in the crowdsourcing community is high.

[1]  W. Weber,et al.  The Influence of Organizational Democracy on Employees' Socio-moral Climate and Prosocial Behavioral Orientations , 2009 .

[3]  Andrew A. King,et al.  Using Open Innovation to Identify the Best Ideas , 2013 .

[4]  J. Füller,et al.  Brand Community Members as a Source of Innovation , 2008 .

[5]  Johannes Gutenberg-Straße,et al.  Does god play dice? Randomness vs. deterministic explanations of crowdsourcing success , 2015 .

[6]  John M. Jermier,et al.  Corporate Reputation: The Definitional Landscape , 2006 .

[7]  Anindya Ghose,et al.  Learning-by-Doing and Project Choice: a Dynamic Structural Model of Crowdsourcing , 2010, ICIS.

[8]  Karl T. Ulrich,et al.  Innovation Tournaments: Creating and Selecting Exceptional Opportunities , 2009 .

[9]  D. McFadden.  Conditional logit analysis of qualitative choice behavior , 1972 .

[10]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[11]  Mark T. Spence,et al.  The moderating effects of problem characteristics on experts' and novices' judgments , 1997 .

[12]  Daren C. Brabham.  Crowdsourcing the Public Participation Process for Planning Projects , 2009 .

[13]  Lada A. Adamic,et al.  Crowdsourcing with All-Pay Auctions: A Field Experiment on Taskcn , 2014, Manag. Sci..

[14]  Milan Vojnovic,et al.  Crowdsourcing and all-pay auctions , 2009, EC '09.

[15]  Jesse C. Bockstedt,et al.  Do Participation Strategy and Experience Impact the Likelihood of Winning in Unblind Innovation Contests , 2011 .

[16]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[17]  V. Vroom.  Work and motivation , 1964 .

[18]  Rajiv D. Banker,et al.  Winner Determination of Open Innovation Contests in Online Markets , 2011, ICIS.

[19]  Mengze Shi,et al.  Designing Optimal Sales Contests: A Theoretical Perspective , 2001 .

[20]  Patrick Sevestre,et al.  The Econometrics of panel data : a handbook of the theory with applications , 1996 .

[21]  Joel Podolny,et al.  Status: Insights from Organizational Sociology , 2012 .

[22]  Hua Ye,et al.  Solvers' participation in crowdsourcing platforms: Examining the impacts of trust, and benefit and cost factors , 2017, J. Strateg. Inf. Syst..

[23]  A. Banerjee,et al.  A Simple Model of Herd Behavior , 1992 .

[24]  Stefano M. Iacus,et al.  Invariant and Metric Free Proximities for Data Matching: An R Package , 2008 .

[25]  Chrysanthos Dellarocas,et al.  Harnessing Crowds: Mapping the Genome of Collective Intelligence , 2009 .

[26]  Likoebe M. Maruping,et al.  Impacts of License Choice and Organizational Sponsorship on User Interest and Development Activity in Open Source Software Projects , 2006, Inf. Syst. Res..

[27]  Alan R. Dennis,et al.  Combating Fake News on Social Media with Source Ratings: The Effects of User and Expert Reputation Ratings , 2019, J. Manag. Inf. Syst..

[28]  Ross A. Malaga.  Web-Based Reputation Management Systems: Problems and Suggested Solutions , 2001, Electron. Commer. Res..

[29]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[30]  David J. Weiss,et al.  Performance-based assessment of expertise: How to decide if someone is an expert or not , 2002, Eur. J. Oper. Res..

[31]  Ann Majchrzak,et al.  Towards an Information Systems Perspective and Research Agenda on Crowdsourcing for Innovation , 2013, J. Strateg. Inf. Syst..

[32]  Eva Chen,et al.  Identifying Expertise to Extract the Wisdom of Crowds , 2015, Manag. Sci..

[33]  K. Anders Ericsson,et al.  Expertise in interpreting: An expert-performance perspective , 2000 .

[34]  M. Haan,et al.  Expert Judgment Versus Public Opinion – Evidence from the Eurovision Song Contest , 2005 .

[35]  Jesse C. Bockstedt,et al.  Quality Assessment of Peer-Produced Content in Knowledge Repositories using Development and Coordination Activities , 2019, J. Manag. Inf. Syst..

[36]  Chaim Fershtman,et al.  Social Status, Education, and Growth , 1996, Journal of Political Economy.

[37]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[38]  G. King,et al.  Multivariate Matching Methods That Are Monotonic Imbalance Bounding , 2011 .

[39]  K. Lakhani,et al.  The Principles of Distributed Innovation , 2007, Innovations: Technology, Governance, Globalization.

[40]  Stephen S. Standifird.  Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings , 2001 .

[41]  P. Allison,et al.  7. Fixed-Effects Negative Binomial Regression Models , 2002 .

[42]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[43]  M. Holbrook.  Popular Appeal versus Expert Judgments of Motion Pictures , 1999 .

[44]  Linus Dahlander,et al.  Distant Search, Narrow Attention: How Crowding Alters Organizations’ Filtering of Suggestions in Crowdsourcing , 2014 .

[45]  N. Allen,et al.  Assessing dissimilarity relations under missing data conditions: evidence from computer simulations. , 2007, The Journal of applied psychology.

[46]  Pei-yu Chen,et al.  Determinants of Open Contest Participation in Online Labor Markets , 2014 .

[47]  Li Chen,et al.  Theory and Analysis of Company-Sponsored Value Co-Creation , 2012, J. Manag. Inf. Syst..

[48]  Wanggen Wan,et al.  A pattern-based approach for developing creativity applications supported by surface computing , 2016, Int. J. Hum. Comput. Stud..

[49]  Emanuela Prandelli,et al.  The Psychological Effects of Empowerment Strategies on Consumers’ Product Demand , 2010 .

[50]  Jing Wang,et al.  The Effects of Age and Expertise on Product Evaluations: Does the Type of Information Matter? , 2016, Manag. Sci..

[51]  E. Zajac,et al.  Status Evolution and Competition: Theory and Evidence , 2005 .

[52]  Dan Li,et al.  Exploring the effects of reward and competition intensity on participation in crowdsourcing contests , 2017, Electronic Markets.

[53]  P. Balestra.  Fixed Effect Models and Fixed Coefficient Models , 1992 .

[54]  Andrew Whinston,et al.  Optimal Design of Consumer Contests , 2007 .

[55]  Olivier Toubia,et al.  Adaptive Idea Screening Using Consumers , 2007 .

[56]  Phil Johnson.  Whence Democracy? A Review and Critique of the Conceptual Dimensions and Implications of the Business Case for Organizational Democracy , 2006 .

[57]  De Liu,et al.  Pure and hybrid crowds in crowdfunding markets , 2016 .

[58]  Yi Xu,et al.  Innovation Contests, Open Innovation, and Multiagent Problem Solving , 2008, Manag. Sci..

[59]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[60]  Edmund A. Mennis.  The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations , 2006 .

[61]  N. Lee,et al.  Word of mouth communication within online communities: Conceptualizing the online social network , 2007 .

[62]  Katherine J. Stewart,et al.  The Impact of Ideology on Effectiveness in Open Source Software Development Teams , 2006, MIS Q..

[63]  Katja Hutter,et al.  Machiavellianism or Morality: Which Behavior Pays Off In Online Innovation Contests? , 2015, J. Manag. Inf. Syst..

[64]  林丽慧,et al.  Optimal Fee Structures of Crowdsourcing Platforms , 2016 .

[65]  Dahui Li,et al.  Task Design, Motivation, and Participation in Crowdsourcing Contests , 2011, Int. J. Electron. Commer..

[66]  Alok Gupta,et al.  Research Note - IT Outsourcing and the Impact of Advisors on Clients and Vendors , 2016, Inf. Syst. Res..

[67]  Ethan Mollick,et al.  Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts , 2015, Manag. Sci..

[68]  L. V. Williams,et al.  Prediction Markets , 2003 .

[69]  Christoph Riedl,et al.  Learning from Mixed Signals in Online Innovation Communities , 2018, Organ. Sci..

[70]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[71]  Karim R. Lakhani,et al.  Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis , 2011, Manag. Sci..

[72]  A. Bullinger,et al.  Innovation Contests: A Review, Classification and Outlook , 2012 .

[73]  Lyman W. Porter,et al.  The Effect of Performance on Job Satisfaction , 1967 .

[74]  Jan Marco Leimeister,et al.  Rate or Trade? Identifying Winning Ideas in Open Idea Sourcing , 2016, Inf. Syst. Res..

[75]  M. Rocío Martínez-Torres,et al.  Analysis of open innovation communities from the perspective of social network analysis , 2014, Technol. Anal. Strateg. Manag..

[76]  Daren C. Brabham.  MOVING THE CROWD AT THREADLESS , 2010 .

[77]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[78]  Z. Griliches,et al.  Econometric Models for Count Data with an Application to the Patents-R&D Relationship , 1984 .

[79]  Ammon Salter,et al.  Managing Unsolicited Ideas for R&D , 2012 .

[80]  Morris B. Holbrook,et al.  Taste versus the Market: An Extension of Research on the Consumption of Popular Culture , 2007 .

[81]  Y. Lacasse,et al.  From the authors , 2005, European Respiratory Journal.

[82]  Ann Majchrzak,et al.  Knowledge Collaboration in Online Communities , 2011, Organ. Sci..

[83]  R. Hogarth,et al.  The attraction of uncertainty: Interactions between skill and levels of uncertainty in market-entry games , 2010 .

[84]  Mark Schankerman,et al.  Motivation and sorting of human capital in open innovation , 2015 .

[85]  G. King,et al.  Causal Inference without Balance Checking: Coarsened Exact Matching , 2012, Political Analysis.