Task Division for Team Success in Crowdsourcing Contests: Resource Allocation and Alignment Effects

Abstract Advances in information technology bring changes to the nature of work by facilitating companies to go beyond the wisdom of their workforce and tap into the “wisdom of the crowd” via online crowdsourcing contests. In these contests, active and motivated individuals collaborate in the form of self-organized teams that compete for rewards. Using a rich data set of 732 teams in 52 contests collected from the crowdsourcing platform, Kaggle.com, from its launch in April 2010 to July 2012, we studied how the allocation of members’ social and intellectual capital within a virtual team affects team performance in online crowdsourcing contests. Our econometric analysis uses a rank-ordered logistic regression model, and suggests that the effect of a member’s social and intellectual capital on team performance varies depending on his or her roles. Though a team leader’s social capital and a team expert’s intellectual capital significantly influence team performance, a team leader’s intellectual capital and a team expert’s social capital do not. Further, we found that the alignment of a member’s social and intellectual capital within a team has a significant influence on team performance. Moreover, the intensity of the competition moderates the impact. When a contest is highly competitive, the social and intellectual capital alignment negatively affects team performance, and when the competitive intensity is low, this alignment positively affects team performance. Our findings provide insights into improving performance in team-based competitions in crowdsourcing communities.

[1]  Brett R. Smith,et al.  Distributed leadership in teams: The network of leadership perceptions and team performance. , 2006 .

[2]  Henry Sauermann,et al.  The Anatomy of Teams: Division of Labor and Allocation of Credit in Collaborative Knowledge Production , 2014 .

[3]  Giovanni Asproni,et al.  Motivation, Teamwork, and Agile Development , 2004 .

[4]  Neil Savage,et al.  Gaining wisdom from crowds , 2012, Commun. ACM.

[5]  Paul A. Pavlou,et al.  OPEN INNOVATION: STRATEGIC DESIGN OF ONLINE , 2009 .

[6]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[7]  Adam Smith,et al.  The Wealth of Nations , 1999 .

[8]  Erich B. Bergiel,et al.  Nature of virtual teams: a summary of their advantages and disadvantages , 2008 .

[9]  D. Harrison,et al.  TIES, LEADERS, AND TIME IN TEAMS: STRONG INFERENCE ABOUT NETWORK STRUCTURE'S EFFECTS ON TEAM VIABILITY AND PERFORMANCE , 2006 .

[10]  Roger Guimerà,et al.  Team Assembly Mechanisms Determine Collaboration Network Structure and Team Performance , 2005, Science.

[11]  Dahui Li,et al.  Task Design, Motivation, and Participation in Crowdsourcing Contests , 2011, Int. J. Electron. Commer..

[12]  Timothy T. Baldwin,et al.  The Social Fabric of a Team-Based M.B.A. Program: Network Effects on Student Satisfaction and Performance , 1997 .

[13]  John H. Kagel,et al.  Are Two Heads Better Than One? Team versus Individual Play in Signaling Games , 2005 .

[14]  Rajiv D. Banker,et al.  Impact of Past Performance and Strategic Bidding on Winner Determination of Open Innovation Contest , 2010 .

[15]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[16]  Martin J. Beckmann,et al.  ON THE DIVISION OF LABOR IN TEAMS , 1956 .

[17]  Katherine J. Stewart,et al.  The Effects of Diversity in Global, Distributed Collectives: A Study of Open Source Project Success , 2013, Inf. Syst. Res..

[18]  J. Marden Analyzing and Modeling Rank Data , 1996 .

[19]  Patricia E. Tweet Brokerage and Closure: An Introduction to Social Capital , 2006 .

[20]  Karim R. Lakhani,et al.  Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis , 2011, Manag. Sci..

[21]  T. Davenport,et al.  The Mysterious Art and Science of Knowledge-Worker Performance , 2002 .

[22]  G. Goodwin,et al.  The Cambridge Handbook of Expertise and Expert Performance: The Making of a Dream Team: When Expert Teams Do Best , 2006 .

[23]  Nikolay Archak,et al.  Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on TopCoder.com , 2010, WWW '10.

[24]  Youngjin Yoo,et al.  The Impact of Knowledge Coordination on Virtual Team Performance Over Time , 2007, MIS Q..

[25]  Pamela R. Johnson,et al.  The “wonderland” of virtual teams , 2001 .

[26]  C KaneGerald,et al.  Centrality-is proficiency alignment and workgroup performance , 2011 .

[27]  Chen Zhang,et al.  Emergence of New Project Teams from Open Source Software Developer Networks: Impact of Prior Collaboration Ties , 2008, Inf. Syst. Res..

[28]  E. Seltzer,et al.  Citizen Participation, Open Innovation, and Crowdsourcing , 2013 .

[29]  Sirkka L. Jarvenpaa,et al.  Communication and Trust in Global Virtual Teams , 1999, J. Comput. Mediat. Commun..

[30]  Barry L. Bayus,et al.  Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community , 2013, Manag. Sci..

[31]  Kimberly A. Furumo,et al.  Counting the cost of virtual teams , 2007, CACM.

[32]  Hua Chen,et al.  Should Managers Use Team-Based Contests? , 2013, Manag. Sci..

[33]  Laku Chidambaram,et al.  Is Out of Sight, Out of Mind? An Empirical Study of Social Loafing in Technology-Supported Groups , 2005, Inf. Syst. Res..

[34]  W. Stevenson,et al.  Social Capital and Social Influence on the Board of Directors , 2009 .

[35]  Guido Hertel,et al.  Managing virtual teams: A review of current empirical research , 2005 .

[36]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[37]  Ezra W. Zuckerman,et al.  Networks, Diversity, and Productivity: The Social Capital of Corporate R&D Teams , 2001 .

[38]  Zahari Taha,et al.  Virtual Teams: A Literature Review , 2009 .

[39]  Bruce Robertson,et al.  The Social Network Ties of Group Leaders: Implications for Group Performance and Leader Reputation , 2006, Organ. Sci..

[40]  Yi Xu,et al.  Innovation Contests, Open Innovation, and Multiagent Problem Solving , 2008, Manag. Sci..

[41]  Jonathon N. Cummings,et al.  Tie and Network Correlates of Individual Performance in Knowledge-Intensive Work , 2004 .

[42]  S. Borgatti,et al.  Network Measures of Social Capital , 2012 .

[43]  Blake Ives,et al.  Virtual teams: a review of current literature and directions for future research , 2004, DATB.

[44]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[45]  Daren C. Brabham Crowdsourcing as a model for problem solving: Leveraging the collective intelligence of online communities for public good , 2010 .

[46]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[47]  Jonathon N. Cummings Work Groups, Structural Diversity, and Knowledge Sharing in a Global Organization , 2004, Manag. Sci..

[48]  S. G. Cohen,et al.  What Makes Teams Work: Group Effectiveness Research from the Shop Floor to the Executive Suite , 1997 .

[49]  Patricia J. Guinan,et al.  Enabling Software Development Team Performance During Requirements Definition: A Behavioral Versus Technical Approach , 1998, Inf. Syst. Res..

[50]  Saonee Sarker,et al.  The Role of Communication and Trust in Global Virtual Teams: A Social Network Perspective , 2011, J. Manag. Inf. Syst..

[51]  Y. Kor,et al.  Experience-Based Human Capital and Social Capital of Outside Directors , 2008 .

[52]  Hideo Joho,et al.  Spatially-Aware Information Retrieval on the Internet , 2022 .

[53]  Param Vir Singh,et al.  Crowdsourcing "blockbuster" Ideas: a Dynamic Structural Model of Ideation , 2011, ICIS.

[54]  L. Freeman Centrality in social networks conceptual clarification , 1978 .

[55]  Param Vir Singh,et al.  Developer Heterogeneity and Formation of Communication Networks in Open Source Software Projects , 2011, J. Manag. Inf. Syst..

[56]  Massimo Magni,et al.  Everybody Needs Somebody: The Influence of Team Network Structure on Information Technology Use , 2012, J. Manag. Inf. Syst..

[57]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[58]  Marvin D. Dunnette,et al.  Human Performance and Productivity : Volumes 1, 2, and 3 , 2014 .

[59]  Goparaju Purna Sudhakar,et al.  Soft factors affecting the performance of software development teams , 2011 .

[60]  Andrew Whinston,et al.  Optimal Design of Consumer Contests , 2007 .

[61]  Lucy Gilson,et al.  Virtual Teams: What Do We Know and Where Do We Go From Here? , 2004 .

[62]  Stephen P. Borgatti,et al.  Centrality and network flow , 2005, Soc. Networks.