A taxonomy of crowdsourcing based on task complexity

Although a great many different crowdsourcing approaches are available to those seeking to accomplish individual or organizational tasks, little research attention has yet been given to characterizing how those approaches might be based on task characteristics. To that end, we conducted an extensive review of the crowdsourcing landscape, including a look at what types of taxonomies are currently available. Our review found that no taxonomy explored the multidimensional nature of task complexity. This paper develops a taxonomy whose specific intent is the classification of approaches in terms of the types of tasks for which they are best suited. To develop this task-based taxonomy, we followed an iterative approach that considered over 100 well-known examples of crowdsourcing. The taxonomy considers three dimensions of task complexity: (a) task structure – is the task well-defined, or does it require a more open-ended solution; (2) task interdependence – can the task be solved by an individual, or does it require a community of problem solvers; and (3) task commitment – what level of commitment is expected from crowd members? Based on this taxonomy, we identify seven categories of crowdsourcing and discuss prototypical examples of each approach. Furnished with such an understanding, one should be able to determine which crowdsourcing approach is most suitable for a particular task situation.

[1]  H. Miller,et al.  Motivation, behavior, and performance: A closer examination of goal setting and monetary incentives. , 1978 .

[2]  Yves L. Doz,et al.  The science behind the smile. Interview by Gardiner Morse. , 2012 .

[3]  Frank Kleemann,et al.  Un(der)paid Innovators , 2008 .

[4]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[5]  G. Jouret Inside Cisco's Search for the Next Big Idea , 2009 .

[6]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[7]  S. Kozlowski,et al.  A Typology of Virtual Teams , 2002 .

[8]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[9]  G. Latham,et al.  A Review of Research on the Application of Goal Setting in Organizations , 1975 .

[10]  Maja Vukovic,et al.  Crowdsourcing for Enterprises , 2009, 2009 Congress on Services - I.

[11]  Amy Bruckman,et al.  Decentralization in Wikipedia Governance , 2009, J. Manag. Inf. Syst..

[12]  Jonathan Corney,et al.  Outsourcing labour to the cloud , 2009 .

[13]  Martin Schader,et al.  Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes , 2011, AMCIS.

[14]  Eric S. Raymond,et al.  The cathedral and the bazaar - musings on Linux and Open Source by an accidental revolutionary , 2001 .

[15]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[16]  Yochai Benkler,et al.  The wealth of networks: how social production transforms markets and freedom , 2006 .

[17]  Eric Schenk,et al.  Towards a characterization of crowdsourcing practices , 2011 .

[18]  Jan Muntermann,et al.  A method for taxonomy development and its application in information systems , 2013, Eur. J. Inf. Syst..

[19]  H. Chesbrough Why Companies Should Have Open Business Models , 2007 .

[20]  C. Fuchs Don Tapscott & Anthony D. Williams: Wikinomics: How Mass Collaboration Changes Everything , 2008 .

[21]  Daren C. Brabham Crowdsourcing as a Model for Problem Solving , 2008 .

[22]  Frank Kleemann,et al.  Un(der)paid innovators: the commercial utilization of consumer work through crowdsourcing , 2008 .

[23]  Peter Green,et al.  ACIS 2010 Proceedings. Information Systems: Defining and Establishing a High Impact Discipline. 21th Australasian Conference on Information Systems , 2010 .

[24]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[25]  Georg von Krogh,et al.  Open Source Software and the "Private-Collective" Innovation Model: Issues for Organization Science , 2003, Organ. Sci..

[26]  H. Chesbrough The Era of Open Innovation , 2003 .

[27]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[28]  Daren C. Brabham Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning , 2012 .

[29]  Josh Lerner,et al.  The Simple Economics of Open Source , 2000 .

[30]  Peter J. Frost,et al.  Goal setting and the task process: I. An interactive influence on individual performance , 1976 .

[31]  Aaron Delwiche,et al.  The Participatory Cultures Handbook , 2012 .

[32]  K. Bailey Typologies and taxonomies: An introduction to classification techniques. , 1994 .

[33]  O. Bjelland,et al.  An Inside View of IBM's 'Innovation Jam' , 2008 .