What can crowdsourcing do for decision support?

Crowdsourcing can be viewed as a method of distributing work to a large number of workers (the crowd) both inside and outside of an organization, for the purpose of improving decision making, completing cumbersome tasks, or co-creation of designs and other projects. Of the various applications of crowdsourcing, the one investigated in this paper is to support various phases of managerial decision-making and problem solving. To examine the research issues related to such support, we created a framework based on four major components of crowdsourcing: the task that is outsourced, the crowd which carries out the task, the crowdsourcing process, and the outcome evaluation. Each component is examined from the managerial, behavioral, and information technology aspects. This framework enables us to organize existing literature and identify key research issues. Suggested topics for future research are described.

[1]  Eric Horvitz,et al.  Combining human and machine intelligence in large-scale crowdsourcing , 2012, AAMAS.

[2]  G. Pisano.  Which kind of collaboration is right for you , 2009 .

[3]  Qinghua Zhu,et al.  Exploring the Motivation of Participants in Crowdsourcing Contest , 2012, ICIS.

[4]  Martin Schader,et al.  Workers' Task Choice in Crowdsourcing and Human Computation Markets , 2012, ICIS.

[5]  Martin Schader,et al.  Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes , 2011, AMCIS.

[6]  E. Jayanti,et al.  Open sourced organizational learning: implications and challenges of crowdsourcing for human resource development (HRD) practitioners , 2012 .

[7]  Scott R. Klemmer,et al.  Shepherding the crowd yields better work , 2012, CSCW.

[8]  Eric Schenk,et al.  Crowdsourcing: What can be Outsourced to the Crowd, and Why ? , 2009 .

[9]  Nicolas Kaufmann,et al.  Worker Motivation in Crowdsourcing and Human Computation , 2011 .

[10]  Eileen M. Trauth,et al.  Hanging with the right crowd: Matching crowdsourcing need to crowd characteristics , 2012, AMCIS.

[11]  James Surowiecki.  The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[12]  David Godes,et al.  Introduction to the Special Issue - Social Media and Business Transformation: A Framework for Research , 2013, Inf. Syst. Res..

[13]  Raimonda Alonderiene,et al.  Value Creation in Innovations Crowdsourcing: Example of Creative Agencies , 2013 .

[14]  Anol Bhattacherjee,et al.  Governance practices and software maintenance: A study of open source projects , 2012, Decis. Support Syst..

[15]  Marios Koufaris,et al.  The Crowd on the Assembly Line: Designing Tasks for a Better Crowdsourcing Experience , 2013, ICIS.

[16]  Jim Euchner,et al.  User Innovation , 2013 .

[17]  Esteve Almirall,et al.  Motives for Participation in On-Line Open Innovation Platforms , 2011 .

[18]  Daren C. Brabham.  Managing Unexpected Publics Online: The Challenge of Targeting Specific Groups with the Wide-Reaching Tool of the Internet , 2012 .

[19]  Mark S. Ackerman,et al.  Crowdsourcing and knowledge sharing: strategic user behavior on taskcn , 2008, EC '08.

[20]  Karim R. Lakhani,et al.  Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis , 2011, Manag. Sci..

[21]  Hajo Hippner,et al.  Crowdsourcing , 2012, Business & Information Systems Engineering.

[22]  Radhika Jain.  Investigation of Governance Mechanisms for Crowdsourcing Initiatives , 2010, AMCIS.

[23]  Sihem Amer-Yahia,et al.  Crowds, not Drones: Modeling Human Factors in Interactive Crowdsourcing , 2013, DBCrowd.

[24]  Karim R Lakhani,et al.  Using the crowd as an innovation partner. , 2013, Harvard business review.

[25]  Eric Schenk,et al.  Towards a characterization of crowdsourcing practices , 2011 .

[26]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[27]  Ian McShane,et al.  Analysing the Challenges for Large Public Libraries in the Twenty-first Century: A Case Study of the State Library of Victoria in Australia , 2008, First Monday.

[28]  E. Bonabeau.  Decisions 2.0: the power of collective intelligence , 2009 .

[29]  Jan Marco Leimeister,et al.  Idea Evaluation Mechanisms for Collective Intelligence in Open Innovation Communities: Do Traders Outperform Raters? , 2011, ICIS.

[30]  John Cullen,et al.  Democratizing Innovation , 2020, Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship.

[31]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[32]  H. Chesbrough,et al.  Open Innovation: A New Paradigm for Understanding Industrial Innovation , 2006 .

[33]  Jan Marco Leimeister,et al.  Does Collaboration among Participants Lead to Better Ideas in IT-Based Idea Competitions? An Empirical Investigation , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[34]  Jan Marco Leimeister,et al.  Does Collaboration among Participants Lead to Better Ideas in IT-Based Idea Competitions? An Empirical Investigation , 2010, HICSS.

[35]  Vladimir Zwass,et al.  Co-Creation: Toward a Taxonomy and an Integrated Research Perspective , 2010, Int. J. Electron. Commer..

[36]  Panagiotis G. Ipeirotis.  Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[37]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[38]  Christopher L. Tucci,et al.  Crowdsourcing As a Solution to Distant Search , 2012 .

[39]  K. Lakhani,et al.  Threadless: The Business of Community , 2008 .

[40]  Jan Marco Leimeister,et al.  Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition , 2009, J. Manag. Inf. Syst..

[41]  Saggi Nevo,et al.  New Capabilities: Can IT Service Providers Leverage Crowdsourcing? , 2012, ICIS.

[42]  Brian A Vander Schee.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2009 .

[43]  O. Bjelland,et al.  An Inside View of IBM's 'Innovation Jam' , 2008 .

[44]  Tobias Hoßfeld,et al.  Analyzing costs and accuracy of validation mechanisms for crowdsourcing platforms , 2013, Math. Comput. Model..

[45]  Param Vir Singh,et al.  Crowdsourcing Contests: A Dynamic Structural Model of the Impact of Incentive Structure on Solution Quality , 2012, ICIS.

[46]  Dahui Li,et al.  Task Design, Motivation, and Participation in Crowdsourcing Contests , 2011, Int. J. Electron. Commer..

[47]  Andrew Potter,et al.  Mass collaboration problem solving: A new approach to wicked problems , 2010, 2010 International Symposium on Collaborative Technologies and Systems.

[48]  Daren C. Brabham.  Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application , 2008, First Monday.

[49]  Arjen P. de Vries,et al.  Increasing cheat robustness of crowdsourcing tasks , 2013, Information Retrieval.

[50]  David W. Chadwick,et al.  Guest editorial: A brief overview of data leakage and insider threats , 2013, Inf. Syst. Frontiers.

[51]  Scott R. Klemmer,et al.  Shepherding the Crowd: An Approach to More Creative Crowd Work , 2011 .

[52]  Rajiv Kishore,et al.  Rules of Crowdsourcing: Models, Issues, and Systems of Control , 2013, Inf. Syst. Manag..

[53]  Jim Euchner.  User Innovation: An Interview with Eric Von Hippel: Eric Von Hippel Talks with Jim Euchner about the Growth of User Innovation and Its Implications for Business , 2013 .

[54]  K. Boudreau,et al.  How to Manage Outside Innovation , 2009 .

[55]  Jan Marco Leimeister,et al.  The Effect of Rating Scales on Decision Quality and User Attitudes in Online Innovation Communities , 2012, Int. J. Electron. Commer..

[56]  Maria Antikainen,et al.  Motivating and supporting collaboration in open innovation , 2010 .

[57]  Lars Hetmank,et al.  Components and Functions of Crowdsourcing Systems - A Systematic Literature Review , 2013, Wirtschaftsinformatik.

[58]  Qinghua Zhu,et al.  Evaluation on crowdsourcing research: Current status and future direction , 2012, Information Systems Frontiers.

[59]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[60]  Tanja Aitamurto.  THE IMPACT OF CROWDFUNDING ON JOURNALISM , 2011 .

[62]  Peter A. Rosen,et al.  Crowdsourcing Lessons for Organizations , 2011, J. Decis. Syst..

[63]  Martin Schreier,et al.  The Value of Crowdsourcing: Can Users Really Compete with Professionals in Generating New Product Ideas? , 2009 .

[64]  Kwong-Sak Leung,et al.  A Survey of Crowdsourcing Systems , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.