Putting the Pieces Back Together Again: Contest Webs for Large-Scale Problem Solving

A key issue, whenever people work together to solve a complex problem, is how to divide the problem into parts done by different people and combine the parts into a solution for the whole problem. This paper presents a novel way of doing this with groups of contests called contest webs. Based on the analogy of supply chains for physical products, the method provides incentives for people to (a) reuse work done by themselves and others, (b) simultaneously explore multiple ways of combining interchangeable parts, and (c) work on parts of the problem where they can contribute the most. The paper also describes a field test of this method in an online community of over 50,000 people who are developing proposals for what to do about global climate change. The early results suggest that the method can, indeed, work at scale as intended.

[1]  P. Lawrence,et al.  Differentiation and Integration in Complex Organizations , 1967 .

[2]  Robert J. Allio,et al.  CEO interview: the InnoCentive model of open innovation , 2004 .

[3]  Michael S. Bernstein,et al.  Expert crowdsourcing with flash teams , 2014, UIST.

[4]  O. Williamson Markets and hierarchies, analysis and antitrust implications : a study in the economics of internal organization , 1975 .

[5]  David Easley,et al.  Networks, Crowds, and Markets: Power Laws and Rich-Get-Richer Phenomena , 2010 .

[6]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[7]  Jonathan L. Zittrain,et al.  The Future of the Internet - And How to Stop It , 2008 .

[8]  Lydia B. Chilton,et al.  Cobi: a community-informed conference scheduling tool , 2013, UIST.

[9]  J. Larson,et al.  An Inquiry into the Nature and Causes of the Wealth of Nations , 2015 .

[10]  Kim B. Clark,et al.  Design Rules: The Power of Modularity Volume 1 , 1999 .

[11]  David A. Hounshell,et al.  From the American System to Mass Production 1800–1932: The Development of Manufacturing Technology in the United States by David A. Hounshell (review) , 2023 .

[12]  Jon M. Kleinberg,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World [Book Review] , 2013, IEEE Technol. Soc. Mag..

[13]  Michael L. Tushman,et al.  Competing by design: the power of organizational architecture , 1998 .

[14]  Gary M. Olson,et al.  The Climate CoLab: Large scale model-based collaborative planning , 2011, 2011 International Conference on Collaboration Technologies and Systems (CTS).

[15]  A. Davies,et al.  From the American System to Mass Production, 1800-1932: The Development of Manufacturing Technology in the United States. , 1985 .

[16]  Aniket Kittur,et al.  CrowdForge: crowdsourcing complex work , 2011, UIST.

[17]  J. Houghton,et al.  Climate Change 2013 - The Physical Science Basis: Working Group I Contribution to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change , 2014 .

[18]  J. Reichman Intellectual Property in the Twenty-First Century: Will the Developing Countries Lead or Follow? , 2009, Houston law review.

[19]  P. Rhodes Administration. , 1983 .

[20]  Björn Hartmann,et al.  Collaboratively crowdsourcing workflows with turkomatic , 2012, CSCW.

[21]  Karim R. Lakhani,et al.  TopCoder (A): Developing Software through Crowdsourcing , 2010 .

[22]  Lydia B. Chilton,et al.  Cascade: crowdsourcing taxonomy creation , 2013, CHI.

[23]  Jay R. Galbraith Designing organizations: An executive briefing on strategy, structure, and process. , 1995 .

[24]  Aniket Kittur,et al.  Searching for analogical ideas with crowds , 2014, CHI.

[25]  Krzysztof Z. Gajos,et al.  Human computation tasks with global constraints , 2012, CHI.

[26]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[27]  Gavin Clarkson,et al.  The Social Efficiency of Fairness: An Innovation Economics Approach to Innovation , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[28]  Jeffrey V. Nickerson,et al.  Topic Prevalence and Reuse in an Open Innovation Community , 2016 .

[29]  E. Christiaanse,et al.  ICT‐enabled coordination of dynamic supply webs , 1999 .

[30]  Thomas W. Malone,et al.  Enabling Open Development Methodologies in Climate Change Assessment Modeling , 2011, IEEE Software.

[31]  Dietmar Plenz,et al.  powerlaw: A Python Package for Analysis of Heavy-Tailed Distributions , 2013, PloS one.

[32]  Jeffrey V. Nickerson,et al.  Appropriation and Creativity: User-Initiated Contests in Scratch , 2011, 2011 44th Hawaii International Conference on System Sciences.

[33]  André van der Hoek,et al.  Microtask programming: building software with a crowd , 2014, UIST.

[34]  Christian D. Schunn,et al.  Do the best design ideas (really) come from conceptually distant sources of inspiration , 2015 .

[35]  K. Arrow,et al.  EXISTENCE OF AN EQUILIBRIUM FOR A COMPETITIVE ECONOMY , 1954 .

[36]  James D. Herbsleb,et al.  Incentives and integration in scientific software production , 2013, CSCW.

[37]  Aniket Kittur,et al.  Distributed analogical idea generation: inventing with crowds , 2014, CHI.

[38]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[39]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[40]  Lydia B. Chilton,et al.  Frenzy: collaborative data organization for creating conference sessions , 2014, CHI.

[41]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[42]  Kim B. Clark,et al.  Design Rules: The Power of Modularity , 2000 .

[43]  Drew Paine,et al.  From The Matrix to a Model of Coordinated Action (MoCA): A Conceptual Framework of and for CSCW , 2015, CSCW.

[44]  Joan V. Robinson,et al.  The Nature of the Firm , 2004 .

[45]  T. Stocker,et al.  Climate Change 2013: The Physical Science Basis. An overview of the Working Group 1 contribution to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC). , 2013 .

[46]  David Weinberger,et al.  Small Pieces Loosely Joined (a unified theory of the web) , 2002 .

[47]  Lada A. Adamic Zipf, Power-laws, and Pareto-a ranking tutorial , 2000 .

[48]  Mark Klein,et al.  Harnessing Collective Intelligence to Address Global Climate Change , 2007, Innovations: Technology, Governance, Globalization.

[49]  James D. Thompson Organizations in Action: Social Science Bases of Administrative Theory , 1967 .

[50]  K. Arrow Economic Welfare and the Allocation of Resources for Invention , 1962 .