Crowdsourcing as a model for problem solving: Leveraging the collective intelligence of online communities for public good

As an application of deliberative democratic theory in practice, traditional public participation programs in urban planning seek to cultivate citizen input and produce public decisions agreeable to all stakeholders. However, the deliberative democratic ideals of these traditional public participation programs, consisting of town hall meetings, hearings, workshops, and design charrettes, are often stymied by interpersonal dynamics, special interest groups, and an absence of key stakeholder demographics due to logistical issues of meetings or lack of interest and awareness. This dissertation project proposes crowdsourcing as an online public participation alternative that may ameliorate some of the hindrances of traditional public participation methods. Crowdsourcing is an online, distributed problem solving and production model largely in use for business. It leverages the collective intelligence of online communities by soliciting ideas and solutions for an organization from these communities through the form of an open call. The mechanism of one type of crowdsourcing, the peer-vetted creative production approach, aligns with the goals of public participation programs. In light of this, Next Stop Design was launched in 2009 in an attempt to test crowdsourcing in a public participation context for transit planning. Next Stop Design was an online competition where users submitted bus stop shelter designs and voted on the designs of peers to determine a best design. This study examines the effectiveness of the Next Stop Design project as an online deliberative democratic process, as perceived by Next Stop Design participants,

[1]  D. Jonassen Learning to Solve Problems: An Instructional Design Guide , 2009 .

[2]  Janette Hartz-Karp How and Why Deliberative Democracy Enables Co-Intelligence and Brings Wisdom to Governance , 2020 .

[3]  Patricia G. Lange Interruptions and Intertasking in Distributed Knowledge Work , 2008 .

[4]  Carl R. Bybee,et al.  Investigating the Assumptions of Uses and Gratifications Research , 1977 .

[5]  M. D. Carpini,et al.  Public deliberation, discursive participation, and citizen engagement: A review of the empirical literature , 2004 .

[6]  Earthea Nance,et al.  Community Participation in Urban Sanitation , 2007 .

[7]  Stefan Stieger,et al.  Dynamic Interviewing Program (DIP): Automatic Online Interviews via the Instant Messenger ICQ , 2008, Cyberpsychology Behav. Soc. Netw..

[8]  J. Suler The Online Disinhibition Effect , 2004, Cyberpsychology, Behavior, and Social Networking.

[9]  Robert Marshall,et al.  Public Involvement and Planning: Looking beyond the One to the Many , 2000 .

[10]  Christopher J. Cowton,et al.  The E-Interview , 2002 .

[11]  Mark Warschauer,et al.  Reconceptualizing the Digital Divide , 2002, First Monday.

[12]  N. Rossiter Organized Networks: Media Theory, Creative Labour, New Institutions , 2006 .

[13]  Joan van Tassel,et al.  Yakety-Yak, Do Talk Back!: PEN, the Nation's First Publicly Funded Electronic Network, Makes a Difference in Santa Monica , 1995, Computerization and Controversy, 2nd Ed..

[14]  F. Cook,et al.  Deliberative Democracy in Action: Evaluation of Americans Discuss Social Security: Pew Charitable Trusts , 1998 .

[15]  Gerhard Fischer,et al.  Beyond "Couch Potatoes": From Consumers to Designers and Active Contributors , 2002, First Monday.

[16]  Ann Van Herzele,et al.  Local Knowledge in Action: Valuing Nonprofessional Reasoning in the Planning Process , 2004 .

[17]  William F. Birdsall,et al.  Geography matters: Mapping human development and digital access , 2005, First Monday.

[18]  Samuel D. Brody,et al.  Measuring the Effects of Stakeholder Participation on the Quality of Local Plans Based on the Principles of Collaborative Ecosystem Management , 2003 .

[19]  Rishab Aiyer Ghosh Cooking pot markets: an economic model for the trade in free goods and services on the Internet , 1998, First Monday.

[20]  L. Jeppesen,et al.  The Value of Openness in Scientific Problem Solving , 2007 .

[21]  Louisa Ha,et al.  Interactivity reexamined: A baseline analysis of early business web sites , 1998 .

[22]  Chris Anderson,et al.  The Long Tail: Why the Future of Business is Selling Less of More , 2006 .

[23]  Ethan J. Leib,et al.  Deliberative Democracy in America: A Proposal for a Popular Branch of Government , 2004 .

[24]  A. Appadurai Modernity at Large: Cultural Dimensions of Globalization , 1996 .

[25]  Jana Carp Wit, Style, and Substance , 2004 .

[26]  John Forester,et al.  Making Participation Work When Interests Conflict: Moving from Facilitating Dialogue and Moderating Debate to Mediating Negotiations , 2006 .

[27]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[28]  A. Bonaccorsi,et al.  Altruistic individuals, selfish firms? , 2004 .

[29]  Miriam Lips,et al.  Exploring Public Recordkeeping Behaviors in Wiki-Supported Public Consultation Activities in the New Zealand Public Sector , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[30]  S. Page Prologue to The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies , 2007 .

[31]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[32]  B. Noveck Wiki Government: How Technology Can Make Government Better, Democracy Stronger, and Citizens More Powerful , 2009 .

[33]  Seeta Peña Gangadharan,et al.  Epilogue: understanding diversity in the field of online deliberation , 2009 .

[34]  Hans Jochen Scholl,et al.  Applying Stakeholder Theory to e-Government - Benefits and Limits , 2001, I3E.

[35]  D. L. Swanson,et al.  The Uses and Misuses of Uses and Gratifications , 1977 .

[36]  Thomas J. Johnson,et al.  Research Methodology: Taming the Cyber Frontier , 1999 .

[37]  James Surowiecki The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[38]  K. Mattson,et al.  Deliberative Democracy in Practice: Challenges and Prospects for Civic Deliberation , 1999, Polity.

[39]  Lyn Carson,et al.  Adapting and combining deliberative designs : juries, polls, and forums , 2005 .

[40]  Andrea Bonaccorsi,et al.  Why Open Source Software Can Succeed , 2003 .

[41]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[42]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[43]  S. Brody,et al.  Mandating Citizen Participation in Plan Making: Six Strategic Planning Choices , 2003 .

[44]  J. Palfrey,et al.  The Accountable Net: Peer Production of Internet Governance , 2004 .

[45]  Katherine Crewe,et al.  The Quality of Participatory Design: The Effects of Citizen Input on the Design of the Boston Southwest Corridor , 2001 .

[46]  Jason Corburn,et al.  Bringing Local Knowledge into Environmental Decision Making , 2003 .

[47]  Tad Hogg,et al.  Effects of feedback and peer pressure on contributions to enterprise social media , 2009, GROUP.

[48]  Todd R. Davies,et al.  Online Deliberation: Design, Research, and Practice , 2008 .

[49]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[50]  Michael J. Bugeja Interpersonal Divide: The Search for Community in a Technological Age , 2005 .

[51]  Douglas C. Engelbart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[52]  Pierre Lévy,et al.  Collective Intelligence: Mankind's Emerging World in Cyberspace , 1997 .

[53]  Lucie Laurian,et al.  A Prerequisite for Participation , 2003 .

[54]  R. Fuller,et al.  Operating Manual for Spaceship Earth , 1969 .

[55]  Daren C. Brabham Crowdsourcing as a Model for Problem Solving , 2008 .

[56]  Su-Houn Liu WHY PEOPLE BLOG: AN EXPECTANCY THEORY ANALYSIS , 2007 .

[57]  J. Dewey Experience and Education , 1938 .

[58]  David Lancashire Code, Culture and Cash: The Fading Altruism of Open Source Development , 2001, First Monday.

[59]  Tiziana Terranova Network Culture: Politics for the Information Age , 2004 .

[60]  B. Noveck "Peer to Patent": Collective Intelligence, Open Review, and Patent Reform , 2006 .

[61]  Amanda A. Madden Teen Content Creators and Consumers , 2005 .

[62]  Simone Abram,et al.  Learning policy—the contextual curtain and conceptual barriers , 2004 .

[63]  A. Follesdal The Place of Self-Interest and the Role of Power in the Deliberative Democracy , 2010 .

[64]  Oded Nov,et al.  What motivates Wikipedians? , 2007, CACM.

[65]  J. Carey Communication as culture: Essays on media and society , 1989 .

[66]  D. Ryfe DOES DELIBERATIVE DEMOCRACY WORK , 2005 .

[67]  Brian Fitzgerald,et al.  Why Hackers Do What They Do: Understanding Motivation and Effort in Free/Open Source Software Projects , 2007 .

[68]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[69]  Alexander Hars,et al.  Working for Free? Motivations for Participating in Open-Source Projects , 2002, Int. J. Electron. Commer..

[70]  K. Hanna,et al.  The Paradox of Participation and the Hidden Role of Information: A Case Study , 2000 .

[71]  Markku Sotarauta,et al.  Network Management and Information Systems in Promotion of Urban Economic Development , 2016 .

[72]  Fang Wu,et al.  Crowdsourcing, attention and productivity , 2008, J. Inf. Sci..

[73]  F. Langerak,et al.  Non-Probability Sampling for WWW Surveys: A Comparison of Methods , 1998 .

[74]  Karim R. Lakhani,et al.  Perspectives on Free and Open Source Software , 2005 .

[75]  Isami Kinoshita,et al.  Bridging Community Differences through Informal Processes , 2007 .

[76]  N. Cross Designerly Ways of Knowing: Design Discipline Versus Design Science , 2001, Design Issues.

[77]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[78]  N. Cross Designerly ways of knowing , 2006 .

[79]  August E. Grant,et al.  Reconceptualizing the role of habit: A new model of television audience activity , 1997 .

[80]  A. Rubin Ritualized and Instrumental Television Viewing , 1984 .

[81]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[82]  Samuel Freeman,et al.  Deliberative Democracy: A Sympathetic Comment , 2000 .

[83]  Patrice Flichy,et al.  The internet imaginaire , 2007 .

[84]  J Elford,et al.  Reflecting on the experience of interviewing online: perspectives from the Internet and HIV study in London , 2004, AIDS care.

[85]  Andrea Bonaccorsi,et al.  Altruistic Individuals, Selfish Firms? The Structure of Motivation in Open Source Software , 2004, First Monday.

[86]  Eric S. Raymond,et al.  The Art of Unix Programming , 2003 .

[87]  Michelle M. Kazmer,et al.  QUALITATIVE INTERVIEWING IN INTERNET STUDIES: Playing with the media, playing with the method , 2008 .

[88]  A. Knops Debate: Agonism as Deliberation – On Mouffe's Theory of Democracy* , 2007 .

[89]  C. Mouffe The Democratic Paradox , 2000 .

[90]  Fang Wu,et al.  Feedback Loops of Attention in Peer Production , 2009, 2009 International Conference on Computational Science and Engineering.

[91]  Henry Jenkins Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[92]  D. Boyd Facebook's Privacy Trainwreck , 2008 .

[93]  M. Castells The rise of the network society , 1996 .

[94]  Fuat Gürsözlü Debate: Agonism and Deliberation— Recognizing the Difference* , 2009 .

[95]  Yochai Benkler,et al.  Coase's Penguin, or Linux and the Nature of the Firm , 2001, ArXiv.

[96]  Brian Fitzgerald,et al.  Understanding Free Software Developers: Findings from the FLOSS Study , 2007 .

[97]  J. Blumler The Role of Theory in Uses and Gratifications Studies , 1979 .

[98]  K. Rasmussen General Approaches to Data Quality and Internet-generated Data , 2008 .

[99]  R. Burby Making Plans that Matter: Citizen Involvement and Government Action , 2003 .

[100]  J. Creighton The Public Participation Handbook: Making Better Decisions Through Citizen Involvement , 2005 .

[101]  Michael Hibbard,et al.  Saving Land but Losing Ground , 2000 .

[102]  M. Hickson Applied communications research: A beginning point for social relevance , 1973 .

[103]  Yi Xu,et al.  Innovation Contests, Open Innovation, and Multiagent Problem Solving , 2008, Manag. Sci..

[104]  Nurit Alfasi,et al.  Is Public Participation Making Urban Planning More Democratic? The Israeli Experience , 2003 .

[105]  Thomas E. Ruggiero Uses and Gratifications Theory in the 21st Century , 2000 .

[106]  I. Illich Tools for Conviviality , 1973 .

[107]  Claudia Landwehr Discourse and Coordination: Modes of Interaction and their Roles in Political Decision‐Making* , 2010 .

[108]  A. Strauss,et al.  Basics of Qualitative Research , 1992 .

[109]  Yasminah Beebeejaun,et al.  The participation trap: The limitations of participation for ethnic and racial groups , 2006 .

[110]  Henrietta O'Connor,et al.  Cyber-Mothers: Online Synchronous Interviewing using Conferencing Software , 2001 .

[111]  Karim R. Lakhani,et al.  Why Hackers Do What They Do: Understanding Motivation and Effort in Free/Open Source Software Projects , 2003 .

[112]  L. Mumford Technics and Civilization , 1934, Nature.

[113]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[114]  R. Weitkunat,et al.  Social Science Computer Review Internet Surveys by Direct Mailing : an Innovative Way of Collecting Data Internet Surveys by Direct Mailing an Innovative Way of Collecting Data , 2022 .

[115]  S. Niemeyer,et al.  Disentangling Diversity in Deliberative Democracy: Competing Theories, their Blind Spots, and Complementarities , 2010 .

[116]  A. Strauss,et al.  Grounded Theory in Practice , 1997 .

[117]  Sarah E Yates Scaling the tower of babel fish: An analysis of the machine translation of legal information , 2006 .

[118]  D. McQuail Mass Communication Theory: An Introduction , 1983 .

[119]  Oded Nov,et al.  What drives content tagging: the case of photos on Flickr , 2008, CHI.

[120]  Theodore H. Nelson,et al.  Computer Lib/Dream Machines , 1974 .

[121]  J. Innes,et al.  Informality as a Planning Strategy , 2007 .

[122]  M. Lane Participation, Decentralization, and Civil Society , 2003 .

[123]  Fiona Stewart,et al.  Internet Communication and Qualitative Research: A Handbook for Researching Online , 2000 .

[124]  B. Noveck Designing Deliberative Democracy in Cyberspace: The Role of the Cyber-lawyer , 2003 .

[125]  Dennis F. Thompson Deliberative Democratic Theory and Empirical Political Science , 2008 .

[126]  Robert Rich,et al.  The shaping of collective values through deliberative democracy: An empirical study from New York's North Country , 1999 .

[127]  Robert D. Putnam,et al.  Bowling alone: the collapse and revival of American community , 2000, CSCW '00.

[128]  M. R. Levy,et al.  AUDIENCE ACTIVITY AND GRATIFICATIONS , 1984 .

[129]  C. Nino The Constitution of Deliberative Democracy , 1996 .

[130]  J. Bohman,et al.  Survey Article: The Coming of Age of Deliberative Democracy , 1998 .

[131]  Claire Hewson,et al.  Research design and tools for Internet research , 2008 .

[132]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[133]  Joseph Schmitz,et al.  The public electronic network (PEN) and the homeless in Santa Monica , 1995 .

[134]  Katherine B. Novak,et al.  Applied Communication Research , 2001 .

[135]  Faranak Miraftab,et al.  The Perils of Participatory Discourse: Housing Policy in Postapartheid South Africa , 2003 .

[136]  S. Chambers,et al.  DELIBERATIVE DEMOCRATIC THEORY , 2003 .

[137]  Kun Huang,et al.  Shared knowledge construction process in an open-source software development community: an investigation of the Gallery community , 2006 .

[138]  Susannah Fox,et al.  Generations online in 2009 , 2009 .

[139]  Rjg Raymond Opdenakker Advantages and disadvantages of four interview techniques in qualitative research , 2006 .

[140]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[141]  Karim R. Lakhani,et al.  Marginality and Problem-Solving Effectiveness in Broadcast Search , 2010, Organ. Sci..

[142]  Kevin B. Wright,et al.  Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services , 2006, J. Comput. Mediat. Commun..

[143]  L. Holt Rationality is still hard work: Some further notes on the disruptive effects of deliberation , 1999 .

[144]  E. Katz,et al.  On the use of the mass media for important things. , 1973 .

[145]  Hassan Masum,et al.  Given enough minds...: Bridging the ingenuity gap , 2006, First Monday.

[146]  Kirsty Williamson,et al.  Online Communities in Saudi Arabia: Evaluating the Impact on Culture Through Online Semi-Structured Interviews , 2004 .

[147]  Helge Fiskaa Past and future for public participation in Norwegian physical planning , 2005 .

[148]  Angela Hull,et al.  Modernizing Democracy: Constructing a Radical Reform of the Planning System? , 2000 .

[149]  Daren C. Brabham Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application , 2008, First Monday.