How Features of a Civic Design Competition Influences the Collective Understanding of a Problem

From Fortune 500 companies to local communities, organizations often strive to build a shared understanding about complex problems. Design competitions provide a compelling approach to create incentives and infrastructure for gathering insights about a problem-space. In this paper, we present an analysis of a two-month civic design competition focused on transportation challenges in a major US city. We examine how the event structure, discussion platform, and participant interactions affected how a community collectively discussed design constraints and proposals. Ninety-two participants took part in the competition's online discussion, hosted on Slack. Applying a mixed-methods analysis, we found that participants shared less as they settled into teams and, due to the discussion system, had difficulty seeing how topics connected across channels; we also learned that certain messages led participants to add depth to existing topics. Based on the findings we provide recommendations for civic competitions aimed at building knowledge around a problem.

[1]  Fiorella De Cindio,et al.  A Two-room E-Deliberation Environment , 2008 .

[2]  Alan Borning,et al.  Integrating on-demand fact-checking with public dialogue , 2014, CSCW.

[3]  Simon Buckingham Shum,et al.  Socially augmented argumentation tools: Rationale, design and evaluation of a debate dashboard , 2014, Int. J. Hum. Comput. Stud..

[4]  Ade Mabogunje,et al.  Developing a visual representation to characterize moment-to-moment concept generation in design teams , 2013 .

[5]  Michael S. Bernstein,et al.  Crowds in two seconds: enabling realtime crowd-powered interfaces , 2011, UIST.

[6]  John Gastil,et al.  A Conceptual Definition and Theoretical Model of Public Deliberation in Small Face—to—Face Groups , 2002 .

[7]  Rousiley Celi Moreira Maia,et al.  Respect and Disrespect in Deliberation Across the Networked Media Environment: Examining Multiple Paths of Political Talk , 2016, J. Comput. Mediat. Commun..

[8]  Jennifer Stromer-Galley,et al.  Coherence in political computer-mediated communication: analyzing topic relevance and drift in chat , 2009 .

[9]  P. Resnick,et al.  Building Successful Online Communities: Evidence-Based Social Design , 2012 .

[10]  David R. Karger,et al.  Wikum: Bridging Discussion Forums and Wikis Using Recursive Summarization , 2017, CSCW.

[11]  Todd R. Davies,et al.  Online Deliberation: Design, Research, and Practice , 2008 .

[12]  Dan Cosley,et al.  Effects of Comment Curation and Opposition on Coherence in Online Policy Discussion , 2018, GROUP.

[13]  Jennifer Stromer-Galley,et al.  Context and Medium Matter: Expressing Disagreements Online and Face-to-Face in Political Deliberations , 2015 .

[14]  Wei Wu,et al.  CrowdCrit: crowdsourcing and aggregating visual design critique , 2014, CSCW Companion.

[15]  Simon Buckingham Shum,et al.  Cohere: Towards Web 2.0 Argumentation , 2008, COMMA.

[16]  Aspa Gospodini,et al.  European Cities in Competition and the New ' Uses ' of Urban Design , 2002 .

[17]  Wei Wu,et al.  Structuring, Aggregating, and Evaluating Crowdsourced Design Critique , 2015, CSCW.

[18]  C. DiSalvo,et al.  Design and the Construction of Publics , 2009, Design Issues.

[19]  Alan Borning,et al.  Is this what you meant?: promoting listening on the web with reflect , 2012, CHI.

[20]  C. Pollard,et al.  Center for the Study of Language and Information , 2022 .

[21]  W. Keith Edwards,et al.  Designs on dignity: perceptions of technology among the homeless , 2008, CHI.

[22]  ROBERT CAVALIER WITH MISO KIM AND ZACHARY SAM ZAISS.  4 Deliberative Democracy , Online Discussion , and Project PICOLA ( Public Informed Citizen Online Assembly ) , 2009 .

[23]  Deen Freelon,et al.  Discourse architecture, ideology, and democratic norms in online political discussion , 2015, New Media Soc..

[24]  Robert E. Kraut,et al.  Mind your Ps and Qs: the impact of politeness and rudeness in online communities , 2008, CSCW.

[25]  S. Coleman,et al.  Bowling Together: Online Public Engagement in Policy Deliberation , 2001 .

[26]  S. Easterbrook,et al.  A Survey of Empirical Studies of Conflict , 1993 .

[27]  Elizabeth Gerber,et al.  Improvisation principles and techniques for design , 2007, CHI.

[28]  Mary J. Newhart,et al.  Scholarship@Cornell Law: A Digital Repository , 2013 .

[29]  Richard G. Weaver,et al.  Managers as Facilitators: A Practical Guide to Getting Work Done in a Changing Workplace , 1997 .

[30]  Gilly Leshed,et al.  The Magic Sauce: Practices of Facilitation in Online Policy Deliberation , 2016, Regular Issue.

[31]  Yan Qu,et al.  Online Community Response to Major Disaster: A Study of Tianya Forum in the 2008 Sichuan Earthquake , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[32]  K. Weick.  FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[33]  M. Klein.  How to Harvest Collective Wisdom on Complex Problems: An Introduction to the MIT Deliberatorium , 2012 .

[34]  Robert E. Kraut,et al.  Predicting Continued Participation in Newsgroups , 2006, J. Comput. Mediat. Commun..

[35]  Laura W. Black.  Blog, Chat, Edit, Text, or Tweet? Using Online Tools to Advance Adult Civic Engagement , 2012 .

[36]  B. Shneiderman,et al.  The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation , 2009 .

[37]  Martin Wattenberg,et al.  Flash forums and forumReader: navigating a new kind of large-scale online discussion , 2004, CSCW.

[38]  Christopher F. Karpowitz,et al.  Deliberative Democracy and Inequality: Two Cheers for Enclave Deliberation among the Disempowered , 2009 .

[39]  G. Michael Weiksner,et al.  Democracy in motion : evaluating the practice and impact of deliberative civic engagement , 2012 .

[40]  Eric S. Fredin.  The Web of Politics: The Internet's Impact on the American Political System , 1999 .

[41]  Lena Mamykina,et al.  Collective Sensemaking in Online Health Forums , 2015, CHI.

[42]  Kevin Crowston,et al.  What is coordination theory and how can it help design cooperative work systems? , 1990, CSCW '90.

[43]  Robert E. Kraut,et al.  Socialization tactics in wikipedia and their effects , 2010, CSCW '10.

[44]  Lydia B. Chilton,et al.  Cobi: communitysourcing large-scale conference scheduling , 2013, CHI Extended Abstracts.

[45]  Desirée Blankenburg Holm,et al.  Exploration and Exploitation , 2015 .

[46]  Scott Wright,et al.  Democracy, deliberation and design: the case of online discussion forums , 2007, New Media Soc..

[47]  Stephen A. Rains,et al.  Online and Uncivil? Patterns and Determinants of Incivility in Newspaper Website Comments , 2014 .

[48]  Dan Cosley,et al.  Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk , 2016, CHI.

[49]  Justin Cheng,et al.  Peer and self assessment in massive online classes , 2013, ACM Trans. Comput. Hum. Interact..

[50]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[51]  Laura A. Dabbish,et al.  Social transparency in networked information exchange: a theoretical framework , 2012, CSCW.

[52]  L. Sanders,et al.  Against Deliberation , 1997 .

[53]  Jennifer Gibbs,et al.  Social media as a catalyst for online deliberation? Exploring the affordances of Facebook and YouTube for political expression , 2013, Comput. Hum. Behav..

[54]  John Naughton,et al.  Anonymity and Online Commenting: The Broken Windows Effect and the End of Drive-by Commenting , 2015, WebSci.

[55]  J. Parkinson,et al.  Holistic Democracy and Physical Public Space , 2009 .

[56]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[57]  Carolyn Penstein Rosé,et al.  Talk to me: foundations for successful individual-group interactions in online communities , 2006, CHI.

[58]  Jane Mansbridge,et al.  Norms of Deliberation: An Inductive Study , 2006, Regular Issue.

[59]  Michael L. Begeman,et al.  gIBIS: a hypertext tool for exploratory policy discussion , 1988, CSCW '88.

[60]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[61]  James D. Herbsleb,et al.  Design Considerations for Online Deliberation Systems , 2012 .

[62]  S. Utz,et al.  Crisis communication online: How medium, crisis type and emotions affected public reactions in the Fukushima Daiichi nuclear disaster , 2013 .

[63]  A. Dobell,et al.  The human touch. , 1982, The Annals of thoracic surgery.

[64]  Yong Lu,et al.  Information exchange in virtual communities under extreme disaster conditions , 2011, Decis. Support Syst..

[65]  Ann Light,et al.  The unit of analysis in understanding the politics of participatory practice , 2010, PDC '10.

[66]  Jocelyn M. DeGroot,et al.  Self-Governance Through Group Discussion in Wikipedia , 2011 .

[67]  Fulong Wu,et al.  Re-orientation of the city plan: Strategic planning and design competition in China , 2007 .

[68]  H. M. Robert.  Robert's Rules Of Order Newly Revised , 2020 .

[69]  Jennifer Stromer-Galley.  Measuring Deliberation’s Content: A Coding Scheme , 2007, Regular Issue.

[70]  Karim R. Lakhani,et al.  TopCoder (A): Developing Software through Crowdsourcing , 2010 .

[71]  Daniel A. Levinthal,et al.  Exploration and Exploitation in Organizational Learning , 2007 .

[72]  Kurt Matzler,et al.  Communitition: The Tension between Competition and Collaboration in Community-Based Design Contests , 2011 .

[73]  Alan Borning,et al.  Supporting reflective public thought with considerit , 2012, CSCW.

[74]  Kuntz Werner,et al.  Issues as Elements of Information Systems , 1970 .

[75]  Cameron Marlow,et al.  Feed me: motivating newcomer contribution in social network sites , 2009, CHI.

[76]  O. Bjelland,et al.  An Inside View of IBM's 'Innovation Jam' , 2008 .

[77]  Ann Light,et al.  The human touch: participatory practice and the role of facilitation in designing with communities , 2012, PDC '12.