Collaborative Problem Solving in an Open-Ended Scientific Discovery Game

Countless human pursuits depend upon collaborative problem solving, especially in complex, open-ended domains. As part of the growing technological support for such collaboration, an opportunity exists to design systems that actively guide and facilitate collaborative problem solving toward the most productive outcomes. A better understanding of the dynamics of open-ended collaboration on complex problems is needed to realize this opportunity. Motivated by this need for better understanding, we investigate the collaborative problem solving ecosystem of the scientific-discovery game Foldit. Our investigation is guided by two primary questions: how do the social aspects of Foldit impact an individual's behavior? and what factors have significant impact on group success? We find that collaboration and competition are associated with increased participation and that collaboration increases individual performance. We also find that measures of group skill, individual skill, and participation correlate with better group performance.

[1]  J. Tudge Peer influences on cognitive development: Piagetian and Vygotskian perspectives , 1989 .

[2]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[3]  Stephanie D. Teasley,et al.  The Construction of Shared Knowledge in Collaborative Problem Solving , 1995 .

[4]  M. Edelstein Citizen Science: A Study of People, Expertise and Sustainable Development , 1998 .

[5]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[6]  Brigid Barron Achieving Coordination in Collaborative Problem-Solving Groups , 2000 .

[7]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[8]  J. Hackman,et al.  Leading Teams: Setting the Stage for Great Performances , 2002 .

[9]  G. Stasser,et al.  Hidden Profiles: A Brief History , 2003 .

[10]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[11]  N. Rummel,et al.  Learning to Collaborate: An Instructional Approach to Promoting Collaborative Problem Solving in Computer-Mediated Settings , 2005 .

[12]  Benjamin F. Jones,et al.  Supporting Online Material Materials and Methods Figs. S1 to S3 References the Increasing Dominance of Teams in Production of Knowledge , 2022 .

[13]  John Riedl,et al.  SuggestBot: using intelligent task routing to help people find work in wikipedia , 2007, IUI '07.

[14]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[15]  Brian L. Sullivan,et al.  eBird: A citizen-based bird observation network in the biological sciences , 2009 .

[16]  C. Lintott,et al.  Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. , 2009, 0909.2925.

[17]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[18]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[19]  Eben M. Haber,et al.  Creek watch: pairing usefulness and usability for successful citizen science , 2011, CHI.

[20]  Gary M. Olson,et al.  The Climate CoLab: Large scale model-based collaborative planning , 2011, 2011 International Conference on Collaboration Technologies and Systems (CTS).

[21]  Aniket Kittur,et al.  CrowdForge: crowdsourcing complex work , 2011, UIST.

[22]  Kevin Crowston,et al.  From Conservation to Crowdsourcing: A Typology of Citizen Science , 2011, 2011 44th Hawaii International Conference on System Sciences.

[23]  Hao Lü,et al.  Analysis of social gameplay macros in the Foldit cookbook , 2011, FDG.

[24]  Z. Popovic,et al.  Crystal structure of a monomeric retroviral protease solved by protein folding game players , 2011, Nature Structural &Molecular Biology.

[25]  Aniket Kittur,et al.  The polymath project: lessons from a successful online collaboration in mathematics , 2011, CHI.

[26]  Sandra B. Fan,et al.  CoSolve: A system for engaging users in computer-supported collaborative problem solving , 2012, 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[27]  Scott R. Klemmer,et al.  Shepherding the crowd yields better work , 2012, CSCW.

[28]  Z. Popovic,et al.  Increased Diels-Alderase activity through backbone remodeling guided by Foldit players , 2012, Nature Biotechnology.

[29]  Jennifer Preece,et al.  Dynamic changes in motivation in collaborative citizen-science projects , 2012, CSCW.

[30]  Burr Settles,et al.  Let's get together: the formation and success of online creative collaborations , 2013, CHI.

[31]  Aniket Kittur,et al.  Collaborative problem solving: a study of MathOverflow , 2014, CSCW.

[32]  Sanna Malinen,et al.  Understanding user participation in online communities: A systematic literature review of empirical studies , 2015, Comput. Hum. Behav..

[33]  Steven Dow,et al.  Improving Crowd Innovation with Expert Facilitation , 2016, CSCW.

[34]  David Engel,et al.  What Makes a Strong Team?: Using Collective Intelligence to Predict Team Performance in League of Legends , 2017, CSCW.