The challenge of designing scientific discovery games

Incorporating the individual and collective problem solving skills of non-experts into the scientific discovery process could potentially accelerate the advancement of science. This paper discusses the design process used for Foldit, a multiplayer online biochemistry game that presents players with computationally difficult protein folding problems in the form of puzzles, allowing ordinary players to gain expertise and help solve these problems. The principle challenge of designing such scientific discovery games is harnessing the enormous collective problem-solving potential of the game playing population, who have not been previously introduced to the specific problem, or, often, the entire scientific discipline. To address this challenge, we took an iterative approach to designing the game, incorporating feedback from players and biochemical experts alike. Feedback was gathered both before and after releasing the game, to create the rules, interactions, and visualizations in Foldit that maximize contributions from game players. We present several examples of how this approach guided the game's design, and allowed us to improve both the quality of the gameplay and the application of player problem-solving.

[1]  References , 1971 .

[2]  C. Anfinsen Principles that govern the folding of protein chains. , 1973, Science.

[3]  W. Delano The PyMOL Molecular Graphics System , 2002 .

[4]  W. Delano The PyMOL Molecular Graphics System (2002) , 2002 .

[5]  Adam Zemla,et al.  LGA: a method for finding 3D similarities in protein structures , 2003, Nucleic Acids Res..

[6]  D. Baker,et al.  Design of a Novel Globular Protein Fold with Atomic-Level Accuracy , 2003, Science.

[7]  Michael R. Shirts,et al.  Atomistic protein folding simulations on the submillisecond time scale using worldwide distributed computing. , 2003, Biopolymers.

[8]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[9]  David Baker,et al.  Protein Structure Prediction Using Rosetta , 2004, Numerical Computer Methods, Part D.

[10]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[11]  P. Bradley,et al.  Toward High-Resolution de Novo Structure Prediction for Small Proteins , 2005, Science.

[12]  Menno D. T. de Jong,et al.  Does think aloud work?: how do we know? , 2006, CHI Extended Abstracts.

[13]  Manuel Blum,et al.  Peekaboom: a game for locating objects in images , 2006, CHI.

[14]  Anna Tramontano,et al.  Critical assessment of methods of protein structure prediction—Round VII , 2007, Proteins.

[15]  Charles A. Cusack,et al.  Volunteer Computing Using Casual Games , 2007 .

[16]  P. Bradley,et al.  High-resolution structure prediction and the crystallographic phase problem , 2007, Nature.

[17]  Per Backlund,et al.  Sidh - a Game Based Firefighter Training Simulation , 2007, 2007 11th International Conference Information Visualization (IV '07).

[18]  Keri Schreiner,et al.  Digital Games Target Social Change , 2008, IEEE Computer Graphics and Applications.

[19]  B. Rost,et al.  Critical assessment of methods of protein structure prediction—Round VIII , 2009, Proteins.

[20]  Oliver F. Lange,et al.  Structure prediction for CASP8 with all‐atom refinement using Rosetta , 2009, Proteins.

[21]  B. Lai,et al.  Non-destructive search for interstellar dust using synchrotron microprobes , 2010 .

[22]  A. Tramontano,et al.  Critical assessment of methods of protein structure prediction (CASP)—round IX , 2011, Proteins.