Citizen Social Lab: A digital platform for human behavior experimentation within a citizen science framework

Cooperation is one of the behavioral traits that define human beings, however we are still trying to understand why humans cooperate. Behavioral experiments have been largely conducted to shed light into the mechanisms behind cooperation—and other behavioral traits. However, most of these experiments have been conducted in laboratories with highly controlled experimental protocols but with limitations in terms of subject pool or decisions’ context, which limits the reproducibility and the generalization of the results obtained. In an attempt to overcome these limitations, some experimental approaches have moved human behavior experimentation from laboratories to public spaces, where behaviors occur naturally, and have opened the participation to the general public within the citizen science framework. Given the open nature of these environments, it is critical to establish the appropriate data collection protocols to maintain the same data quality that one can obtain in the laboratories. In this article we introduce Citizen Social Lab, a software platform designed to be used in the wild using citizen science practices. The platform allows researchers to collect data in a more realistic context while maintaining the scientific rigor, and it is structured in a modular and scalable way so it can also be easily adapted for online or brick-and-mortar experimental laboratories. Following citizen science guidelines, the platform is designed to motivate a more general population into participation, but also to promote engaging and learning of the scientific research process. We also review the main results of the experiments performed using the platform up to now, and the set of games that each experiment includes. Finally, we evaluate some properties of the platform, such as the heterogeneity of the samples of the experiments, the satisfaction level of participants, or the technical parameters that demonstrate the robustness of the platform and the quality of the data collected.

[1]  S. Hooper,et al.  Single Sustained Inflation followed by Ventilation Leads to Rapid Cardiorespiratory Recovery but Causes Cerebral Vascular Leakage in Asphyxiated Near-Term Lambs , 2016, PloS one.

[2]  J. Duch,et al.  Quantitative account of social interactions in a mental health care ecosystem: cooperation, trust and collective action , 2018, Scientific Reports.

[3]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[4]  J. Horowitz,et al.  Fairness in Simple Bargaining Experiments , 1994 .

[5]  P. Kollock SOCIAL DILEMMAS: The Anatomy of Cooperation , 1998 .

[6]  Jochem Marotzke,et al.  The collective-risk social dilemma and the prevention of simulated dangerous climate change , 2008, Proceedings of the National Academy of Sciences.

[7]  Mario Gutiérrez-Roig,et al.  Citizen Science Practices for Computational Social Science Research: The Conceptualization of Pop-Up Experiments , 2015, Front. Phys..

[8]  Yamir Moreno,et al.  Humans display a reduced set of consistent behavioral phenotypes in dyadic games , 2016, Science Advances.

[9]  Lada A. Adamic,et al.  Computational Social Science , 2009, Science.

[10]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[11]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[12]  Joyce E. Berg,et al.  Trust, Reciprocity, and Social History , 1995 .

[13]  John P. A. Ioannidis,et al.  A manifesto for reproducible science , 2017, Nature Human Behaviour.

[14]  J. Carpenter,et al.  Altruistic behavior in a representative dictator experiment , 2008 .

[15]  Steven D. Levitt,et al.  Viewpoint: On the Generalizability of Lab Behaviour to the Field , 2007 .

[16]  Pablo Brañas-Garza,et al.  Strategic risk and response time across games , 2017, Int. J. Game Theory.

[17]  A. Licht Games Commissions Play: 2x2 Games of International Securities Regulation , 1997 .

[18]  A. Rapoport,et al.  The Game of Chicken , 1966 .

[19]  Pablo Brañas-Garza,et al.  Experimental subjects are not different , 2013, Scientific Reports.

[20]  Cheree James,et al.  Autonomic markers of emotional processing: skin sympathetic nerve activity in humans during exposure to emotionally charged images , 2012, Front. Physio..

[21]  Cameron Marlow,et al.  A 61-million-person experiment in social influence and political mobilization , 2012, Nature.

[22]  J. Silvertown A new dawn for citizen science. , 2009, Trends in ecology & evolution.

[23]  Elizabeth Gilbert,et al.  Reproducibility Project: Results (Part of symposium called "The Reproducibility Project: Estimating the Reproducibility of Psychological Science") , 2014 .

[24]  J. Gómez-Gardeñes,et al.  Resource heterogeneity leads to unjust effort distribution in climate change mitigation , 2017, PloS one.

[25]  Claudio Cioffi-Revilla,et al.  Computational social science , 2010 .

[26]  Christopher Kullenberg,et al.  What Is Citizen Science? – A Scientometric Meta-Analysis , 2016, PloS one.

[27]  David A. Schroeder,et al.  Social Dilemmas: Perspectives on Individuals and Groups , 1995 .

[28]  R. Bonney,et al.  Next Steps for Citizen Science , 2014, Science.

[29]  John A. List,et al.  Journal of Economic Behavior & Organization , 1999 .

[30]  Robert van Rooij,et al.  The Stag Hunt and the Evolution of Social Structure , 2007, Stud Logica.

[31]  Luis F. Ciria,et al.  Organizations should know their people: a behavioral economics approach , 2017 .

[32]  Armin Falk,et al.  Do Lab Experiments Misrepresent Social Preferences? The Case of Self-Selected Student Samples , 2013 .

[33]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[34]  R. Bonney,et al.  Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy , 2009 .

[35]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[36]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[37]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[38]  David G. Rand,et al.  The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments. , 2012, Journal of theoretical biology.

[39]  E. Fehr,et al.  The Hidden Costs and Returns of Incentives - Trust and Trustworthiness Among CEOS , 2004 .

[40]  Jody W. Enck,et al.  Can citizen science enhance public understanding of science? , 2016, Public understanding of science.

[41]  John A. List,et al.  Homo economicus Evolves , 2008, Science.

[42]  Jennifer Preece,et al.  Using gamification to inspire new citizen science volunteers , 2013, Gamification.

[43]  Alessandro Tavoni,et al.  Inequality, communication, and the avoidance of disastrous climate change in a public goods game , 2011, Proceedings of the National Academy of Sciences.

[44]  J. Perelló,et al.  Participatory design of citizen science experiments , 2018 .

[45]  Steven D. Levitt,et al.  What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World , 2007 .

[46]  E. Hand,et al.  Citizen science: People power , 2010, Nature.

[47]  David Lazer,et al.  Volunteer Science , 2016 .

[48]  J. Duch,et al.  Market Imitation and Win-Stay Lose-Shift Strategies Emerge as Unintended Patterns in Market Direction Guesses , 2016, PloS one.

[49]  Adam Mann,et al.  Core Concept: Computational social science , 2016, Proceedings of the National Academy of Sciences.

[50]  R. Sugden The Economics of Rights, Co-Operation, and Welfare , 1986 .

[51]  Ernst Fehr,et al.  Third Party Punishment and Social Norms , 2004 .

[52]  Daniel L. Chen,et al.  oTree - An Open-Source Platform for Laboratory, Online, and Field Experiments , 2016 .

[53]  Xiao-Bing Gao,et al.  CORRIGENDUM: Fetal Radiofrequency Radiation Exposure From 800-1900 Mhz-Rated Cellular Telephones Affects Neurodevelopment and Behavior in Mice , 2013, Scientific Reports.

[54]  Phillip Li,et al.  Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say 'Usually Not' , 2015 .

[55]  Angel Sánchez,et al.  Physics of human cooperation: experimental evidence and theoretical models , 2018 .

[56]  Hee-Sun Lee,et al.  Changes in participants' scientific attitudes and epistemological beliefs during an astronomical citizen science project , 2013 .

[57]  Nicholas A. Christakis,et al.  Locally noisy autonomous agents improve global human coordination in network experiments , 2017, Nature.

[58]  J. Nadal,et al.  Manifesto of computational social science , 2012 .

[59]  R. Dunlap,et al.  Why researchers should resolve to engage in 2017 , 2017, Nature.

[60]  N. Oliver,et al.  People power , 2014, Nature.

[61]  Trisha Gura,et al.  Citizen science: Amateur experts , 2013, Nature.

[62]  J. Perelló,et al.  High Motivation and Relevant Scientific Competencies Through the Introduction of Citizen Science at Secondary Schools : An assessment using a rubric model , 2017 .

[63]  Announcement: Transparency upgrade for Nature journals , 2017, Nature.

[64]  Thomas Hillman,et al.  Getting it Right or Being Top Rank: Games in Citizen Science , 2018 .