Strategies Employed by Citizen Science Programs to Increase the Credibility of Their Data

The success of citizen science in producing important and unique data is attracting interest from scientists and resource managers. Nonetheless, questions remain about the credibility of citizen science data. Citizen science programs desire to meet the same standards of credibility as academic science, but they usually work within a different context, for example, training and managing significant numbers of volunteers with limited resources. We surveyed the credibility-building strategies of 30 citizen science programs that monitor environmental aspects of the California coast. We identified a total of twelve strategies: Three that are applied during training and planning; four that are applied during data collection; and five that are applied during data analysis and program evaluation. Variation in the application of these strategies by program is related to factors such as the number of participants, the focus on group or individual work, and the time commitment required of volunteers. The structure of each program and available resources require program designers to navigate tradeoffs in the choices of their credibility strategies. Our results illustrate those tradeoffs and provide a framework for the necessary discussions between citizen science programs and potential users of their data—including scientists and decision makers—about shared expectations for credibility and practical approaches for meeting those expectations. This article has been corrected here: http://dx.doi.org/10.5334/cstp.91

[1]  A. Lawrence.  The first cuckoo in winter: Phenology, recording, credibility and meaning in Britain , 2009 .

[2]  R. Brodeur,et al.  Recurrent jellyfish blooms are a consequence of global oscillations , 2012, Proceedings of the National Academy of Sciences.

[3]  Jun Yu,et al.  A Human/Computer Learning Network to Improve Biodiversity Conservation and Research , 2012, AI Mag..

[4]  S. Shapin.  Cordelia’s Love: Credibility and the Social Studies of Science , 1995, Perspectives on Science.

[5]  R. Bonney,et al.  Thinking scientifically during participation in a citizen‐science project , 2000 .

[6]  R. Jordan,et al.  Evaluating the Performance of Volunteers in Mapping Invasive Plants in Public Conservation Lands , 2012, Environmental Management.

[7]  António Câmara,et al.  Promoting the use of environmental data collected by concerned citizens through information and communication technologies. , 2004, Journal of environmental management.

[8]  Helen E. Roy,et al.  Understanding citizen science and environmental monitoring: final report on behalf of UK Environmental Observation Framework , 2012 .

[9]  Eric Biber,et al.  The Challenge of Collecting and Using Environmental Monitoring Data , 2013 .

[10]  David N. Bonter,et al.  Citizen Science as an Ecological Research Tool: Challenges and Benefits , 2010 .

[11]  Shankar Aswani,et al.  Incorporating Fishermen' s Local Knowledge and Behavior into geographical information Systems (giS) for Designing marine Protected areas in Oceania , 2006 .

[12]  Steve Kelling,et al.  Data-intensive science applied to broad-scale citizen science. , 2012, Trends in ecology & evolution.

[13]  Yi Yang,et al.  Citizen Science as an Approach for Overcoming Insufficient Monitoring and Inadequate Stakeholder Buy-in in Adaptive Management: Criteria and Evidence , 2015, Ecosystems.

[14]  S. Jasanoff.  States of Knowledge: The Co-production of Science and the Social Order , 2004 .

[15]  Ryan Meyer,et al.  Correction: Strategies Employed by Citizen Science Programs to Increase the Credibility of Their Data , 2016 .

[16]  Sandra Henderson,et al.  Citizen science comes of age , 2012 .

[17]  Ann C. Keller,et al.  Credibility and Relevance in Environmental Policy: Measuring Strategies and Performance among Science Assessment Organizations , 2010 .

[18]  D. Wilson,et al.  Social theory and fisheries co-management , 1998 .

[19]  Allison Woodruff,et al.  A vehicle for research: using street sweepers to explore the landscape of environmental community action , 2009, CHI.

[20]  Carly Strasser,et al.  Primer on Data Management: What you always wanted to know , 2012 .

[21]  Nolan J. Doesken,et al.  The Value of the Citizen Weather Observer , 2010 .

[22]  Jun Yu,et al.  eBird: A Human/Computer Learning Network for Biodiversity Conservation and Research , 2012, IAAI.

[23]  Chidi Oguamanam.  Localizing Intellectual Property in the Globalization Epoch: The Integration of Indigenous Knowledge , 2004 .

[24]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[25]  Teresa E. Thornton,et al.  Trust in Citizen Science Research: A Case Study of the Groundwater Education Through Water Evaluation & Testing Program 1 , 2012 .

[26]  F. Fischer.  Citizens, Experts, and the Environment: The Politics of Local Knowledge , 2000 .

[27]  Aaron T. Dale,et al.  Marine mammal co-management in Canada's Arctic: Knowledge co-production for learning and adaptive capacity , 2011 .

[28]  Tomas J. Bird,et al.  Statistical solutions for error and bias in global citizen science datasets , 2014 .

[29]  Thomas G. Dietterich,et al.  The eBird enterprise: An integrated approach to development and application of citizen science , 2014 .

[30]  R. W. Kimmerer.  Searching for synergy: integrating traditional and scientific ecological knowledge in environmental science education , 2012, Journal of Environmental Studies and Sciences.

[31]  Robert Still,et al.  What Is A Marine Mammal , 2014 .

[32]  M. Kelly,et al.  Citizen Science in the Age of Neogeography: Utilizing Volunteered Geographic Information for Environmental Monitoring , 2012 .

[33]  Helen E. Roy,et al.  Choosing and using citizen science: a guide to when and how to use citizen science to monitor biodiversity and the environment , 2014 .

[34]  S. Funtowicz,et al.  Science for the Post-Normal Age , 1993, Commonplace.

[35]  Melinda Laituri,et al.  The art and science of multi-scale citizen science support , 2011, Ecol. Informatics.

[36]  Sabrina McCormick,et al.  Democratizing Science Movements , 2007 .

[37]  J. Silvertown.  A new dawn for citizen science. , 2009, Trends in ecology & evolution.

[38]  Fikret Berkes,et al.  Evolution of co-management: role of knowledge generation, bridging organizations and social learning. , 2009, Journal of environmental management.

[39]  F. Danielsen,et al.  Increasing Conservation Management Action by Involving Local People in Natural Resource Monitoring , 2007, Ambio.

[40]  J. Caselle,et al.  Comparing volunteer and professionally collected monitoring data from the rocky subtidal reefs of Southern California, USA , 2012, Environmental Monitoring and Assessment.