PITFALLS AND POTENTIALS OF CROWD SCIENCE: A META-ANALYSIS OF CONTEXTUAL INFLUENCES

Abstract. Crowd science is becoming an integral part of research in many disciplines. The research discussed in this paper lies at the intersection of spatial and behavioral sciences, two of the greatest beneficiaries of crowd science. As a young methodological development, crowd science needs attention from the perspective of a rigorous evaluation of the data collected to explore potentials as well as limitations (pitfalls). Our research has addressed a variety of contextual effects on the validity of crowdsourced data such as cultural, linguistic, regional, as well as methodological differences that we will discuss here in light of semantics.

[1]  Charles Anderson,et al.  The end of theory: The data deluge makes the scientific method obsolete , 2008 .

[2]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[3]  Z. Popovic,et al.  Crystal structure of a monomeric retroviral protease solved by protein folding game players , 2011, Nature Structural &Molecular Biology.

[4]  Judith Gelernter,et al.  An algorithm for local geoparsing of microtext , 2013, GeoInformatica.

[5]  D. Clery.  Galaxy evolution. Galaxy zoo volunteers share pain and glory of research. , 2011, Science.

[6]  Jeremy Witmer,et al.  A Comparison of Approaches for Geospatial Entity Extraction from Wikipedia , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[7]  Steffen Fritz,et al.  Geo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover , 2009, Remote. Sens..

[8]  Steffen Fritz,et al.  Comparing Expert and Non-expert Conceptualisations of the Land: An Analysis of Crowdsourced Land Cover Data , 2013, COSIT.

[9]  Xiao Zhang,et al.  GeoCAM: A geovisual analytics workspace to contextualize and interpret statements about movement , 2011, J. Spatial Inf. Sci..

[10]  Giles M. Foody,et al.  Using Volunteered Data in Land Cover Map Validation: Mapping West African Forests , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Steffen Fritz,et al.  A campaign to collect volunteered geographic information and land cover and human impact , 2012 .

[12]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[13]  Arno Scharl,et al.  The Geospatial Web: How Geobrowsers, Social Software and the Web 2.0 are Shaping the Network Society , 2007, The Geospatial Web.

[14]  Steffen Fritz,et al.  Assessing quality of volunteer crowdsourcing contributions: lessons from the Cropland Capture game , 2016, Int. J. Digit. Earth.

[15]  Stephen C. Levinson,et al.  Rethinking Linguistic Relativity , 1991, Current Anthropology.

[16]  L. Boroditsky.  Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[17]  L. Barsalou,et al.  Ad hoc categories , 1983, Memory & cognition.

[18]  Linlin Ge,et al.  A Supervised Machine Learning Approach to Toponym Disambiguation , 2007, The Geospatial Web.

[19]  M. Goodchild.  Citizens as sensors: the world of volunteered geography , 2007 .

[20]  M. Bertolotto,et al.  Conceptualizing Landscapes : A Comparative Study of Landscape Categories with Navajo and English-speaking Participants , 2015 .

[21]  M. Foucault,et al.  The Order of Things , 2017 .

[22]  Alexander Klippel,et al.  Exploring Regional Variation in Spatial Language Using Spatially Stratified Web-Sampled Route Direction Documents , 2014, Spatial Cogn. Comput..

[23]  Michael F. Goodchild,et al.  Please Scroll down for Article International Journal of Digital Earth Crowdsourcing Geographic Information for Disaster Response: a Research Frontier Crowdsourcing Geographic Information for Disaster Response: a Research Frontier , 2022 .

[24]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[25]  David M. Mark,et al.  Conceptualizing Landscap - A Comparative Study of Landscape Categories with Navajo and English-Speaking Participants , 2015, COSIT.

[26]  J. A. Glennona.  Crowdsourcing geographic information for disaster response: a research , 2010 .

[27]  David M. Mark,et al.  Fundamental Cognitive Concepts of Space (and Time): Using Cross-Linguistic, Crowdsourced Data to Cognitively Calibrate Modes of Overlap , 2013, COSIT.

[28]  A. Papafragou,et al.  Event categorisation and language: A cross-linguistic study of motion , 2010 .

[29]  Peter Gärdenfors,et al.  Conceptual spaces - the geometry of thought , 2000 .

[30]  David M. Mark,et al.  Citizen Science Land Cover Classification Based on Ground and Aerial Imagery , 2015, COSIT.

[31]  W. Wooster,et al.  Crystal structure of , 2005 .

[32]  C Psenicka,et al.  Measuring Cluster Similarity across Methods , 2000, Psychological reports.

[33]  S. Levinson,et al.  Rethinking Linguistic Relativity , 1991, Current Anthropology.

[34]  Carl F. Salk,et al.  Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts , 2013, PloS one.

[35]  Kevin A. Sparks,et al.  Crowdsourcing Landscape Perceptions to Validate Land Cover Classifications , 2018, Land Use and Land Cover Semantics.

[36]  Todd M. Gureckis,et al.  CUNY Academic , 2016 .