A platform for crowdsourcing the creation of representative, accurate landcover maps

Accurate landcover maps are fundamental to understanding socio-economic and environmental patterns and processes, but existing datasets contain substantial errors. Crowdsourcing map creation may substantially improve accuracy, particularly for discrete cover types, but the quality and representativeness of crowdsourced data is hard to verify. We present an open-sourced platform, DIYlandcover, that serves representative samples of high resolution imagery to an online job market, where workers delineate individual landcover features of interest. Worker mapping skill is frequently assessed, providing estimates of overall map accuracy and a basis for performance-based payments. A trial of DIYlandcover showed that novice workers delineated South African cropland with 91% accuracy, exceeding the accuracy of current generation global landcover products, while capturing important geometric data. A scaling-up assessment suggests the possibility of developing an Africa-wide vector-based dataset of croplands for $2-3 million within 1.2-3.8 years. DIYlandcover can be readily adapted to map other discrete cover types. A crowdsourcing platform that uses human pattern recognition skill to create accurate, geometrically rich landcover maps.Primary features: representative sampling, worker-specific accuracy assessment, and connection to online job markets.A cropland mapping trial showed 91% accuracy, and potential to make an Africa-wide map for $2-3 million within 1.2-3.8 years.

[1]  N. Ramankutty,et al.  Farming the planet: 1. Geographic distribution of global agricultural lands in the year 2000 , 2008 .

[2]  Elisa Bertino,et al.  Quality Control in Crowdsourcing Systems: Issues and Directions , 2013, IEEE Internet Computing.

[3]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[4]  Lilly Irani,et al.  Amazon Mechanical Turk , 2018, Advances in Intelligent Systems and Computing.

[5]  Maria Cristina Rulli,et al.  Global land and water grabbing , 2013, Proceedings of the National Academy of Sciences.

[6]  Asli Ozdarici-Ok,et al.  Object-Based Classification of Multi-temporal Images for Agricultural Crop Mapping in Karacabey Plain, Turkey , 2014 .

[7]  Boualem Benatallah,et al.  Quality Control in Crowdsourcing , 2018, ACM Comput. Surv..

[8]  M. Hardy,et al.  Rainfed Farming Systems in South Africa , 2011 .

[9]  Konrad Schindler,et al.  Mapping of Agricultural Crops from Single High-Resolution Multispectral Images - Data-Driven Smoothing vs. Parcel-Based Smoothing , 2015, Remote. Sens..

[10]  Antonio Criminisi,et al.  Object Class Segmentation using Random Forests , 2008, BMVC.

[11]  C. Justice,et al.  High-Resolution Global Maps of 21st-Century Forest Cover Change , 2013, Science.

[12]  Colin W. Rundel,et al.  Interface to Geometry Engine - Open Source (GEOS) , 2015 .

[13]  David B. Lobell,et al.  The use of satellite data for crop yield gap analysis , 2013 .

[14]  F. Achard,et al.  Tropical forests were the primary sources of new agricultural land in the 1980s and 1990s , 2010, Proceedings of the National Academy of Sciences.

[15]  Navin Ramankutty,et al.  Mind the gap: how do climate and agricultural management explain the ‘yield gap’ of croplands around the world? , 2010 .

[16]  Steffen Fritz,et al.  Geo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover , 2009, Remote. Sens..

[17]  Brian L. Sullivan,et al.  eBird: A citizen-based bird observation network in the biological sciences , 2009 .

[18]  Michael Oppenheimer,et al.  Projected climate impacts to South African maize and wheat production in 2055: a comparison of empirical and mechanistic modeling approaches , 2013, Global change biology.

[19]  Pinki Mondal,et al.  Mapping cropping intensity of smallholder farms: A comparison of methods using multiple sensors , 2013 .

[20]  Steffen Fritz,et al.  Improved global cropland data as an essential ingredient for food security , 2015 .

[21]  Hannah Jacobson,et al.  A novel approach to mapping land conversion using Google Earth with an application to East Africa , 2015, Environ. Model. Softw..

[22]  Miriam J. Metzger,et al.  The credibility of volunteered geographic information , 2008 .

[23]  Andrea Castelletti,et al.  Putting humans in the loop: Social computing for Water Resources Management , 2012, Environ. Model. Softw..

[24]  Steffen Fritz,et al.  Identifying and quantifying uncertainty and spatial disagreement in the comparison of Global Land Cover for different applications , 2008 .

[25]  JacobsonAndrew,et al.  A novel approach to mapping land conversion using Google Earth with an application to East Africa , 2015 .

[26]  Guy Ziv,et al.  Using Changes in Agricultural Utility to Quantify Future Climate‐Induced Risk to Conservation , 2014, Conservation biology : the journal of the Society for Conservation Biology.

[27]  C. Lintott,et al.  Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey , 2008, 0804.4483.

[28]  G.A.K. Arroyo Ohori Validation and Automatic Repair of Planar Partitions using a Constrained Triangulation , 2012 .

[29]  Thomas J. Fuchs,et al.  A generalized computer vision approach to mapping crop fields in heterogeneous agricultural landscapes , 2016 .

[30]  Joachim Denzler,et al.  LAND COVER CLASSIFICATION OF SATELLITE IMAGES USING CONTEXTUAL INFORMATION , 2013 .

[31]  G. B. Williamson,et al.  The fate of Amazonian forest fragments: A 32-year investigation , 2011 .

[32]  Cj Birch,et al.  Rainfed Farming Systems , 2011 .

[33]  N. Ramankutty,et al.  Farming the planet: 2. Geographic distribution of crop areas, yields, physiological types, and net primary production in the year 2000 , 2008 .

[34]  Omri Allouche,et al.  Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS) , 2006 .

[35]  Rick Mueller,et al.  Mapping global cropland and field size , 2015, Global change biology.

[36]  BertinoElisa,et al.  Quality Control in Crowdsourcing Systems , 2013 .

[37]  John Langford,et al.  CAPTCHA: Using Hard AI Problems for Security , 2003, EUROCRYPT.

[38]  Grégoire Dubois,et al.  Monitoring land cover changes in African protected areas in the 21st century , 2013, Ecol. Informatics.

[39]  Lin Yan,et al.  Automated crop field extraction from multi-temporal Web Enabled Landsat Data , 2014 .

[40]  S. Fritz,et al.  Comparison of global and regional land cover maps with statistical information for the agricultural domain in Africa , 2010 .

[41]  Holly K. Gibbs,et al.  New IPCC Tier-1 Global Biomass Carbon Map for the Year 2000 , 2008 .

[42]  Piotr Tokarczyk,et al.  Features, Color Spaces, and Boosting: New Insights on Semantic Classification of Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[43]  D. Lettenmaier,et al.  A simple hydrologically based model of land surface water and energy fluxes for general circulation models , 1994 .

[44]  Jaap Schellekens,et al.  Rapid setup of hydrological and hydraulic models using OpenStreetMap and the SRTM derived digital elevation model , 2014, Environ. Model. Softw..

[45]  M. Oppenheimer,et al.  Comparing mechanistic and empirical model projections of crop suitability and productivity: implications for ecological forecasting , 2013 .

[46]  Steffen Fritz,et al.  Geo-Wiki: An online platform for improving global land cover , 2012, Environ. Model. Softw..

[47]  Steffen Fritz,et al.  Cropland for sub‐Saharan Africa: A synergistic approach using five land cover data sets , 2011 .

[48]  Philip K. Thornton,et al.  High carbon and biodiversity costs from converting Africa’s wet savannahs to cropland , 2015 .