Usability of VGI for validation of land cover maps

Volunteered Geographic Information (VGI) represents a growing source of potentially valuable data for many applications, including land cover map validation. It is still an emerging field and many different approaches can be used to take value from VGI, but also many pros and cons are related to its use. Therefore, since it is timely to get an overview of the subject, the aim of this article is to review the use of VGI as reference data for land cover map validation. The main platforms and types of VGI that are used and that are potentially useful are analysed. Since quality is a fundamental issue in map validation, the quality procedures used by the platforms that collect VGI to increase and control data quality are reviewed and a framework for addressing VGI quality assessment is proposed. A review of cases where VGI was used as an additional data source to assist in map validation is made, as well as cases where only VGI was used, indicating the procedures used to assess VGI quality and fitness for use. A discussion and some conclusions are drawn on best practices, future potential and the challenges of the use of VGI for land cover map validation.

[1]  Giles M. Foody,et al.  The impact of imperfect ground reference data on the accuracy of land cover change estimation , 2009 .

[2]  Martin Herold,et al.  A global land-cover validation data set, II: augmenting a stratified sampling design to estimate accuracy by region and land-cover class , 2012 .

[3]  Adam C. Winstanley,et al.  Towards quality metrics for OpenStreetMap , 2010, GIS '10.

[4]  Steffen Fritz,et al.  Cropland Capture: A gaming approach to improve global land cover , 2014 .

[5]  Grégoire Dubois,et al.  Open-source mapping and services for Web-based land-cover validation , 2013, Ecol. Informatics.

[6]  Miriam J. Metzger,et al.  The credibility of volunteered geographic information , 2008 .

[7]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[8]  Giles M. Foody,et al.  Ground reference data error and the mis-estimation of the area of land cover change as a function of its abundance , 2013 .

[9]  Steffen Fritz,et al.  Geo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover , 2009, Remote. Sens..

[10]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[11]  Antoine Collin,et al.  Spatial location and ecological content of support vectors in an SVM classification of tropical vegetation , 2013 .

[12]  M. Painho,et al.  Comparative study of Land Use/Cover classification using Flickr photos, satellite imagery and Corine Land Cover database , 2014 .

[13]  Martin Herold,et al.  Some challenges in global land cover mapping : An assessment of agreement and accuracy in existing 1 km datasets , 2008 .

[14]  M. Clark,et al.  Asymmetric forest transition driven by the interaction of socioeconomic development and environmental heterogeneity in Central America , 2012, Proceedings of the National Academy of Sciences.

[15]  Robert Jeansoulin,et al.  Fundamentals of Spatial Data Quality , 2006 .

[16]  S. de Bruin,et al.  Assessing global land cover reference datasets for different user communities , 2015 .

[17]  Peter Mooney,et al.  The Annotation Process in OpenStreetMap , 2012, Trans. GIS.

[18]  Christoph Perger,et al.  Using control data to determine the reliability of volunteered geographic information about land cover , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[19]  Michael F. Goodchild,et al.  Assuring the quality of volunteered geographic information , 2012 .

[20]  Steffen Fritz,et al.  Geo-Wiki: An online platform for improving global land cover , 2012, Environ. Model. Softw..

[21]  Alan M. MacEachren,et al.  Developing a conceptual framework for visually-enabled geocollaboration , 2004, Int. J. Geogr. Inf. Sci..

[22]  G. Meehl,et al.  The Importance of Land-Cover Change in Simulating Future Climates , 2005, Science.

[23]  R. Scholes,et al.  Ecosystems and human well-being: current state and trends , 2005 .

[24]  Jacinto Estima,et al.  Flickr Geotagged and Publicly Available Photos: Preliminary Study of Its Adequacy for Helping Quality Control of Corine Land Cover , 2013, ICCSA.

[25]  Steffen Fritz,et al.  Downgrading recent estimates of land available for biofuel production. , 2013, Environmental science & technology.

[26]  Steffen Fritz,et al.  Improved light and temperature responses for light-use-efficiency-based GPP models , 2013 .

[27]  Carl F. Salk,et al.  Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts , 2013, PloS one.

[28]  M. Goodchild,et al.  Prospects for VGI Research and the Emerging Fourth Paradigm , 2013 .

[29]  Yuanjie Li,et al.  A global map of rainfed cropland areas (GMRCA) at the end of last millennium using remote sensing , 2009, Int. J. Appl. Earth Obs. Geoinformation.

[30]  Christian Heipke,et al.  Crowdsourcing geospatial data , 2010 .

[31]  Sucharita Gopal,et al.  Fuzzy set theory and thematic maps: accuracy assessment and area estimation , 2000, Int. J. Geogr. Inf. Sci..

[32]  Damien Sulla-Menashe,et al.  MODIS Collection 5 global land cover: Algorithm refinements and characterization of new datasets , 2010 .

[33]  Stephen V. Stehman,et al.  Sampling designs for accuracy assessment of land cover , 2009 .

[34]  Matthew Lease,et al.  Semi-Supervised Consensus Labeling for Crowdsourcing , 2011 .

[35]  Damien Sulla-Menashe,et al.  A global land-cover validation data set, part I: fundamental design principles , 2012 .

[36]  M. Goodchild.  Citizens as sensors: the world of volunteered geography , 2007 .

[37]  M. Goodchild,et al.  Researching Volunteered Geographic Information: Spatial Data, Geographic Research, and New Social Practice , 2012 .

[38]  Jacinto Estima,et al.  Exploratory analysis of OpenStreetMap for land use classification , 2013, GEOCROWD '13.

[39]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[40]  Dennis Zielstra,et al.  Positional Accuracy of Flickr and Panoramio Images in Europe , 2012 .

[41]  G. Foody.  Assessing the accuracy of land cover change with imperfect ground reference data , 2010 .

[42]  Steffen Fritz,et al.  Mapping Cropland in Ethiopia Using Crowdsourcing , 2013 .

[43]  Brian M. Steele,et al.  Maximum posterior probability estimators of map accuracy , 2005 .

[44]  Y. Yamagata,et al.  Validating land cover maps with Degree Confluence Project information , 2006 .

[45]  Matthew L. Clark,et al.  Virtual Interpretation of Earth Web-Interface Tool (VIEW-IT) for Collecting Land-Use/Land-Cover Reference Data , 2011, Remote. Sens..

[46]  Francis Harvey,et al.  To Volunteer or to Contribute Locational Information? Towards Truth in Labeling for Crowdsourced Geographic Information , 2013 .

[47]  M. Haklay.  Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation , 2013 .

[48]  E. Munson.  Ecosystems and Human Well-being : Current State and Trends Main Messages , 2006 .

[49]  Vyron Antoniou,et al.  User generated spatial content: an analysis of the phenomenon and its challenges for mapping agencies , 2011 .

[50]  Yongping Yuan,et al.  Assessing impacts of Landuse and Landcover changes on hydrology for the upper San Pedro watershed , 2011 .

[51]  Kathleen Neumann,et al.  Challenges in using land use and land cover data for global change studies , 2011 .

[52]  S. Guptill,et al.  Elements of Spatial Data Quality , 1995 .

[53]  Vyron Antoniou,et al.  How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus’ Law to Volunteered Geographic Information , 2010 .

[54]  S. Carpenter,et al.  Global Consequences of Land Use , 2005, Science.

[55]  R. Sieber.  Public Participation Geographic Information Systems: A Literature Review and Framework , 2006 .

[56]  Panagiotis G. Ipeirotis,et al.  Repeated labeling using multiple noisy labelers , 2012, Data Mining and Knowledge Discovery.

[57]  Steffen Fritz,et al.  Assessing the Accuracy of Volunteered Geographic Information arising from Multiple Contributors to an Internet Based Collaborative Project , 2013, Trans. GIS.

[58]  Cyrus Shahabi.  Crowdsourcing What Is Where: Community-Contributed Photos as Volunteered Geographic Information , 2010, IEEE Multim..

[59]  Pascal Neis,et al.  The Street Network Evolution of Crowdsourced Maps: OpenStreetMap in Germany 2007-2011 , 2011, Future Internet.

[60]  Alexander Zipf,et al.  Toward mapping land-use patterns from volunteered geographic information , 2013, Int. J. Geogr. Inf. Sci..

[61]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[62]  Jan de Leeuw,et al.  An Assessment of the Accuracy of Volunteered Road Map Production in Western Kenya , 2011, Remote. Sens..

[63]  Giles M. Foody,et al.  Using volunteered data in land cover map validation: Mapping tropical forests across West Africa , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[64]  Frédéric Achard,et al.  Global forest land-use change 1990–2005 , 2012 .

[65]  G. Foody.  Impacts of imperfect reference data on the apparent accuracy of species presence–absence models and their predictions , 2011 .

[66]  Kenlo Nishida Nasahara,et al.  Creation of New Global Land Cover Map with Map Integration , 2011, J. Geogr. Inf. Syst..

[67]  M. Clark,et al.  Deforestation and Reforestation of Latin America and the Caribbean (2001–2010) , 2013 .

[68]  Stephen C. Guptill.  CHAPTER EIGHT – Temporal information , 1995 .

[69]  Steffen Fritz,et al.  A campaign to collect volunteered geographic information and land cover and human impact , 2012 .

[70]  Alan H. Strahler,et al.  Validation of the global land cover 2000 map , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Elisa Bertino,et al.  Quality Control in Crowdsourcing Systems: Issues and Directions , 2013, IEEE Internet Computing.

[72]  Giles M. Foody,et al.  Using Volunteered Data in Land Cover Map Validation: Mapping West African Forests , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.