Quality Evaluation of Volunteered Geographic Information: The Case of OpenStreetMap

A large amount of crowd-sourced geospatial data have been created in recent years due to the interactivity of Web 2.0 and the availability of Global Positioning System (GPS). This geo-information is typically referred to as volunteered geographic information (VGI). OpenStreetMap (OSM) is a popular VGI platform that allows users to create or edit maps using GPS-enabled devices or aerial imageries. The issue of quality of geo-information generated by OSM has become a trending research topic because of the large size of the dataset and the inapplicability of Linus’ Law in a geospatial context. This chapter systematically reviews the quality evaluation process of OSM, and demonstrates a case study of London, Canada for the assessment of completeness, positional accuracy and attribute accuracy. The findings of the quality evaluation can potentially serve as a guide of cartographic product selection and provide a better understanding of the development of OSM quality over geographic space and time.

[1]  Alexander Zipf,et al.  Quality Evaluation of VGI Using Authoritative Data - A Comparison with Land Use Data in Southern Germany , 2015, ISPRS Int. J. Geo Inf..

[2]  Eric Vaz,et al.  An assessment of a collaborative mapping approach for exploring land use patterns for several European metropolises , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[3]  B. Jiang.  Volunteered Geographic Information and Computational Geography: New Perspectives , 2012, 1212.0941.

[4]  Ning Jing,et al.  Amateur or Professional: Assessing the Expertise of Major Contributors in OpenStreetMap Based on Contributing Behaviors , 2016, ISPRS Int. J. Geo Inf..

[5]  Carsten Keßler,et al.  Trust as a Proxy Measure for the Quality of Volunteered Geographic Information in the Case of OpenStreetMap , 2013, AGILE Conf..

[6]  Jamal Jokar Arsanjani,et al.  The emergence and evolution of OpenStreetMap: a cellular automata approach , 2015, Int. J. Digit. Earth.

[7]  Mahmoud Reza Delavar,et al.  A Quality Study of the OpenStreetMap Dataset for Tehran , 2014, ISPRS Int. J. Geo Inf..

[8]  Alexander Zipf,et al.  Quality Assessment of the Contributed Land Use Information from OpenStreetMap Versus Authoritative Datasets , 2015, OpenStreetMap in GIScience.

[9]  Anthony Stefanidis,et al.  Assessing Completeness and Spatial Error of Features in Volunteered Geographic Information , 2013, ISPRS Int. J. Geo Inf..

[10]  Peter Mooney,et al.  Characteristics of Heavily Edited Objects in OpenStreetMap , 2012, Future Internet.

[11]  W. Tobler.  A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[12]  Adam C. Winstanley,et al.  Quality assessment of OpenStreetMap data using trajectory mining , 2016, Geo spatial Inf. Sci..

[14]  A. Friedman,et al.  Bidimensional regression: assessing the configural similarity and accuracy of cognitive maps and other two-dimensional data sets. , 2003, Psychological methods.

[15]  P.A.J. van Oort,et al.  Spatial data quality: from description to application , 2006 .

[16]  Pascal Neis,et al.  Assessing the Completeness of Bicycle Trail and Designated Lane Features in OpenStreetMap for the United States and Europe , 2013 .

[17]  Peter Mooney,et al.  Analysis of Interaction and Co‐editing Patterns amongst OpenStreetMap Contributors , 2014, Trans. GIS.

[18]  M. Goodchild.  Citizens as sensors: the world of volunteered geography , 2007 .

[19]  Angi Voß,et al.  A Comparison of the Street Networks of Navteq and OSM in Germany , 2011, AGILE Conf..

[20]  Pascal Neis,et al.  The Street Network Evolution of Crowdsourced Maps: OpenStreetMap in Germany 2007-2011 , 2011, Future Internet.

[21]  Claire Ellul,et al.  Assessing Data Completeness of VGI through an Automated Matching Procedure for Linear Data , 2012, Trans. GIS.

[22]  Amir Pourabdollah,et al.  Towards an Authoritative OpenStreetMap: Conflating OSM and OS OpenData National Maps' Road Network , 2013, ISPRS Int. J. Geo Inf..

[23]  Pascal Neis,et al.  Assessing the Completeness of Bicycle Trail and Lane Features in OpenStreetMap for the United States , 2015, Trans. GIS.

[24]  Karl Rehrl,et al.  Estimating Completeness of VGI Datasets by Analyzing Community Activity Over Time Periods , 2014, AGILE Conf..

[25]  Jaiteg Singh,et al.  Quality Assessment of Crowdsourced Data against Custom Recorded Map Data , 2015 .

[26]  Michael W. Dobson,et al.  VGI as a Compilation Tool for Navigation Map Databases , 2013 .

[27]  Guillaume Touya,et al.  Inferring the Scale of OpenStreetMap Features , 2015, OpenStreetMap in GIScience.

[28]  David Coleman,et al.  Volunteered Geographic Information: the nature and motivation of produsers , 2009, Int. J. Spatial Data Infrastructures Res..

[29]  MICHAEL F. GOODCHILD,et al.  A Simple Positional Accuracy Measure for Linear Features , 1997, Int. J. Geogr. Inf. Sci..

[30]  Sarah Elwood,et al.  Critical Issues in Participatory GIS: Deconstructions, Reconstructions, and New Research Directions , 2006, Trans. GIS.

[31]  Dennis Zielstra,et al.  Development and Completeness of Points Of Interest in Free and Proprietary Data Sets: A Florida Case Study , 2013 .

[32]  Christoph Schlieder,et al.  Spatial Collaboration Networks of OpenStreetMap , 2015, OpenStreetMap in GIScience.

[33]  Pascal Neis,et al.  Analyzing the Contributor Activity of a Volunteered Geographic Information Project - The Case of OpenStreetMap , 2012, ISPRS Int. J. Geo Inf..

[34]  A. Getis.  The Analysis of Spatial Association by Use of Distance Statistics , 2010 .

[35]  Steven P. Jackson,et al.  Assessing the impact of demographic characteristics on spatial error in volunteered geographic information features , 2015 .

[36]  Robert Hecht,et al.  Measuring Completeness of Building Footprints in OpenStreetMap over Space and Time , 2013, ISPRS Int. J. Geo Inf..

[37]  P. Mooney,et al.  Comparison of the accuracy of OpenStreetMap for Ireland with Google Maps and Bing Maps , 2010 .

[38]  Michela Bertolotto,et al.  Automated highway tag assessment of OpenStreetMap road networks , 2014, SIGSPATIAL/GIS.

[39]  Pascal Neis,et al.  Quality assessment for building footprints data on OpenStreetMap , 2014, Int. J. Geogr. Inf. Sci..

[40]  M. Haklay.  How Good is Volunteered Geographical Information? A Comparative Study of OpenStreetMap and Ordnance Survey Datasets , 2010 .

[41]  Rahim Ali Abbaspour,et al.  Assessment of Logical Consistency in OpenStreetMap Based on the Spatial Similarity Concept , 2015, OpenStreetMap in GIScience.

[42]  Qingwu Hu,et al.  QUALITY ANALYSIS OF OPEN STREET MAP DATA , 2013 .

[43]  Michela Bertolotto,et al.  Analysing the growth of OpenStreetMap networks , 2013 .

[44]  M. Goodchild,et al.  Prospects for VGI Research and the Emerging Fourth Paradigm , 2013 .

[45]  Pascal Neis,et al.  Recent Developments and Future Trends in Volunteered Geographic Information Research: The Case of OpenStreetMap , 2014, Future Internet.

[46]  Tinghua Ai,et al.  How to Model Roads in OpenStreetMap? A Method for Evaluating the Fitness-for-Use of the Network for Navigation , 2015 .

[47]  Rob Feick,et al.  Understanding the Value of VGI , 2013 .

[48]  Michael F. Goodchild,et al.  Assuring the quality of volunteered geographic information , 2012 .

[49]  Alexander Zipf,et al.  Toward mapping land-use patterns from volunteered geographic information , 2013, Int. J. Geogr. Inf. Sci..

[50]  M. Goodchild,et al.  Data-driven geography , 2014, GeoJournal.

[51]  Michael F. Goodchild,et al.  The quality of big (geo)data , 2013 .

[52]  Takayuki Ito,et al.  Analysis of Quality of Data in OpenStreetMap , 2012, 2012 IEEE 14th International Conference on Commerce and Enterprise Computing.

[53]  David A. Parr.  The Production of Volunteered Geographic Information: A Study of OpenStreetMap in the United States , 2015 .

[54]  MohammadReza Malek,et al.  Artificial intelligence-based solution to estimate the spatial accuracy of volunteered geographic data , 2015 .

[55]  Alexander Zipf,et al.  A polygon-based approach for matching OpenStreetMap road networks with regional transit authority data , 2016, Int. J. Geogr. Inf. Sci..

[56]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[57]  G. Sithole,et al.  Assessment of the Homogeneity of Volunteered Geographic Information in South Africa , 2012 .

[58]  Jamal Jokar Arsanjani,et al.  Crowdsourced mapping of land use in urban dense environments: An assessment of Toronto , 2015 .

[59]  João Vitor Meza Bravo,et al.  An Investigation into the Completeness of, and the Updates to, OpenStreetMap Data in a Heterogeneous Area in Brazil , 2015, ISPRS Int. J. Geo Inf..

[60]  Anita Graser,et al.  Towards an Open Source Analysis Toolbox for Street Network Comparison: Indicators, Tools and Results of a Comparison of OSM and the Official Austrian Reference Graph , 2014, Trans. GIS.

[61]  Alexander Zipf,et al.  An Introduction to OpenStreetMap in Geographic Information Science: Experiences, Research, and Applications , 2015, OpenStreetMap in GIScience.

[62]  Pascal Neis,et al.  Assessing the Effect of Data Imports on the Completeness of OpenStreetMap – A United States Case Study , 2013, Trans. GIS.

[63]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[64]  Guillaume Touya,et al.  Detecting Level-of-Detail Inconsistencies in Volunteered Geographic Information Data Sets , 2013, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[65]  Vyron Antoniou,et al.  How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus’ Law to Volunteered Geographic Information , 2010 .

[66]  J. Pucher,et al.  Cycling to work in 90 large American cities: new evidence on the role of bike paths and lanes , 2012 .

[67]  Giovanni Quattrone,et al.  Modelling growth of urban crowd-sourced information , 2014, WSDM.

[68]  Giovanni Quattrone,et al.  The Impact of Society on Volunteered Geographic Information: The Case of OpenStreetMap , 2015, OpenStreetMap in GIScience.

[69]  Robert B McMaster,et al.  A Statistical Analysis of Mathematical Measures for Linear Simplification , 1986 .

[70]  Peter Mooney,et al.  The Annotation Process in OpenStreetMap , 2012, Trans. GIS.

[71]  Hanfa Xing,et al.  A Spatio-Temporal VGI Model Considering Trust-Related Information , 2016, ISPRS Int. J. Geo Inf..

[72]  Michael F. Goodchild,et al.  What Problem? Spatial Autocorrelation and Geographic Information Science , 2009 .

[73]  Jacinto Estima,et al.  Exploratory analysis of OpenStreetMap for land use classification , 2013, GEOCROWD '13.

[74]  Adam C. Winstanley,et al.  Towards quality metrics for OpenStreetMap , 2010, GIS '10.

[75]  David J. Coleman,et al.  Potential Contributions and Challenges of VGI for Conventional Topographic Base-Mapping Programs , 2013 .

[76]  François Vauglin.  Modèles statistiques des imprécisions géométriques des objets géographiques linéaires , 1997 .

[77]  Guillaume Touya,et al.  Quality Assessment of the French OpenStreetMap Dataset , 2010, Trans. GIS.

[78]  Jacinto Estima,et al.  Investigating the Potential of OpenStreetMap for Land Use/Land Cover Production: A Case Study for Continental Portugal , 2015, OpenStreetMap in GIScience.

[79]  Marco Minghini,et al.  Towards an Automated Comparison of OpenStreetMap with Authoritative Road Datasets , 2017, Trans. GIS.

[80]  M. Haklay.  Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation , 2013 .

[81]  Khalid L. A. El-Ashmawy,et al.  Testing the positional accuracy of OpenStreetMap data for mapping applications , 2016 .

[82]  Monika Sester,et al.  Quality Analysis of OpenStreetMap Data Based on Application Needs , 2011, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[83]  Jamal Jokar Arsanjani,et al.  Understanding the potential relationship between the socio-economic variables and contributions to OpenStreetMap , 2015, Int. J. Digit. Earth.

[84]  Alexander Zipf,et al.  A Conceptual Quality Framework for Volunteered Geographic Information , 2015, COSIT.

[85]  Melanie Eckle,et al.  Quality Assessment of Remote Mapping in OpenStreetMap for Disaster Management Purposes , 2015, ISCRAM.

[86]  Rodolphe Devillers,et al.  Improving Volunteered Geographic Information Quality Using a Tag Recommender System: The Case of OpenStreetMap , 2015, OpenStreetMap in GIScience.

[87]  Mohsen Kalantari,et al.  Assessing OpenStreetMap as an Open Property Map , 2015, OpenStreetMap in GIScience.

[88]  Wen Lin,et al.  When Web 2.0 Meets Public Participation GIS (PPGIS): VGI and Spaces of Participatory Mapping in China , 2013 .

[89]  Pascal Neis,et al.  A Comprehensive Framework for Intrinsic OpenStreetMap Quality Analysis , 2014, Trans. GIS.

[90]  Alexander Zipf,et al.  An Exploration of Future Patterns of the Contributions to OpenStreetMap and Development of a Contribution Index , 2015, Trans. GIS.

[91]  Vyron Antoniou,et al.  User generated spatial content: an analysis of the phenomenon and its challenges for mapping agencies , 2011 .