Modeling aggregated expertise of user contributions to assess the credibility of OpenStreetMap features

The emergence of volunteered geographic information (VGI) during the past decade has fueled a wide range of research and applications. The assessment of VGI quality and fitness-of-use is still a challenge because of the non-standardized and crowdsourced data collection process, as well as the unknown skill and motivation of the contributors. However, the frequent approach of assessing VGI quality against external data sources using ISO quality standard measures is problematic because of a frequent lack of available external (reference) data, and because for certain types of features, VGI might be more up-to-date than the reference data. Therefore, a VGI-intrinsic measure of quality is highly desirable. This study proposes such an intrinsic measure of quality by developing the concept of aggregated expertise based on the characteristics of a feature's contributors. The article further operationalizes this concept and examines its feasibility through a case study using OpenStreetMap (OSM). The comparison of model OSM feature quality with information from a field survey demonstrates the successful implementation of this novel approach.

[1]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.

[2]  K. Janowicz,et al.  Can we Trust Information ?-The Case of Volunteered Geographic Information , 2010 .

[3]  D. Bégin,et al.  ASSESSING VOLUNTEERED GEOGRAPHIC INFORMATION (VGI) QUALITY BASED ON CONTRIBUTORS' MAPPING BEHAVIOURS , 2013 .

[4]  M. Exel,et al.  The impact of crowdsourcing on spatial data quality indicators , 2010 .

[5]  Peter Mooney,et al.  Characteristics of Heavily Edited Objects in OpenStreetMap , 2012, Future Internet.

[6]  Pascal Neis,et al.  A Comprehensive Framework for Intrinsic OpenStreetMap Quality Analysis , 2014, Trans. GIS.

[7]  Miriam J. Metzger,et al.  The credibility of volunteered geographic information , 2008 .

[8]  Yolanda Gil,et al.  A survey of trust in computer science and the Semantic Web , 2007, J. Web Semant..

[9]  Pascal Neis,et al.  Recent Developments and Future Trends in Volunteered Geographic Information Research: The Case of OpenStreetMap , 2014, Future Internet.

[10]  Pascal Neis,et al.  The Street Network Evolution of Crowdsourced Maps: OpenStreetMap in Germany 2007-2011 , 2011, Future Internet.

[11]  Carsten Keßler,et al.  Trust as a Proxy Measure for the Quality of Volunteered Geographic Information in the Case of OpenStreetMap , 2013, AGILE Conf..

[12]  Tomi Kauppinen,et al.  Tracking Editing Processes in Volunteered Geographic Information: The Case of OpenStreetMap , 2011, COSIT 2011.

[13]  Ning Jing,et al.  Amateur or Professional: Assessing the Expertise of Major Contributors in OpenStreetMap Based on Contributing Behaviors , 2016, ISPRS Int. J. Geo Inf..

[14]  M. Haklay How Good is Volunteered Geographical Information? A Comparative Study of OpenStreetMap and Ordnance Survey Datasets , 2010 .

[15]  David R. Musicant,et al.  Barriers to the Localness of Volunteered Geographic Information , 2015, CHI.

[16]  C. Haythornthwaite,et al.  Motivation for Open Collaboration , 2013 .

[17]  Rodolphe Devillers,et al.  Improving Volunteered Geographic Information Quality Using a Tag Recommender System: The Case of OpenStreetMap , 2015, OpenStreetMap in GIScience.

[18]  Vyron Antoniou,et al.  MEASURES AND INDICATORS OF VGI QUALITY: AN OVERVIEW , 2015 .

[19]  M. Bishr,et al.  Geospatial Information Bottom-Up: A Matter of Trust and Semantics , 2007, AGILE Conf..

[20]  Carlos Granell,et al.  Advancing Science with VGI: Reproducibility and Replicability of Recent Studies using VGI , 2017, Trans. GIS.

[21]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .