A Framework of Quality Assessment Methods for Crowdsourced Geographic Information: a Systematic Literature Review

Collaboration is the foundation to strengthen disaster preparedness and for effective emergency response actions at all levels. Some studies have highlighted that remote volunteers, i.e., volunteers supported by Web 2.0 technologies, possess the potential to strengthen humanitarian relief organizations by offering information regarding disaster-affected people and infrastructure. Although studies have explored various aspects of this topic, none of those provided an overview of the state-of-the-art of researches on the collaboration among humanitarian organizations and communities of remote volunteers. With the aim of overcoming this gap, a systematic literature review was conducted on the existing research works. Therefore, the main contribution of this work lies in examining the state of research in this field and in identifying potential research gaps. The results show that most of the research works addresses the general domain of disaster management, whereas only few of them address the domain of humanitarian logistics. Collaboration among Humanitarian Relief Organizations and Volunteer Technical Communities: Identifying Research Opportunities and Challenges through a Systematic Literature Review (PDF Download Available). Available from: https://www.researchgate.net/publication/315790817_Collaboration_among_Humanitarian_Relief_Organizations_and_Volunteer_Technical_Communities_Identifying_Research_Opportunities_and_Challenges_through_a_Systematic_Literature_Review [accessed May 26, 2017].

[1]  Stefan Stieglitz,et al.  Volunteered Geographic Information and Its Implications for Disaster Management , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[2]  Dennis Zielstra,et al.  Positional accuracy analysis of Flickr and Panoramio images for selected world regions , 2013 .

[3]  Pascal Neis,et al.  A Comprehensive Framework for Intrinsic OpenStreetMap Quality Analysis , 2014, Trans. GIS.

[4]  Michael F. Goodchild,et al.  Assuring the quality of volunteered geographic information , 2012 .

[5]  De Groeve Tom,et al.  Citizens as Sensors for Natural Hazards: A VGI integration Workflow , 2010 .

[6]  Kevin Crowston,et al.  Mechanisms for Data Quality and Validation in Citizen Science , 2011, 2011 IEEE Seventh International Conference on e-Science Workshops.

[7]  Paula Gomes Mian,et al.  Systematic Review in Software Engineering , 2005 .

[8]  Giles M. Foody,et al.  Rating crowdsourced annotations: evaluating contributions of variable quality and completeness , 2014, Int. J. Digit. Earth.

[9]  Carsten Keßler,et al.  Trust as a Proxy Measure for the Quality of Volunteered Geographic Information in the Case of OpenStreetMap , 2013, AGILE Conf..

[10]  Alexander Zipf,et al.  A geographic approach for combining social media and authoritative data towards identifying useful information for disaster management , 2015, Int. J. Geogr. Inf. Sci..

[11]  Alexander Zipf,et al.  Crowdsourcing geographic information for disaster management and improving urban resilience: an overview of recent developments and lessons learned , 2016 .

[12]  John Krumm,et al.  Discovering points of interest from users’ map annotations , 2008 .

[13]  Adam C. Winstanley,et al.  Towards quality metrics for OpenStreetMap , 2010, GIS '10.

[14]  Francis Harvey,et al.  To Volunteer or to Contribute Locational Information? Towards Truth in Labeling for Crowdsourced Geographic Information , 2013 .

[15]  Vyron Antoniou,et al.  How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus’ Law to Volunteered Geographic Information , 2010 .

[16]  Steffen Fritz,et al.  Assessing the Accuracy of Volunteered Geographic Information arising from Multiple Contributors to an Internet Based Collaborative Project , 2013, Trans. GIS.

[17]  K. Janowicz,et al.  Can we Trust Information ?-The Case of Volunteered Geographic Information , 2010 .

[18]  Alexander Zipf,et al.  An Advanced Systematic Literature Review on Spatiotemporal Analyses of Twitter Data , 2015, Trans. GIS.

[19]  Bernhard Höfle,et al.  Volunteered Geographic Information in Natural Hazard Analysis: A Systematic Literature Review of Current Approaches with a Focus on Preparedness and Mitigation , 2016, ISPRS Int. J. Geo Inf..

[20]  Bin Jiang,et al.  Crowdsourcing, Citizen Science or Volunteered Geographic Information? The Current State of Crowdsourced Geographic Information , 2016, ISPRS Int. J. Geo Inf..

[21]  Christoph Perger,et al.  Using control data to determine the reliability of volunteered geographic information about land cover , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[22]  Guillaume Touya,et al.  Quality Assessment of the French OpenStreetMap Dataset , 2010, Trans. GIS.

[23]  Michele Melchiori,et al.  A Crowdsourcing-Based Framework for Improving Geo-spatial Open Data , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[24]  Hansi Senaratne,et al.  A review of volunteered geographic information quality assessment methods , 2017, Int. J. Geogr. Inf. Sci..

[25]  Hansi Senaratne,et al.  Using Reverse Viewshed Analysis to Assess the Location Correctness of Visually Generated VGI , 2013, Trans. GIS.

[26]  Michela Bertolotto,et al.  Automated highway tag assessment of OpenStreetMap road networks , 2014, SIGSPATIAL/GIS.

[27]  Ahmed Loai Ali,et al.  Data Quality Assurance for Volunteered Geographic Information , 2014, GIScience.

[28]  Maria Clara Fava,et al.  Modelo de alerta hidrológico com base participativa usando sistema de informações voluntárias para previsão de enchentes , 2015 .

[29]  João Porto de Albuquerque,et al.  Flood Citizen Observatory: a crowdsourcing-based approach for flood risk management in Brazil , 2014, SEKE.

[30]  Chitu Okoli,et al.  A Guide to Conducting a Systematic Literature Review of Information Systems Research , 2010 .

[31]  Sven G. Bilen,et al.  Increasing the veracity of event detection on social media networks through user trust modeling , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[32]  Werner Kuhn,et al.  Trust and Reputation Models for Quality Assessment of Human Sensor Observations , 2013, COSIT.

[33]  Vyron Antoniou,et al.  MEASURES AND INDICATORS OF VGI QUALITY: AN OVERVIEW , 2015 .

[34]  Alexander Zipf,et al.  A Conceptual Quality Framework for Volunteered Geographic Information , 2015, COSIT.

[35]  Yue Cui,et al.  A systematic approach to evaluate and validate the spatial accuracy of farmers market locations using multi-geocoding services , 2013 .

[36]  Alexander Zipf,et al.  The use of Volunteered Geographic Information (VGI) and Crowdsourcing in Disaster Management: a Systematic Literature Review , 2013, AMCIS.

[37]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .

[38]  Carl F. Salk,et al.  Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts , 2013, PloS one.

[39]  Gloria Bordogna,et al.  On predicting and improving the quality of Volunteer Geographic Information projects , 2016, Int. J. Digit. Earth.

[40]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[41]  J. A. Glennona Crowdsourcing geographic information for disaster response: a research , 2010 .

[42]  Virach Sornlertlamvanich,et al.  Reliable Improvement for Collective Intelligence on Thai Herbal Information , 2010, Advances in Intelligent Information and Database Systems.

[43]  Gloria Bordogna,et al.  A linguistic decision making approach to assess the quality of volunteer geographic information for citizen science , 2014, Inf. Sci..

[44]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[45]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[46]  Michael F. Goodchild,et al.  Please Scroll down for Article International Journal of Digital Earth Crowdsourcing Geographic Information for Disaster Response: a Research Frontier Crowdsourcing Geographic Information for Disaster Response: a Research Frontier , 2022 .

[47]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[48]  MohammadReza Malek,et al.  Artificial intelligence-based solution to estimate the spatial accuracy of volunteered geographic data , 2015 .