Using gamification to increase map data production during humanitarian volunteered geographic information (VGI) campaigns

ABSTRACT Volunteered geographic information (VGI) offers a solution to inequalities in authoritative map data that can limit our response to humanitarian crises. However, sustaining voluntary contributions of map data can be difficult and hybrid machine learning-VGI (ML-VGI) workflows developed to encourage sustained volunteer contributions have been demonstrated to be insufficient. Gamification can be used to encourage volunteers to map for longer, however evaluations of gamification to increase humanitarian mapping contributions are rare. Here we develop a gamified humanitarian ML-VGI mapping platform (“Map Safari”) and evaluate the use of game elements to encourage sustained volunteer contributions without reducing contribution quality. Our results suggest that gamification makes mapping more fun, particularly for first time mappers, without degrading map data quality. Competition is demonstrated to be important for encouraging enjoyment of game elements and increasing map data contributions. Future gamified mapping platforms should emphasize competition and ensure there are enough game elements to make platform use feel game-like. This research demonstrates that gamification can be used to encourage continued voluntary contributions of map data thereby increasing the amount of map data available to humanitarian organizations.

[1]  Kirsty Watkinson,et al.  Centaur VGI: An Evaluation of Engagement, Speed, and Quality in Hybrid Humanitarian Mapping , 2022, Annals of the American Association of Geographers.

[2]  A. Zipf,et al.  The evolution of humanitarian mapping within the OpenStreetMap community , 2021, Scientific reports.

[3]  M. Haklay Geographic citizen science: , 2021 .

[4]  Jonny Huck,et al.  Centaur VGI: A Hybrid Human–Machine Approach to Address Global Inequalities in Map Coverage , 2020, Annals of the American Association of Geographers.

[5]  Devis Tuia,et al.  Deploying machine learning to assist digital humanitarians: making image annotation in OpenStreetMap more efficient , 2020, Int. J. Geogr. Inf. Sci..

[6]  Abeba Birhane,et al.  Algorithmic Colonization of Africa , 2020, SCRIPT-ed.

[7]  Dirk Tiede,et al.  Earth observation tools and services to increase the effectiveness of humanitarian assistance , 2020, European Journal of Remote Sensing.

[8]  Jason C. Young,et al.  Volunteer geographic information in the Global South: barriers to local implementation of mapping projects across Africa , 2020, GeoJournal.

[9]  Bernhard Höfle,et al.  Behavioural Effects of Spatially Structured Scoring Systems in Location-Based Serious Games - A Case Study in the Context of OpenStreetMap , 2020, ISPRS Int. J. Geo Inf..

[10]  M. Painho,et al.  Addressing Geospatial Preparedness Inequity: A Sustainable Bottom-up approach for Non-Governmental Development Organizations , 2019 .

[11]  H. Balakrishnan,et al.  Inferring and improving street maps with data-driven automation , 2019, Commun. ACM.

[12]  Yasin Bulduklu,et al.  Mobile games on the basis of uses and gratifications approach: A comparison of the mobile game habits of university and high school students , 2019 .

[13]  Konstantinos Chorianopoulos,et al.  Mobile Mapmaking: A Field Study of Gamification and Cartographic Editing , 2019, INTERACT.

[14]  Alexander Zipf,et al.  Mapping Human Settlements with Higher Accuracy and Less Volunteer Efforts by Combining Crowdsourcing and Deep Learning , 2019, Remote. Sens..

[15]  Zorica Nedovic-Budic,et al.  AN INTERDISCIPLINARY FRAME FOR UNDERSTANDING VOLUNTEERED GEOGRAPHIC INFORMATION , 2019 .

[16]  Ross S. Purves,et al.  StarBorn: Towards making in‐situ land cover data generation fun with a location‐based game , 2019, Trans. GIS.

[17]  Juho Hamari,et al.  Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use , 2019, User Modeling and User-Adapted Interaction.

[18]  E. Bruce,et al.  The Good, the Bad, and the Uncertain: Contributions of Volunteered Geographic Information to Community Disaster Resilience , 2018, Front. Earth Sci..

[19]  Leysia Palen,et al.  The Crowd is the Territory: Assessing Quality in Peer-Produced Spatial Data During Disasters , 2018, Int. J. Hum. Comput. Interact..

[20]  Thomas Hillman,et al.  Getting it Right or Being Top Rank: Games in Citizen Science , 2018 .

[21]  Billy Haworth,et al.  Implications of Volunteered Geographic Information for Disaster Management and GIScience: A More Complex World of Volunteered Geography , 2018 .

[22]  Licia Capra,et al.  Private Peer Feedback as Engagement Driver in Humanitarian Mapping , 2017, Proc. ACM Hum. Comput. Interact..

[23]  Elena Paslaru Bontas Simperl,et al.  An investigation of player motivations in Eyewire, a gamified citizen science project , 2017, Comput. Hum. Behav..

[24]  Erik W. Johnston,et al.  A framework for analyzing digital volunteer contributions in emergent crisis response efforts , 2017, New Media Soc..

[25]  Giovanni Quattrone,et al.  Mass Participation During Emergency Response: Event-centric Crowdsourcing in Humanitarian Mapping , 2017, CSCW.

[26]  Giovanni Quattrone,et al.  Social Contribution Settings and Newcomer Retention in Humanitarian Crowd Mapping , 2016, SocInfo.

[27]  Steffen Fritz,et al.  Crowdsourcing In-Situ Data on Land Cover and Land Use Using Gamification and Mobile Technology , 2016, Remote. Sens..

[28]  Emily J. Eros Putting 200 Million People “on the Map”: Evolving Methods and Tools , 2016 .

[29]  Mark Snyder,et al.  Understanding and encouraging volunteerism and community involvement , 2016, The Journal of social psychology.

[30]  Steffen Fritz,et al.  Assessing quality of volunteer crowdsourcing contributions: lessons from the Cropland Capture game , 2016, Int. J. Digit. Earth.

[31]  Vickie Curtis,et al.  Motivation to Participate in an Online Citizen Science Game , 2015 .

[32]  Valérie Maquil,et al.  Towards Geospatial Tangible User Interfaces: An Observational User Study Exploring Geospatial Interactions of the Novice , 2015 .

[33]  Manuela Schmidt,et al.  Testing the Usability of OpenStreetMap's iD Tool , 2015 .

[34]  Abbas Rajabifard,et al.  ROADPLEX: A MOBILE VGI GAME TO COLLECT AND VALIDATE DATA FOR POIs , 2014 .

[35]  Ryan Burns Rethinking big data in digital humanitarianism: practices, epistemologies, and social relations , 2014, GeoJournal.

[36]  David L. Tulloch Crowdsourcing geographic knowledge: volunteered geographic information (VGI) in theory and practice , 2014, Int. J. Geogr. Inf. Sci..

[37]  Anna L. Cox,et al.  “I want to be a captain! I want to be a captain!”: gamification in the old weather citizen science project , 2013, Gamification.

[38]  Jennifer Preece,et al.  Using gamification to inspire new citizen science volunteers , 2013, Gamification.

[39]  C. Haythornthwaite,et al.  Motivation for Open Collaboration , 2013 .

[40]  M. Goodchild,et al.  Volunteered Geographic Information, the Exaflood, and the Growing Digital Divide , 2013 .

[41]  John G. Breslin,et al.  Gamification of citizen sensing through mobile social reporting , 2012, 2012 IEEE International Games Innovation Conference.

[42]  Emanuele Della Valle,et al.  Urbanopoly -- A Social and Location-Based Game with a Purpose to Crowdsource Your Urban Data , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[43]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.

[44]  Daren C. Brabham Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning , 2012 .

[45]  Christoph Schlieder,et al.  Wisdom about the Crowd: Assuring Geospatial Data Quality Collected in Location-Based Games , 2011, ICEC.

[46]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[47]  Melinda Laituri,et al.  User-friendly web mapping: lessons from a citizen science website , 2010, Int. J. Geogr. Inf. Sci..

[48]  Christine M. Fox,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interact. Comput..

[49]  David Coleman,et al.  Volunteered Geographic Information: the nature and motivation of produsers , 2009, Int. J. Spatial Data Infrastructures Res..

[50]  C. Lintott,et al.  Galaxy Zoo: Motivations of Citizen Scientists , 2013, 1303.6886.

[51]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .

[52]  John L. Sherry,et al.  Narrative and interactivity in computer games , 2006 .

[53]  C. Kray,et al.  Crowdsourcing geographic information with a gamification approach , 2019, Geodetski vestnik.

[54]  Christoph Schlieder,et al.  Addressing Uneven Participation Patterns in VGI Through Gamification Mechanisms , 2018 .

[55]  Paul Coulton,et al.  Mapping the beach beneath the street : digital cartography for the playable city , 2017 .

[56]  Christian Kray,et al.  A Gamification Framework for Volunteered Geographic Information , 2015, AGILE Conf..

[57]  C. Schlieder,et al.  Game Principles for Enhancing the Quality of User-generated Data Collections , 2014 .

[58]  F. Canters,et al.  A NEW APPROACH FOR DESIGNING ORTHOPHANIC WORLD MAPS , 2005 .

[59]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[60]  Alan M. MacEachren,et al.  Compactness of Geographic Shape: Comparison and Evaluation of Measures , 1985 .

[61]  Nikola Davidovic,et al.  Using Location Based Game MapSigns to motivate VGI data collection related to traffic signs , 2022 .