EPIC-OSM: A Software Framework for OpenStreetMap Data Analytics

An important area of work in big data software engineering involves the design and development of software frameworks for data-intensive systems that perform large-scale data collection and analysis. We report on our work to design and develop a software framework for analyzing the collaborative editing behavior of OpenStreetMap users when working on the task of crisis mapping. Crisis mapping occurs after a disaster or humanitarian crisis and involves the coordination of a distributed set of users who collaboratively work to improve the quality of the map for the impacted area in support of emergency response efforts. Our paper presents the challenges related to the analysis of OpenStreetMap and how our software framework tackles those challenges to enable the efficient processing of gigabytes of OpenStreetMap data. Our framework has already been deployed to analyze crisis mapping efforts in 2015 and has an active development community.

[1]  S. Elwood.  Volunteered geographic information: future research directions motivated by critical, participatory, and feminist GIS , 2008 .

[2]  Kenneth M. Anderson.  Embrace the Challenges: Software Engineering in a Big Data World , 2015, 2015 IEEE/ACM 1st International Workshop on Big Data Software Engineering.

[3]  Leysia Palen,et al.  From Crowdsourced Mapping to Community Mapping: The Post-earthquake Work of OpenStreetMap Haiti , 2014, COOP.

[4]  M. Goodchild.  Citizens as sensors: the world of volunteered geography , 2007 .

[5]  C. Haythornthwaite,et al.  Motivation for Open Collaboration , 2013 .

[6]  Leysia Palen,et al.  Engineering Crowdwork for Disaster Events: The Human-Centered Development of a Lost-and-Found Tasking Environment , 2015, 2015 48th Hawaii International Conference on System Sciences.

[7]  Leysia Palen,et al.  Resilience-building and the crisis informatics agenda: Lessons learned from open cities Kathmandu , 2014, ISCRAM.

[8]  Peter Mooney,et al.  Analysis of Interaction and Co‐editing Patterns amongst OpenStreetMap Contributors , 2014, Trans. GIS.

[9]  Brian Keegan.  Breaking news on wikipedia: dynamics, structures, and roles in high-tempo collaboration , 2012, CSCW.

[10]  Leysia Palen,et al.  Success & Scale in a Data-Producing Organization: The Socio-Technical Evolution of OpenStreetMap in Response to Humanitarian Events , 2015, CHI.

[11]  Pascal Neis,et al.  Analyzing the Contributor Activity of a Volunteered Geographic Information Project - The Case of OpenStreetMap , 2012, ISPRS Int. J. Geo Inf..

[12]  Kenneth Mark Anderson,et al.  MySQL to NoSQL: data modeling challenges in supporting scalability , 2012, SPLASH '12.

[13]  Sophia B. Liu,et al.  Citizen communications in crisis: anticipating a future of ICT-supported public participation , 2007, CHI.