Analysing Volunteer Engagement in Humanitarian Mapping: Building Contributor Communities at Large Scale

Organisers of large-scale crowdsourcing initiatives need to consider how to produce outcomes with their projects, but also how to build volunteer capacity. The initial project experience of contributors plays an important role in this, particularly when the contribution process requires some degree of expertise. We propose three analytical dimensions to assess first-time contributor engagement based on readily available public data: cohort analysis, task analysis, and observation of contributor performance. We apply these to a large-scale study of remote mapping activities coordinated by the Humanitarian OpenStreetMap Team, a global volunteer effort with thousands of contributors. Our study shows that different coordination practices can have a marked impact on contributor retention, and that complex task designs can be a deterrent for certain contributor groups. We close by providing recommendations about how to build and sustain volunteer capacity in these and comparable crowdsourcing systems.

[1]  Giovanni Quattrone,et al.  The Life of the Party: Impact of Social Mapping in OpenStreetMap , 2013, ICWSM.

[2]  Cameron Marlow,et al.  Feed me: motivating newcomer contribution in social network sites , 2009, CHI.

[3]  John Riedl,et al.  Searching for the goldilocks zone: trade-offs in managing online volunteer groups , 2012, CSCW.

[4]  Melanie Eckle,et al.  Quality Assessment of Remote Mapping in OpenStreetMap for Disaster Management Purposes , 2015, ISCRAM.

[5]  Y. Benkler,et al.  Commons‐based Peer Production and Virtue* , 2006 .

[6]  N. Budhathoki Participants' motivations to contribute geographic information in an online community , 2010 .

[7]  Clay Westrope,et al.  Groundtruthing OpenStreetMap building damage assessment , 2014 .

[8]  Lesandro Ponciano,et al.  Volunteers' Engagement in Human Computation for Astronomy Projects , 2014, Computing in Science & Engineering.

[9]  Leysia Palen,et al.  Success & Scale in a Data-Producing Organization: The Socio-Technical Evolution of OpenStreetMap in Response to Humanitarian Events , 2015, CHI.

[10]  Robert E. Kraut,et al.  Socialization tactics in wikipedia and their effects , 2010, CSCW '10.

[11]  James Davis,et al.  Evaluating and improving the usability of Mechanical Turk for low-income workers in India , 2010, ACM DEV '10.

[12]  Leysia Palen,et al.  From Crowdsourced Mapping to Community Mapping: The Post-earthquake Work of OpenStreetMap Haiti , 2014, COOP.

[13]  R. Wood Task complexity: Definition of the construct , 1986 .

[14]  Oded Nov,et al.  What motivates Wikipedians? , 2007, CACM.

[15]  Aaron Halfaker,et al.  Using edit sessions to measure participation in wikipedia , 2013, CSCW.

[16]  J. Havens,et al.  Social participation and charitable giving: A multivariate analysis , 1997 .

[17]  Lesandro Ponciano,et al.  Finding Volunteers' Engagement Profiles in Human Computation for Citizen Science Projects , 2014, Hum. Comput..

[18]  Robert E. Kraut,et al.  Socializing volunteers in an online community: a field experiment , 2012, CSCW.

[19]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[20]  Kevin Crowston,et al.  From Conservation to Crowdsourcing: A Typology of Citizen Science , 2011, 2011 44th Hawaii International Conference on System Sciences.

[21]  Dario Taraborelli,et al.  MoodBar: Increasing New User Retention in Wikipedia through Lightweight Socialization , 2014, CSCW.

[22]  Arthur A. Stukas,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Understanding and Assessing the Motivations of Volunteers: A Functional Approach , 2004 .

[23]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[24]  A. Bandura Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.