Crowdsourcing and the crisis-affected community

This article reports on Mission 4636, a real-time humanitarian crowdsourcing initiative that processed 80,000 text messages (SMS) sent from within Haiti following the 2010 earthquake. It was the first time that crowdsourcing (microtasking) had been used for international relief efforts, and is the largest deployment of its kind to date. This article presents the first full report and analysis of the initiative looking at the accuracy and timeliness in creating structured data from the messages and the collaborative nature of the process. Contrary to all previous papers, studies and media reports about Mission 4636, which have typically chosen to exclude empirical analyses and the involvement of the Haitian population, it is found that the greatest volume, speed and accuracy in information processing was by Haitian nationals, the Haitian diaspora, and those working closest with them, and that no new technologies played a significant role. It is concluded that international humanitarian organizations have been wrongly credited for large-scale information processing initiatives (here and elsewhere) and that for the most part they were largely just witnesses to crisis-affected communities bootstrapping their own recovery through communications technologies. The particular focus is on the role of the diaspora, an important population that are increasingly able to contribute to response efforts thanks to their increased communication potential. It is recommended that future humanitarian deployments of crowdsourcing focus on information processing within the populations they serve, engaging those with crucial local knowledge wherever they happen to be in the world.

[1]  Chris Callison-Burch,et al.  Creating Speech and Language Data With Amazon’s Mechanical Turk , 2010, Mturk@HLT-NAACL.

[2]  Chris Callison-Burch,et al.  Crowdsourcing Translation: Professional Quality from Non-Professionals , 2011, ACL.

[3]  Robert Munro,et al.  The Start of the Art: An Introduction to Crowdsourcing Technologies for Language and Cognition Studies , 2011 .

[4]  William Lewis,et al.  Haitian Creole: How to Build and Ship an MT Engine from Scratch in 4 days, 17 hours, & 30 minutes , 2010, EAMT.

[5]  Manuel Orozco,et al.  Understanding the remittance economy in Haiti , 2006 .

[6]  S. Gorman,et al.  Volunteered Geographic Information and Crowdsourcing Disaster Relief: A Case Study of the Haitian Earthquake , 2010 .

[7]  Paul E. Ceruzzi,et al.  When Computers Were Human , 1991, Annals of the History of Computing.

[8]  Jaime G. Carbonell,et al.  Active Learning and Crowd-Sourcing for Machine Translation , 2010, LREC.

[9]  Sophia B. Liu,et al.  The New Cartographers: Crisis Map Mashups and the Emergence of Neogeographic Practice , 2010 .

[10]  Robert Munro Crowdsourced translation for emergency response in Haiti: the global collaboration of local knowledge , 2010, AMTA.

[11]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[12]  Jeannie A. Stamberger,et al.  Tweak the tweet: Leveraging microblogging proliferation with a prescriptive syntax to support citizen reporting , 2010, ISCRAM.

[13]  Christopher D. Manning,et al.  Subword Variation in Text Message Classification , 2010, NAACL.

[14]  Robert Munro,et al.  Short message communications: users, topics, and in-language processing , 2012, ACM DEV '12.

[15]  George Chamales,et al.  Securing Crisis Maps in Conflict Zones , 2011, 2011 IEEE Global Humanitarian Technology Conference.

[16]  Mary Croarken,et al.  Tabulating the Heavens: Computing the Nautical Almanac in 18th-Century England , 2003, IEEE Ann. Hist. Comput..

[17]  Philipp Koehn,et al.  Sixth workshop on statistical machine translation: proceedings of the workshop , 2011 .

[18]  D. V. van Hoving,et al.  Haiti Disaster Tourism—A Medical Shame , 2010, Prehospital and Disaster Medicine.

[19]  William Lewis,et al.  Crisis MT: Developing A Cookbook for MT in Crisis Situations , 2011, WMT@EMNLP.

[20]  Björn-Sören Gigler,et al.  The Role of Crowdsourcing for Better Governance in Fragile State Contexts , 2014 .

[21]  Anthony D. Williams,et al.  Macrowikinomics: Rebooting Business and the World , 2010 .

[22]  Matthew Lease,et al.  Crowdsourcing for search evaluation , 2011, SIGF.

[23]  Lukas Biewald,et al.  Scalable crisis relief: Crowdsourced SMS translation and categorization with Mission 4636 , 2010, ACM DEV '10.

[24]  Matthew Lease,et al.  Crowdsourcing Document Relevance Assessment with Mechanical Turk , 2010, Mturk@HLT-NAACL.

[25]  Omar Alonso,et al.  Crowdsourcing for relevance evaluation , 2008, SIGF.

[26]  Robert Munro,et al.  Subword and Spatiotemporal Models for Identifying Actionable Information in Haitian Kreyol , 2011, CoNLL.

[27]  Robert Weibel,et al.  Spatial information retrieval and geographical ontologies an overview of the SPIRIT project , 2002, SIGIR '02.

[28]  Philipp Koehn,et al.  Findings of the 2011 Workshop on Statistical Machine Translation , 2011, WMT@EMNLP.