Social-EOC: Serviceability Model to Rank Social Media Requests for Emergency Operation Centers

The public expects a prompt response from emergency services to address requests for help posted on social media. However, the information overload of social media experienced by these organizations, coupled with their limited human resources, challenges them to timely identify and prioritize critical requests. This is particularly acute in crisis situations where any delay may have a severe impact on the effectiveness of the response. While social media has been extensively studied during crises, there is limited work on formally characterizing serviceable help requests and automatically prioritizing them for a timely response. In this paper, we present a formal model of serviceability called Social-EOC (Social Emergency Operations Center), which describes the elements of a serviceable message posted in social media that can be expressed as a request. We also describe a system for the discovery and ranking of highly serviceable requests, based on the proposed serviceability model. We validate the model for emergency services, by performing an evaluation based on real-world data from six crises, with ground truth provided by emergency management practitioners. Our experiments demonstrate that features based on the serviceability model improve the performance of discovering and ranking (nDCG up to 25%) service requests over different baselines. In the light of these experiments, the application of the serviceability model could reduce the cognitive load on emergency operation center personnel, in filtering and ranking public requests at scale.

[1]  C. Castillo,et al.  Big Crisis Data: Social Media in Disasters and Time-Critical Situations , 2019 .

[2]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[3]  Tie-Yan Liu,et al.  Learning to Rank for Information Retrieval , 2011 .

[4]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[5]  Jong-Hoon Oh,et al.  Aid is Out There: Looking for Help from Tweets during a Large Scale Disaster , 2013, ACL.

[6]  Kate Starbird,et al.  Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter after the 2013 Boston Marathon Bombing , 2014 .

[7]  Huan Liu,et al.  Finding requests in social media for disaster relief , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[8]  Mengdi Wang,et al.  The Signals and Noise: Actionable Information in Improvised Social Media Channels During a Disaster , 2017, WebSci.

[9]  Christian Reuter,et al.  Towards social resilience: A quantitative and qualitative survey on citizens' perception of social media in emergencies in Europe , 2017 .

[10]  Fernando Diaz,et al.  Emergency-relief coordination on social media: Automatically matching resource requests and offers , 2013, First Monday.

[11]  Bruno S. Silvestre,et al.  Social Media? Get Serious! Understanding the Functional Building Blocks of Social Media , 2011 .

[12]  Premkumar T. Devanbu,et al.  How social Q&A sites are changing knowledge sharing in open source software communities , 2014, CSCW.

[13]  Huan Liu,et al.  Facilitating Time Critical Information Seeking in Social Media , 2017, IEEE Transactions on Knowledge and Data Engineering.

[14]  Leysia Palen,et al.  The Evolving Role of the Public Information Officer: An Examination of Social Media in Emergency Management , 2012 .

[15]  Starr Roxanne Hiltz,et al.  Use of Social Media by U.S. Public Sector Emergency Managers: Barriers and Wish Lists , 2014, ISCRAM.

[16]  Paul Rayson,et al.  Understanding Actionable Knowledge in Social Media: BBC Question Time and Twitter, a Case Study , 2012, ICWSM.

[17]  Leysia Palen,et al.  Online public communications by police & fire services during the 2012 Hurricane Sandy , 2014, CHI.

[18]  Hemant Purohit,et al.  CitizenHelper: A Streaming Analytics System to Mine Citizen and Web Data for Humanitarian Organizations , 2017, ICWSM.

[19]  Paul Solomon,et al.  Looking for Information—A Survey of Research on Information Seeking, Needs, and Behavior , 2003, Information Retrieval.

[20]  Muhammad Imran,et al.  Twitter as a Lifeline: Human-annotated Twitter Corpora for NLP of Crisis-related Messages , 2016, LREC.

[21]  L. Palen,et al.  Crisis informatics—New data for extraordinary times , 2016, Science.

[22]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[23]  Niharika Sachdeva,et al.  Call for Service: Characterizing and Modeling Police Response to Serviceable Requests on Facebook , 2017, CSCW.

[24]  Jie Yin,et al.  Using Social Media to Enhance Emergency Situation Awareness , 2012, IEEE Intelligent Systems.

[25]  Donald O. Case,et al.  Looking for Information: A Survey of Research on Information Seeking, Needs and Behavior , 2012 .

[26]  Susan T. Dumais,et al.  Characterizing and Predicting Enterprise Email Reply Behavior , 2017, SIGIR.

[27]  Amit P. Sheth,et al.  Twitris: A System for Collective Social Intelligence , 2014, Encyclopedia of Social Network Analysis and Mining.

[28]  Sarah Vieweg,et al.  Processing Social Media Messages in Mass Emergency , 2014, ACM Comput. Surv..