Epidemic Intelligence for the Crowd, by the Crowd

Event Based Epidemic Intelligence (e-EI) encompasses activities related to early warnings and their assessments as part of the outbreak investigation task. Recently, modern disease surveillance systems have started to also monitor social media streams, with the objective of improving their timeliness in detecting disease outbreaks, and producing warnings against potential public health threats. In this tutorial we show how social media analysis can be exploited for two important stages of e-EI, namely: (i) Early Outbreak Detection, and (ii) Outbreak Analysis and Control. We discuss techniques and methods for detecting health-related events from unstructured text and outline approaches, as well as the challenges faced in social media-based surveillance. In particular, we will show how using Twitter can help us to find early cases of an outbreak, as well as, understand the potential causes of contamination and spread from the perspective of the field practitioners.

[1]  Harry Shum,et al.  An Empirical Study on Learning to Rank of Tweets , 2010, COLING.

[2]  Nigel Collier,et al.  OMG U got flu? Analysis of shared health messages for bio-surveillance , 2011, Semantic Mining in Biomedicine.

[3]  Alberto Maria Segre,et al.  The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U.S. during the Influenza A H1N1 Pandemic , 2011, PloS one.

[4]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[5]  Avare Stewart,et al.  Medical case-driven classification of microblogs: characteristics and annotation , 2012, IHI '12.

[6]  Martin Szomszor,et al.  Twitter Informatics: Tracking and Understanding Public Reaction during the 2009 Swine Flu Pandemic , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[7]  Avare Stewart,et al.  Towards personalized learning to rank for epidemic intelligence based on social media streams , 2012, WWW.

[8]  Avare Stewart,et al.  Detecting Health Events on the Social Web to Enable Epidemic Intelligence , 2011, SPIRE.

[9]  Aron Culotta,et al.  Towards detecting influenza epidemics by analyzing Twitter messages , 2010, SOMA '10.

[10]  Nello Cristianini,et al.  Flu Detector - Tracking Epidemics on Twitter , 2010, ECML/PKDD.

[11]  Tao Qin,et al.  LETOR: A benchmark collection for research on learning to rank for information retrieval , 2010, Information Retrieval.

[12]  Leysia Palen,et al.  Microblogging during two natural hazards events: what twitter may contribute to situational awareness , 2010, CHI.

[13]  Tie-Yan Liu,et al.  Learning to Rank for Information Retrieval , 2011 .

[14]  Armin R. Mikler,et al.  Text and Structural Data Mining of Influenza Mentions in Web and Social Media , 2010, International journal of environmental research and public health.

[15]  Sharib A. Khan.  Handbook of Biosurveillance, M.M. Wagner, A.W. Moore, R.M. Aryel (Eds.). Elsevier Inc. ISBN-13: 978-0-12-369378-5 , 2007, J. Biomed. Informatics.

[16]  Nigel Collier,et al.  What's unusual in online disease outbreak news? , 2010, J. Biomed. Semant..

[17]  Ralf Steinberger,et al.  Text Mining from the Web for Medical Intelligence , 2007, NATO ASI Mining Massive Data Sets for Security.

[18]  Mark Dredze,et al.  You Are What You Tweet: Analyzing Twitter for Public Health , 2011, ICWSM.

[19]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[20]  Erik Van der Goot,et al.  Tracking Media Reports on the Shiga Toxin-Producing Escherichia coli O104: H4 Outbreak in Germany , 2011, eHealth.

[21]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[22]  Ernesto Diaz-Aviles,et al.  Tracking Twitter for epidemic intelligence: case study: EHEC/HUS outbreak in Germany, 2011 , 2012, WebSci '12.

[23]  Nello Cristianini,et al.  Nowcasting Events from the Social Web with Statistical Learning , 2012, TIST.

[24]  L. Hutwagner,et al.  The bioterrorism preparedness and response Early Aberration Reporting System (EARS) , 2003, Journal of Urban Health.

[25]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[26]  Nick Koudas,et al.  TwitterMonitor: trend detection over the twitter stream , 2010, SIGMOD Conference.

[27]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[28]  Mizuki Morita,et al.  Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter , 2011, EMNLP.

[29]  Nello Cristianini,et al.  Tracking the flu pandemic by monitoring the social web , 2010, 2010 2nd International Workshop on Cognitive Information Processing.

[30]  Hakan Ferhatosmanoglu,et al.  Short text classification in twitter to improve information filtering , 2010, SIGIR.

[31]  D. Sculley,et al.  Large Scale Learning to Rank , 2009 .

[32]  David M. Pennock,et al.  Using internet searches for influenza surveillance. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[33]  Klaus Stark,et al.  Epidemic profile of Shiga-toxin-producing Escherichia coli O104:H4 outbreak in Germany. , 2011, The New England journal of medicine.

[34]  G. Eysenbach,et al.  Pandemics in the Age of Twitter: Content Analysis of Tweets during the 2009 H1N1 Outbreak , 2010, PloS one.

[35]  Avare Stewart,et al.  A transfer approach to detecting disease reporting events in blog social media , 2011, HT '11.

[36]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[37]  Mark Dredze,et al.  A Model for Mining , 2011 .

[38]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[39]  Jure Leskovec,et al.  Patterns of temporal variation in online media , 2011, WSDM '11.

[40]  Michael M. Wagner,et al.  Handbook of biosurveillance , 2006 .