#Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages

It is well-established that within crisis-related communications, rumors are likely to emerge. False rumors, i.e. misinformation, can be detrimental to crisis communication and response; it is therefore important not only to be able to identify messages that propagate rumors, but also corrections or denials of rumor content. In this work, we explore the task of automatically classifying rumor stances expressed in crisisrelated content posted on social media. Utilizing a dataset of over 4,300 manually coded tweets, we build a supervised machine learning model for this task, achieving an accuracy over 88% across a diverse set of rumors of different types.

[1]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[2]  Kate Starbird,et al.  How Information Snowballs: Exploring the Role of Exposure in Online Rumor Propagation , 2016, CSCW.

[3]  Starr Roxanne Hiltz,et al.  Use of Social Media by U.S. Public Sector Emergency Managers: Barriers and Wish Lists , 2014, ISCRAM.

[4]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[5]  Leysia Palen,et al.  Microblogging during two natural hazards events: what twitter may contribute to situational awareness , 2010, CHI.

[6]  Li Zeng,et al.  Rumors at the Speed of Light? Modeling the Rate of Rumor Transmission During Crisis , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[7]  Carter T. Butts,et al.  Warning tweets: serial transmission of messages during the warning phase of a disaster event , 2014 .

[8]  Kate Starbird,et al.  Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter after the 2013 Boston Marathon Bombing , 2014 .

[9]  Brendan T. O'Connor,et al.  Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters , 2013, NAACL.

[10]  Sean Fitzhugh,et al.  Rumoring during extreme events: a case study of deepwater horizon 2010 , 2012, WebSci '12.

[11]  Barbara Poblete,et al.  Twitter under crisis: can we trust what we RT? , 2010, SOMA '10.

[12]  Dragomir R. Radev,et al.  Rumor has it: Identifying Misinformation in Microblogs , 2011, EMNLP.