Simple Open Stance Classification for Rumour Analysis

Stance classification determines the attitude, or stance, in a (typically short) text. The task has powerful applications, such as the detection of fake news or the automatic extraction of attitudes toward entities or events in the media. This paper describes a surprisingly simple and efficient classification approach to open stance classification in Twitter, for rumour and veracity classification. The approach profits from a novel set of automatically identifiable problem-specific features, which significantly boost classifier accuracy and achieve above state-of-the-art results on recent benchmark datasets. This calls into question the value of using complex sophisticated models for stance classification without first doing informed feature extraction.

[1]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[2]  Kalina Bontcheva,et al.  Stance Detection with Bidirectional Conditional Encoding , 2016, EMNLP.

[3]  Arkaitz Zubiaga,et al.  Stance Classification in Rumours as a Sequential Task Exploiting the Tree Structure of Social Media Conversations , 2016, COLING.

[4]  Kalina Bontcheva,et al.  Classifying Tweet Level Judgements of Rumours in Social Media , 2015, EMNLP.

[5]  Ankit Srivastava,et al.  DFKI-DKT at SemEval-2017 Task 8: Rumour Detection and Classification using Cascading Heuristics , 2017, *SEMEVAL.

[6]  Kalina Bontcheva,et al.  Estimating collective judgement of rumours in social media , 2015, ArXiv.

[7]  Isabelle Augenstein,et al.  Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification with Branch-LSTM , 2017, *SEMEVAL.

[8]  Barbara Poblete,et al.  Twitter under crisis: can we trust what we RT? , 2010, SOMA '10.

[9]  Saif Mohammad,et al.  SemEval-2016 Task 6: Detecting Stance in Tweets , 2016, *SEMEVAL.

[10]  Edward Tjörnhammar,et al.  Mama Edha at SemEval-2017 Task 8: Stance Classification with CNN and Rules , 2017, *SEMEVAL.

[11]  Man Lan,et al.  ECNU at SemEval-2017 Task 8: Rumour Evaluation Using Effective Features and Supervised Ensemble Models , 2017, *SEMEVAL.

[12]  Arkaitz Zubiaga,et al.  Hawkes Processes for Continuous Time Sequence Classification: an Application to Rumour Stance Classification in Twitter , 2016, ACL.

[13]  Mona T. Diab,et al.  Rumor Detection and Classification for Twitter Data , 2015, ArXiv.

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[15]  Mona T. Diab,et al.  Rumor Identification and Belief Investigation on Twitter , 2016, WASSA@NAACL-HLT.

[16]  Georgiana Dinu,et al.  Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors , 2014, ACL.

[17]  Xiaomo Liu,et al.  Real-time Rumor Debunking on Twitter , 2015, CIKM.

[18]  Douglas Biber,et al.  Stance in spoken and written university registers , 2006 .

[19]  Weiwei Guo,et al.  Modeling Sentences in the Latent Space , 2012, ACL.

[20]  Li Zeng,et al.  #Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages , 2016, ICWSM.

[21]  Samhaa R. El-Beltagy,et al.  NileTMRG at SemEval-2017 Task 8: Determining Rumour and Veracity Support for Rumours on Twitter. , 2017, *SEMEVAL.

[22]  Arkaitz Zubiaga,et al.  Microblog Analysis as a Program of Work , 2018, ACM Trans. Soc. Comput..

[23]  Pushpak Bhattacharyya,et al.  IITP at SemEval-2017 Task 8 : A Supervised Approach for Rumour Evaluation , 2017, SemEval@ACL.

[24]  Arkaitz Zubiaga,et al.  SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours , 2017, *SEMEVAL.

[25]  Dragomir R. Radev,et al.  Rumor has it: Identifying Misinformation in Microblogs , 2011, EMNLP.

[26]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[27]  Percy Liang,et al.  Semi-Supervised Learning for Natural Language , 2005 .

[28]  Hareesh Bahuleyan,et al.  UWaterloo at SemEval-2017 Task 8: Detecting Stance towards Rumours with Topic Independent Features , 2017, SemEval@ACL.

[29]  Hung-Yu Kao,et al.  IKM at SemEval-2017 Task 8: Convolutional Neural Networks for stance detection and rumor verification , 2017, *SEMEVAL.

[30]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[31]  Arindam Ghosh,et al.  In the mood for sharing contents: Emotions, personality and interaction styles in the diffusion of news , 2016, Inf. Process. Manag..

[32]  R. Procter,et al.  Reading the riots: what were the police doing on Twitter? , 2013 .

[33]  Arkaitz Zubiaga,et al.  Microblog Analysis as a Programme of Work , 2015, ArXiv.

[34]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[35]  Arkaitz Zubiaga,et al.  Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads , 2015, PloS one.

[36]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[37]  Kalina Bontcheva,et al.  Pheme: Veracity in Digital Social Networks , 2014, UMAP Workshops.