Neural Stance Detection With Hierarchical Linguistic Representations

Stance detection aims to assign a stance label (i.e., favor or against) to a post towards a specific target. Recently, there is a growing interest in adopting neural models to detect stance of a document. However, most of these works focus on modeling the sequence of words to learn document representation, though other linguistic information, such as sentiment and arguments, are correlated with the stance of document, and may inspire us to explore the stance. In this article, we propose a hierarchical attention neural model to well study various linguistic information to better represent a document via hierarchical linguistic representations. In addition, we propose a hierarchical network with attention mechanism to weight the importance of various kinds of linguistic information, and learn the mutual attention between document and linguistic information. Detail evaluation on two benchmark datasets demonstrates the effectiveness of proposed hierarchical network with attention mechanism.

[1]  Qun Liu,et al.  Incorporating Word Reordering Knowledge into Attention-based Neural Machine Translation , 2017, ACL.

[2]  Nan Yang,et al.  Dependency-to-Dependency Neural Machine Translation , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[3]  Swapna Somasundaran,et al.  Recognizing Stances in Ideological On-Line Debates , 2010, HLT-NAACL 2010.

[4]  Stan Matwin,et al.  From Argumentation Mining to Stance Classification , 2015, ArgMining@HLT-NAACL.

[5]  Noah A. Smith,et al.  Transition-Based Dependency Parsing with Stack Long Short-Term Memory , 2015, ACL.

[6]  Vincent Ng,et al.  Modeling Stance in Student Essays , 2016, ACL.

[7]  Deyi Xiong,et al.  Accelerating Neural Transformer via an Average Attention Network , 2018, ACL.

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Lun-Wei Ku,et al.  UTCNN: a Deep Learning Model of Stance Classification on Social Media Text , 2016, COLING.

[10]  Saif Mohammad,et al.  SemEval-2016 Task 6: Detecting Stance in Tweets , 2016, *SEMEVAL.

[11]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[12]  Hua Wu,et al.  An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge , 2017, ACL.

[13]  Vincent Ng,et al.  Why are You Taking this Stance? Identifying and Classifying Reasons in Ideological Debates , 2014, EMNLP.

[14]  Timothy Baldwin,et al.  Collective Classification of Congressional Floor-Debate Transcripts , 2011, ACL.

[15]  Chang Li,et al.  Structured Representation Learning for Online Debate Stance Prediction , 2018, COLING.

[16]  Tiejun Zhao,et al.  Question Generation With Doubly Adversarial Nets , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  Ramakrishnan Srikant,et al.  Mining newsgroups using networks arising from social behavior , 2003, WWW '03.

[18]  Soroush Vosoughi,et al.  Automatic Detection and Categorization of Election-Related Tweets , 2016, ICWSM.

[19]  Vasu Sharma,et al.  Segmentation Guided Attention Networks for Visual Question Answering , 2017, ACL.

[20]  Xiaojun Wan,et al.  Abstractive Document Summarization with a Graph-Based Attentional Neural Model , 2017, ACL.

[21]  Balaraman Ravindran,et al.  Diversity driven attention model for query-based abstractive summarization , 2017, ACL.

[22]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[23]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[24]  Guido Zarrella,et al.  MITRE at SemEval-2016 Task 6: Transfer Learning for Stance Detection , 2016, *SEMEVAL.

[25]  Guodong Zhou,et al.  Exploring Various Linguistic Features for Stance Detection , 2016, NLPCC/ICCPOL.

[26]  Xiao Zhang,et al.  pkudblab at SemEval-2016 Task 6 : A Specific Convolutional Neural Network System for Effective Stance Detection , 2016, *SEMEVAL.

[27]  Preslav Nakov,et al.  Automatic Stance Detection Using End-to-End Memory Networks , 2018, NAACL.

[28]  James R. Foulds,et al.  Joint Models of Disagreement and Stance in Online Debate , 2015, ACL.

[29]  Ruifeng Xu,et al.  Stance Classification with Target-specific Neural Attention , 2017, IJCAI.

[30]  ˇ FilipBoltu Back up your Stance: Recognizing Arguments in Online Discussions , 2014 .

[31]  Naoaki Okazaki,et al.  Predicting Stances from Social Media Posts using Factorization Machines , 2018, COLING.

[32]  Cécile Paris,et al.  Cross-Target Stance Classification with Self-Attention Networks , 2018, ACL.

[33]  Vincent Ng,et al.  Stance Classification of Ideological Debates: Data, Models, Features, and Constraints , 2013, IJCNLP.

[34]  Dejing Dou,et al.  A Joint Sentiment-Target-Stance Model for Stance Classification in Tweets , 2016, COLING.

[35]  Wei Wang,et al.  Multi-Granularity Hierarchical Attention Fusion Networks for Reading Comprehension and Question Answering , 2018, ACL.

[36]  Mirella Lapata,et al.  Document Modeling with External Attention for Sentence Extraction , 2018, ACL.

[37]  Matt Thomas,et al.  Get out the vote: Determining support or opposition from Congressional floor-debate transcripts , 2006, EMNLP.

[38]  Saif Mohammad,et al.  Detecting Stance in Tweets And Analyzing its Interaction with Sentiment , 2016, *SEMEVAL.

[39]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[40]  Marilyn A. Walker,et al.  Cats Rule and Dogs Drool!: Classifying Stance in Online Debate , 2011, WASSA@ACL.

[41]  Kalina Bontcheva,et al.  Stance Detection with Bidirectional Conditional Encoding , 2016, EMNLP.

[42]  Min Zhang,et al.  Incorporating Statistical Machine Translation Word Knowledge Into Neural Machine Translation , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.