Is Something Better than Nothing? Automatically Predicting Stance-based Arguments Using Deep Learning and Small Labelled Dataset

© 2018 Association for Computational Linguistics. Online reviews have become a popular portal among customers making decisions about purchasing products. A number of corpora of reviews have been widely investigated in NLP in general, and, in particular, in argument mining. This is a subset of NLP that deals with extracting arguments and the relations among them from user-based content. A major problem faced by argument mining research is the lack of human-annotated data. In this paper, we investigate the use of weakly supervised and semi-supervised methods for automatically annotating data, and thus providing large annotated datasets. We do this by building on previous work that explores the classification of opinions present in reviews based on whether the stance is expressed explicitly or implicitly. In the work described here, we automatically annotate stance as implicit or explicit and our results show that the datasets we generate, although noisy, can be used to learn better models for implicit/explicit opinion classification.

[1]  Graeme Hirst,et al.  Argumentation Mining in Parliamentary Discourse , 2015, PRIMA Workshops.

[2]  Danushka Bollegala,et al.  Identifying Argument based Relation Properties in Opinions , 2017 .

[3]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Claire Cardie,et al.  Identifying Appropriate Support for Propositions in Online User Comments , 2014, ArgMining@ACL.

[6]  Jan Snajder,et al.  Back up your Stance: Recognizing Arguments in Online Discussions , 2014, ArgMining@ACL.

[7]  Nina Wacholder,et al.  Analyzing Argumentative Discourse Units in Online Interactions , 2014, ArgMining@ACL.

[8]  Iryna Gurevych,et al.  Exploiting Debate Portals for Semi-Supervised Argumentation Mining in User-Generated Web Discourse , 2015, EMNLP.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  Iryna Gurevych,et al.  Which argument is more convincing? Analyzing and predicting convincingness of Web arguments using bidirectional LSTM , 2016, ACL.

[11]  Zhiguang Liu,et al.  Reserved Self-training: A Semi-supervised Sentiment Classification Method for Chinese Microblogs , 2013, IJCNLP.

[12]  Benno Stein,et al.  A Review Corpus for Argumentation Analysis , 2014, CICLing.

[13]  Trevor J. M. Bench-Capon,et al.  Semi-Automated Argumentative Analysis of Online Product Reviews , 2012, COMMA.

[14]  Iryna Gurevych,et al.  Neural End-to-End Learning for Computational Argumentation Mining , 2017, ACL.

[15]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[17]  Benno Stein,et al.  The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants , 2017, NAACL.

[18]  Paolo Torroni,et al.  Argumentation Mining , 2016, ACM Trans. Internet Techn..

[19]  Owen Rambow,et al.  Identifying Justifications in Written Dialogs , 2011, 2011 IEEE Fifth International Conference on Semantic Computing.

[20]  Ana Gabriela Maguitman,et al.  Integrating argumentation and sentiment analysis for mining opinions from Twitter , 2015, AI Commun..

[21]  Patrick Saint-Dizier,et al.  A Framework to Extract Arguments in Opinion Texts , 2012, Int. J. Cogn. Informatics Nat. Intell..

[22]  Serena Villata,et al.  Combining Textual Entailment and Argumentation Theory for Supporting Online Debates Interactions , 2012, ACL.

[23]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[24]  Danushka Bollegala,et al.  Assessing Weight of Opinion by Aggregating Coalitions of Arguments , 2016, COMMA.

[25]  Claire Cardie,et al.  Weakly Supervised Natural Language Learning Without Redundant Views , 2003, NAACL.

[26]  Danushka Bollegala,et al.  Contextual stance classification of opinions: A step towards enthymeme reconstruction in online reviews , 2016, ArgMining@ACL.

[27]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[28]  Matthias Hagen,et al.  Cross-Domain Mining of Argumentative Text through Distant Supervision , 2016, NAACL.

[29]  Douglas Biber,et al.  Adverbial stance types in English , 1988 .

[30]  Vibhu O. Mittal,et al.  Comparative Experiments on Sentiment Classification for Online Product Reviews , 2006, AAAI.

[31]  Marie-Francine Moens,et al.  Argumentation mining: the detection, classification and structure of arguments in text , 2009, ICAIL.

[32]  Serena Villata,et al.  DART: a Dataset of Arguments and their Relations on Twitter , 2016, LREC.

[33]  Anthony Hunter,et al.  Representing and Reasoning About Arguments Mined from Texts and Dialogues , 2015, ECSQARU.

[34]  Francesco Santini,et al.  A Micro Study on the Evolution of Arguments in Amazon.com's Reviews , 2015, PRIMA.

[35]  Francesca Toni,et al.  Argument Mining and Social Debates , 2014, COMMA.