And That’s A Fact: Distinguishing Factual and Emotional Argumentation in Online Dialogue

We investigate the characteristics of factual and emotional argumentation styles observed in online debates. Using an annotated set of "factual" and "feeling" debate forum posts, we extract patterns that are highly correlated with factual and emotional arguments, and then apply a bootstrapping methodology to find new patterns in a larger pool of unannotated forum posts. This process automatically produces a large set of patterns representing linguistic expressions that are highly correlated with factual and emotional language. Finally, we analyze the most discriminating patterns to better understand the defining characteristics of factual and emotional arguments.

[1]  Soo-Min Kim,et al.  Determining the Sentiment of Opinions , 2004, COLING.

[2]  Janyce Wiebe,et al.  RECOGNIZING STRONG AND WEAK OPINION CLAUSES , 2006, Comput. Intell..

[3]  William L. Benoit.  Argument and Credibility Appeals in Persuasion. , 1987 .

[4]  M. Inés Torres,et al.  Extracting relevant knowledge for the detection of sarcasm and nastiness in the social web , 2014, Knowl. Based Syst..

[5]  Sanda M. Harabagiu,et al.  EmpaTweet: Annotating and Detecting Emotions on Twitter , 2012, LREC.

[6]  Ellen Riloff,et al.  Creating Subjective and Objective Sentence Classifiers from Unannotated Texts , 2005, CICLing.

[7]  J. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986 .

[8]  S. Chaiken,et al.  An attribution analysis of the effect of communicator characteristics on opinion change: The case of communicator attractiveness. , 1975 .

[9]  Claire Cardie,et al.  Identifying Appropriate Support for Propositions in Online User Comments , 2014, ArgMining@ACL.

[10]  Ellen Riloff,et al.  An Introduction to the Sundance and AutoSlog Systems , 2011 .

[11]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[12]  Claire Cardie,et al.  Context-aware Learning for Sentence-level Sentiment Analysis with Posterior Regularization , 2014, ACL.

[13]  Janyce Wiebe,et al.  Identifying Collocations for Recognizing Opinions , 2001 .

[14]  Chris Reed,et al.  Araucaria: Software for Argument Analysis, Diagramming and Representation , 2004, Int. J. Artif. Intell. Tools.

[15]  Chris Reed,et al.  From Big Data to Argument Analysis and Automated Extraction: A Selective Study of Argument in the Philosophy of Animal Psychology from the Volumes of the Hathi Trust Collection , 2014 .

[16]  S. Chaiken.  Heuristic versus systematic information processing and the use of source versus message cues in persuasion. , 1980 .

[17]  Hong Yu,et al.  Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences , 2003, EMNLP.

[18]  Scott Counts,et al.  Modeling Ideology and Predicting Policy Change with Social Media: Case of Same-Sex Marriage , 2015, CHI.

[19]  Marilyn A. Walker,et al.  Really? Well. Apparently Bootstrapping Improves the Performance of Sarcasm and Nastiness Classifiers for Online Dialogue , 2013, ArXiv.

[20]  William L. Benoit,et al.  On reluctant testimony , 1999 .

[21]  Marilyn A. Walker,et al.  A Corpus for Research on Deliberation and Debate , 2012, LREC.

[22]  Matt Thomas,et al.  Get out the vote: Determining support or opposition from Congressional floor-debate transcripts , 2006, EMNLP.

[23]  D. Walton,et al.  Emotive Language in Argumentation , 2014 .

[24]  Ellen Riloff,et al.  Exploiting Subjectivity Classification to Improve Information Extraction , 2005, AAAI.

[25]  Charles D. Barrett.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[26]  R. Cialdini.  Influence: Science and Practice , 1984 .

[27]  James Pustejovsky,et al.  FactBank: a corpus annotated with event factuality , 2009, Lang. Resour. Evaluation.

[28]  Swapna Somasundaran,et al.  Recognizing Stances in Online Debates , 2009, ACL.

[29]  Jean E. Fox Tree,et al.  Discourse Markers across Speakers and Settings , 2010, Lang. Linguistics Compass.

[30]  Saif Mohammad,et al.  Portable Features for Classifying Emotional Text , 2012, NAACL.

[31]  Avi Rosenfeld,et al.  First Steps in Chat-Based Negotiating Agents , 2015, Next Frontier in Agent-Based Complex Automated Negotiation.

[32]  Sarit Kraus,et al.  Providing Arguments in Discussions Based on the Prediction of Human Argumentative Behavior , 2015, AAAI.

[33]  Saif Mohammad,et al.  #Emotional Tweets , 2012, *SEMEVAL.

[34]  H. Kelman.  PROCESSES OF OPINION CHANGE , 1961 .

[35]  Claire Cardie,et al.  Joint Inference for Fine-grained Opinion Extraction , 2013, ACL.

[36]  Ellen Riloff,et al.  Learning Extraction Patterns for Subjective Expressions , 2003, EMNLP.

[37]  J. Cacioppo,et al.  Personal involvement as a determinant of argument based persuasion , 1981 .

[38]  Dragomir R. Radev,et al.  What’s with the Attitude? Identifying Sentences with Attitude in Online Discussions , 2010, EMNLP.

[39]  J. Shand,et al.  The Place of Emotion in Argument , 1995 .

[40]  Clinton Burfoot,et al.  Using Multiple Sources of Agreement Information for Sentiment Classification of Political Transcripts , 2008, ALTA.

[41]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[42]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.

[43]  Claire Cardie,et al.  Active learning for e-rulemaking: public comment categorization , 2008, DG.O.

[44]  Dan Jurafsky,et al.  Automatic Extraction of Opinion Propositions and their Holders , 2004 .

[45]  Owen Rambow,et al.  Identifying Justifications in Written Dialogs , 2011, 2011 IEEE Fifth International Conference on Semantic Computing.

[46]  G. Marwell,et al.  Dimensions of Compliance-Gaining Behavior: An Empirical Analysis , 1967 .

[47]  Ellen Riloff,et al.  Bootstrapped Learning of Emotion Hashtags #hashtags4you , 2013, WASSA@NAACL-HLT.

[48]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[49]  Ellen Spertus,et al.  Smokey: Automatic Recognition of Hostile Messages , 1997, AAAI/IAAI.

[50]  William L. Benoit.  Argumentation in Miranda v. Arizona , 1991 .

[51]  J. Cacioppo,et al.  Effects of need for cognition on message evaluation, recall, and persuasion. , 1983 .

[52]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[53]  Janyce Wiebe,et al.  Learning Subjective Language , 2004, CL.

[54]  Ellen Riloff,et al.  Automatically Generating Extraction Patterns from Untagged Text , 1996, AAAI/IAAI, Vol. 2.

[55]  Swapna Somasundaran,et al.  Recognizing Stances in Ideological On-Line Debates , 2010, HLT-NAACL 2010.