Is This Post Persuasive? Ranking Argumentative Comments in Online Forum

In this paper we study how to identify persuasive posts in the online forum discussions, using data from Change My View sub-Reddit. Our analysis confirms that the users’ voting score for a comment is highly correlated with its metadata information such as published time and author reputation. In this work, we propose and evaluate other features to rank comments for their persuasive scores, including textual information in the comments and social interaction related features. Our experiments show that the surface textual features do not perform well compared to the argumentation based features, and the social interaction based features are effective especially when more users participate in the discussion.

[1]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[2]  Mari Ostendorf,et al.  Talking to the crowd: What do people react to in online discussions? , 2015, EMNLP.

[3]  Ani Nenkova,et al.  What Makes Writing Great? First Experiments on Article Quality Prediction in the Science Journalism Domain , 2013, TACL.

[4]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR '00.

[5]  Rajeev Sangal,et al.  Stance Classification in Online Debates by Recognizing Users’ Intentions , 2013, SIGDIAL Conference.

[6]  Swapna Somasundaran,et al.  Recognizing Stances in Ideological On-Line Debates , 2010, HLT-NAACL 2010.

[7]  Vincent Ng,et al.  Why are You Taking this Stance? Identifying and Classifying Reasons in Ideological Debates , 2014, EMNLP.

[8]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[9]  Vasudeva Varma,et al.  Online debate summarization using topic directed sentiment analysis , 2013, WISDOM '13.

[10]  Iryna Gurevych,et al.  Identifying Argumentative Discourse Structures in Persuasive Essays , 2014, EMNLP.

[11]  Cristian Danescu-Niculescu-Mizil,et al.  Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussions , 2016, WWW.

[12]  Gözde Özbal,et al.  Echoes of Persuasion: The Effect of Euphony in Persuasive Communication , 2015, NAACL.

[13]  Cody Buntain,et al.  Identifying social roles in reddit using network structure , 2014, WWW.

[14]  Amine Trabelsi,et al.  Finding Arguing Expressions of Divergent Viewpoints in Online Debates , 2014 .

[15]  Niklas Elmqvist,et al.  Supporting Comment Moderators in Identifying High Quality Online News Comments , 2016, CHI.

[16]  Bo Pang,et al.  The effect of wording on message propagation: Topic- and author-controlled natural experiments on Twitter , 2014, ACL.