Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations

Online conversations can go in many directions: some turn out poorly due to antisocial behavior, while others turn out positively to the benefit of all. Research on improving online spaces has focused primarily on detecting and reducing antisocial behavior. Yet we know little about positive outcomes in online conversations and how to increase them—is a prosocial outcome simply the lack of antisocial behavior or something more? Here, we examine how conversational features lead to prosocial outcomes within online discussions. We introduce a series of new theory-inspired metrics to define prosocial outcomes such as mentoring and esteem enhancement. Using a corpus of 26M Reddit conversations, we show that these outcomes can be forecasted from the initial comment of an online conversation, with the best model providing a relative 24% improvement over human forecasting performance at ranking conversations for predicted outcome. Our results indicate that platforms can use these early cues in their algorithmic ranking of early conversations to prioritize better outcomes.

[1]  Jure Leskovec,et al.  Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks , 2019, KDD.

[2]  Thomas Ashby Wills,et al.  Social support and interpersonal relationships. , 1991 .

[3]  Lucas Dixon,et al.  Ex Machina: Personal Attacks Seen at Scale , 2016, WWW.

[4]  Yan Li,et al.  The associations between young adults' face-to-face prosocial behaviors and their online prosocial behaviors , 2011, Comput. Hum. Behav..

[5]  Michael S. Bernstein,et al.  Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussions , 2017, CSCW.

[6]  David Jurgens,et al.  A Just and Comprehensive Strategy for Using NLP to Address Online Abuse , 2019, ACL.

[7]  J. Bachorowski,et al.  Reconsidering the Evolution of Nonlinguistic Communication: The Case of Laughter , 2003 .

[8]  Anthony L. Burrow,et al.  How many likes did I get?: Purpose moderates links between positive social media feedback and self-esteem. , 2017 .

[9]  Ashish Sharma,et al.  A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support , 2020, EMNLP.

[10]  P. Taylor,et al.  Linguistic Style Matching and Negotiation Outcome , 2005 .

[11]  Cristian Danescu-Niculescu-Mizil,et al.  Conversations Gone Awry: Detecting Early Signs of Conversational Failure , 2018, ACL.

[12]  Alice H. Oh,et al.  Self-disclosure topic model for classifying and analyzing Twitter conversations , 2014, EMNLP.

[13]  John Yen,et al.  Pragmatic Alignment on Social Support Type in Health Forum Conversations , 2015, CMCL@NAACL-HLT.

[14]  Munmun De Choudhury,et al.  Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities , 2018, CHI.

[15]  Scott A. Hale,et al.  Challenges and frontiers in abusive content detection , 2019, Proceedings of the Third Workshop on Abusive Language Online.

[16]  Ingmar Weber,et al.  Understanding Abuse: A Typology of Abusive Language Detection Subtasks , 2017, ALW@ACL.

[17]  Beáta Nagy.  The psychology of gratitude , 2013 .

[18]  Maite Taboada,et al.  Constructive Language in News Comments , 2017, ALW@ACL.

[19]  William L. Hamilton,et al.  Language from police body camera footage shows racial disparities in officer respect , 2017, Proceedings of the National Academy of Sciences.

[20]  Caroline Brun,et al.  Steps Toward Automatic Understanding of the Function of Affective Language in Support Groups , 2016, SocialNLP@EMNLP.

[21]  P. Brown.  Politeness and language , 2015 .

[22]  J. Bachorowski,et al.  Not All Laughs are Alike: Voiced but Not Unvoiced Laughter Readily Elicits Positive Affect , 2001, Psychological science.

[23]  D. Quercia,et al.  Ten Social Dimensions of Conversations and Relationships , 2020, WWW.

[24]  J. N. Matias.  Preventing harassment and increasing group participation through social norms in 2,190 online science discussions , 2019, Proceedings of the National Academy of Sciences.

[25]  M. Prinstein,et al.  Forms and Functions of Adolescent Peer Aggression Associated With High Levels of Peer Status , 2003 .

[26]  Sérgio Nunes,et al.  A Survey on Automatic Detection of Hate Speech in Text , 2018, ACM Comput. Surv..

[27]  Julie J. Exline,et al.  Social exclusion decreases prosocial behavior. , 2007, Journal of personality and social psychology.

[28]  Maeve Duggan,et al.  Online Harassment 2017 , 2017 .

[29]  Munmun De Choudhury,et al.  Prevalence and Psychological Effects of Hateful Speech in Online College Communities , 2019, WebSci.

[30]  R. Berry.  You could say that: the generic second-person pronoun in modern English , 2009, English Today.

[31]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[32]  Lyle H. Ungar,et al.  Modeling Empathy and Distress in Reaction to News Stories , 2018, EMNLP.

[33]  Jure Leskovec,et al.  Antisocial Behavior on the Web: Characterization and Detection , 2017, WWW.

[34]  Michelle F. Wright,et al.  Prosocial Behaviors in the Cyber Context , 2012 .

[35]  Kevin Gimpel,et al.  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations , 2019, ICLR.

[36]  Rafael A. Calvo,et al.  CLPsych 2016 Shared Task: Triaging content in online peer-support forums , 2016, CLPsych@HLT-NAACL.

[37]  Azy Barak,et al.  Degree and Reciprocity of Self-Disclosure in Online Forums , 2007, Cyberpsychology Behav. Soc. Netw..

[38]  Barbara Poblete,et al.  Hate Speech Detection is Not as Easy as You May Think: A Closer Look at Model Validation , 2019, SIGIR.

[39]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[40]  Sara B. Algoe,et al.  Find, Remind, and Bind: The Functions of Gratitude in Everyday Relationships , 2012 .

[41]  Self Book.  Self Disclosure An Experimental Analysis Of The Transparent Self , 2016 .

[42]  David Huffman,et al.  The Impact of Social Ties on Group Interactions: Evidence from Minimal Groups and Randomly Assigned Real Groups , 2012 .

[43]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[44]  David Jurgens,et al.  Condolences and Empathy in Online Communities , 2020, EMNLP.

[45]  Darren Gergle,et al.  Linguistic mimicry and trust in text-based CMC , 2008, CSCW.

[46]  Jon M. Kleinberg,et al.  Echoes of power: language effects and power differences in social interaction , 2011, WWW.

[47]  Sarah T. Roberts.  Behind the screen: the hidden digital labor of commercial content moderation , 2014 .

[48]  Cheng Li,et al.  Find the Conversation Killers: A Predictive Study of Thread-ending Posts , 2017, WWW.

[49]  Mauro Conti,et al.  All You Need is "Love": Evading Hate Speech Detection , 2018, ArXiv.

[50]  Karl Aquino,et al.  A decline in prosocial language helps explain public disapproval of the US Congress , 2015, Proceedings of the National Academy of Sciences.

[51]  Cristian Danescu-Niculescu-Mizil,et al.  Trouble on the Horizon: Forecasting the Derailment of Online Conversations as they Develop , 2019, EMNLP.

[52]  Mehmet Fatih Çömlekçi.  Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media , 2019 .

[53]  Timothy S. Clark,et al.  Displaying Group Cohesiveness: Humour and Laughter in the Public Lectures of Management Gurus , 2003 .

[54]  A. Joinson.  Self‐disclosure in computer‐mediated communication: The role of self‐awareness and visual anonymity , 2001 .

[55]  Zijian Wang,et al.  It’s going to be okay: Measuring Access to Support in Online Communities , 2018, EMNLP.

[56]  Ping Liu,et al.  Forecasting the presence and intensity of hostility on Instagram using linguistic and social features , 2018, ICWSM.

[57]  Daniel Bar-Tal,et al.  Prosocial behavior: Theory and research , 1976 .

[58]  S. Gelman,et al.  How “you” makes meaning , 2017, Science.

[59]  John Yen,et al.  Identifying Emotional and Informational Support in Online Health Communities , 2014, COLING.

[60]  Lee Sproull,et al.  Prosocial Behavior on the Net , 2011, Daedalus.

[61]  Kelly Anderson,et al.  Prosocial Behavior , 2009 .

[62]  David Lazer,et al.  The rise of the social algorithm , 2015, Science.

[63]  Joel R. Tetreault,et al.  Automatically Identifying Good Conversations Online (Yes, They Do Exist!) , 2017, ICWSM.

[64]  Jonathon D. Brown,et al.  The Self and Social Conduct: Linking Self-Representations to Prosocial Behavior , 1991 .

[65]  Yejin Choi,et al.  The Risk of Racial Bias in Hate Speech Detection , 2019, ACL.

[66]  Taina Bucher,et al.  Want to be on the top? Algorithmic power and the threat of invisibility on Facebook , 2012, New Media Soc..

[67]  George A. Akerlof,et al.  Economics and Identity , 2000 .

[68]  Jeremy A. Frimer,et al.  Moral actor, selfish agent. , 2014, Journal of personality and social psychology.

[69]  Maite Taboada,et al.  Classifying Constructive Comments , 2020, ArXiv.

[70]  P. Mussen,et al.  Roots of caring, sharing, and helping: The development of pro-social behavior in children. , 1977 .

[71]  M. McCullough,et al.  Is gratitude a moral affect? , 2001, Psychological bulletin.

[72]  J. Pennebaker,et al.  Linguistic Style Matching in Social Interaction , 2002 .

[73]  A. Joinson,et al.  Self-disclosure, Privacy and the Internet , 2009 .

[74]  Lysandre Debut,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[75]  Joel R. Tetreault,et al.  Finding Good Conversations Online: The Yahoo News Annotated Comments Corpus , 2017, LAW@ACL.

[76]  Mark Snyder,et al.  Altruism and Prosocial Behavior , 2012 .

[77]  Jure Leskovec,et al.  A computational approach to politeness with application to social factors , 2013, ACL.