Interactional Stancetaking in Online Forums

Language is shaped by the relationships between the speaker/writer and the audience, the object of discussion, and the talk itself. In turn, language is used to reshape these relationships over the course of an interaction. Computational researchers have succeeded in operationalizing sentiment, formality, and politeness, but each of these constructs captures only some aspects of social and relational meaning. Theories of interactional stancetaking have been put forward as holistic accounts, but until now, these theories have been applied only through detailed qualitative analysis of (portions of) a few individual conversations. In this article, we propose a new computational operationalization of interpersonal stancetaking. We begin with annotations of three linked stance dimensions—affect, investment, and alignment—on 68 conversation threads from the online platform Reddit. Using these annotations, we investigate thread structure and linguistic properties of stancetaking in online conversations. We identify lexical features that characterize the extremes along each stancetaking dimension, and show that these stancetaking properties can be predicted with moderate accuracy from bag-of-words features, even with a relatively small labeled training set. These quantitative analyses are supplemented by extensive qualitative analysis, highlighting the compatibility of computational and qualitative methods in synthesizing evidence about the creation of interactional meaning.

[1]  Elinor Ochs Constructing Social Identity: A Language Socialization Perspective , 1993 .

[2]  Jennifer Preece,et al.  Sociability and usability in online communities: Determining and measuring success , 2001, Behav. Inf. Technol..

[3]  Andrei Popescu-Belis,et al.  What are discourse markers ? , 2003 .

[4]  Kira Hall,et al.  Identity and interaction: a sociocultural linguistic approach , 2005, Discourse Studies.

[5]  Jacob Eisenstein,et al.  "You're Mr. Lebowski, I'm the Dude": Inducing Address Term Formality in Signed Social Networks , 2015, HLT-NAACL.

[6]  Jack Sidnell,et al.  Conversation Analysis: List of tables , 2009 .

[7]  F. Maxwell Harper,et al.  Facts or friends?: distinguishing informational and conversational questions in social Q&A sites , 2009, CHI.

[8]  Scott F. Kiesling,et al.  Style as Stance , 2009 .

[9]  Variation and the indexical field , 1970 .

[10]  Ellen Riloff,et al.  Learning Extraction Patterns for Subjective Expressions , 2003, EMNLP.

[11]  Michael P. Lempert The poetics of stance: Text-metricality, epistemicity, interaction , 2008, Language in Society.

[12]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[13]  E. Goffman,et al.  Forms of talk , 1982 .

[14]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[15]  P. Eckert,et al.  Think Practically and Look Locally: Language and Gender as Community-Based Practice , 1992 .

[16]  Douglas Biber,et al.  Historical patterns for the grammatical marking of stance: A cross-register comparison , 2004 .

[17]  Kathy McKeown,et al.  I Couldn't Agree More: The Role of Conversational Structure in Agreement and Disagreement Detection in Online Discussions , 2015, SIGDIAL Conference.

[18]  Owen Rambow,et al.  Automatic Committed Belief Tagging , 2010, COLING.

[19]  Margaret L. Kern,et al.  Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach , 2013, PloS one.

[20]  Owen Rambow,et al.  Predicting Overt Display of Power in Written Dialogs , 2012, NAACL.

[21]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[22]  S. Levinson Activity types and language , 1979, Linguistics.

[23]  Harvey Sacks,et al.  Lectures on Conversation , 1995 .

[24]  E. Schegloff,et al.  Opening up Closings , 1973 .

[25]  Kristen Precht,et al.  Stance moods in spoken English: Evidentiality and affect in British and American conversation* , 2003 .

[26]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[27]  Siobhan Chapman Logic and Conversation , 2005 .

[28]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[29]  T. Keisanen Stancetaking as an interactional activity : Challenging the prior speaker , 2007 .

[30]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 2015 .

[31]  Mary McGee Wood,et al.  A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue , 2004, ADS.

[32]  Marilyn A. Walker,et al.  Stance Classification using Dialogic Properties of Persuasion , 2012, NAACL.

[33]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[34]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[35]  Paul Kockelman Stance and Subjectivity , 2004 .

[36]  James Pustejovsky,et al.  FactBank: a corpus annotated with event factuality , 2009, Lang. Resour. Evaluation.

[37]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[38]  Joel R. Tetreault,et al.  An Empirical Analysis of Formality in Online Communication , 2016, TACL.

[39]  Elise Kärkkäinen,et al.  Stance taking in conversation: From subjectivity to intersubjectivity , 2006 .

[40]  John R. Searle,et al.  Speech Acts: An Essay in the Philosophy of Language , 1970 .

[41]  P. Eckert Linguistic variation as social practice , 2000 .

[42]  Cliff Lampe,et al.  Follow the (slash) dot: effects of feedback on new members in an online community , 2005, GROUP.

[43]  K. Scherer What are emotions? And how can they be measured? , 2005 .

[44]  Harvey Sacks,et al.  Lectures on Conversation: Sacks/Lectures on Conversation , 1995 .

[45]  Jennifer Preece,et al.  A multilevel analysis of sociability, usability, and community dynamics in an online health community , 2005, TCHI.

[46]  Mari Ostendorf,et al.  Conversation Modeling on Reddit Using a Graph-Structured LSTM , 2017, TACL.

[47]  Manuela Herman,et al.  Rethinking Context Language As An Interactive Phenomenon , 2016 .

[48]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[49]  Jon M. Kleinberg,et al.  Characterizing and curating conversation threads: expansion, focus, volume, re-entry , 2013, WSDM.

[50]  Jacob Eisenstein,et al.  What to do about bad language on the internet , 2013, NAACL.

[51]  Jure Leskovec,et al.  A computational approach to politeness with application to social factors , 2013, ACL.

[52]  P. White Beyond modality and hedging: A dialogic view of the language of intersubjective stance , 2003 .

[53]  D. Biber,et al.  Styles of stance in English: Lexical and grammatical marking of evidentiality and affect , 1989 .

[54]  Kristina Lerman,et al.  Evolution of Conversations in the Age of Email Overload , 2015, WWW.

[55]  Klaus Krippendorff,et al.  Computing Krippendorff's Alpha-Reliability , 2011 .

[56]  Yue Zhang,et al.  Context-Sensitive Twitter Sentiment Classification Using Neural Network , 2016, AAAI.

[57]  Loren G. Terveen,et al.  The dynamics of mass interaction , 1998, CSCW '98.

[58]  M. Thelwall,et al.  Sentiment Strength Detection in Short Informal Text 1 , 2010 .

[59]  Elise Kärkkäinen,et al.  Taking a stance on emotion: affect, sequence, and intersubjectivity in dialogic interaction , 2012 .

[60]  Marilyn A. Walker,et al.  Cats Rule and Dogs Drool!: Classifying Stance in Online Debate , 2011, WASSA@ACL.

[61]  Louis-Philippe Morency,et al.  MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos , 2016, ArXiv.

[62]  H. Giles,et al.  Contexts of Accommodation: Developments in Applied Sociolinguistics , 2010 .

[63]  Philip J. Stone,et al.  Extracting Information. (Book Reviews: The General Inquirer. A Computer Approach to Content Analysis) , 1967 .

[64]  William L. Hamilton,et al.  Language from police body camera footage shows racial disparities in officer respect , 2017, Proceedings of the National Academy of Sciences.

[65]  Owen Rambow,et al.  Committed Belief Tagging on the Factbank and LU Corpora: A Comparative Study , 2015 .

[66]  Francis Bach,et al.  SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives , 2014, NIPS.

[67]  P. Eckert Variation and the indexical field 1 , 2008 .

[68]  John W. Du Bois The stance triangle , 2007 .

[69]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[70]  Jacob Eisenstein,et al.  A Multidimensional Lexicon for Interpersonal Stancetaking , 2017, ACL.

[71]  Saif Mohammad,et al.  SemEval-2016 Task 6: Detecting Stance in Tweets , 2016, *SEMEVAL.

[72]  S. Kiesling Masculine stances and the linguistics of affect: on masculine ease , 2018 .

[73]  Maite Taboada,et al.  Evaluative Language Beyond Bags of Words: Linguistic Insights and Computational Applications , 2017, CL.

[74]  Ravi Kumar,et al.  Dynamics of conversations , 2010, KDD.

[75]  A. Jaffe Stance: Sociolinguistic Perspectives , 2009 .

[76]  Elisabeth Ahlsén,et al.  Some Suggestions for the Study of Stance in Communication , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[77]  Charles Goodwin,et al.  Participation, stance and affect in the organization of activities , 2007 .