Automatic Sarcasm Detection

Automatic sarcasm detection is the task of predicting sarcasm in text. This is a crucial step to sentiment analysis, considering prevalence and challenges of sarcasm in sentiment-bearing text. Beginning with an approach that used speech-based features, automatic sarcasm detection has witnessed great interest from the sentiment analysis community. This article is a compilation of past work in automatic sarcasm detection. We observe three milestones in the research so far: semi-supervised pattern extraction to identify implicit sentiment, use of hashtag-based supervision, and incorporation of context beyond target text. In this article, we describe datasets, approaches, trends, and issues in sarcasm detection. We also discuss representative performance values, describe shared tasks, and provide pointers to future work, as given in prior works. In terms of resources to understand the state-of-the-art, the survey presents several useful illustrations—most prominently, a table that summarizes past papers along different dimensions such as the types of features, annotation techniques, and datasets used.

[1]  Tony Veale,et al.  Detecting Ironic Intent in Creative Comparisons , 2010, ECAI.

[2]  Sanjay Kumar Jena,et al.  Parsing-based sarcasm sentiment recognition in Twitter data , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[3]  Pushpak Bhattacharyya,et al.  Your Sentiment Precedes You: Using an author’s historical tweets to predict sarcasm , 2015, WASSA@EMNLP.

[4]  Pushpak Bhattacharyya,et al.  Automatic Sarcasm Detection: A Survey , 2016 .

[5]  Nathalie Aussenac-Gilles,et al.  Exploring the Impact of Pragmatic Phenomena on Irony Detection in Tweets: A Multilingual Corpus Study , 2017, EACL.

[6]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[7]  R. Kreuz,et al.  How to be sarcastic: The echoic reminder theory of verbal irony. , 1989 .

[8]  Tomoaki Ohtsuki,et al.  Opinion mining in Twitter: How to make use of sarcasm to enhance sentiment analysis , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[9]  Debanjan Ghosh,et al.  Sarcastic or Not: Word Embeddings to Predict the Literal or Sarcastic Meaning of Words , 2015, EMNLP.

[10]  Paolo Rosso,et al.  SemEval-2015 Task 11: Sentiment Analysis of Figurative Language in Twitter , 2015, *SEMEVAL.

[11]  R. Giora On irony and negation , 1995 .

[12]  Penny M. Pexman,et al.  Context Incongruity and Irony Processing , 2003 .

[13]  Elisabetta Fersini,et al.  Detecting irony and sarcasm in microblogs: The role of expressive signals and ensemble classifiers , 2015, 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[14]  Ellen Riloff,et al.  Sarcasm as Contrast between a Positive Sentiment and Negative Situation , 2013, EMNLP.

[15]  Pushpak Bhattacharyya,et al.  'Who would have thought of that!': A Hierarchical Topic Model for Extraction of Sarcasm-prevalent Topics and Sarcasm Detection , 2016, ArXiv.

[16]  Edward Nelson,et al.  Syntax and Semantics , 1974 .

[17]  Pushpak Bhattacharyya,et al.  Harnessing Sequence Labeling for Sarcasm Detection in Dialogue from TV Series ‘Friends’ , 2016, CoNLL.

[18]  Zhijian Wu,et al.  Twitter Sarcasm Detection Exploiting a Context-Based Model , 2015, WISE.

[19]  Roi Reichart,et al.  Sarcasm SIGN: Interpreting Sarcasm with Sentiment Based Monolingual Machine Translation , 2017, ACL.

[20]  Paolo Rosso,et al.  Figurative messages and affect in Twitter: Differences between #irony, #sarcasm and #not , 2016, Knowl. Based Syst..

[21]  Antal van den Bosch,et al.  The perfect solution for detecting sarcasm in tweets #not , 2013, WASSA@NAACL-HLT.

[22]  A. Katz,et al.  Are There Necessary Conditions for Inducing a Sense of Sarcastic Irony? , 2012 .

[23]  David Bamman,et al.  Contextualized Sarcasm Detection on Twitter , 2015, ICWSM.

[24]  Andrew Rosenberg,et al.  "sure, I Did the Right Thing": a System for Sarcasm Detection in Speech , 2013, INTERSPEECH.

[25]  Po-Ya Angela Wang #Irony or #Sarcasm — A Quantitative and Qualitative Study Based on Twitter , 2013, PACLIC.

[26]  Marilyn A. Walker,et al.  Really? Well. Apparently Bootstrapping Improves the Performance of Sarcasm and Nastiness Classifiers for Online Dialogue , 2013, ArXiv.

[27]  Tomoaki Ohtsuki,et al.  Sarcasm Detection in Twitter: "All Your Products Are Incredibly Amazing!!!" - Are They Really? , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[28]  Dimitris Spathis,et al.  A comparison between semi-supervised and supervised text mining techniques on detecting irony in greek political tweets , 2016, Eng. Appl. Artif. Intell..

[29]  Dirk Hovy,et al.  Putting Sarcasm Detection into Context: The Effects of Class Imbalance and Manual Labelling on Supervised Machine Classification of Twitter Conversations , 2016, ACL.

[30]  Paolo Rosso,et al.  Irony Detection in Twitter , 2016, ACM Trans. Internet Techn..

[31]  Paolo Rosso,et al.  Applying Basic Features from Sentiment Analysis for Automatic Irony Detection , 2015, IbPRIA.

[32]  Pushpak Bhattacharyya,et al.  How Do Cultural Differences Impact the Quality of Sarcasm Annotation?: A Case Study of Indian Annotators and American Text , 2016, LaTeCH@ACL.

[33]  Preslav Nakov,et al.  SemEval-2014 Task 9: Sentiment Analysis in Twitter , 2014, *SEMEVAL.

[34]  Pradip Kumar Bala,et al.  Sarcasm detection in microblogs using Naïve Bayes and fuzzy clustering , 2017 .

[35]  Nina Wacholder,et al.  Identifying Sarcasm in Twitter: A Closer Look , 2011, ACL.

[36]  共立出版株式会社 コンピュータ・サイエンス : ACM computing surveys , 1978 .

[37]  Peng Liu,et al.  Sarcasm Detection in Social Media Based on Imbalanced Classification , 2014, WAIM.

[38]  Dan Sperber,et al.  Verbal irony: Pretense or echoic mention? , 1984 .

[39]  Paolo Rosso,et al.  A multidimensional approach for detecting irony in Twitter , 2013, Lang. Resour. Evaluation.

[40]  Ari Rappoport,et al.  ICWSM - A Great Catchy Name: Semi-Supervised Recognition of Sarcastic Sentences in Online Product Reviews , 2010, ICWSM.

[41]  Madhav M. Deshpande,et al.  Indian Linguistic Studies: Festschrift in Honor of George Cardona , 2002 .

[42]  Ayu Purwarianti,et al.  Indonesian social media sentiment analysis with sarcasm detection , 2013, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[43]  Byron C. Wallace,et al.  Modelling Context with User Embeddings for Sarcasm Detection in Social Media , 2016, CoNLL.

[44]  Deirdre Wilson,et al.  The pragmatics of verbal irony: Echo or pretence? , 2006 .

[45]  R. Gibbs,et al.  Psychological aspects of irony understanding , 1991 .

[46]  R. Gibbs The Poetics of Mind: Figurative Thought, Language, and Understanding , 1994 .

[47]  Horacio Saggion,et al.  Modelling Irony in Twitter: Feature Analysis and Evaluation , 2014, LREC.

[48]  Pushpak Bhattacharyya,et al.  Harnessing Cognitive Features for Sarcasm Detection , 2016, ACL.

[49]  Byron C. Wallace Computational irony: A survey and new perspectives , 2013, Artificial Intelligence Review.

[50]  Reza Zafarani,et al.  Sarcasm Detection on Twitter: A Behavioral Modeling Approach , 2015, WSDM.

[51]  Zsófia Zvolenszky,et al.  A Gricean Rearrangement of Epithets , 2012 .

[52]  Marilyn A. Walker,et al.  A Corpus for Research on Deliberation and Debate , 2012, LREC.

[53]  David R. Traum,et al.  "yeah Right": Sarcasm Recognition for Spoken Dialogue Systems , 2006, INTERSPEECH.

[54]  Paolo Rosso,et al.  On the difficulty of automatically detecting irony: beyond a simple case of negation , 2014, Knowledge and Information Systems.

[55]  Albert N. Katz,et al.  The Differential Role of Ridicule in Sarcasm and Irony , 1998 .

[56]  Arthur C. Graesser,et al.  Wit and humor in discourse processing , 1988 .

[57]  Nina Wacholder,et al.  Identification of nonliteral language in social media: A case study on sarcasm , 2016, J. Assoc. Inf. Sci. Technol..

[58]  Pushpak Bhattacharyya,et al.  Are Word Embedding-based Features Useful for Sarcasm Detection? , 2016, EMNLP.

[59]  Jun Hong,et al.  Sarcasm Detection on Czech and English Twitter , 2014, COLING.

[60]  Mikhail Khodak,et al.  A Large Self-Annotated Corpus for Sarcasm , 2017, LREC.

[61]  Diana Maynard,et al.  Who cares about Sarcastic Tweets? Investigating the Impact of Sarcasm on Sentiment Analysis. , 2014, LREC.

[62]  Byron C. Wallace,et al.  Sparse, Contextually Informed Models for Irony Detection: Exploiting User Communities, Entities and Sentiment , 2015, ACL.

[63]  Pushpak Bhattacharyya,et al.  Harnessing Context Incongruity for Sarcasm Detection , 2015, ACL.

[64]  Elena Filatova,et al.  Irony and Sarcasm: Corpus Generation and Analysis Using Crowdsourcing , 2012, LREC.

[65]  Ari Rappoport,et al.  Semi-Supervised Recognition of Sarcasm in Twitter and Amazon , 2010, CoNLL.

[66]  Paolo Rosso,et al.  Making objective decisions from subjective data: Detecting irony in customer reviews , 2012, Decis. Support Syst..

[67]  Elisabeth Camp Sarcasm, Pretense, and The Semantics/ Pragmatics Distinction ∗ , 2012 .

[68]  S. Stieger,et al.  Humor styles and their relationship to explicit and implicit self-esteem , 2011 .

[69]  Diana Boxer,et al.  Reactions to irony in discourse: evidence for the least disruption principle , 2006 .

[70]  Erik Cambria,et al.  A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks , 2016, COLING.

[71]  Horacio Saggion,et al.  Modelling Sarcasm in Twitter, a Novel Approach , 2014, WASSA@ACL.

[72]  Byron C. Wallace,et al.  Humans Require Context to Infer Ironic Intent (so Computers Probably do, too) , 2014, ACL.

[73]  Tony Veale,et al.  Fracking Sarcasm using Neural Network , 2016, WASSA@NAACL-HLT.

[74]  José Saias,et al.  Senti.ue: Tweet Overall Sentiment Classification Approach for SemEval-2014 Task 9 , 2014, *SEMEVAL.

[75]  Philipp Cimiano,et al.  An Impact Analysis of Features in a Classification Approach to Irony Detection in Product Reviews , 2014, WASSA@ACL.

[76]  R. Kreuz,et al.  Lexical Influences on the Perception of Sarcasm , 2007 .

[77]  Davide Buscaldi,et al.  From humor recognition to irony detection: The figurative language of social media , 2012, Data Knowl. Eng..