Sarcasm Detection Using Feature-Variant Learning Models

Sentiment Analysis is the text classification tool that analyses a sentiment, message, emotion, attitude and tells whether the sentiment is positive, negative or neutral. The prime challenging aspect of sentiment analysis is the presence of sarcasm in message. Sarcasm is one kind of sentiment that is expressed verbally through the use of rolling of eyes and tonal stress. It consist of words mean the opposite of what user want to convey in order to be funny, or to show some irritation. The active online users and their reviews on websites are large in number so it is hard to detect even for humans, so in order to achieve error-free sentiment analysis it is imperative for machines to detect it accurately. The paper proposes the use of three different classes of features to help computers identify sarcasm reasonably well. In this paper, we intend to implement and empirically analyze number of computing techniques like Support Vector Machine, Decision Trees, Logistic Regression, Random Forest, K-Nearest Neighbors and Neural Networks for sarcasm detection on social media. The experimentation was done using three datasets i.e. SemEval 2015 Twitter benchmark dataset; random tweets collected using the Streaming API and a publicly available dataset of Reddit posts. The datasets provide interesting insights into how different forms of social media use the tool of sarcasm differently. The evaluated results were based on the performance measures like precision, recall, accuracy and F score. Amongst all, Twitter datasets had achieved the highest accuracy of around 91% to 92%, while the Reddit dataset had obtained peak accuracy of 80%.

[1]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[2]  David Bamman,et al.  Contextualized Sarcasm Detection on Twitter , 2015, ICWSM.

[3]  Ari Rappoport,et al.  Semi-Supervised Recognition of Sarcasm in Twitter and Amazon , 2010, CoNLL.

[4]  Pravin Chandra,et al.  CONSTRUCTIVE NEURAL NETWORKS: A REVIEW , 2010 .

[5]  Ari Rappoport,et al.  ICWSM - A Great Catchy Name: Semi-Supervised Recognition of Sarcastic Sentences in Online Product Reviews , 2010, ICWSM.

[6]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[7]  Nina Wacholder,et al.  Identifying Sarcasm in Twitter: A Closer Look , 2011, ACL.

[8]  Jun Hong,et al.  Sarcasm Detection on Czech and English Twitter , 2014, COLING.

[9]  Björn W. Schuller,et al.  SenticNet 4: A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives , 2016, COLING.

[10]  Zhijian Wu,et al.  Twitter Sarcasm Detection Exploiting a Context-Based Model , 2015, WISE.

[11]  Tomoaki Ohtsuki,et al.  A Pattern-Based Approach for Sarcasm Detection on Twitter , 2016, IEEE Access.

[12]  Reza Zafarani,et al.  Sarcasm Detection on Twitter: A Behavioral Modeling Approach , 2015, WSDM.

[13]  Ellen Riloff,et al.  Sarcasm as Contrast between a Positive Sentiment and Negative Situation , 2013, EMNLP.

[14]  Pravin Chandra,et al.  Sentiment Predictions Using Deep Belief Networks Model for Odd-Even Policy in Delhi , 2016, Int. J. Synth. Emot..

[15]  Byron C. Wallace,et al.  Modelling Context with User Embeddings for Sarcasm Detection in Social Media , 2016, CoNLL.

[16]  Peng Liu,et al.  Sarcasm Detection in Social Media Based on Imbalanced Classification , 2014, WAIM.

[17]  Akshi Kumar,et al.  Sentiment analysis using neural network , 2016, 2016 2nd International Conference on Next Generation Computing Technologies (NGCT).

[18]  Sudhir Kumar Sharma,et al.  Sentiment Predictions using Support Vector Machines for Odd-Even Formula in Delhi , 2017 .

[19]  Sanjay Kumar Jena,et al.  Parsing-based sarcasm sentiment recognition in Twitter data , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[20]  Sudhir Kumar Sharma,et al.  Twitter sentiment analysis using various classification algorithms , 2016, 2016 5th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO).

[21]  Yue Zhang,et al.  Tweet Sarcasm Detection Using Deep Neural Network , 2016, COLING.

[22]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[23]  Paolo Rosso,et al.  Figurative messages and affect in Twitter: Differences between #irony, #sarcasm and #not , 2016, Knowl. Based Syst..

[24]  Antal van den Bosch,et al.  The perfect solution for detecting sarcasm in tweets #not , 2013, WASSA@NAACL-HLT.

[25]  Horacio Saggion,et al.  Modelling Sarcasm in Twitter, a Novel Approach , 2014, WASSA@ACL.

[26]  Akshi Kumar,et al.  Sentiment Analysis: A Perspective on its Past, Present and Future , 2012 .

[27]  Finn Årup Nielsen,et al.  A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs , 2011, #MSM.

[28]  A. Majid Current Emotion Research in the Language Sciences , 2012 .