Hybrid attention-based Long Short-Term Memory network for sarcasm identification

Abstract Sentiment analysis of people’s opinion is used in a lot of business and decision-making scenarios. Although social media is an informal medium in which to express one’s opinions, it is being used in many business and decision-making scenarios now. Social media posts contain a lot of sarcastic statements that affect the automatic extraction of the correct sentiment of the post, as sarcasm can flip the overall polarity of the sentence. Sarcasm is a bitterly cutting form of irony to be unpleasant to somebody or to make fun of them. Therefore, identifying sarcastic statements from the users’ posts has become an important task to extract the actual sentiments from informal statements regarding an event or a person. In this work, we propose a hybrid attention-based Long Short Term Memory (HA-LSTM) network to identify sarcastic statements. This HA-LSTM network is different than the existing LSTM model, as the proposed HA-LSTM network combines 16 different linguistic features in their hidden layers. The proposed HA-LSTM network is validated with three benchmark datasets. The combination of 16 different linguistic features shows an improvement in the performance of the model in comparison with other state-of-the-art models with an improvement of up to 2% in terms of F 1 -score with three different gold standard datasets.

[1]  J. Plazak An empirical investigation of a sarcastic tone of voice in instrumental music , 2011 .

[2]  Tony Veale,et al.  Magnets for Sarcasm: Making Sarcasm Detection Timely, Contextual and Very Personal , 2017, EMNLP.

[3]  Waqar Mehmood,et al.  Automatic identification of sarcasm in tweets and customer reviews , 2019, J. Intell. Fuzzy Syst..

[4]  Mahima Varshney,et al.  Sarcasm Detection of Amazon Alexa Sample Set , 2019 .

[5]  Akshi Kumar,et al.  Sarcasm detection in mash-up language using soft-attention based bi-directional LSTM and feature-rich CNN , 2020, Appl. Soft Comput..

[6]  Pulkit Mehndiratta,et al.  Identification of sarcasm using word embeddings and hyperparameters tuning , 2019, Journal of Discrete Mathematical Sciences and Cryptography.

[7]  Pushpak Bhattacharyya,et al.  Feature Specific Sentiment Analysis for Product Reviews , 2012, CICLing.

[8]  Timothy Baldwin,et al.  Automatic Satire Detection: Are You Having a Laugh? , 2009, ACL.

[9]  Akshi Kumar,et al.  Empirical study of shallow and deep learning models for sarcasm detection using context in benchmark datasets , 2019, Journal of Ambient Intelligence and Humanized Computing.

[10]  Xiaojun Wan,et al.  Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model , 2019, ACL.

[11]  Akshi Kumar,et al.  Sarcasm Detection Using Soft Attention-Based Bidirectional Long Short-Term Memory Model With Convolution Network , 2019, IEEE Access.

[12]  Ewan Klein,et al.  NLTK , 2020, Python for Linguists.

[13]  Pushpak Bhattacharyya,et al.  Harnessing Sequence Labeling for Sarcasm Detection in Dialogue from TV Series ‘Friends’ , 2016, CoNLL.

[14]  Devpriya Soni,et al.  Identification of Sarcasm in Textual Data: A Comparative Study , 2019, J. Data Inf. Sci..

[15]  Cornelia Caragea,et al.  Sentiment analysis during Hurricane Sandy in emergency response , 2017 .

[16]  Erik Cambria,et al.  Sentiment and Sarcasm Classification With Multitask Learning , 2019, IEEE Intelligent Systems.

[17]  Antal van den Bosch,et al.  The perfect solution for detecting sarcasm in tweets #not , 2013, WASSA@NAACL-HLT.

[18]  Pushpak Bhattacharyya,et al.  Are Word Embedding-based Features Useful for Sarcasm Detection? , 2016, EMNLP.

[19]  Yogesh Kumar Dwivedi,et al.  A deep multi-modal neural network for informative Twitter content classification during emergencies , 2020, Ann. Oper. Res..

[20]  Anit Chakraborty,et al.  A Deep Learning-Inspired Method for Social Media Satire Detection , 2019, Advances in Intelligent Systems and Computing.

[21]  Chaitali Chandankhede,et al.  Sarcasm Detection for Workplace Stress Management , 2019, Int. J. Synth. Emot..

[22]  Pietro Ducange,et al.  An effective Decision Support System for social media listening based on cross-source sentiment analysis models , 2019, Eng. Appl. Artif. Intell..

[23]  Paolo Rosso,et al.  SemEval-2015 Task 11: Sentiment Analysis of Figurative Language in Twitter , 2015, *SEMEVAL.

[24]  Hongfei Lin,et al.  Sarcasm Detection with Sentiment Semantics Enhanced Multi-level Memory Network , 2020, Neurocomputing.

[25]  Zhijian Wu,et al.  Twitter Sarcasm Detection Exploiting a Context-Based Model , 2015, WISE.

[26]  Peng Liu,et al.  Sarcasm Detection in Social Media Based on Imbalanced Classification , 2014, WAIM.

[27]  Mário J. Silva,et al.  Clues for detecting irony in user-generated contents: oh...!! it's "so easy" ;-) , 2009, TSA@CIKM.

[28]  Kazutaka Shimada,et al.  Sarcasm Detection Using RNN with Relation Vector , 2019, Int. J. Data Warehous. Min..

[29]  Philipp Cimiano,et al.  An Impact Analysis of Features in a Classification Approach to Irony Detection in Product Reviews , 2014, WASSA@ACL.

[30]  Jayashree Subramanian,et al.  Exploiting Emojis for Sarcasm Detection , 2019, SBP-BRiMS.

[31]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[32]  Reza Zafarani,et al.  Sarcasm Detection on Twitter: A Behavioral Modeling Approach , 2015, WSDM.

[33]  R. Gibbs Irony in Talk Among Friends , 2000 .

[34]  Sanjay Kumar Jena,et al.  Harnessing Online News for Sarcasm Detection in Hindi Tweets , 2017, PReMI.

[35]  Nina Wacholder,et al.  Identifying Sarcasm in Twitter: A Closer Look , 2011, ACL.

[36]  Ellen Riloff,et al.  Sarcasm as Contrast between a Positive Sentiment and Negative Situation , 2013, EMNLP.

[37]  Sudhir Dhage,et al.  Sarcasm Detection on Twitter: User Behavior Approach , 2019, Intelligent Systems, Technologies and Applications.

[38]  Yogesh Kumar Dwivedi,et al.  Social media in marketing: A review and analysis of the existing literature , 2017, Telematics Informatics.

[39]  Tomoaki Ohtsuki,et al.  A Pattern-Based Approach for Sarcasm Detection on Twitter , 2016, IEEE Access.

[40]  Liyuan Liu,et al.  A2Text-Net: A Novel Deep Neural Network for Sarcasm Detection , 2019, 2019 IEEE First International Conference on Cognitive Machine Intelligence (CogMI).

[41]  Nur Rokhman,et al.  Analysis of Emoticon and Sarcasm Effect on Sentiment Analysis of Indonesian Language on Twitter , 2019, Journal of Information Systems Engineering and Business Intelligence.

[42]  Paul K. Mandal,et al.  Deep CNN-LSTM with Word Embeddings for News Headline Sarcasm Detection , 2019 .

[43]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[44]  B. S. Harish,et al.  Automatic Irony Detection using Feature Fusion and Ensemble Classifier , 2019, Int. J. Interact. Multim. Artif. Intell..

[45]  Pushpak Bhattacharyya,et al.  Automatic Sarcasm Detection , 2016, ACM Comput. Surv..

[46]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.