Towards Improved Deep Contextual Embedding for the identification of Irony and Sarcasm

Humans use tonal stress and gestural cues to reveal negative feelings that are expressed ironically using positive or intensified positive words when communicating vocally. However, in textual data, like posts on social media, cues on sentiment valence are absent, thus making it challenging to identify the true meaning of utterances, even for the human reader. For a given post, an intelligent natural language processing system should be able to identify whether a post is ironic/sarcastic or not. Recent work confirms the difficulty of detecting sarcastic/ironic posts. To overcome challenges involved in the identification of sentiment valence, this paper presents the identification of irony and sarcasm in social media posts through transformer-based deep, intelligent contextual embedding – T-DICE – which improves noise within contexts. It solves the language ambiguities such as polysemy, semantics, syntax, and words sentiments by integrating embeddings. T-DICE is then forwarded to attention-based Bidirectional Long Short Term Memory (BiLSTM) to find out the sentiment of a post. We report the classification performance of the proposed network on benchmark datasets for #irony & #sarcasm. Results demonstrate that our approach outperforms existing state-of-the-art methods.

[1]  Horacio Saggion,et al.  Modelling Irony in Twitter , 2014, EACL.

[2]  Tony Veale,et al.  Fracking Sarcasm using Neural Network , 2016, WASSA@NAACL-HLT.

[3]  Katarzyna Musial,et al.  DICE: Deep Intelligent Contextual Embedding for Twitter Sentiment Analysis , 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[4]  Erik Cambria,et al.  Sentiment and Sarcasm Classification With Multitask Learning , 2019, IEEE Intelligent Systems.

[5]  Ellen Riloff,et al.  Sarcasm as Contrast between a Positive Sentiment and Negative Situation , 2013, EMNLP.

[6]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[7]  Chuhan Wu,et al.  THU_NGN at SemEval-2018 Task 3: Tweet Irony Detection with Densely connected LSTM and Multi-task Learning , 2018, *SEMEVAL.

[8]  Guandong Xu,et al.  What’s Happening Around the World? A Survey and Framework on Event Detection Techniques on Twitter , 2019, Journal of Grid Computing.

[9]  Véronique Hoste,et al.  Exploring the fine-grained analysis and automatic detection of irony on Twitter , 2018, Lang. Resour. Evaluation.

[10]  Byron C. Wallace,et al.  Modelling Context with User Embeddings for Sarcasm Detection in Social Media , 2016, CoNLL.

[11]  Paolo Rosso,et al.  Irony detection via sentiment-based transfer learning , 2019, Inf. Process. Manag..

[12]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[13]  Guandong Xu,et al.  Event Detection in Twitter Stream using Weighted Dynamic Heartbeat Graph Approach , 2019, IEEE Comput. Intell. Mag..

[14]  Usman Naseem,et al.  Hybrid Words Representation for Airlines Sentiment Analysis , 2019, Australasian Conference on Artificial Intelligence.

[15]  Diego Reforgiato Recupero,et al.  ESWC'14 Challenge on Concept-Level Sentiment Analysis , 2014, SemWebEval@ESWC.

[16]  Pushpak Bhattacharyya,et al.  "Having 2 hours to write a paper is fun!": Detecting Sarcasm in Numerical Portions of Text , 2017, ArXiv.

[17]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[18]  Ibrahim A. Hameed,et al.  Deep Context-Aware Embedding for Abusive and Hate Speech detection on Twitter , 2019, Aust. J. Intell. Inf. Process. Syst..

[19]  Andreas Stafylopatis,et al.  A Robust Deep Ensemble Classifier for Figurative Language Detection , 2019, EANN.

[20]  Guillaume Lample,et al.  Neural Architectures for Named Entity Recognition , 2016, NAACL.

[21]  Georgios Siolas,et al.  A transformer-based approach to irony and sarcasm detection , 2019, Neural Computing and Applications.

[22]  Guandong Xu,et al.  Text Stream to Temporal Network - A Dynamic Heartbeat Graph to Detect Emerging Events on Twitter , 2018, PAKDD.

[23]  Jian Su,et al.  Reasoning with Sarcasm by Reading In-Between , 2018, ACL.

[24]  Davide Buscaldi,et al.  From humor recognition to irony detection: The figurative language of social media , 2012, Data Knowl. Eng..

[25]  Hsin-Hsi Chen,et al.  Irony Detection with Attentive Recurrent Neural Networks , 2017, ECIR.

[26]  Guandong Xu,et al.  Enhanced Heartbeat Graph for emerging event detection on Twitter using time series networks , 2019, Expert Syst. Appl..

[27]  Rada Mihalcea,et al.  CASCADE: Contextual Sarcasm Detection in Online Discussion Forums , 2018, COLING.

[28]  Georgios Paraskevopoulos,et al.  NTUA-SLP at SemEval-2018 Task 3: Tracking Ironic Tweets using Ensembles of Word and Character Level Attentive RNNs , 2018, *SEMEVAL.

[29]  Yutaka Matsuo,et al.  Deep contextualized word representations for detecting sarcasm and irony , 2018, WASSA@EMNLP.

[30]  Nina Wacholder,et al.  Identifying Sarcasm in Twitter: A Closer Look , 2011, ACL.

[31]  Kevin Gimpel,et al.  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations , 2019, ICLR.