Evaluation of Different Sarcasm Detection Models for Arabic News Headlines

Being sarcastic is to say something and to mean something else. Detecting sarcasm is key for social media analysis to differentiate between the two opposite polarities that an utterance may convey. Different techniques for detecting sarcasm are varying from rule-based models to Machine Learning and Deep Learning models. However, researchers tend to leverage Deep Learning in detecting sarcasm recently. On the other hand, the Arabic language has not witnessed much improvement in this research area. Bridging the gap in sarcasm detection of the Arabic language is the target behind this work. In this paper, efficient models in short text classification are tested for detecting sarcasm in the Arabic news headlines for the first time. The dataset used to train and test these different architectures was manually collected by scrapping two different websites, sarcastic and non-sarcastic. Detailed results for each model were also represented, based on different performance metrics, such as accuracy, precision, recall and F1 score.

[1]  Rada Mihalcea,et al.  CASCADE: Contextual Sarcasm Detection in Online Discussion Forums , 2018, COLING.

[2]  Tony Veale,et al.  Magnets for Sarcasm: Making Sarcasm Detection Timely, Contextual and Very Personal , 2017, EMNLP.

[3]  Farah Benamara,et al.  SOUKHRIA: Towards an Irony Detection System for Arabic in Social Media , 2017, ACLING.

[4]  Christopher Potts,et al.  Representing Social Media Users for Sarcasm Detection , 2018, EMNLP.

[5]  Hongwei Ge,et al.  Recognition of Ironic Sentences in Twitter using Attention-Based LSTM , 2018 .

[6]  Pushpak Bhattacharyya,et al.  Are Word Embedding-based Features Useful for Sarcasm Detection? , 2016, EMNLP.

[7]  Nivid Limbasiya,et al.  Feature based Composite Approach for Sarcasm Detection using MapReduce , 2018, 2018 Second International Conference on Computing Methodologies and Communication (ICCMC).

[8]  Jian Su,et al.  Reasoning with Sarcasm by Reading In-Between , 2018, ACL.

[9]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[10]  Rodney D. Nielsen,et al.  Detecting Sarcasm is Extremely Easy ;-) , 2018 .

[11]  Wil M. P. van der Aalst,et al.  Business Process Variability Modeling , 2017, ACM Comput. Surv..

[12]  Steven Euijong Whang,et al.  A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective , 2018, IEEE Transactions on Knowledge and Data Engineering.

[13]  Houbing Song,et al.  Internet of Things and Big Data Analytics for Smart and Connected Communities , 2016, IEEE Access.

[14]  Debanjan Ghosh,et al.  "With 1 follower I must be AWESOME : P". Exploring the role of irony markers in irony recognition , 2018, ICWSM.

[15]  S. R. El-Beltagy,et al.  Open issues in the sentiment analysis of Arabic social media: A case study , 2013, 2013 9th International Conference on Innovations in Information Technology (IIT).

[16]  Walaa Medhat,et al.  Sentiment analysis algorithms and applications: A survey , 2014 .

[17]  Shalini Raghav,et al.  Review of automatic sarcasm detection , 2017, 2017 2nd International Conference on Telecommunication and Networks (TEL-NET).

[18]  Dana Al-Ghadhban,et al.  Arabic sarcasm detection in Twitter , 2017, 2017 International Conference on Engineering & MIS (ICEMIS).

[19]  Yue Zhang,et al.  Tweet Sarcasm Detection Using Deep Neural Network , 2016, COLING.

[20]  Ye Zhang,et al.  A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification , 2015, IJCNLP.

[21]  Nagwa M. El-Makky,et al.  Sentiment Analysis of Arabic Tweets using Deep Learning , 2018, ACLING.

[22]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[23]  Tony Veale,et al.  Fracking Sarcasm using Neural Network , 2016, WASSA@NAACL-HLT.

[24]  Priyanka Ingole,et al.  Hybrid Model For Text Classification , 2018, 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA).

[25]  Aijun An,et al.  Affective Representations for Sarcasm Detection , 2018, SIGIR.

[26]  Pushpak Bhattacharyya,et al.  Automatic Sarcasm Detection , 2016, ACM Comput. Surv..

[27]  Pushpak Bhattacharyya,et al.  'Who would have thought of that!': A Hierarchical Topic Model for Extraction of Sarcasm-prevalent Topics and Sarcasm Detection , 2016, ArXiv.