Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language

The prominence of figurative language devices, such as sarcasm and irony, poses serious challenges for Arabic Sentiment Analysis (SA). While previous research works tackle SA and sarcasm detection separately, this paper introduces an end-to-end deep Multi-Task Learning (MTL) model, allowing knowledge interaction between the two tasks. Our MTL model’s architecture consists of a Bidirectional Encoder Representation from Transformers (BERT) model, a multi-task attention interaction module, and two task classifiers. The overall obtained results show that our proposed model outperforms its single-task and MTL counterparts on both sarcasm and sentiment detection subtasks.

[1]  Ines Abbes,et al.  DAICT: A Dialectal Arabic Irony Corpus Extracted from Twitter , 2020, LREC.

[2]  Abed Allah Khamaiseh,et al.  A comprehensive survey of arabic sentiment analysis , 2019, Inf. Process. Manag..

[3]  Farah Benamara,et al.  SOUKHRIA: Towards an Irony Detection System for Arabic in Social Media , 2017, ACLING.

[4]  Walid Magdy,et al.  From Arabic Sentiment Analysis to Sarcasm Detection: The ArSarcasm Dataset , 2020, OSACT.

[5]  Paolo Rosso,et al.  Irony Detection in a Multilingual Context , 2020, ECIR.

[6]  HajjHazem,et al.  A Survey of Opinion Mining in Arabic , 2019 .

[7]  Muhammad Abdul-Mageed,et al.  ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic , 2020, ACL.

[8]  Ibrahim Abu Farha,et al.  Overview of the WANLP 2021 Shared Task on Sarcasm and Sentiment Detection in Arabic , 2021, WANLP.

[9]  Walid Magdy,et al.  A comparative study of effective approaches for Arabic sentiment analysis , 2021, Inf. Process. Manag..

[10]  Zheng-Yu Niu,et al.  Multi-task Attention-based Neural Networks for Implicit Discourse Relationship Representation and Identification , 2017, EMNLP.

[11]  Hazem Hajj,et al.  AraBERT: Transformer-based Model for Arabic Language Understanding , 2020, OSACT.

[12]  Erik Cambria,et al.  A review of sentiment analysis research in Arabic language , 2020, Future Gener. Comput. Syst..

[13]  Paolo Rosso,et al.  IDAT at FIRE2019: Overview of the Track on Irony Detection in Arabic Tweets , 2019, FIRE.

[14]  Paolo Rosso,et al.  Irony detection via sentiment-based transfer learning , 2019, Inf. Process. Manag..

[15]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.