CFN: A Complex-Valued Fuzzy Network for Sarcasm Detection in Conversations

Sarcasm detection in conversation, a theoretically and practically challenging artificial intelligence task, aims to discover elusively ironic, contemptuous, and metaphoric information implied in daily conversations. Most of the recent approaches in sarcasm detection have neglected the intrinsic vagueness and uncertainty of human language in emotional expression and understanding. To address this gap, we propose a complex-valued fuzzy network by leveraging the mathematical formalisms of quantum theory and fuzzy logic. In particular, the target utterance to be recognized is considered as a quantum superposition of a set of separate words. The contextual interaction between adjacent utterances is described as the interaction between a quantum system and its surrounding environment, constructing the quantum composite system, where the weight of interaction is determined by a fuzzy membership function. In order to model both the vagueness and uncertainty, the aforementioned superposition and composite systems are mathematically encapsulated in a density matrix. Finally, a quantum fuzzy measurement is performed on the density matrix of each utterance to yield the probabilistic outcomes of sarcasm recognition. Extensive experiments are conducted on the MUStARD and the 2020 sarcasm detection Reddit track datasets, and the results show that our model outperforms a wide range of strong baselines.

[1]  Reza Tavakkoli-Moghaddam,et al.  Multiobjective fuzzy mathematical model for a financially constrained closed‐loop supply chain with labor employment , 2019, Comput. Intell..

[2]  Erik Kropat,et al.  Eco-Finance Networks under Uncertainty , 2008 .

[3]  Erik Cambria,et al.  Context-Dependent Sentiment Analysis in User-Generated Videos , 2017, ACL.

[4]  Diana Maynard,et al.  Who cares about Sarcastic Tweets? Investigating the Impact of Sarcasm on Sentiment Analysis. , 2014, LREC.

[5]  Debanjan Ghosh,et al.  A Report on the 2020 Sarcasm Detection Shared Task , 2020, FIGLANG.

[6]  Rohit Agarwal,et al.  C-Net: Contextual Network for Sarcasm Detection , 2020, FIGLANG.

[7]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[8]  Massimo Melucci,et al.  Semantic Hilbert Space for Text Representation Learning , 2019, WWW.

[9]  Erik Cambria,et al.  A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks , 2016, COLING.

[10]  Xiang Li,et al.  Unsupervised Sentiment Analysis of Twitter Posts Using Density Matrix Representation , 2018, ECIR.

[11]  Avinash Kumar,et al.  Sarcasm Detection Using Multi-Head Attention Based Bidirectional LSTM , 2020, IEEE Access.

[12]  Verónica Pérez-Rosas,et al.  Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper) , 2019, ACL.

[13]  Erik Kropat,et al.  Regression Analysis for Clusters in Gene-Environment Networks based on Ellipsoidal Calculus and Optimization , 2009 .

[14]  Andreas Nürnberger,et al.  On the Relation between Fuzzy and Quantum Logic , 2009 .

[15]  Gerhard-Wilhelm Weber,et al.  Multi-objective optimization for the reliable pollution-routing problem with cross-dock selection using Pareto-based algorithms , 2020 .

[16]  Yoshua Bengio,et al.  Modeling term dependencies with quantum language models for IR , 2013, SIGIR.

[17]  Alireza Goli,et al.  Fuzzy Integrated Cell Formation and Production Scheduling Considering Automated Guided Vehicles and Human Factors , 2021, IEEE Transactions on Fuzzy Systems.

[18]  Xiang Li,et al.  A Quantum-Like multimodal network framework for modeling interaction dynamics in multiparty conversational sentiment analysis , 2020, Inf. Fusion.

[19]  Pradip Kumar Bala,et al.  Sarcasm detection in microblogs using Naïve Bayes and fuzzy clustering , 2017 .

[20]  Nikhil Jaiswal,et al.  Neural Sarcasm Detection using Conversation Context , 2020, FIGLANG.

[21]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[22]  Alireza Goli,et al.  A Covering Tour Approach for Disaster Relief Locating and Routing with Fuzzy Demand , 2020, Int. J. Intell. Transp. Syst. Res..

[23]  Reza Tavakkoli-Moghaddam,et al.  Hybrid artificial intelligence and robust optimization for a multi-objective product portfolio problem Case study: The dairy products industry , 2019, Comput. Ind. Eng..

[24]  Joanne Kuzma,et al.  Rudimentary Lexicon Based Method for Sarcasm Detection , 2017 .

[25]  Dawei Song,et al.  A quantum-inspired sentiment representation model for twitter sentiment analysis , 2019, Applied Intelligence.

[26]  Niladri Chatterjee,et al.  Sarcasm Detection Using Deep Learning-Based Techniques , 2020 .

[27]  V. Haripriya,et al.  Detection of Sarcasm from Consumer Sentiments on Social Media About Luxury Brands , 2018, RTIP2R.

[28]  Tomoaki Ohtsuki,et al.  A Pattern-Based Approach for Sarcasm Detection on Twitter , 2016, IEEE Access.

[29]  Liyuan Liu,et al.  A2Text-Net: A Novel Deep Neural Network for Sarcasm Detection , 2019, 2019 IEEE First International Conference on Cognitive Machine Intelligence (CogMI).

[30]  Erik Cambria,et al.  Sentiment and Sarcasm Classification With Multitask Learning , 2019, IEEE Intelligent Systems.

[31]  Dawei Song,et al.  End-to-End Quantum-like Language Models with Application to Question Answering , 2018, AAAI.

[32]  C. Pearce,et al.  Rumours with general initial conditions , 2004 .

[33]  Gianpiero Cattaneo,et al.  Fuzzy intuitionistic quantum logics , 1993, Stud Logica.

[34]  Kazutaka Shimada,et al.  A Sarcasm Extraction Method Based on Patterns of Evaluation Expressions , 2016, 2016 5th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[35]  Paolo Rosso,et al.  Applying Basic Features from Sentiment Analysis for Automatic Irony Detection , 2015, IbPRIA.

[36]  Massimo Melucci,et al.  CNM: An Interpretable Complex-valued Network for Matching , 2019, NAACL.

[37]  Ashraf Kamal,et al.  Self-Deprecating Sarcasm Detection: An Amalgamation of Rule-Based and Machine Learning Approach , 2018, 2018 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[38]  Pushpak Bhattacharyya,et al.  Harnessing Sequence Labeling for Sarcasm Detection in Dialogue from TV Series ‘Friends’ , 2016, CoNLL.

[39]  G. Hegel.  The Philosophy of Fine Art , 1975 .

[40]  Yazhou Zhang,et al.  Learning interaction dynamics with an interactive LSTM for conversational sentiment analysis , 2020, Neural Networks.

[41]  Pushpak Bhattacharyya,et al.  All-in-One: A Deep Attentive Multi-task Learning Framework for Humour, Sarcasm, Offensive, Motivation, and Sentiment on Memes , 2020, AACL.

[42]  Yue Zhang,et al.  Tweet Sarcasm Detection Using Deep Neural Network , 2016, COLING.

[44]  Witold Pedrycz,et al.  A Fuzzy Deep Neural Network With Sparse Autoencoder for Emotional Intention Understanding in Human–Robot Interaction , 2020, IEEE Transactions on Fuzzy Systems.

[45]  Erik Kropat,et al.  Fuzzy target-environment networks and fuzzy-regression approaches , 2018 .

[46]  Dawei Song,et al.  Quantum-Inspired Interactive Networks for Conversational Sentiment Analysis , 2019, IJCAI.

[47]  Charles E. M. Pearce,et al.  Impulsive control of rumours with two broadcasts , 2005 .

[48]  Reza Zafarani,et al.  Sarcasm Detection on Twitter: A Behavioral Modeling Approach , 2015, WSDM.

[49]  R. Gibbs.  On the psycholinguistics of sarcasm. , 1986 .

[50]  Debanjan Ghosh,et al.  The Role of Conversation Context for Sarcasm Detection in Online Interactions , 2017, SIGDIAL Conference.

[51]  Yi Shen,et al.  Interval Observer Design for Discrete-Time Uncertain Takagi–Sugeno Fuzzy Systems , 2019, IEEE Transactions on Fuzzy Systems.

[52]  Erik Cambria,et al.  Fuzzy commonsense reasoning for multimodal sentiment analysis , 2019, Pattern Recognit. Lett..

[53]  Silja Meyer-Nieberg,et al.  Fuzzy prediction strategies for gene-environment networks - Fuzzy regression analysis for two-modal regulatory systems , 2016, RAIRO Oper. Res..

[54]  Erik Kropat,et al.  Regulatory Networks under Ellipsoidal Uncertainty – Data Analysis and Prediction by Optimization Theory and Dynamical Systems , 2012 .

[55]  Cynthia Rudin,et al.  A Transformer Approach to Contextual Sarcasm Detection in Twitter , 2020, FIGLANG.

[56]  Pushpak Bhattacharyya,et al.  Sentiment and Emotion help Sarcasm? A Multi-task Learning Framework for Multi-Modal Sarcasm, Sentiment and Emotion Analysis , 2020, ACL.

[57]  Erik Kropat,et al.  Spline regression models for complex multi-modal regulatory networks , 2014, Optim. Methods Softw..

[58]  Erik Kropat,et al.  On the classical Maki–Thompson rumour model in continuous time , 2011, Central Eur. J. Oper. Res..

[59]  Ken Chen,et al.  Self-Supervised Learning for Specified Latent Representation , 2020, IEEE Transactions on Fuzzy Systems.

[60]  Alex Granik.  Fuzziness in quantum mechanics , 1994, Defense + Commercial Sensing.

[61]  Jun Hong,et al.  Sarcasm Detection on Czech and English Twitter , 2014, COLING.

[62]  Sanjay Kumar Jena,et al.  Parsing-based sarcasm sentiment recognition in Twitter data , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[63]  Seba Susan,et al.  Fuzzy rule based unsupervised sentiment analysis from social media posts , 2019, Expert Syst. Appl..

[64]  Xiaojun Wan,et al.  Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model , 2019, ACL.

[65]  Akshi Kumar,et al.  PROD: A Potential Rumour Origin Detection Model Using Supervised Machine Learning , 2019 .

[66]  Ayu Purwarianti,et al.  Indonesian social media sentiment analysis with sarcasm detection , 2013, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS).