BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysis

Sentiment analysis in conversations has gained increasing attention in recent years for the growing amount of applications it can serve, e.g., sentiment analysis, recommender systems, and human-robot interaction. The main difference between conversational sentiment analysis and single sentence sentiment analysis is the existence of context information which may influence the sentiment of an utterance in a dialogue. How to effectively encode contextual information in dialogues, however, remains a challenge. Existing approaches employ complicated deep learning structures to distinguish different parties in a conversation and then model the context information. In this paper, we propose a fast, compact and parameter-efficient party-ignorant framework named bidirectional emotional recurrent unit for conversational sentiment analysis. In our system, a generalized neural tensor block followed by a two-channel classifier is designed to perform context compositionality and sentiment classification, respectively. Extensive experiments on three standard datasets demonstrate that our model outperforms the state of the art in most cases.

[1]  Rada Mihalcea,et al.  MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations , 2018, ACL.

[2]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[3]  Michael R. Lyu,et al.  Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Network , 2019, AAAI.

[4]  Fabrício Benevenuto,et al.  Supervised Learning for Fake News Detection , 2019, IEEE Intelligent Systems.

[5]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[6]  Rada Mihalcea,et al.  What Men Say, What Women Hear: Finding Gender-Specific Meaning Shades , 2016, IEEE Intelligent Systems.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Rada Mihalcea,et al.  Utterance-level Dialogue Understanding: An Empirical Study , 2020, ArXiv.

[9]  Arno Scharl,et al.  Aspect-Based Extraction and Analysis of Affective Knowledge from Social Media Streams , 2017, IEEE Intelligent Systems.

[10]  Rada Mihalcea,et al.  COSMIC: COmmonSense knowledge for eMotion Identification in Conversations , 2020, FINDINGS.

[11]  P. Alam ‘T’ , 2021, Composites Engineering: An A–Z Guide.

[12]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[13]  Björn W. Schuller,et al.  AVEC 2012: the continuous audio/visual emotion challenge , 2012, ICMI '12.

[14]  Jianfei Yu,et al.  Instance-based Domain Adaptation via Multiclustering Logistic Approximation , 2018, IEEE Intelligent Systems.

[15]  E. W. Morris No , 1923, The Hospital and health review.

[16]  Zhaoxia Wang,et al.  A review of emotion sensing: categorization models and algorithms , 2020, Multimedia Tools and Applications.

[17]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[18]  Rajiv Ratn Shah,et al.  Detecting Personal Intake of Medicine from Twitter , 2018, IEEE Intelligent Systems.

[19]  Alexander Gelbukh,et al.  DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation , 2019, EMNLP.

[20]  Maja Pantic,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING , 2022 .

[21]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[22]  Erik Cambria,et al.  Department: Affective Computing and Sentiment Analysis Department: Affective Computing and Sentiment Analysis , 2022 .

[23]  Erik Cambria,et al.  Sentic Computing for social media marketing , 2012, Multimedia Tools and Applications.

[24]  Erik Cambria,et al.  SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings , 2018, AAAI.

[25]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[26]  Asif Ekbal,et al.  No, That Never Happened!! Investigating Rumors on Twitter , 2018, IEEE Intelligent Systems.

[27]  Alessandro Vinciarelli,et al.  Type Like a Man! Inferring Gender from Keystroke Dynamics in Live-Chats , 2019, IEEE Intelligent Systems.

[28]  Asif Ekbal,et al.  How Intense Are You? Predicting Intensities of Emotions and Sentiments using Stacked Ensemble [Application Notes] , 2020, IEEE Comput. Intell. Mag..

[29]  Guangqiang Diao,et al.  Speech Expression Multimodal Emotion Recognition Based on Deep Belief Network , 2021, Journal of Grid Computing.

[30]  Martin D. Sykora,et al.  What about Mood Swings: Identifying Depression on Twitter with Temporal Measures of Emotions , 2018, WWW.

[31]  Wei Li,et al.  User reviews: Sentiment analysis using lexicon integrated two-channel CNN-LSTM​ family models , 2020, Appl. Soft Comput..

[32]  Erik Cambria,et al.  Intention awareness: improving upon situation awareness in human-centric environments , 2013, Human-centric Computing and Information Sciences.

[33]  Yong Shi,et al.  DWWP: Domain-specific new words detection and word propagation system for sentiment analysis in the tourism domain , 2018, Knowl. Based Syst..

[34]  Erik Cambria,et al.  The Hourglass Model Revisited , 2020, IEEE Intelligent Systems.

[35]  Francisco Herrera,et al.  Sentiment Analysis in TripAdvisor , 2017, IEEE Intelligent Systems.

[36]  F. Sebastiani,et al.  Cross-Lingual Sentiment Quantification , 2019, IEEE Intelligent Systems.

[37]  Erik Cambria,et al.  SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis , 2020, CIKM.

[38]  B. Partee Lexical semantics and compositionality. , 1995 .

[39]  Erik Cambria,et al.  Context-Dependent Sentiment Analysis in User-Generated Videos , 2017, ACL.

[40]  Guodong Long,et al.  Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications , 2019, IEEE Transactions on Computational Social Systems.

[41]  Flavius Frasincar,et al.  Intent Classification for Dialogue Utterances , 2020, IEEE Intelligent Systems.

[42]  P. Alam ‘L’ , 2021, Composites Engineering: An A–Z Guide.

[43]  Haoran Xie,et al.  Segment-Level Joint Topic-Sentiment Model for Online Review Analysis , 2019, IEEE Intelligent Systems.

[44]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[45]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[46]  Ivor W. Tsang,et al.  Learning word dependencies in text by means of a deep recurrent belief network , 2016, Knowl. Based Syst..

[47]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[48]  Yangming Li,et al.  DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification , 2020, AAAI.

[49]  Erik Cambria,et al.  Natural language based financial forecasting: a survey , 2017, Artificial Intelligence Review.

[50]  Haixun Wang,et al.  Guest Editorial: Big Social Data Analysis , 2014, Knowl. Based Syst..

[51]  Erik Cambria,et al.  Multitask Representation Learning for Multimodal Estimation of Depression Level , 2019, IEEE Intelligent Systems.

[52]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[53]  Stewart Massie,et al.  Lexicon Generation for Emotion Detection from Text , 2017, IEEE Intelligent Systems.

[54]  Erik Cambria,et al.  A survey on empathetic dialogue systems , 2020, Inf. Fusion.

[55]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[56]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[57]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[58]  Carlos Busso,et al.  IEMOCAP: interactive emotional dyadic motion capture database , 2008, Lang. Resour. Evaluation.

[59]  Chunyan Miao,et al.  Knowledge-Enriched Transformer for Emotion Detection in Textual Conversations , 2019, EMNLP.

[60]  Yang Liu,et al.  Crowd Intelligence: Conducting Asymmetric Impact-Performance Analysis Based on Online Reviews , 2020, IEEE Intelligent Systems.

[61]  Erik Cambria,et al.  Sentiment and Sarcasm Classification With Multitask Learning , 2019, IEEE Intelligent Systems.

[62]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[63]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[64]  Yunming Ye,et al.  Knowledge Guided Capsule Attention Network for Aspect-Based Sentiment Analysis , 2020, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[65]  Rada Mihalcea,et al.  DialogueRNN: An Attentive RNN for Emotion Detection in Conversations , 2018, AAAI.

[66]  Erik Cambria,et al.  Cognitive-inspired domain adaptation of sentiment lexicons , 2019, Inf. Process. Manag..

[67]  Yong Shi,et al.  SentiVec: Learning Sentiment-Context Vector via Kernel Optimization Function for Sentiment Analysis , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[68]  Paolo Gastaldo,et al.  Image Polarity Detection on Resource-Constrained Devices , 2020, IEEE Intelligent Systems.

[69]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[70]  Maximilien Servajean,et al.  Attention-based Modeling for Emotion Detection and Classification in Textual Conversations , 2019, ArXiv.

[71]  Stewart Massie,et al.  Lexicon based feature extraction for emotion text classification , 2017, Pattern Recognit. Lett..

[72]  Luca Oneto,et al.  Technical analysis and sentiment embeddings for market trend prediction , 2019, Expert Syst. Appl..

[73]  Erik Cambria,et al.  Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos , 2018, NAACL.

[74]  Shangfei Wang,et al.  Capturing Emotion Distribution for Multimedia Emotion Tagging , 2019 .

[75]  Erik Cambria,et al.  ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis , 2021, Future Gener. Comput. Syst..

[76]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..

[77]  Amit P. Sheth,et al.  Challenges of Sentiment Analysis for Dynamic Events , 2017, IEEE Intelligent Systems.

[78]  Louis-Philippe Morency,et al.  Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages , 2016, IEEE Intelligent Systems.

[79]  Rada Mihalcea,et al.  ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection , 2018, EMNLP.

[80]  Rada Mihalcea,et al.  Learning From Personal Longitudinal Dialog Data , 2019, IEEE Intelligent Systems.

[81]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.