A Multi-channel Neural Network for Imbalanced Emotion Recognition

Imbalanced issue becomes one of major bottleneck for further popularizing of emotion recognition in actual applications. Recently, some resampling methods have been proposed to improve performance by balancing the training samples. However, over-sampling methods may lead to overfitting, and undersampling methods would lose useful emotion information. In this paper, we propose a multi-channel deep architecture to improve performance in both samples and features imbalance. Specifically, we design a class correction loss function to overcome the gap between majority and minority emotions. Meanwhile, emotionspecific word embedding and a fine-tuning BERT are used to increase the differentiation of emotion words and sentences. Experimental results on two Chinese micro-blog emotion classification datasets show that our proposed architecture outperforms state-of-the-art in imbalanced emotion recognition.

[1]  Yue Zhang,et al.  A Bilingual Attention Network for Code-switched Emotion Prediction , 2016, COLING.

[2]  Min Wu,et al.  Adaptive Cost-Sensitive Online Classification , 2018, IEEE Transactions on Knowledge and Data Engineering.

[3]  Chuhan Wu,et al.  Imbalanced Sentiment Classification with Multi-Task Learning , 2018, CIKM.

[4]  Guodong Zhou,et al.  Imbalanced sentiment classification , 2011, CIKM '11.

[5]  Francisco Herrera,et al.  An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics , 2013, Inf. Sci..

[6]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[7]  Osmar R. Zaïane,et al.  Automatic Dialogue Generation with Expressed Emotions , 2018, NAACL.

[8]  Robert E. Mercer,et al.  Multi-Channel Convolutional Neural Network for Twitter Emotion and Sentiment Recognition , 2019, NAACL.

[9]  Alan Ritter,et al.  “i have a feeling trump will win..................”: Forecasting Winners and Losers from User Predictions on Twitter , 2017, EMNLP.

[10]  Zhenyu He,et al.  A Sentence Vector Based Over-Sampling Method for Imbalanced Emotion Classification , 2014, CICLing.

[11]  Iyad Rahwan,et al.  Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm , 2017, EMNLP.

[12]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[13]  Kalina Bontcheva,et al.  Stance Detection with Bidirectional Conditional Encoding , 2016, EMNLP.

[14]  Zhiyuan Liu,et al.  Joint Learning of Character and Word Embeddings , 2015, IJCAI.

[15]  Tat-Seng Chua,et al.  Depression Detection via Harvesting Social Media: A Multimodal Dictionary Learning Solution , 2017, IJCAI.

[16]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Sanja Fidler,et al.  Skip-Thought Vectors , 2015, NIPS.

[18]  Zhen Wu,et al.  Target-oriented Opinion Words Extraction with Target-fused Neural Sequence Labeling , 2019, NAACL.

[19]  Muhammad Abdul-Mageed,et al.  EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks , 2017, ACL.

[20]  J. Berry,et al.  Guilt, fear, submission, and empathy in depression. , 2002, Journal of affective disorders.

[21]  Hao Xin,et al.  Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components , 2017, EMNLP.

[22]  Gianmaria Silvello,et al.  Supervised Lexicon Extraction for Emotion Classification , 2019, WWW.

[23]  Daling Wang,et al.  Detecting Multiple Coexisting Emotions in Microblogs with Convolutional Neural Networks , 2017, Cognitive Computation.

[24]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[25]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[26]  Angela Ka-yee Leung,et al.  Putting Their Best Foot Forward: Emotional Disclosure on Facebook , 2012, Cyberpsychology Behav. Soc. Netw..

[27]  Yang Wang,et al.  Boosting for Learning Multiple Classes with Imbalanced Class Distribution , 2006, Sixth International Conference on Data Mining (ICDM'06).

[28]  Yichen Wang,et al.  Detecting Emotions in Social Media: A Constrained Optimization Approach , 2015, IJCAI.

[29]  Zhen Liu,et al.  Objective cost-sensitive-boosting-WELM for handling multi class imbalance problem , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[30]  Tao Chen,et al.  Word Embedding Composition for Data Imbalances in Sentiment and Emotion Classification , 2015, Cognitive Computation.

[31]  Sebastian Ruder,et al.  Universal Language Model Fine-tuning for Text Classification , 2018, ACL.