Fine-Grained Emotion Detection in Contact Center Chat Utterances

Contact center chats are textual conversations involving customers and agents on queries, issues, grievances etc. about products and services. Contact centers conduct periodic analysis of these chats to measure customer satisfaction, of which the chat emotion forms one crucial component. Typically, these measures are performed at chat level. However, retrospective chat-level analysis is not sufficiently actionable for agents as it does not capture the variation in the emotion distribution across the chat. Towards that, we propose two novel weakly supervised approaches for detecting fine-grained emotions in contact center chat utterances in real time. In our first approach, we identify novel contextual and meta features and treat the task of emotion prediction as a sequence labeling problem. In second approach, we propose a neural net based method for emotion prediction in call center chats that does not require extensive feature engineering. We establish the effectiveness of the proposed methods by empirically evaluating them on a real-life contact center chat dataset. We achieve average accuracy of the order 72.6% with our first approach and 74.38% with our second approach respectively.

[1]  P. Ekman Universal facial expressions of emotion. , 1970 .

[2]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[3]  Patricio Martínez-Barco,et al.  Emotion Detection from text: A Survey , 2014 .

[4]  François-Régis Chaumartin,et al.  UPAR7: A knowledge-based system for headline sentiment tagging , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[5]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[6]  Mitsuru Ishizuka,et al.  Recognition of Affect, Judgment, and Appreciation in Text , 2010, COLING.

[7]  Vladan Devedzic,et al.  Synesketch: An Open Source Library for Sentence-Based Emotion Recognition , 2013, IEEE Transactions on Affective Computing.

[8]  Rosalind W. Picard Affective Computing , 1997 .

[9]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[10]  Carlo Strapparava,et al.  Learning to identify emotions in text , 2008, SAC '08.

[11]  Aijun An,et al.  Unsupervised Emotion Detection from Text Using Semantic and Syntactic Relations , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[12]  Kenji Kita,et al.  A Joint Prediction Model for Multiple Emotions Analysis in Sentences , 2013, CICLing.

[13]  Mitsuru Ishizuka,et al.  Emotion Estimation and Reasoning Based on Affective Textual Interaction , 2005, ACII.

[14]  Erkki Sutinen,et al.  Are They Different? Affect, Feeling, Emotion, Sentiment, and Opinion Detection in Text , 2014, IEEE Transactions on Affective Computing.

[15]  H. Prendinger,et al.  Emotion Sensitive News Agent: An Approach Towards User Centric Emotion Sensing from the News , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[16]  R. Plutchik Emotions and Life: Perspectives from Psychology, Biology, and Evolution , 2002 .

[17]  Saif Mohammad,et al.  #Emotional Tweets , 2012, *SEMEVAL.

[18]  Sunghwan Mac Kim,et al.  Evaluation of Unsupervised Emotion Models to Textual Affect Recognition , 2010, HLT-NAACL 2010.

[19]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.