Have You Made a Decision? Where? A Pilot Study on Interpretability of Polarity Analysis Based on Advising Problem

The general approaches for polarity analysis in dialogue, e.g. Multiple Instance Learning (MIL), have achieved significant progress. However, one significant drawback of current approaches is that the contribution of an utterance towards the polarity being a black-box. For existing methods, the polarity contained in each utterance, which we call meta-polarity, is not explicitly utilized. In this paper, we study the problem of adding interpretability to the overall polarity by predicting the meta-polarity at the same time. First, we reformulate a large advising dataset [1], where the meta-polarity of each utterance is given. Second, we propose an utterance classification model (UCM) and a two-stage progressive training method that strengthens the connection between the meta-polarity and the overall polarity. Experimental results show that our overall approach outperforms all competitive base-lines by substantial margins, achieving a new state-of-the-art performance on this dataset.

[1]  SangKeun Lee,et al.  Dynamic Self-Attention : Computing Attention over Words Dynamically for Sentence Embedding , 2018, ArXiv.

[2]  Qiong Zhang,et al.  Using Customer Service Dialogues for Satisfaction Analysis with Context-Assisted Multiple Instance Learning , 2019, EMNLP.

[3]  Christophe Cerisara,et al.  Multi-task dialog act and sentiment recognition on Mastodon , 2018, COLING.

[4]  Zhen-Hua Ling,et al.  Enhancing Sentence Embedding with Generalized Pooling , 2018, COLING.

[5]  Walter S. Lasecki,et al.  NOESIS II: Predicting Responses, Identifying Success, and Managing Complexity in Task-Oriented Dialogue , 2019 .

[6]  Xiaojun Wan,et al.  Sentiment Analysis of Peer Review Texts for Scholarly Papers , 2018, SIGIR.

[7]  Zhen-Hua Ling,et al.  Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots , 2019, CIKM.

[8]  Quan Liu,et al.  Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems , 2020, ArXiv.

[9]  Erik Cambria,et al.  Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos , 2018, NAACL.

[10]  Zhen-Hua Ling,et al.  Dually Interactive Matching Network for Personalized Response Selection in Retrieval-Based Chatbots , 2019, EMNLP.

[11]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[12]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[13]  Colin Wei,et al.  Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss , 2019, NeurIPS.

[14]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[15]  Tae-Yoon Kim,et al.  SUMBT: Slot-Utterance Matching for Universal and Scalable Belief Tracking , 2019, ACL.

[16]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[17]  Birgitta Ojamaa,et al.  Sentiment analysis on conversational texts , 2015, NODALIDA.

[18]  Anoop Cherian,et al.  The Eighth Dialog System Technology Challenge , 2019, ArXiv.

[19]  Rada Mihalcea,et al.  DialogueRNN: An Attentive RNN for Emotion Detection in Conversations , 2018, AAAI.

[20]  Yuki Arase,et al.  Dialogue-Act Prediction of Future Responses Based on Conversation History , 2019, ACL.