SGD-QA: Fast Schema-Guided Dialogue State Tracking for Unseen Services

Dialogue state tracking is an essential part of goal-oriented dialogue systems, while most of these state tracking models often fail to handle unseen services. In this paper, we propose SGD-QA, a simple and extensible model for schema-guided dialogue state tracking based on a question answering approach. The proposed multi-pass model shares a single encoder between the domain information and dialogue utterance. The domain’s description represents the query and the dialogue utterance serves as the context. The model improves performance on unseen services by at least 1.6x compared to single-pass baseline models on the SGD dataset. SGD-QA shows competitive performance compared to state-of-theart multi-pass models while being significantly more efficient in terms of memory consumption and training performance. We provide a thorough discussion on the model with ablation study and error analysis.

[1]  Hao Wu,et al.  Mixed Precision Training , 2017, ICLR.

[2]  Bernardo Magnini,et al.  Domain-Aware Dialogue State Tracker for Multi-Domain Dialogue Systems , 2020, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[3]  Jian Zhang,et al.  SQuAD: 100,000+ Questions for Machine Comprehension of Text , 2016, EMNLP.

[4]  Zheng Zhang,et al.  Recent advances and challenges in task-oriented dialog systems , 2020, Science China Technological Sciences.

[5]  Thomas Wolf,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[6]  Haoqi Xiong,et al.  The SPPD System for Schema Guided Dialogue State Tracking Challenge , 2020, ArXiv.

[7]  Kevin Gimpel,et al.  Gaussian Error Linear Units (GELUs) , 2016 .

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Xuan Li,et al.  An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classification , 2019, ArXiv.

[10]  Gökhan Tür,et al.  Building a Conversational Agent Overnight with Dialogue Self-Play , 2018, ArXiv.

[11]  Raghav Gupta,et al.  Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset , 2020, AAAI.

[12]  Boris Ginsburg,et al.  NeMo: a toolkit for building AI applications using Neural Modules , 2019, ArXiv.

[13]  Quan Liu,et al.  Fine-Tuning BERT for Schema-Guided Zero-Shot Dialogue State Tracking , 2020, ArXiv.

[14]  Tomasz Kornuta,et al.  A Fast and Robust BERT-based Dialogue State Tracker for Schema Guided Dialogue Dataset , 2020, Converse@KDD.

[15]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.