A Measure for Dialog Complexity and its Application in Streamlining Service Operations

Dialog is a natural modality for interaction between customers and businesses in the service industry. As customers call up the service provider, their interactions may be routine or extraordinary. We believe that these interactions, when seen as dialogs, can be analyzed to obtain a better understanding of customer needs and how to efficiently address them. We introduce the idea of a dialog complexity measure to characterize multi-party interactions, propose a general data-driven method to calculate it, use it to discover insights in public and enterprise dialog datasets, and demonstrate its beneficial usage in facilitating better handling of customer requests and evaluating service agents.

[1]  Douglas Biber,et al.  On the complexity of discourse complexity: A multidimensional analysis , 1992 .

[2]  Martin Christopher,et al.  Relationship Marketing: Bringing Quality, Customer Service and Marketing Together , 1993 .

[3]  Paul P. Maglio,et al.  Steps Toward a Science of Service Systems , 2007, Computer.

[4]  Milica Gasic,et al.  POMDP-Based Statistical Spoken Dialog Systems: A Review , 2013, Proceedings of the IEEE.

[5]  Joelle Pineau,et al.  The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems , 2015, SIGDIAL Conference.

[6]  J. Chatwin.  Conversation analysis. , 2004, Complementary therapies in medicine.

[7]  Matthew Henderson,et al.  The Second Dialog State Tracking Challenge , 2014, SIGDIAL Conference.

[8]  Relationship Marketing—Bringing Quality, Customer Service and Marketing Together. M. Christopher, A. Payne and D. Ballantyne, Butterworth‐Heinemann, Oxford, 1991, 204 pp, ISBN 0 750602589, price £25.00 , 1994 .

[9]  Anand Kumar Jaiswal,et al.  Customer satisfaction and service quality measurement in Indian call centres , 2008 .

[10]  J. Anton.  The past, present and future of customer access centers , 2000 .

[11]  Shourya Roy,et al.  QART: A System for Real-Time Holistic Quality Assurance for Contact Center Dialogues , 2016, AAAI.

[12]  Mary Jo Bitner,et al.  Evaluating service encounters: The effects of physical surroundings and employee responses. , 1990 .

[13]  Alexander I. Rudnicky,et al.  An open concept metric for assessing dialog system complexity , 2001, IEEE Workshop on Automatic Speech Recognition and Understanding, 2001. ASRU '01..

[14]  Steven A. Taylor,et al.  Measuring Service Quality: A Reexamination and Extension , 1992 .

[15]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.

[16]  Oriol Vinyals,et al.  Adversarial Evaluation of Dialogue Models , 2017, ArXiv.

[17]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[18]  Gwm Matthias Rauterberg.  How to measure cognitive complexity in human-computer interaction , 1996 .

[19]  Shannon Duvall.  Implementation of DomCAT: the domain complexity analysis tool for natural language dialog processing , 2007, TAPIA '07.

[20]  Bowen Zhou,et al.  Applying deep learning to answer selection: A study and an open task , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[21]  Ronnie W. Smith,et al.  Defining the complexity of natural language dialogue system domains , 2006 .

[22]  Carl Gutwin,et al.  KEA: practical automatic keyphrase extraction , 1999, DL '99.

[23]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.

[24]  Chengzhi Zhang,et al.  Automatic Keyword Extraction from Documents Using Conditional Random Fields , 2008 .