Adaptive dialogue management using intent clustering and fuzzy rules

Conversational systems have become an element of everyday life for billions of users who use speech‐based interfaces to services, engage with personal digital assistants on smartphones, social media chatbots, or smart speakers. One of the most complex tasks in the development of these systems is to design the dialogue model, the logic that provided a user input selects the next answer. The dialogue model must also consider mechanisms to adapt the response of the system and the interaction style according to different groups and user profiles. Rule‐based systems are difficult to adapt to phenomena that were not taken into consideration at design‐time. However, many of the systems that are commercially available are based on rules, and so are the most widespread tools for the development of chatbots and speech interfaces. In this article, we present a proposal to: (a) automatically generate the dialogue rules from a dialogue corpus through the use of evolving algorithms, (b) adapt the rules according to the detected user intention. We have evaluated our proposal with several conversational systems of different application domains, from which our approach provided an efficient way for adapting a set of dialogue rules considering user utterance clusters.

[1]  Pushpak Bhattacharyya,et al.  A Multi-Task Hierarchical Approach for Intent Detection and Slot Filling , 2019, Knowl. Based Syst..

[2]  Matthieu Geist,et al.  Clustering behaviors of Spoken Dialogue Systems users , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Gökhan Tür,et al.  A Discriminative Classification-Based Approach to Information State Updates for a Multi-Domain Dialog System , 2012, INTERSPEECH.

[4]  Pei-hao Su,et al.  Reward estimation for dialogue policy optimisation , 2018, Comput. Speech Lang..

[5]  Ramón López-Cózar,et al.  A domain-independent statistical methodology for dialog management in spoken dialog systems , 2014, Comput. Speech Lang..

[6]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[7]  Oliver Lemon,et al.  Strategic Dialogue Management via Deep Reinforcement Learning , 2015, NIPS 2015.

[8]  Gary Geunbae Lee,et al.  Recent Approaches to Dialog Management for Spoken Dialog Systems , 2010, J. Comput. Sci. Eng..

[9]  Yorick Wilks,et al.  Some background on dialogue management and conversational speech for dialogue systems , 2011, Comput. Speech Lang..

[10]  Hui Ye,et al.  Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System , 2007, NAACL.

[11]  Maxine Eskénazi,et al.  Doing research on a deployed spoken dialogue system: one year of let's go! experience , 2006, INTERSPEECH.

[12]  Andreas Holzinger,et al.  Dialogue Systems for Intelligent Human Computer Interactions , 2019, BRAINS/WS-AFFIN@AmI.

[13]  Masahiro Araki,et al.  Fatal or not? Finding errors that lead to dialogue breakdowns in chat-oriented dialogue systems , 2015, EMNLP.

[14]  Encarna Segarra,et al.  User simulation in a stochastic dialog system , 2008, Comput. Speech Lang..

[15]  Milica Gasic,et al.  POMDP-Based Statistical Spoken Dialog Systems: A Review , 2013, Proceedings of the IEEE.

[16]  Jason D. Williams,et al.  The best of both worlds: unifying conventional dialog systems and POMDPs , 2008, INTERSPEECH.

[17]  Klaus-Peter Engelbrecht,et al.  A Clustering Approach to Assess Real User Profiles in Spoken Dialogue Systems , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[18]  H. Cuayahuitl,et al.  Human-computer dialogue simulation using hidden Markov models , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[19]  Steve J. Young,et al.  A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies , 2006, The Knowledge Engineering Review.

[20]  Pierre Lison,et al.  A hybrid approach to dialogue management based on probabilistic rules , 2015, Comput. Speech Lang..

[21]  Kallirroi Georgila,et al.  Learning user simulations for information state update dialogue systems , 2005, INTERSPEECH.

[22]  Hans-Peter Kriegel,et al.  DBSCAN Revisited, Revisited , 2017, ACM Trans. Database Syst..

[23]  Erik Cambria,et al.  Learning short-text semantic similarity with word embeddings and external knowledge sources , 2019, Knowl. Based Syst..

[24]  Cristina Conde,et al.  Combining dynamic finite state machines and text-based similarities to represent human behavior , 2019, Eng. Appl. Artif. Intell..

[25]  Araceli Sanchis,et al.  Online activity recognition using evolving classifiers , 2013, Expert Syst. Appl..

[26]  Encarna Segarra,et al.  Spoken dialog systems based on online generated stochastic finite-state transducers , 2016, Speech Commun..

[27]  Long Duong,et al.  An adaptable task-oriented dialog system for stand-alone embedded devices , 2019, ACL.

[28]  Michael F. McTear,et al.  Spoken Dialogue Technology , 2004, Springer London.

[29]  Roberto Pieraccini,et al.  The use of belief networks for mixed-initiative dialog modeling , 2000, IEEE Trans. Speech Audio Process..

[30]  David Griol,et al.  The Conversational Interface , 2016 .

[31]  Wei Li,et al.  Store classification using Text-Exemplar-Similarity and Hypotheses-Weighted-CNN , 2017, J. Vis. Commun. Image Represent..

[32]  David Griol,et al.  A statistical approach to spoken dialog systems design and evaluation , 2008, Speech Commun..

[33]  Wael Hassan Gomaa,et al.  A Survey of Text Similarity Approaches , 2013 .

[34]  Min Lin,et al.  Review of Intent Detection Methods in the Human-Machine Dialogue System , 2019, Journal of Physics: Conference Series.

[35]  Maxine Eskénazi,et al.  From rule-based to data-driven lexical entrainment models in spoken dialog systems , 2015, Comput. Speech Lang..

[36]  Steve J. Young,et al.  Partially observable Markov decision processes for spoken dialog systems , 2007, Comput. Speech Lang..

[37]  Milica Gasic,et al.  Bayesian dialogue system for the Let's Go Spoken Dialogue Challenge , 2010, 2010 IEEE Spoken Language Technology Workshop.

[38]  Andrew McCallum,et al.  A comparison of event models for naive bayes text classification , 1998, AAAI 1998.

[39]  Jorge Luis Victória Barbosa,et al.  Conversational agents in business: A systematic literature review and future research directions , 2020, Comput. Sci. Rev..

[40]  Alessandro Moschitti,et al.  Supervised Clustering of Questions into Intents for Dialog System Applications , 2018, EMNLP.

[41]  Maxine Eskénazi,et al.  Spoken Dialog Challenge 2010 , 2010, 2010 IEEE Spoken Language Technology Workshop.

[42]  Hui Ye,et al.  The Hidden Information State Approach to Dialog Management , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[43]  Anton Leuski,et al.  PRIMER: An Emotionally Aware Virtual Agent , 2019, IUI Workshops.

[44]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[45]  Michael J. Paul Mixed Membership Markov Models for Unsupervised Conversation Modeling , 2012, EMNLP.

[46]  Alexander I. Rudnicky,et al.  Acquiring Domain-Specific Dialog Information from Task-Oriented Human-Human Interaction through an Unsupervised Learning , 2008, EMNLP.

[47]  Roberto Navigli,et al.  From senses to texts: An all-in-one graph-based approach for measuring semantic similarity , 2015, Artif. Intell..

[48]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  P Deepak,et al.  MixKMeans: Clustering Question-Answer Archives , 2016, EMNLP.

[50]  Helen F. Hastie,et al.  “Let's Go, DUDE!” using the Spoken Dialogue Challenge to teach Spoken Dialogue development , 2010, 2010 IEEE Spoken Language Technology Workshop.

[51]  Carlos D. Martínez-Hinarejos,et al.  Statistical framework for a Spanish spoken dialogue corpus , 2008, Speech Commun..

[52]  NavigliRoberto,et al.  From senses to texts , 2015 .

[53]  Angel Mora,et al.  A conversational recommender system for diagnosis using fuzzy rules , 2020, Expert Syst. Appl..

[54]  Asif Ekbal,et al.  A Deep Multi-task Model for Dialogue Act Classification, Intent Detection and Slot Filling , 2020, Cognitive Computation.

[55]  Jonathan Weese,et al.  UMBC_EBIQUITY-CORE: Semantic Textual Similarity Systems , 2013, *SEMEVAL.

[56]  Gökhan Tür,et al.  Optimizing SVMs for complex call classification , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[57]  Dilpal Singh,et al.  Migration Effects on BBO Evolution in Optimizing Fifteen Element Yagi-Uda Antenna Design , 2013 .

[58]  Silvia Rossi,et al.  Special issue on user profiling and behavior adaptation for human-robot interaction , 2017, Pattern Recognit. Lett..

[59]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[60]  Gary Geunbae Lee,et al.  Hybrid user intention modeling to diversify dialog simulations , 2011, Comput. Speech Lang..

[61]  A. Tiwari,et al.  Soft Computing in the Service Industry , 2006 .

[62]  K Sreelakshmi,et al.  Deep Bi-Directional LSTM Network for Query Intent Detection , 2018 .