A Neural Network Approach to Intention Modeling for User-Adapted Conversational Agents

Spoken dialogue systems have been proposed to enable a more natural and intuitive interaction with the environment and human-computer interfaces. In this contribution, we present a framework based on neural networks that allows modeling of the user's intention during the dialogue and uses this prediction to dynamically adapt the dialogue model of the system taking into consideration the user's needs and preferences. We have evaluated our proposal to develop a user-adapted spoken dialogue system that facilitates tourist information and services and provide a detailed discussion of the positive influence of our proposal in the success of the interaction, the information and services provided, and the quality perceived by the users.

[1]  Joelle Pineau,et al.  Spoken Dialogue Management Using Probabilistic Reasoning , 2000, ACL.

[2]  G. Jonathan,et al.  Dynamics and the Semantics of Dialogue , 1996 .

[3]  Sokratis Kartakis,et al.  A design-and-play approach to accessible user interface development in Ambient Intelligence environments , 2010, Comput. Ind..

[4]  David Traum,et al.  Speech Acts for Dialogue Agents , 1999 .

[5]  David Suendermann-Oeft,et al.  Caller Experience: A method for evaluating dialog systems and its automatic prediction , 2008, 2008 IEEE Spoken Language Technology Workshop.

[6]  Chin-Hui Lee,et al.  An artificial neural network approach to automatic speech processing , 2014, Neurocomputing.

[7]  Kallirroi Georgila,et al.  Learning user simulations for information state update dialogue systems , 2005, INTERSPEECH.

[8]  David Griol,et al.  Influence of the data codification when applying evolving classifiers to develop spoken dialog systems , 2014, 2014 IEEE Symposium on Evolving and Autonomous Learning Systems (EALS).

[9]  Hua Ai,et al.  Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users , 2007, SIGDIAL.

[10]  MAGDALINI EIRINAKI,et al.  Web mining for web personalization , 2003, TOIT.

[11]  Masafumi Hagiwara,et al.  Natural language neural network and its application to question-answering system , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[12]  David Griol,et al.  A statistical approach to spoken dialog systems design and evaluation , 2008, Speech Commun..

[13]  James R. Lewis.  The Voice in the Machine: Building Computers That Understand Speech , 2012, Int. J. Hum. Comput. Interact..

[14]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[15]  Gary Geunbae Lee,et al.  Hybrid user intention modeling to diversify dialog simulations , 2011, Comput. Speech Lang..

[16]  Georgios Paliouras,et al.  Web Usage Mining as a Tool for Personalization: A Survey , 2003, User Modeling and User-Adapted Interaction.

[17]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[18]  Hui Ye,et al.  Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System , 2007, NAACL.

[19]  Roberto Pieraccini,et al.  User modeling for spoken dialogue system evaluation , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[20]  Encarna Segarra,et al.  Error handling in a stochastic dialog system through confidence measures , 2005, Speech Commun..

[21]  Kristiina Jokinen.  Natural Interaction in Spoken Dialogue Systems , .

[22]  Evans Jasmine.  A COMPARATIVE STUDY OF VARIOUS APPROACHES FOR DIALOGUE MANAGEMENT , 2016 .

[23]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[24]  Pierre Lison.  Model-based Bayesian reinforcement learning for dialogue management , 2013, INTERSPEECH.

[25]  Katsuhito Sudoh,et al.  Incorporating discourse features into confidence scoring of intention recognition results in spoken dialogue systems , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[26]  Eric Horvitz,et al.  Conversation as Action Under Uncertainty , 2000, UAI.

[27]  H. Cuayahuitl,et al.  Human-computer dialogue simulation using hidden Markov models , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[28]  J. Sadock.  Speech acts , 2007 .

[29]  Roberto Pieraccini,et al.  The use of belief networks for mixed-initiative dialog modeling , 2000, IEEE Trans. Speech Audio Process..

[30]  Mariano Sigman,et al.  Fast Distributed Dynamics of Semantic Networks via Social Media , 2015, Comput. Intell. Neurosci..

[31]  S. Singh,et al.  Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System , 2011, J. Artif. Intell. Res..

[32]  Computers Helping People with Special Needs , 2010, Lecture Notes in Computer Science.

[33]  Leszek Gajecki.  Architectures of neural networks applied for LVCSR language modeling , 2014, Neurocomputing.

[34]  Mingyuan Yang,et al.  Learning Document Semantic Representation with Hybrid Deep Belief Network , 2015, Comput. Intell. Neurosci..

[35]  Lee A. Kirkpatrick,et al.  A Simple Guide to IBM SPSS: for Version 22.0 , 2014 .

[36]  Steve Young,et al.  The statistical approach to the design of spoken dialogue systems , 2003 .

[37]  Wei Gao,et al.  Gradient Learning Algorithms for Ontology Computing , 2014, Comput. Intell. Neurosci..

[38]  Doreen Eichel.  Spoken Dialogue Technology Towards The Conversational User Interface , 2016 .

[39]  Peter A. Heeman.  Combining Reinforcement Learning with Information-State Update Rules ∗ , 2007 .

[40]  Michael F. McTear,et al.  Spoken Dialogue Technology , 2004, Springer London.

[41]  Oliver Lemon,et al.  DIPPER: Description and Formalisation of an Information-State Update Dialogue System Architecture , 2003, SIGDIAL Workshop.

[42]  Hui Ye,et al.  The Hidden Information State Approach to Dialog Management , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[43]  James R. Glass,et al.  Exploiting Context Information in Spoken Dialogue Interaction with Mobile Devices ? , 2022 .

[44]  Joelle Pineau,et al.  Building Adaptive Dialogue Systems Via Bayes-Adaptive POMDPs , 2012, IEEE Journal of Selected Topics in Signal Processing.

[45]  Wolfgang L. Zagler,et al.  Computers Helping People with Special Needs, 12th International Conference, ICCHP 2010, Vienna, Austria, July 14-16, 2010, Proceedings, Part II , 2010, ICCHP.

[46]  Emilio Sanchis,et al.  Managing Unseen Situations in a Stochastic Dialog Model , 2006 .

[47]  Encarna Segarra,et al.  An Online Generated Transducer to Increase Dialog Manager Coverage , 2012, INTERSPEECH.

[48]  Fangju Wang,et al.  Modeling user behavior online for disambiguating user input in a spoken dialogue system , 2013, Speech Commun..

[49]  Jungyun Seo,et al.  A statistical prediction model of speakers' intentions using multi-level features in a goal-oriented dialog system , 2012, Pattern Recognit. Lett..

[50]  Volkmar Frinken,et al.  Neural network language models for off-line handwriting recognition , 2014, Pattern Recognition.

[51]  Satoshi Nakamura,et al.  Recent advances in WFST-based dialog system , 2009, INTERSPEECH.

[52]  David Griol,et al.  Development of Interactive Virtual Voice Portals to Provide Municipal Information , 2012, DCAI.

[53]  Steve J. Young,et al.  A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies , 2006, The Knowledge Engineering Review.

[54]  Gary Geunbae Lee,et al.  Recent Approaches to Dialog Management for Spoken Dialog Systems , 2010, J. Comput. Sci. Eng..

[55]  Patrick Haffner,et al.  Scaling large margin classifiers for spoken language understanding , 2006, Speech Commun..

[56]  Marilyn A. Walker,et al.  Reinforcement Learning for Spoken Dialogue Systems , 1999, NIPS.

[57]  Peter A. Heeman.  Combining Reinformation Learning with Information-State Update Rules , 2007, HLT-NAACL.

[58]  Yorick Wilks,et al.  Some background on dialogue management and conversational speech for dialogue systems , 2011, Comput. Speech Lang..

[59]  Kallirroi Georgila,et al.  Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems , 2005, SIGDIAL.