TFSM‐based dialogue management model framework for affective dialogue systems

A new dialogue management model for affective dialogue system, which aims to provide a service of information inquiry and affective interaction, is proposed in this paper. First, we construct two finite state machines (TFSM) to model the user and the system, respectively, and simulate the dialogue process as an information exchange between the two state machines. All possible state transitions in dialogue and its probabilities of the user are summarized as a user model, which is helpful for the system to inference and predict the user's internal states. Second, we further discuss the implementation methods of information inquiry and emotional response modules. Finally, we employ the return function of partially observable Markov decision processes (POMDP) model to analyze and evaluate the TFSM‐based dialogue management model. The experimental results not only show the relationships between the average returns, recognition error rates, and state transition probabilities but also confirm that our TFSM‐based dialogue management model outperforms the conventional FSM model. © 2015 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

[1]  Nikos A. Vlassis,et al.  Perseus: Randomized Point-based Value Iteration for POMDPs , 2005, J. Artif. Intell. Res..

[2]  Pascal Poupart,et al.  Factored partially observable Markov decision processes for dialogue management , 2005 .

[3]  Gary Geunbae Lee,et al.  Example-based dialog modeling for practical multi-domain dialog system , 2009, Speech Commun..

[4]  Joelle Pineau,et al.  Spoken Dialogue Management Using Probabilistic Reasoning , 2000, ACL.

[5]  Ramón López-Cózar,et al.  Enhancement of emotion detection in spoken dialogue systems by combining several information sources , 2011, Speech Commun..

[6]  Ioannis Arapakis,et al.  Theories, methods and current research on emotions in library and information science, information retrieval and human-computer interaction , 2011, Inf. Process. Manag..

[7]  Rosalind W. Picard.  Affective Computing , 1997 .

[8]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[9]  Fuji Ren,et al.  Affective Information Processing and Recognizing Human Emotion , 2006, MFCSIT.

[10]  Ramón López-Cózar,et al.  Predicting user mental states in spoken dialogue systems , 2011, EURASIP J. Adv. Signal Process..

[11]  Gary Geunbae Lee,et al.  Recent Approaches to Dialog Management for Spoken Dialog Systems , 2010, J. Comput. Sci. Eng..

[12]  Fuji Ren,et al.  Predicting User-Topic Opinions in Twitter with Social and Topical Context , 2013, IEEE Transactions on Affective Computing.

[13]  Arvid Kappas,et al.  Affect and Social Processes in Online Communication--Experiments with an Affective Dialog System , 2013, IEEE Transactions on Affective Computing.

[14]  Hyo-Jung Oh,et al.  An Intelligent TV interface based on Statistical Dialogue Management , 2007, IEEE Transactions on Consumer Electronics.

[15]  Rosalind W. Picard.  Affective computing: (526112012-054) , 1997 .

[16]  Milica Gasic,et al.  POMDP-Based Statistical Spoken Dialog Systems: A Review , 2013, Proceedings of the IEEE.

[17]  Kee-Eung Kim,et al.  Robust Performance Evaluation of POMDP-Based Dialogue Systems , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  Anton Nijholt,et al.  A tractable hybrid DDN–POMDP approach to affective dialogue modeling for probabilistic frame-based dialogue systems , 2008, Natural Language Engineering.

[19]  Tae-Yong Kuc,et al.  Implementation of dialogue system for intelligent service robots , 2008, 2008 International Conference on Control, Automation and Systems.

[20]  S. Young,et al.  Scaling POMDPs for Spoken Dialog Management , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[21]  Sumio Ohno,et al.  A new method for dialogue management in an intelligent system for information retrieval , 2000, INTERSPEECH.

[22]  Anton Nijholt,et al.  A tractable DDN-POMDP Approach to Affective Dialogue Modeling for General Probabilistic Frame-based Dialogue Systems , 2007 .

[23]  Joseph Mariani,et al.  An Overview of EU Programs Related to Conversational/Interactive Systems , 2007 .

[24]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[25]  Milica Gasic,et al.  The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management , 2010, Comput. Speech Lang..

[26]  Elisabeth André,et al.  Affective dialogue systems : Tutorial and Research Workshop, ADS 2004, Kloster Irsee, Germany, June 14-16, 2004 : proceedings , 2004 .

[27]  Fuji Ren,et al.  A hybrid approach for word emotion recognition , 2013 .

[28]  Steve J. Young,et al.  Partially observable Markov decision processes for spoken dialog systems , 2007, Comput. Speech Lang..

[29]  Xin Kang,et al.  Employing hierarchical Bayesian networks in simple and complex emotion topic analysis , 2013, Comput. Speech Lang..

[30]  Wolfgang Minker,et al.  Emotion recognition and adaptation in spoken dialogue systems , 2010, Int. J. Speech Technol..

[31]  Anton Nijholt,et al.  Affective Dialogue Management Using Factored POMDPs , 2010, Interactive Collaborative Information Systems.

[32]  Gregory A. Sanders,et al.  Darpa Communicator Evaluation: Progress from 2000 to 2001 Darpa Communicator Evaluation: Progress from 2000 to 2001 , 2022 .

[33]  Kai-Tai Song,et al.  Robotic Emotional Expression Generation Based on Mood Transition and Personality Model , 2013, IEEE Transactions on Cybernetics.