Acquisition and Assessment of Semantic Content for the Generation of Elaborateness and Indirectness in Spoken Dialogue Systems

In a dialogue system, the dialogue manager selects one of several system actions and thereby determines the system’s behaviour. Defining all possible system actions in a dialogue system by hand is a tedious work. While efforts have been made to automatically generate such system actions, those approaches are mostly focused on providing functional system behaviour. Adapting the system behaviour to the user becomes a difficult task due to the limited amount of system actions available. We aim to increase the adaptability of a dialogue system by automatically generating variants of system actions. In this work, we introduce an approach to automatically generate action variants for elaborateness and indirectness. Our proposed algorithm extracts RDF triplets from a knowledge base and rates their relevance to the original system action to find suitable content. We show that the results of our algorithm are mostly perceived similarly to human generated elaborateness and indirectness and can be used to adapt a conversation to the current user and situation. We also discuss where the results of our algorithm are still lacking and how this could be improved: Taking into account the conversation topic as well as the culture of the user is likely to have beneficial effect on the user’s perception.

[1]  Gregor Bertrand,et al.  Adapting Dialogue to User Emotion - A Wizard-of-Oz study for adaptation strategies , 2011 .

[2]  Mirella Lapata,et al.  Collective Content Selection for Concept-to-Text Generation , 2005, HLT.

[3]  Georgios Meditskos,et al.  Towards an Ontology-Driven Adaptive Dialogue Framework , 2016, MARMI@ICMR.

[4]  L. Miguel Encarnação,et al.  The effectiveness of social agents in reducing user frustration , 2006, CHI EA '06.

[5]  Dietmar F. Rösner,et al.  Adaptive Dialogue Management in the NIMITEK Prototype System , 2008, PIT.

[6]  Satoshi Nakamura,et al.  Cultural Communication Idiosyncrasies in Human-Computer Interaction , 2016, SIGDIAL Conference.

[7]  David Vandyke,et al.  Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems , 2015, EMNLP.

[8]  Rudolf Kadlec,et al.  Improved Deep Learning Baselines for Ubuntu Corpus Dialogs , 2015, ArXiv.

[9]  Wolfgang Minker,et al.  Quality-adaptive Spoken Dialogue Initiative Selection And Implications On Reward Modelling , 2015, SIGDIAL Conference.

[10]  Kathleen McKeown,et al.  Statistical Acquisition of Content Selection Rules for Natural Language Generation , 2003, EMNLP.

[11]  Oliver Lemon,et al.  Reinforcement Learning for Adaptive Dialogue Systems - A Data-driven Methodology for Dialogue Management and Natural Language Generation , 2011, Theory and Applications of Natural Language Processing.

[12]  Veikko Surakka,et al.  The effects of affective interventions in human-computer interaction , 2004, Interact. Comput..

[13]  Kathleen F. McCoy,et al.  Generation of Single-sentence Paraphrases from Predicate/Argument Structure using Lexico-grammatical Resources , 2003, IWP@ACL.

[14]  Tatsuya Kawahara,et al.  User Modeling in Spoken Dialogue Systems to Generate Flexible Guidance , 2004, User Modeling and User-Adapted Interaction.

[15]  Ruth Aylett,et al.  Computational Modelling of Culture and Affect , 2012 .

[16]  Georgios Meditskos,et al.  Description Logics and Rules for Multimodal Situational Awareness in Healthcare , 2017, MMM.

[17]  Yiannis Kompatsiaris,et al.  Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities , 2016, MARMI@ICMR.

[18]  Luciano Serafini,et al.  From Ontology to NL: Generation of Multilingual User-Oriented Environmental Reports , 2012, NLDB.

[19]  Wolfgang Minker,et al.  Managing adaptive spoken dialogue for Intelligent Environments , 2014, J. Ambient Intell. Smart Environ..

[20]  Kevin Knight,et al.  Generation that Exploits Corpus-Based Statistical Knowledge , 1998, ACL.

[21]  Vasile Rus,et al.  Forms2Dialog: Automatic dialog generation for Web tasks , 2014, 2014 IEEE Spoken Language Technology Workshop (SLT).

[22]  Johannes Pittermann,et al.  A data-oriented approach to integrate emotions in adaptive dialogue management , 2007, IUI '07.

[23]  Juliana Miehle,et al.  Automatic Modification of Communication Style in Dialogue Management , 2016, CC-NLG.

[24]  John Fox,et al.  Automatic generation of spoken dialogue from medical plans and ontologies , 2006, J. Biomed. Informatics.

[25]  Wolfgang Minker,et al.  Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management , 2017, IWSDS.

[26]  Ke Zhai,et al.  Discovering Latent Structure in Task-Oriented Dialogues , 2014, ACL.

[27]  Wolfgang Minker,et al.  Endowing Spoken Language Dialogue Systems with Emotional Intelligence , 2004, ADS.

[28]  Ana Paiva,et al.  Social Importance Dynamics: A Model for Culturally-Adaptive Agents , 2013, IVA.