Information Seeking Spoken Dialogue Systems— Part I: Semantics and Pragmatics

In this paper, the semantic and pragmatic modules of a spoken dialogue system development platform are presented and evaluated. The main goal of this research is to create spoken dialogue system modules that are portable across applications domains and interaction modalities. We propose a hierarchical semantic representation that encodes all information supplied by the user over multiple dialogue turns and can efficiently represent and be used to argue with ambiguous or conflicting information. Implicit in this semantic representation is a pragmatic module, consisting of context tracking, pragmatic analysis and pragmatic scoring submodules, which computes pragmatic confidence scores for all system beliefs. These pragmatic scores are obtained by combining semantic and pragmatic evidence from the various sub-modules (taking into account the modality of input) and are used to rank-order attribute-value pairs in the semantic representation, as well as identifying and resolving ambiguities. These modules were implemented and evaluated within a travel reservation dialogue system under the auspices of the DARPA Communicator project, as well as for a movie information application. Formal evaluation of the semantic and pragmatic modules has shown that by incorporating pragmatic analysis and scoring, the quality of the system improves for over 20% of the dialogue fragments examined

[1]  Staffan Larsson,et al.  Information state and dialogue management in the TRINDI dialogue move engine toolkit , 2000, Natural Language Engineering.

[2]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[3]  Alexander H. Waibel,et al.  Dialogue strategies guiding users to their communicative goals , 1997, EUROSPEECH.

[4]  Alexander I. Rudnicky,et al.  Creating natural dialogs in the carnegie mellon communicator system , 1999, EUROSPEECH.

[5]  Gregory A. Sanders,et al.  Darpa Communicator Evaluation: Progress from 2000 to 2001 Darpa Communicator Evaluation: Progress from 2000 to 2001 , 2022 .

[6]  Marilyn A. Walker,et al.  Quantitative and Qualitative Evaluation of Darpa Communicator Spoken Dialogue Systems , 2001, ACL.

[7]  Shrikanth S. Narayanan,et al.  SPOKEN LANGUAGE DIALOGUE : FROM THEORY TO PRACTICE , 1999 .

[8]  B. Carpenter,et al.  Type-Logical Semantics , 1997 .

[9]  Stanley Peters,et al.  Probabilistic Dialogue Modelling , 2002, SIGDIAL Workshop.

[10]  Tatsuya Kawahara,et al.  Generating effective confirmation and guidance using two-level confidence measures for dialogue systems , 2000, INTERSPEECH.

[11]  Wayne H. Ward,et al.  THE CU COMMUNICATOR SYSTEM 1 , 1999 .

[12]  Robert C. Moore,et al.  Formal Theories of the Commonsense World , 1985 .

[13]  Alexander I. Rudnicky.  AN AGENDA-BASED DIALOG MANAGEMENT ARCHITECTURE FOR SPOKEN LANGUAGE SYSTEMS , 1999 .

[14]  David Heckerman,et al.  Probabilistic Interpretation for MYCIN's Certainty Factors , 1990, UAI.

[15]  E. Shortliffe.  Computer-based medical consultations: mycin (elsevier north holland , 1976 .

[16]  Joseph Polifroni,et al.  A form-based dialogue manager for spoken language applications , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[17]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[18]  Chin-Hui Lee,et al.  DESIGN PRINCIPLES AND TOOLS FOR MULTIMODAL DIALOG SYSTEMS , 2000 .

[19]  Eric Fosler-Lussier,et al.  Ambiguity representation and resolution in spoken dialogue systems , 2001, INTERSPEECH.

[20]  Jennifer Chu-Carroll.  Form-based reasoning for mixed-initiative dialogue management in information-query systems , 1999, EUROSPEECH.

[21]  Edward H. Shortliffe,et al.  Computer-based medical consultations, MYCIN , 1976 .

[22]  Alexander I. Rudnicky,et al.  Sorry and I Didn’t Catch That! - An Investigation of Non-understanding Errors and Recovery Strategies , 2005, SIGDIAL.

[23]  A.I. Rudnicky,et al.  Constructing accurate beliefs in spoken dialog systems , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[24]  Marilyn A. Walker,et al.  Towards developing general models of usability with PARADISE , 2000, Natural Language Engineering.

[25]  Michael Johnston,et al.  Finite-state multimodal integration and understanding , 2005, Natural Language Engineering.

[26]  Eric Fosler-Lussier,et al.  Information Seeking Spoken Dialogue Systems— Part II: Multimodal Dialogue , 2007, IEEE Transactions on Multimedia.

[27]  Marilyn A. Walker,et al.  Evaluation for Darpa Communicator Spoken Dialogue Systems , 2000, LREC.

[28]  Lars Bo Larsen,et al.  Combining Objective and Subjective Data in Evaluation of Spoken Dialogues , 1999 .

[29]  Gregory A. Sanders,et al.  DARPA communicator: cross-system results for the 2001 evaluation , 2002, INTERSPEECH.

[30]  Bo Xu,et al.  Bridging the Gap between Dialogue management and dialogue models , 2002, SIGDIAL Workshop.

[31]  Sherif Abdou,et al.  An enhanced BLSTIP dialogue research platform , 2000, INTERSPEECH.

[32]  Jennifer Chu-Carroll,et al.  MIMIC: An Adaptive Mixed Initiative Spoken Dialogue System for Information Queries , 2000, ANLP.

[33]  Matthias Denecke.  Rapid Prototyping for Spoken Dialogue Systems , 2002, COLING.

[34]  Mikio Nakano,et al.  Corpus-Based Discourse Understanding in Spoken Dialogue Systems , 2003, ACL.

[35]  Marilyn A. Walker,et al.  DATE: A Dialogue Act Tagging Scheme for Evaluation of Spoken Dialogue Systems , 2001, HLT.