A context resolution server for the galaxy conversational systems

The context resolution (CR) component of a conversational dialogue system is responsible for interpreting a user’s utterance in the context of previously spoken user utterances, spatial and temporal context, inference, and shared world knowledge. This paper describes a new and independent CR server for the GALAXY conversational system framework. Among the functionality provided by the CR server is the inheritance and masking of historical information, pragmatic verification, as well as reference and ellipsis resolution. The new server additionally features a process that attempts to reconstruct the intention of the user given a robust parse of an utterance. Design issues are described, followed by a description of each function in the context resolution process along with examples. The effectiveness of the CR server in various domains attests to its success as a module for context resolution.

[1]  Terry Winograd,et al.  Understanding natural language , 1974 .

[2]  Daniel G. Bobrow,et al.  GUS, A Frame-Driven Dialog System , 1986, Artif. Intell..

[3]  William A. Woods,et al.  Semantics and Quantification in Natural Language Question Answering , 1986, Adv. Comput..

[4]  Gary G. Hendrix,et al.  Developing a natural language interface to complex data , 1977, TODS.

[5]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[6]  R. Schank,et al.  Inside Computer Understanding: Five Programs Plus Miniatures , 1982 .

[7]  Teun A. van Dijk,et al.  Discourse and dialogue , 1985 .

[8]  J. Hobbs.  On the coherence and structure of discourse , 1985 .

[9]  Sandra Carberry.  A Pragmatics-Based Approach to Understanding Intersentential Ellipsis , 1985, ACL.

[10]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[11]  Bonnie Webber,et al.  So what can we talk about now , 1986 .

[12]  K. Witte,et al.  Discourse and Dialogue , 1987 .

[13]  James F. Allen.  Natural language understanding , 1987, Bejnamin/Cummings series in computer science.

[14]  William C. Mann,et al.  Rhetorical Structure Theory: Toward a functional theory of text organization , 1988 .

[15]  S. Chipman.  The Remembered Present: A Biological Theory of Consciousness , 1990, Journal of Cognitive Neuroscience.

[16]  Nicole Chovil.  Discourse‐oriented facial displays in conversation , 1991 .

[17]  Kathleen McKeown,et al.  Text generation: using discourse strategies and focus constraints to generate natural language text , 1985 .

[18]  Stephanie Seneff,et al.  TINA: A Natural Language System for Spoken Language Applications , 1992, Comput. Linguistics.

[19]  Stephanie Seneff.  Robust parsing for spoken language systems , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[21]  Andrew Kehler,et al.  A Discourse Copying Algorithm for Ellipsis and Anaphora Resolution , 1993, EACL.

[22]  Kenneth Wauchope,et al.  Eucalyptus: Integrating Natural Language Input with a Graphical User Interface , 1994 .

[23]  Victor Zue,et al.  PEGASUS: A spoken dialogue interface for on-line air travel planning , 1994, Speech Communication.

[24]  Akikazu Takeuchi,et al.  Speech Dialogue With Facial Displays: Multimodal Human-Computer Conversation , 1994, ACL.

[25]  Carla Huls,et al.  EDWARD: full integration of language and action in a multimodal user interface , 1994, Int. J. Hum. Comput. Stud..

[26]  Victor Zue,et al.  PEGASUS: A Spoken Language Interface for On-Line Air Travel Planning I , 1994, HLT.

[27]  Victor Zue,et al.  GALAXY: a human-language interface to on-line travel information , 1994, ICSLP.

[28]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[29]  Victor Zue,et al.  Multilingual spoken-language understanding in the MIT Voyager system , 1995, Speech Commun..

[30]  Joseph Polifroni,et al.  Multimodal discourse modelling in a multi-user multi-domain environment , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[31]  James R. Glass,et al.  A probabilistic framework for feature-based speech recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[32]  Bonnie L. Webber,et al.  Structure and Ostension in the Interpretation of Discourse Deixis , 1991, ArXiv.

[33]  Thomas Rist,et al.  Referring Phenomena in a Multimedia Context and their Computational Treatment , 1997 .

[34]  Victor Zue,et al.  WebGALAXY: Beyond Point and Click - a Conversational Interface to a Browser , 1997, Comput. Networks.

[35]  Adam Cheyer,et al.  CommandTalk: A Spoken-Language Interface for Battlefield Simulations , 1997, ANLP.

[36]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[37]  An Architecture for Dialogue Management, Context Tracking, and Pragmatic Adaptation in Spoken Dialogue Systems , 1998, COLING.

[38]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[39]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[40]  Donna K. Byron.  Improving discourse management in TRIPS-98 , 1999, EUROSPEECH.

[41]  Amanda Stent,et al.  The CommandTalk Spoken Dialogue System , 1999, ACL.

[42]  Sharon Goldwater,et al.  Interpreting Language in Context in CommandTalk , 1999 .

[43]  Michael Strube,et al.  Resolving Discourse Deictic Anaphora in Dialogues , 1999, EACL.

[44]  Stephanie Seneff,et al.  GENESIS-II: a versatile system for language generation in conversational system applications , 2000, INTERSPEECH.

[45]  Stephanie Seneff,et al.  ORION: from on-line interaction to off-line delegation , 2000, INTERSPEECH.

[46]  James R. Glass,et al.  A flexible, scalable finite-state transducer architecture for corpus-based concatenative speech synthesis , 2000, INTERSPEECH.

[47]  Stephanie Seneff,et al.  Dialogue Management in the Mercury Flight Reservation System , 2000 .

[48]  Victor Zue,et al.  Data collection and performance evaluation of spoken dialogue systems: the MIT experience , 2000, INTERSPEECH.

[49]  Victor Zue,et al.  JUPlTER: a telephone-based conversational interface for weather information , 2000, IEEE Trans. Speech Audio Process..

[50]  James R. Glass,et al.  Speechbuilder: facilitating spoken dialogue system development , 2001, INTERSPEECH.

[51]  James F. Allen,et al.  An architecture for more realistic conversational systems , 2001, IUI '01.

[52]  Stanley Peters,et al.  The WITAS multi-modal dialogue system I , 2001, INTERSPEECH.

[53]  Hao Yan,et al.  More than just a pretty face: conversational protocols and the affordances of embodiment , 2001, Knowl. Based Syst..

[54]  Joseph Polifroni,et al.  PROMOTING PORTABILITY IN DIALOGUE MANAGEMENT , 2002 .

[55]  Stephanie Seneff,et al.  Response planning and generation in the MERCURY flight reservation system , 2002, Comput. Speech Lang..