Multilingual human-computer interactions: from information access to language learning

The paper describes the authors' recent work in developing multilingual conversational systems that support human-computer interactions. The approach is based on the premise that a common semantic representation can be extracted from the input for all languages, at least within the context of restricted domains. In the design of such systems, language dependent information is separated from the system kernel as much as possible, and encoded in external data structures. The internal system manager, discourse and dialogue component, and database are all maintained in a language transparent form. They describe two possible application areas for such multilingual capabilities: on-line information access using multilingual spoken dialogue, and the learning and maintenance of a foreign language using a multilingual conversational system.

[1]  Joseph Polifroni,et al.  Multimodal discourse modelling in a multi-user multi-domain environment , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[2]  Joseph Polifroni,et al.  A new restaurant guide conversational system: issues in rapid prototyping for specialized domains , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[3]  James R. Glass,et al.  A probabilistic framework for feature-based speech recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[4]  Victor Zue,et al.  PEGASUS: A spoken dialogue interface for on-line air travel planning , 1994, Speech Communication.

[5]  Harold L. Somers,et al.  An introduction to machine translation , 1992 .

[6]  Victor Zue,et al.  WHEELS: a conversational system in the automobile classifieds domain , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[7]  Stephanie Seneff,et al.  TINA: A Natural Language System for Spoken Language Applications , 1992, Comput. Linguistics.

[8]  Joseph Polifroni,et al.  A form-based dialogue manager for spoken language applications , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[9]  Stephanie Sene Robust Parsing for Spoken Language Systems , 1992 .

[10]  Victor Zue,et al.  Multilingual spoken-language understanding in the MIT Voyager system , 1995, Speech Commun..

[11]  James R. Glass,et al.  Multilingual language generation across multiple domains , 1994, ICSLP.

[12]  Victor Zue,et al.  Language modelling for recognition and understanding using layered bigrams , 1992, ICSLP.

[13]  Victor Zue,et al.  GALAXY: a human-language interface to on-line travel information , 1994, ICSLP.

[14]  Victor Zue,et al.  PEGASUS: A Spoken Language Interface for On-Line Air Travel Planning I , 1994, HLT.