JUPlTER: a telephone-based conversational interface for weather information

In early 1997, our group initiated a project to develop JUPITER, a conversational interface that allows users to obtain worldwide weather forecast information over the telephone using spoken dialogue. It has served as the primary research platform for our group on many issues related to human language technology, including telephone-based speech recognition, robust language understanding, language generation, dialogue modeling, and multilingual interfaces. Over a two year period since coming online in May 1997, JUPITER has received, via a toll-free number in North America, over 30000 calls (totaling over 180000 utterances), mostly from naive users. The purpose of this paper is to describe our development effort in terms of the underlying human language technologies as well as other system-related issues such as utterance rejection and content harvesting. We also present some evaluation results on the system and its components.

[1]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[2]  Michael Riley,et al.  Speech Recognition by Composition of Weighted Finite Automata , 1996, ArXiv.

[3]  James Glass,et al.  Evaluation methodology for a telephone-based conversational system , 1998 .

[4]  Timothy J. Hazen,et al.  Word and phone level acoustic confidence scoring , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[5]  Stephanie Seneff,et al.  TINA: A Natural Language System for Spoken Language Applications , 1992, Comput. Linguistics.

[6]  Victor Zue,et al.  From interface to content: translingual access and delivery of on-line information , 1997, EUROSPEECH.

[7]  Victor Zue,et al.  GALAXY: a human-language interface to on-line travel information , 1994, ICSLP.

[8]  Victor Zue,et al.  Multilingual spoken-language understanding in the MIT Voyager system , 1995, Speech Commun..

[9]  FlammiaGiovanni,et al.  Multilingual spoken-language understanding in the MIT Voyager system , 1995 .

[10]  James R. Glass,et al.  Heterogeneous measurements and multiple classifiers for speech recognition , 1998, ICSLP.

[11]  James R. Glass,et al.  Confidence scoring for speech understanding systems , 1998, ICSLP.

[12]  Victor Zue,et al.  PEGASUS: A spoken dialogue interface for on-line air travel planning , 1994, Speech Communication.

[13]  Stephanie Sene Robust Parsing for Spoken Language Systems , 1992 .

[14]  Victor Zue,et al.  Webgalaxy - integrating spoken language and hypertext navigation , 1997, EUROSPEECH.

[15]  James R. Glass,et al.  Real-time telephone-based speech recognition in the Jupiter domain , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[16]  Victor Zue,et al.  Conversational interfaces: advances and challenges , 1997, Proceedings of the IEEE.

[17]  Jean-Luc Gauvain,et al.  Field trials of a telephone service for rail travel information , 1996, Proceedings of IVTTA '96. Workshop on Interactive Voice Technology for Telecommunications Applications.

[18]  Jean-Luc Gauvain,et al.  The LIMSI RailTel System: Field trial of a telephone service for rail travel information , 1997, Speech Commun..

[19]  Stephanie Seneff,et al.  Towards multi-domain speech understanding using a two-stage recognizer , 1999, EUROSPEECH.

[20]  Andrej Ljolje,et al.  Full expansion of context-dependent networks in large vocabulary speech recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[21]  James R. Glass,et al.  A probabilistic framework for feature-based speech recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[22]  Yves Schabes,et al.  Speech Recognition by Composition of Weighted Finite Automata , 1997 .

[23]  Giuseppe Riccardi,et al.  How may I help you? , 1997, Speech Commun..

[24]  Volker Steinbiss,et al.  The Philips automatic train timetable information system , 1995, Speech Commun..

[25]  Roberto Billi,et al.  Interactive voice technology at work: The CSELT experience , 1995, Speech Commun..

[26]  Victor Zue,et al.  Multilingual human-computer interactions: from information access to language learning , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[27]  Victor Zue,et al.  PEGASUS: A Spoken Language Interface for On-Line Air Travel Planning I , 1994, HLT.

[28]  James R. Glass,et al.  Multilingual language generation across multiple domains , 1994, ICSLP.