University of Colorado Dialogue Systems for Travel and Navigation

This paper presents recent improvements in the development of the University of Colorado "CU Communicator" and "CU-Move" spoken dialog systems. First, we describe the CU Communicator system that integrates speech recognition, synthesis and natural language understanding technologies using the DARPA Hub Architecture. Users are able to converse with an automated travel agent over the phone to retrieve up-to-date travel information such as flight schedules, pricing, along with hotel and rental car availability. The CU Communicator has been under development since April of 1999 and represents our test-bed system for developing robust human-computer interactions where reusability and dialogue system portability serve as two main goals of our work. Next, we describe our more recent work on the CU Move dialog system for in-vehicle route planning and guidance. This work is in joint collaboration with HRL and is sponsored as part of the DARPA Communicator program. Specifically, we will provide an overview of the task, describe the data collection environment for in-vehicle systems development, and describe our initial dialog system constructed for route planning.

[1]  John H. L. Hansen,et al.  Constrained iterative speech enhancement with application to speech recognition , 1991, IEEE Trans. Signal Process..

[2]  Wayne H. Ward.  Extracting information in spontaneous speech , 1994, ICSLP.

[3]  Mosur Ravishankar,et al.  Efficient Algorithms for Speech Recognition. , 1996 .

[4]  Roland Reagan.  THE CU COMMUNICATOR SYSTEM , 1998 .

[5]  John H. L. Hansen,et al.  An improved (Auto: I, LSP: T) constrained iterative speech enhancement for colored noise environments , 1998, IEEE Trans. Speech Audio Process..

[6]  Victor Zue,et al.  GALAXY-II: a reference architecture for conversational system development , 1998, ICSLP.

[7]  Wayne H. Ward,et al.  THE CU COMMUNICATOR SYSTEM 1 , 1999 .

[8]  Maxine Eskénazi,et al.  Data collection and processing in the carnegie mellon communicator , 1999, EUROSPEECH.

[9]  John H. L. Hansen,et al.  Improved Jacobian adaptation for fast acoustic model adaptation in noisy speech recognition , 2000, INTERSPEECH.

[10]  Wayne H. Ward,et al.  The CU communicator: an architecture for dialogue systems , 2000, INTERSPEECH.

[11]  John H. L. Hansen,et al.  "CU-move": robust speech processing for in-vehicle speech systems , 2000, INTERSPEECH.

[12]  Wayne H. Ward,et al.  Confidence measures for dialogue management in the CU Communicator system , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[13]  John H. L. Hansen,et al.  PCA-PMC: a novel use of a priori knowledge for fast parallel model combination , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[14]  Wayne H. Ward,et al.  On Combining Language Models: Oracle Approach , 2001, HLT.

[15]  Wayne H. Ward,et al.  Confidence measures for spoken dialogue systems , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[16]  Wayne H. Ward,et al.  Dialog-context dependent language modeling combining n-grams and stochastic context-free grammars , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).