ISIS : A Trilingual Conversational System with Learning Capabilities and Combined Interaction and Delegation Dialogs

ISIS, which abbreviates Intelligent Speech for Information Systems, is a trilingual spoken dialog system (SDS) for the financial domain. It handles two dialects of Chinese (Cantonese and Putonghua), as well as English – the predominant languages in our region. The system supports spoken language queries regarding stock market information and simulated personal portfolios. Real-time information is retrieved directly from a dedicated Reuters satellite feed. ISIS provides a system test-bed for our work in multilingual speech recognition and generation, speaker authentication, language understanding and dialog modeling. Furthermore, ISIS supports our new explorations in: (i) CORBA's interoperability and scalability for SDS development; (ii) asynchronous human-computer interaction by delegation to KQML software agents; (iii) switching between online interaction and offline delegation in a single dialog thread, and (iv) automatic incorporation of newly listed stocks to expand our system’s knowledge base.

[1]  Wai Lam,et al.  To believe is to understand , 1999, EUROSPEECH.

[2]  Tim Finin,et al.  KQML - A Language and Protocol for Knowledge and Information Exchange , 1994 .

[3]  Alexander I. Rudnicky,et al.  Creating natural dialogs in the carnegie mellon communicator system , 1999, EUROSPEECH.

[4]  Ke Chen,et al.  ISIS: a learning system with combined interaction and delegation dialogs , 2001, INTERSPEECH.

[5]  Eric Brill,et al.  Automatic Grammar Induction and Parsing Free Text: A Transformation-Based Approach , 1993, ACL.

[6]  Salim Roukos,et al.  Free-flow dialog management using forms , 1999, EUROSPEECH.

[7]  Paul Taylor,et al.  The architecture of the Festival speech synthesis system , 1998, SSW.

[8]  Christine Doran,et al.  Exploring Speech-Enabled Dialogue with the Galaxy Communicator Infrastructure , 2001, HLT.

[9]  Joseph Polifroni,et al.  Organization, communication, and control in the GALAXY-II conversational system , 1999, EUROSPEECH.

[10]  Helen Meng,et al.  Concatenating syllables for response generation in domain-specific applications , 2000 .

[11]  Lori Lamel,et al.  Design strategies for spoken language dialog systems , 1999, EUROSPEECH.

[12]  Helen Meng,et al.  Comprehension across Application Domains and Languages , 2000 .

[13]  Douglas A. Reynolds,et al.  A Gaussian mixture modeling approach to text-independent speaker identification , 1992 .

[14]  Ke Chen,et al.  ISIS: A multilingual spoken dialog system developed with CORBA and KQML agents , 2000, INTERSPEECH.