Conspeakuous : Contextualising Conversational Systems

There has been a tremendous increase in the amount and type of information that is available through the Internet and through various sensors that now pervade our daily lives. Consequentially, the field of context aware computing has also contributed significantly in providing new technologies to mine and use the available context data. We present Conspeakuous - an architecture for modeling, aggregating and using the context in spoken language conversational systems. Since Conspeakuous is aware of the environment through different sources of context, it helps in making the conversation more relevant to the user, and thus reducing the cognitive load on the user. Additionally, the architecture allows for representing learning of various user/environment parameters as a source of context. We built a sample tourist information portal application based on the Conspeakuous architecture and conducted user studies to evaluate the usefulness of the system.

[1]  Wayne H. Ward,et al.  Dialog-context dependent language modeling combining n-grams and stochastic context-free grammars , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[2]  Stephanie Seneff,et al.  TINA: A Natural Language System for Spoken Language Applications , 1992, Comput. Linguistics.

[3]  Tanja Schultz,et al.  Comparison of acoustic model adaptation techniques on non-native speech , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[4]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[5]  David R. Traum,et al.  Book Reviews: Spoken Natural Language Dialogue Systems: A Practical Approach , 1996, CL.

[6]  Jadwiga Indulska,et al.  Modeling Context Information in Pervasive Computing Systems , 2002, Pervasive.

[7]  Shimei Pan,et al.  Context-based multimodal input understanding in conversational systems , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[8]  Vaibhava Goel,et al.  Task adaptation of acoustic and language models based on large quantities of data , 2004, INTERSPEECH.

[9]  K. Tanaka,et al.  An acoustic model adaptation using HMM-based speech synthesis , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[10]  Hsiao-Wuen Hon,et al.  An overview of the SPHINX speech recognition system , 1990, IEEE Trans. Acoust. Speech Signal Process..