Multimodal Generation in the COMIC Dialogue System

We describe how context-sensitive, user-tailored output is specified and produced in the COMIC multimodal dialogue system. At the conference, we will demonstrate the user-adapted features of the dialogue manager and text planner.

[1]  Simon King,et al.  Festival 2 - build your own general purpose unit selection speech synthesiser , 2004, SSW.

[2]  H. Kirchmann,et al.  SmartKom : Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell , 2003 .

[3]  Michael White,et al.  Efficient Realization of Coordinate Structures in Combinatory Categorial Grammar , 2006 .

[4]  Amy Isard,et al.  Speaking the Users' Languages , 2003, IEEE Intell. Syst..

[5]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[6]  Jeff A. Bilmes,et al.  Factored Language Models and Generalized Parallel Backoff , 2003, NAACL.

[7]  Martin Kay,et al.  Syntactic Process , 1979, ACL.

[8]  Mary Ellen Foster.  Interleaved Preparation and Output in the COMIC Fission Module , 2005, ACL 2005.

[9]  Yorick Wilks,et al.  Multimodal Dialogue Management in the COMIC Project , 2003 .

[10]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[11]  Mark Steedman,et al.  Information Structure and the Syntax-Phonology Interface , 2000, Linguistic Inquiry.

[12]  Mary Ellen Foster,et al.  Techniques for Text Planning with XSLT , 2004, NLPXML@ACL.

[13]  Johanna D. Moore,et al.  Speech-Plans: Generating Evaluative Responses in Spoken Dialogue , 2002, INLG.

[14]  Michael White,et al.  Reining in CCG Chart Realization , 2004, INLG.

[15]  Johanna D. Moore,et al.  Generating and evaluating evaluative arguments , 2006, Artif. Intell..

[16]  Michael White,et al.  Synthesising contextually appropriate intonation in limited domains , 2004, SSW.

[17]  Matthew Stone,et al.  Specifying and animating facial signals for discourse in embodied conversational agents , 2004, Comput. Animat. Virtual Worlds.

[18]  Joakim Gustafson,et al.  The August Spoken Dialogue System , 1999 .

[19]  Johanna D. Moore,et al.  Generating Tailored, Comparative Descriptions in Spoken Dialogue , 2004, FLAIRS Conference.

[20]  Michael White,et al.  Designing an Extensible API for Integrating Language Modeling and Realization , 2005, ACL 2005.

[21]  Mary Ellen Foster,et al.  Assessing the Impact of Adaptive Generation in the COMIC Multimodal Dialogue System , 2005 .