Multimodal Cooperative Resolution of Referential Expressions in the DenK System

We present an approach to the resolution of multimodal referential expressions in a cooperative human-machine communication setting, provided by the DenK system. We discuss how references involving multiple modalities are resolved, and we also indicate how the system can respond cooperatively in case the resolution process fails.

[1]  de Ng Dick Bruijn,et al.  A survey of the project Automath , 1980 .

[2]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[3]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[4]  H. C. Bunt,et al.  DIT: Dynamic interpretation in text and dialogue , 1990 .

[5]  Scott Weinstein,et al.  Providing a Unified Account of Definite Noun Phrases in Discourse , 1983, ACL.

[6]  R. Ahn,et al.  Discourse representation meets constructive mathematics , 1990 .

[7]  L. A. Kievit.  Context-driven natural language interpretation , 1998 .

[8]  Harry Bunt,et al.  Multimodal Cooperation with the DENK System , 1995, Multimodal Human-Computer Communication.

[9]  Pla Paul Piwek,et al.  Logic, information and conversation , 1998 .

[10]  Michael D. Wilson,et al.  Multimodal integration in MMI2: anaphora resolution and mode selection , 1992 .

[11]  Hiyan Alshawi,et al.  Memory and context for language interpretation , 1987 .

[12]  Harry Bunt,et al.  Issues in Multimodal Human-Computer Communication , 1995, Multimodal Human-Computer Communication.

[13]  Eaj Eric Peeters.  Design of an object-oriented, interactive animation system , 1995 .

[14]  Manfred Pinkal,et al.  On Semantic Underspecification , 1999 .

[15]  M.E.M.C. Verlinden.  A constraint-based grammar for dialogue utterances , 1999 .

[16]  Per Martin-Löf,et al.  Intuitionistic type theory , 1984, Studies in proof theory.