The DenK-architecture: A fundamental approach to user-interfaces

In this paper we present the basic principles underlying the DenK-system, a generic cooperative interface combining linguistic and visual interaction. The system integrates results from fundamental research in knowledge representation, communication, natural language semantics and pragmatics, and object-oriented animation. Our design incorporates a cooperative and knowledgeable electronic assistant that communicates with a user in natural language, and an application domain, which is presented visually. The assistant, that we call thecooperator, has an information state that is represented in a rich form of Type Theory, a formalism that enables us to model the inherent cognitive dynamics of a dialogue participant. Pragmatic issues in man-machine interaction, concerning the use of natural language and knowledge in cooperative communication, are central to our approach.

[1]  Stuart C. Shapiro,et al.  Intelligent multi-media interface technology , 1991 .

[2]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[3]  R. J. Beun.  A framework for cooperative dialogues , 1991 .

[4]  Pierre Falzon,et al.  AN ARCHITECTURE FOR MULTIMODAL DIALOGUE , 1991 .

[5]  Leen Helmink,et al.  Goal directed proof construction in type theory , 1991 .

[6]  Wolfgang Wahlster,et al.  Plan-Based Integration of Natural Language and Graphics Generation , 1993, Artif. Intell..

[7]  簡聰富,et al.  物件導向軟體之架構(Object-Oriented Software Construction)探討 , 1989 .

[8]  Mark T. Maybury,et al.  Intelligent multimedia interfaces , 1994, CHI Conference Companion.

[9]  R. Ahn,et al.  Discourse representation meets constructive mathematics , 1990 .

[10]  Per Martin-Löf,et al.  Intuitionistic type theory , 1984, Studies in proof theory.

[11]  Siobhan Chapman.  Logic and Conversation , 2005 .

[12]  Miriam Lanskoy,et al.  From the Database , 1997 .

[13]  Barbara J. Grosz,et al.  Understanding Spoken Language , 1978 .

[14]  Robbert-Jan Beun,et al.  The recognition of Dutch declarative questions , 1990 .

[15]  D. Bouwhuis,et al.  The Structure of Multimodal Dialogue , 1989 .

[16]  M. de Rijke,et al.  Diamonds and Defaults , 1993 .

[17]  Cornelius W. A. M. van Overveld.  The generalized display processors as an approach to real-time interactive 3-D computer animation , 1991, Comput. Animat. Virtual Worlds.

[18]  T. Coquand.  Une théorie des constructions , 1985 .

[19]  Hendrik Pieter Barendregt,et al.  Introduction to generalized type systems , 1991, Journal of Functional Programming.

[20]  Harry Bunt,et al.  Dynamic Interpretation and Dialogue Theory , 2000 .

[21]  John D. Burger,et al.  The Application of Natural Language Models to Intelligent Multimedia , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[22]  Edwin Hutchins,et al.  Metaphors for Interface Design , 1987 .

[23]  de Ng Dick Bruijn,et al.  A survey of the project Automath , 1980 .

[24]  Brouwer-Janse,et al.  Referring in a shared workspace , 1994 .

[25]  Tijn Borghuis,et al.  Interpreting Modal Natural Deduction in Type Theory , 1993 .

[26]  Clarisse Sieckenius de Souza,et al.  The Semiotic Engineering of User Interface Languages , 1993, Int. J. Man Mach. Stud..

[27]  Jeroen Groenendijk,et al.  Formal methods in the study of language , 1983 .