A Modal Logic Framework for Human-Computer Spoken Interaction

One major goal of human computer interfaces is to simplify the communication task. Traditionally, users have been restricted to the language of computers for this task. With the emerging of the graphical and multimodal interfaces the effort required for working with a computer is decreasing. However, the problem of communication is still present, and users continue caring about the communication task when they deal with a computer. Our work focuses on improving the communication between the human and the computer. This paper presents the foundations of a multimodal dialog model based on a modal logic, which integrates the speech and the action under the same framework.

[1]  Sharon L. Oviatt,et al.  Breaking the Robustness Barrier: Recent Progress on the Design of Robust Multimodal Systems , 2002, Adv. Comput..

[2]  Philip R. Cohen,et al.  Intentions in Communication. , 1992 .

[3]  Hector J. Levesque,et al.  Rational interaction as the basis for communication , 2003 .

[4]  M. Martin Taylor,et al.  The Structure of Multimodal Dialogue II , 2001, Computational Linguistics.

[5]  W. van der Hoek,et al.  Unravelling nondeterminism: On having the ability to choose , 1993 .

[6]  D. Bouwhuis,et al.  The Structure of Multimodal Dialogue , 1989 .

[7]  Joseph Y. Halpern,et al.  A Guide to Completeness and Complexity for Modal Logics of Knowledge and Belief , 1992, Artif. Intell..

[8]  John-Jules Ch. Meyer,et al.  Communicating Rational Agents , 1994, KI.

[9]  C. Raymond Perrault,et al.  Elements of a Plan-Based Theory of Speech Acts , 1979, Cogn. Sci..

[10]  Philip R. Cohen,et al.  Persistence, Intention, and Commitment , 2003 .

[11]  D. Vernant,et al.  Approche actionnelle et modèle projectif du dialogue informatif , 1992 .

[12]  Helmut Prendinger,et al.  Reasoning about action and change , 1996, J. Log. Lang. Inf..

[13]  M. David Sadek,et al.  Logical Task Modelling for Man-Machine Dialogue , 1990, AAAI.

[14]  John-Jules Ch. Meyer,et al.  A Logic of Capabilities , 1994, LFCS.

[15]  Anil Nerode,et al.  Logical Foundations of Computer Science, International Symposium, LFCS 2009, Deerfield Beach, FL, USA, January 3-6, 2009. Proceedings , 1994, LFCS.

[16]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.