Dialogue management for gestural interfaces

Gestural interfaces are electronic analogues to pencil and paper. Since the effectiveness of such interfaces depends heavily on enduser familiarity with pencil markup of printed documents, the interface must conform to the user's behaviour and not rely on educating the enduser. Spatial relationships among the gestural forms partially determine the syntactic interpretation of gestures, along with information about the context in the neighborhood of the gesture. Temporal grouping of gestural forms is more important than their temporal sequence. Such characteristics suggest a form of dialogue recognition in which rules do not specify temporal ordering of forms, and in which multiple parses are carried out in parallel.

[1]  Luca Cardelli,et al.  Squeak: a language for communicating with mice , 1985, SIGGRAPH.

[2]  David L. Parnas,et al.  On the use of transition diagrams in the design of a user interface for an interactive computer system , 1969, ACM '69.

[3]  Andrew J. Schulert,et al.  ADM — a dialog manager , 1985, CHI '85.

[4]  David J. Kasik,et al.  A user interface management system , 1982, SIGGRAPH.

[5]  David Robson,et al.  Smalltalk-80: The Language and Its Implementation , 1983 .

[6]  Alan Kay,et al.  Microelectronics and the Personal Computer , 1977 .

[7]  Charles C. Tappert,et al.  Handwriting recognition of transparent tablet over flat display , 1987 .

[8]  Daniel E. Lipkie,et al.  Star graphics: An object-oriented implementation , 1982, SIGGRAPH.

[9]  D. A. Henderson,et al.  The Trillium user interface design environment , 1986, CHI '86.

[10]  Phyllis Reisner,et al.  Formal Grammar and Human Factors Design of an Interactive Graphics System , 1981, IEEE Transactions on Software Engineering.

[11]  Barry Blesser,et al.  Interactive Recognition of Handprinted Characters for Computer Input , 1985, IEEE Computer Graphics and Applications.

[12]  Dan R. Olsen,et al.  SYNGRAPH: A graphical user interface generator , 1983, SIGGRAPH.

[13]  Greg Nelson,et al.  Juno, a constraint-based graphics system , 1985, SIGGRAPH.

[14]  Adele Goldberg,et al.  Personal Dynamic Media , 1977, Computer.

[15]  R. A. Duisberg,et al.  Animated graphical interfaces using temporal constraints , 1986, CHI '86.

[16]  Paul R. Hanau,et al.  Prototyping and simulation tools for user/computer dialogue design , 1980, SIGGRAPH '80.

[17]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[18]  Mark Green,et al.  The University of Alberta user interface management system , 1985, SIGGRAPH.

[19]  G. Pfister A high level language extension for creating and controlling dynamic pictures , 1976, ACM Symposium on Graphic Languages.

[20]  Catherine G. Wolf CAN PEOPLE USE GESTURE COMMANDS? , 1986, SGCH.

[21]  Jean R. Ward,et al.  Interactive Recognition of Handprinted Characters for Computer Input , 1985, IEEE Computer Graphics and Applications.

[22]  Alan Borning,et al.  The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory , 1981, TOPL.

[23]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..