Temporal Aspects of Tasks in the User Action Notation

The need for communication among a multiplicity of cooperating roles in user interface development translates into the need for a common set of interface design representation techniques. The important difference between design of the interaction part of the interface and design of the interface software calls for representation techniques with a behavioral view - a view that focuses on user interaction rather than on the software. The User Action Notation (UAN) is a user- and task-oriented notation that describes physical (and other) behavior of the user and interface as they perform a task together. The primary abstraction of the UAN is a user task. The work reported here addresses the need to identify temporal relationships within user task descriptions and to express explicitly and precisely how designers view temporal relationships among those tasks. Drawing on simple temporal concepts such as events in time and preceding and overlapping of time intervals, we identify basic temporal relationships among tasks: sequence, waiting, repeated disjunction, order independence, interruptibility, one-way interleavability, mutual interleavability, and concurrency. The UAN temporal relations, through the notion of modal logic, offer an explicit and precise representation of the specific kinds of temporal behavior that can occur in asynchronous user interaction without the need to detail all cases that might result.

[1]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[2]  Max J. Cresswell,et al.  A New Introduction to Modal Logic , 1998 .

[3]  Antonio C. Siochi,et al.  The UAN: a user-oriented representation for direct manipulation interface designs , 1990, TOIS.

[4]  David A. Duce Concerning the Specification of User Interfaces , 1985, Comput. Graph. Forum.

[5]  Robert J. K. Jacob,et al.  A Specification Language for Direct-Manipulation User Interfaces , 1986, ACM Trans. Graph..

[6]  Ralph D. Hill,et al.  The Structure of Tube - A Tool for Implementing Advanced User Interfaces , 1989, Eurographics.

[7]  Phyllis Reisner,et al.  Formal Grammar and Human Factors Design of an Interactive Graphics System , 1981, IEEE Transactions on Software Engineering.

[8]  F. Decortis,et al.  TIME: THE CINDERELLA OF MAN-MACHINE INTERACTION , 1988 .

[9]  Stephen J. Payne,et al.  Task-Action Grammars: A Model of the Mental Representation of Task Languages , 1986, Hum. Comput. Interact..

[10]  Luca Cardelli,et al.  Squeak: a language for communicating with mice , 1985, SIGGRAPH.

[11]  H. Rex Hartson,et al.  Toward Empirically Derived Methodologies and Tools for Human-Computer Interface Development , 1989, Int. J. Man Mach. Stud..

[12]  Ralph D. Hill,et al.  Event-response systems: a technique for specifying multi-threaded dialogues , 1986, CHI '87.

[13]  Mark Green,et al.  A survey of three dialogue models , 1986, TOGS.

[14]  Kenneth M. Kahn,et al.  Mechanizing Temporal Knowledge , 1977, Artif. Intell..

[15]  D. Norman The psychology of everyday things , 1990 .

[16]  R.S. Nickerson,et al.  Toward more compatible human-computer interfaces , 1990, IEEE Spectrum.

[17]  William Buxton,et al.  Lexical and pragmatic considerations of input structures , 1983, COMG.

[18]  Howard Barringer A Survey of Verification Techniques for Parallel Programs , 1985, Lecture Notes in Computer Science.

[19]  Brad A. Myers Creating dynamic interaction techniques by demonstration , 1987, CHI 1987.

[20]  James F. Allen Towards a General Theory of Action and Time , 1984, Artif. Intell..

[21]  D. McDermott A Temporal Logic for Reasoning About Processes and Plans , 1982, Cogn. Sci..

[22]  Mark Green,et al.  The University of Alberta user interface management system , 1985, SIGGRAPH.

[23]  Thomas P. Moran,et al.  The Command Language Grammar: A Representation for the User Interface of Interactive Computer Systems , 1981, Int. J. Man Mach. Stud..

[24]  S. J. Boies,et al.  Rapid prototyping and system development: examination of an interface toolkit for voice and telephony applications , 1986, CHI '86.

[25]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[26]  Ben C. Moszkowski,et al.  Executing temporal logic programs , 1986, Seminar on Concurrency.

[27]  Dan R. Olsen,et al.  SYNGRAPH: A graphical user interface generator , 1983, SIGGRAPH.