Human-computer protocols

We have recently developed an approach to modelling interaction that encompasses not just the device, but also aspects of a cognitive model. This integrated framework, called syndetic modelling, has been used to reason about the interplay between cognitive and computational resources deployed within an interaction. Here, a new view on this integrated framework is described. We consider the interaction between user and device as forming a hierarchy of protocols, covering different levels of abstraction over the information exchanged. As the protocol is layered, we can discuss interaction in terms of different levels of granularity, better accommodating the representation of new technologies such as vision tracking and speech which can be considered as “continuous” at some levels. We conclude by summarising classes of mathematical representation that can be utilised to represent and reason within such a model.

[1]  David A. Duce,et al.  Syndetic Modelling , 1998, Hum. Comput. Interact..

[2]  David A. Duce,et al.  Interaction, Cognition and Visualization , 1995, DSV-IS.

[3]  Zhou Chaochen,et al.  Duration Calculi: An overview , 1993 .

[4]  Mieke Massink,et al.  The Hybrid World of Virtual Environments , 1999, Comput. Graph. Forum.

[5]  Philip J. Barnard,et al.  Affect, Cognition and Change: Re-Modelling Depressive Thought , 1993 .

[6]  Philip J. Barnard,et al.  Representing cognitive activity in complex tasks , 1999 .

[7]  Matthias Hemmje,et al.  A Dynamic Gesture Language and Graphical Feedback for Interaction in a 3D User Interface , 1993, Comput. Graph. Forum.

[8]  Joëlle Coutaz,et al.  A generic platform for addressing the multimodal challenge , 1995, CHI '95.

[9]  David J. Duke.  Reasoning About Gestural Interaction , 1995, Comput. Graph. Forum.

[10]  P. M. Melliar-Smith.  Extending Interval Logic to Real Time Systems , 1987, Temporal Logic in Specification.

[11]  Colin J. Fidge,et al.  Modelling Discrete Behaviour in a Continuous-Time Formalism , 1999, IFM.

[12]  David A. Duce,et al.  Systematic development of the human interface , 1995, Proceedings 1995 Asia Pacific Software Engineering Conference.

[13]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[14]  Philip J. Barnard,et al.  Interactions with Advanced Graphical Interfaces and the Deployment of Latent Human Knowledge , 1994, DSV-IS.

[15]  Mieke Massink,et al.  Towards Hybrid Interface Specifications for Virtual Environments , 1999, DSV-IS.

[16]  Thomas G. Moher,et al.  Revising Mental Models to Accomodate Expectation Failures in Human-Computer Dialogues , 1995, DSV-IS.

[17]  David J. Duke,et al.  Device Models , 1996, DSV-IS.