Modelling Devices for Natural Interaction

We do not interact with systems without first performing some physical action on a physical device. This paper shows how formal notations and formal models can be developed to account for the relationship between the physical devices that we actually press, twist or pull and their effects on systems. We use state diagrams of each but find we have to extend these in order to account for features such as bounce-back, where buttons or other controls are sprung. Critical to all is the fact that we are physical creatures and so formal models have to take into account that physicality.

[1]  Jock D. Mackinlay,et al.  A morphological analysis of the design space of input devices , 1991, TOIS.

[2]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[3]  Alan Dix.  Designing for appropriation , 2007 .

[4]  William Buxton,et al.  There's more to interaction than meets the eye: some issues in manual input , 1987 .

[5]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[6]  Karsten Loer,et al.  Towards usable and relevant model checking techniques for the analysis of dependable interactive systems , 2002, Proceedings 17th IEEE International Conference on Automated Software Engineering,.

[7]  Phyllis Reisner,et al.  Formal Grammar and Human Factors Design of an Interactive Graphics System , 1981, IEEE Transactions on Software Engineering.

[8]  Nasa,et al.  A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop , 1992, SGCH.

[9]  Alan J. Dix,et al.  Formal methods for interactive systems , 1991, Computers and people series.

[10]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[11]  Gregory D. Abowd,et al.  Human-Computer Interaction, third edition , 2004 .

[12]  William W. Gaver.  Technology affordances , 1991, CHI.

[13]  Masitah Ghazali,et al.  Visceral Interaction , 2005 .

[14]  Robert J. K. Jacob,et al.  A software model and specification language for non-WIMP user interfaces , 1999, TCHI.

[15]  Charles Albert Wüthrich.  An analysis and a Model of 3D Interaction Methods and Devices for Virtual Reality , 1999, DSV-IS.

[16]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[17]  H. Rex Hartson,et al.  Cognitive, physical, sensory, and functional affordances in interaction design , 2003, Behav. Inf. Technol..

[18]  Gregory D. Abowd,et al.  Modelling status and event behaviour of interactive systems , 1996, Softw. Eng. J..

[19]  N. P. Milner,et al.  A Review of Human Performance and Preferences with Different Input Devices to Computer Systems , 1988, BCS HCI.

[20]  David L. Parnas,et al.  On the use of transition diagrams in the design of a user interface for an interactive computer system , 1969, ACM '69.

[21]  Ben Shneiderman,et al.  Response time and display rate in human performance with computers , 1984, CSUR.

[22]  Alan Dix,et al.  Delays and temporal incoherence due to the mediated status-status mappings , 1996, SGCH.

[23]  Joëlle Coutaz,et al.  A generic platform for addressing the multimodal challenge , 1995, CHI '95.

[24]  Céline Coutrix,et al.  Mixed reality: a model of mixed interaction , 2006, AVI '06.

[25]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[26]  Alan Bundy,et al.  Constructing Induction Rules for Deductive Synthesis Proofs , 2006, CLASE.

[27]  Hiroshi Ishii,et al.  Tangible User Interfaces , 2006 .

[28]  Scott E. Hudson,et al.  Forming interactivity: a tool for rapid prototyping of physical interactive products , 2002, DIS '02.

[29]  Mícheál Mac an Airchinnigh,et al.  Seeheim Workshop on User Interface Management Systems Report of the Working Group on the User's Conceptual Model * , 1985, Comput. Graph. Forum.

[30]  Laurinda Poirier-Solomon.  Getting physical. , 2002, Diabetes forecast.

[31]  Jock D. Mackinlay,et al.  The design space of input devices , 1990, CHI '90.

[32]  Harold W. Thimbleby,et al.  Press on - principles of interaction programming , 2007 .

[33]  Andrew F. Monk,et al.  Mode Errors: A User-Centered Analysis and Some Preventative Measures Using Keying-Contingent Sound , 1986, Int. J. Man Mach. Stud..

[34]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[35]  Emmanuel Dubois,et al.  Notational Support for the Design of Augmented Reality Systems , 2002, DSV-IS.

[36]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[37]  Alan J. Dix,et al.  Artefacts as designed, artefacts as used: resources for uncovering activity dynamics , 2005, Cognition, Technology & Work.

[38]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[39]  Stephan Wensveen,et al.  Interaction frogger: a design framework to couple action and function through feedback and feedforward , 2004, DIS '04.

[40]  Andrew Ramsay,et al.  A Model-based Approach to Describing and Reasoning About the Physicality of Interaction , 2007 .

[41]  Alan J. Dix,et al.  XSED - XML-Based Description of Status-Event Components and Systems , 2008, EHCI/DS-VIS.

[42]  Ed Anson,et al.  The device model of interaction , 1982, SIGGRAPH.

[43]  S. Benford,et al.  Sensible , sensable and desirable : a framework for designing physical interfaces , 2003 .

[44]  Michael D. Harrison,et al.  Formal methods in human-computer interaction , 1990 .

[45]  Alexander K. Petrenko,et al.  Electronic Notes in Theoretical Computer Science , 2009 .

[46]  Saul Greenberg,et al.  Phidgets: easy development of physical interfaces through physical widgets , 2001, UIST '01.

[47]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[48]  Richard M. Young,et al.  Programmable user models for predictive evaluation of interface designs , 1989, CHI '89.

[49]  Christian Kray,et al.  Exploring an Option Space to Engineer a Ubiquitous Computing System , 2008, Electron. Notes Theor. Comput. Sci..

[50]  Céline Coutrix,et al.  Balancing physical and digital properties in mixed objects , 2008, AVI '08.