Engineering for Human-Computer Interaction

There have been several recent examples of user interface techniques in which the user uses a computational device by physically manipulating the device. This paper proposes that these form an interesting new paradigm for user interface design, Embodied User Interfaces. This paper presents and defines this paradigm, and places it in the evolution of user interface paradigms leading towards the ideal of an invisible user interface. This paper outlines the space of design possibilities in this paradigm, presents a design framework for embodied user interface design, and articulates a set of design principles to guide design.

[1]  Jack Homer,et al.  Structure, Data, and Compelling Conclusions: Notes from the Field , 1997 .

[2]  Ben Shneiderman,et al.  Visual information seeking: tight coupling of dynamic query filters with starfield displays , 1994, CHI '94.

[3]  Ian Sommerville.  Software engineering, 5th Edition , 1996 .

[4]  Franca Garzotto,et al.  Information reuse in hypermedia applications , 1996, HYPERTEXT '96.

[5]  Mark Apperley,et al.  An architecture and environment for decentralised, internet-wide software process modelling and enactment , 1998 .

[6]  Bonnie E. John,et al.  Tracking the effectiveness of usability evaluation methods , 1997, Behav. Inf. Technol..

[7]  Hans van Vliet,et al.  Software engineering - principles and practice , 1993 .

[8]  Jörg M. Haake,et al.  Designing object-oriented synchronous groupware with COAST , 1996, CSCW '96.

[9]  Constantine Stephanidis,et al.  Preference-Based Human Factors Knowledge Repository for Designing User Interfaces , 1997, Int. J. Hum. Comput. Interact..

[10]  Ralph D. Hill,et al.  Supporting concurrency, communication, and synchronization in human-computer interaction—the Sassafras UIMS , 1986, TOGS.

[11]  W. W. Royce,et al.  Managing the development of large software systems , 1970 .

[12]  John M. Vlissides,et al.  Automatic Code Generation from Design Patterns , 1996, IBM Syst. J..

[13]  Fabio Paternò,et al.  Automatic generation of task-oriented help , 1995, UIST '95.

[14]  Leonard J. Bass,et al.  SAAM: a method for analyzing the properties of software architectures , 1994, Proceedings of 16th International Conference on Software Engineering.

[15]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[16]  Rick Kazman,et al.  Rapid prototyping of information visualizations using VANISH , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[17]  John C. Grundy,et al.  Visual specification of multi-view visual environments , 1998, Proceedings. 1998 IEEE Symposium on Visual Languages (Cat. No.98TB100254).

[18]  R. Ascherl,et al.  Rapid Prototyping , 1997, IEEE Robotics & Automation Magazine.

[19]  Keith Vander Linden,et al.  DRAFTER : An Interactive Support Tool for Writing Multilingual Instructions , 1996 .

[20]  John Grundy,et al.  Collaborative work with the World Wide Web: Adding CSCW support to a Web Browser , 1996 .

[21]  Saul Greenberg,et al.  Building real-time groupware with GroupKit, a groupware toolkit , 1996, TCHI.

[22]  Chris W. Johnson,et al.  Requirements for the Next Generation of User Interface Specification Languages , 1995, DSV-IS.

[23]  Douglas C. Schmidt,et al.  Object-oriented application frameworks , 1997, CACM.

[24]  Mary Shaw,et al.  Abstractions for Software Architecture and Tools to Support Them , 1995, IEEE Trans. Software Eng..

[25]  Steven K. Feiner,et al.  Top-down hierarchical planning of coherent visual discourse , 1997, IUI '97.

[26]  Philippe Kruchten,et al.  The 4+1 View Model of Architecture , 1995, IEEE Softw..

[27]  John D. Gould,et al.  How to design usable systems , 1995 .

[28]  T. C. Nicholas Graham.  GroupScape: Integrating Synchronous Groupware and the World Wide Web , 1997, INTERACT.

[29]  Ralph E. Johnson,et al.  Frameworks = (components + patterns) , 1997, CACM.

[30]  CohenA.,et al.  Tools for Working with Guidelines , 2001, Springer London.

[31]  Dan R. Olsen,et al.  Propositional production systems for dialog description , 1990, CHI '90.

[32]  Alan J. Dix,et al.  Formal methods for interactive systems , 1991, Computers and people series.

[33]  Lisa Tweedie,et al.  Interactive Visualisation Artifacts: How can Abstractions Inform Design? , 1996, BCS HCI.

[34]  Gerard Henri ter Hofte,et al.  Working apart together: foundations for component groupware , 1998 .

[35]  Loren G. Terveen,et al.  Living Design Memory: Framework, Implementation, Lessons Learned , 1995, Hum. Comput. Interact..

[36]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[37]  Gustavo Rossi,et al.  Design reuse in hypermedia applications development , 1997, HYPERTEXT '97.

[38]  K. Andrews,et al.  Case study. Visualising cyberspace: information visualisation in the Harmony Internet browser , 1995, Proceedings of Visualization 1995 Conference.

[39]  Saul Greenberg,et al.  Simplifying component development in an integrated groupware environment , 1997, UIST '97.

[40]  John D. Gould,et al.  Tools for generating consistent user interfaces , 1989 .

[41]  Aaron Marcus,et al.  Graphic design for electronic documents and user interfaces , 1992, ACM Press tutorial series.

[42]  Rob Miller,et al.  The Amulet Environment: New Models for Effective User Interface Software Development , 1997, IEEE Trans. Software Eng..

[43]  Mark Apperley,et al.  Data base navigation: an office environment for the professional , 1982 .

[44]  Peter Johnson,et al.  ADEPT: Advanced Design Environment for Prototyping with Task Models , 1993, INTERCHI.

[45]  L. Johnston,et al.  Fluid: Specifying Control and Data Flow for User Interfaces , 1996 .

[46]  Yigal Hoffner,et al.  A new user interface architecture , 1990 .

[47]  Fabio Paternò,et al.  On the use of LOTOS to describe graphical interaction , 1993 .

[48]  John T. Kelso,et al.  Remote evaluation: the network as an extension of the usability laboratory , 1996, CHI.

[49]  F. Tarpin-Bernard.  Travail coopératif synchrone assisté par ordinateur : Approche AMF-C , 1997 .

[50]  Brad A. Myers.  Scripting graphical applications by demonstration , 1998, CHI.

[51]  Lloyd Rutledge,et al.  A framework for generating adaptable hypermedia documents , 1997, MULTIMEDIA '97.

[52]  Allen Macro.  Software engineering - concepts and management , 1990, Practical software engineering series.

[53]  Steven S. Popovich,et al.  Integrating groupware and process technologies in the Oz environment , 1994, Proceedings. Ninth International Software Process Workshop.

[54]  Jade Goldstein-Stewart,et al.  Interactive graphic design using automatic presentation knowledge , 1994, CHI Conference Companion.

[55]  Constantine Stephanidis,et al.  Integrated support for working with guidelines: the Sherlock guideline management system , 2000, Interact. Comput..

[56]  H. Domeisen,et al.  Interactive Graphic Design of Signal Flow Diagrams for Simulation , 1985 .

[57]  Steven F. Roth,et al.  On the semantics of interactive visualizations , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[58]  Prasun Dewan,et al.  A high-level and flexible framework for implementing multiuser user interfaces , 1992, TOIS.

[59]  Peter Johnson,et al.  Bridging the Generation Gap: From Work Tasks to User Interface Designs , 1996, CADUI.

[60]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[61]  Prasun Dewan,et al.  A flexible object merging framework , 1994, CSCW '94.

[62]  Franck Tarpin-Bernard,et al.  AMF : un modèle d'architecture multi-agents multi-facettes , 1999 .

[63]  Philippe A. Palanque,et al.  Petri net based Design of User-driven Interfaces Using the Interactive Cooperative Objects Formalism , 1994, DSV-IS.

[64]  Anders Kristensen.  Template Resolution in XML/HTML , 1998, Comput. Networks.

[65]  Wolfgang Emmerich.  An architecture for viewpoint environments based on OMG/CORBA , 1996, ISAW '96.

[66]  Jakob Nielsen,et al.  Usability engineering at a discount , 1989 .

[67]  Eamonn J. O'Neill.  Task model support for cooperative analysis , 1996, CHI 1996.

[68]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[69]  Jocelyne Nanard,et al.  Pushing reuse in hypermedia design: golden rules, design patterns and constructive templates , 1998, HYPERTEXT '98.

[70]  Bonnie E. John,et al.  Exploring the unrealized potential of computer-aided drafting , 1996, CHI.

[72]  Sidney L. Smith,et al.  Application of Guidelines for Designing User Interface Software , 1985 .

[73]  Kaj Grønbæk,et al.  Designing Dexter-based hypermedia services for the World Wide Web , 1997, HYPERTEXT '97.

[74]  Mark Roseman.  TCL/TK AS A BASIS FOR GROUPWARE , 1993 .

[75]  Melvin D. Montemerlo,et al.  The Judgmental Nature of Task Analysis , 1978 .

[76]  David A. Carr,et al.  Using Interaction Object Graphs to Specify and Develop Graphical Widgets , 1994 .

[77]  John Grundy,et al.  Supporting flexible consistency management via discrete change description propagation , 1996 .

[78]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[79]  Saul Greenberg,et al.  TeamRooms: network places for collaboration , 1996, CSCW '96.

[80]  Stephen Travis Pope,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[81]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[82]  Clifford A. Shaffer,et al.  Transparent sharing of Java applets: a replicated approach , 1997, UIST '97.

[83]  Andrew F. Monk,et al.  Why Industry Doesn’t Use the Wonderful Notations We Researchers Have Given Them to Reason About Their Designs , 1994 .

[84]  Roger S. Pressman,et al.  Software Engineering: A Practitioner's Approach , 1982 .

[85]  Dan Diaper,et al.  Task Analysis for Human-Computer Interaction , 1990 .

[86]  Fabio Paternò,et al.  Reusable structures in task models , 1997, DSV-IS.

[87]  Barry W. Boehm,et al.  Software Requirements Negotiation and Renegotiation Aids: A Theory-W Based Spiral Approach , 1995, 1995 17th International Conference on Software Engineering.

[88]  Jocelyne Nanard,et al.  Generating hypermedia from specifications by sketching multimedia templates , 1997, MULTIMEDIA '96.

[89]  Michael Freed,et al.  Managing Decision Resources in Plan Execution , 1997, IJCAI.

[90]  Jean Vanderdonckt,et al.  Visual techniques for traditional and multimedia layouts , 1994, AVI '94.

[91]  Pablo Castells,et al.  Declarative models of presentation , 1997, IUI '97.

[92]  Gordon S. Blair,et al.  CSCW and Distributed Systems: The Problem of Control , 1991, ECSCW.

[93]  Joëlle Coutaz,et al.  From single-user architectural design to PAC*: a generic software architecture model for CSCW , 1997, CHI.

[94]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[95]  Rick Stout.  Web Site Stats: Tracking Hits and Analyzing Web Traffic , 1996 .

[96]  Ping Luo,et al.  Facilitating the exploration of interface design alternatives: the HUMANOID model of interface design , 1992, CHI.

[97]  Deborah A. Boehm-Davis,et al.  User interface development processes and methodologies , 1993, Behav. Inf. Technol..

[98]  Jakob Nielsen.  A Virtual Protocol Model for Computer-Human Interaction , 1984 .

[99]  Martti Penttonen,et al.  Transformation of Structured Documents with the Use of Grammar , 1993, Electron. Publ..

[100]  Bill Curtis,et al.  A field study of the software design process for large systems , 1988, CACM.

[101]  Alfonso Fuggetta,et al.  Integrating Process Technology and CSCW , 1995, EWSPT.

[102]  Romain Zeiliger,et al.  Automating Tasks for Groups of Users: A System-Wide "Epiphyte" Approach , 1997, INTERACT.

[103]  John G. Hosking,et al.  A Java-based toolkit for the construction of multi-view editing systems , 1997 .

[104]  Prasun Dewan,et al.  Flexible user interface coupling in a collaborative system , 1991, CHI.

[105]  Fabio Paternò,et al.  Task-Oriented Design for Interactive User Interfaces of Museum Systems , 1997, ICHIM.

[106]  Fabio Paternò,et al.  Design of multimedia semantic presentation templates: options, problems and criteria of use , 1998, AVI '98.

[107]  Franca Garzotto,et al.  Hypermedia design, analysis, and evaluation issues , 1995, CACM.

[108]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[109]  Jocelyne Nanard,et al.  Hypertext design environments and the hypertext design process , 1995, CACM.

[110]  Toshiro Wakayama,et al.  SIMON: A Grammar-based Transformation System for Structured Documents , 1993, Electron. Publ..

[111]  Peter Gorny,et al.  EXPOSE. HCI-counseling for user interface design , 1995, INTERACT.

[112]  Atul Prakash,et al.  The Session Capture and Replay Paradigm for Asynchronous Collaboration , 1995, ECSCW.

[113]  Kevin M. Corker,et al.  AN ARCHITECTURE AND MODEL FOR COGNITIVE ENGINEERING SIMULATION ANALYSIS: APPLICATION TO ADVANCED AVIATION AUTOMATION , 1993 .

[114]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[115]  Marcelo R. Campo,et al.  Automatic abstraction management in information visualization systems , 1997, Proceedings. 1997 IEEE Conference on Information Visualization (Cat. No.97TB100165).

[116]  Gilbert Cockton,et al.  Workshop on Technical Feasibility: Initial Lessons from an IFIP WG2.7 Virtual University Case Study , 1998, EHCI.

[117]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[118]  James D. Foley,et al.  Coupling a UI framework with automatic generation of context-sensitive animated help , 1990, UIST '90.

[119]  Saul Greenberg,et al.  A tour of TeamRooms , 1997, CHI Extended Abstracts.

[120]  Raghu V. Hudli,et al.  CORBA fundamentals and programming , 1996 .

[121]  Boris Magnusson,et al.  Fine-grained revision control for collaborative software development , 1993, SIGSOFT '93.

[122]  Carl Gutwin,et al.  Effects of awareness support on groupware usability , 1998, CHI.

[123]  Wei-Tek Tsai,et al.  Distributed, collaborative software inspection , 1993, IEEE Software.

[124]  Phyllis Reisner,et al.  Formal Grammar and Human Factors Design of an Interactive Graphics System , 1981, IEEE Transactions on Software Engineering.

[125]  Kevin M. Corker,et al.  Analysis and Modeling of Flight Crew Performance in Automated Air Traffic Management Systems , 1995 .

[126]  Andrew F. Monk,et al.  Dialogue modelling of graphical user interfaces with a production system , 1995, Behav. Inf. Technol..

[127]  T. C. Nicholas Graham,et al.  Integrating Support for Temporal Media into an Architecture for Graphical User Interfaces , 1997, Proceedings of the (19th) International Conference on Software Engineering.

[128]  Terry Winograd,et al.  From programming environments to environments for designing , 1995, CACM.

[129]  Mary Beth Rosson,et al.  The task-artifact cycle , 1991 .

[130]  Ping Luo,et al.  Beyond interface builders: model-based interface tools , 1993, INTERCHI.

[131]  Michael J. Smith,et al.  Beyond task analysis: exploiting task models in application implementation , 1996, CHI 1996.

[132]  Katsuhiko Ogawa,et al.  GuideBook: design guidelines database for assisting the interface design task , 1995, SGCH.

[133]  Clarence A. Ellis,et al.  Groupware: some issues and experiences , 1991, CACM.

[134]  Gustavo Rossi,et al.  Systematic hypermedia application design with OOHDM , 1996, HYPERTEXT '96.

[135]  E. Hutchins.  Cognition in the wild , 1995 .

[136]  Marcelo R. Campo,et al.  Interactive abstraction control in visualization systems , 1997, Proceedings 17th International Conference of the Chilean Computer Science Society.

[137]  John Grundy,et al.  Experiences in using Java on a software tool integration project , 1998, Proceedings. 1998 International Conference Software Engineering: Education and Practice (Cat. No.98EX220).