Reality-based interaction: a framework for post-WIMP interfaces

We are in the midst of an explosion of emerging human-computer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a large subset of these emerging interaction styles. Based on this concept of RBI, we provide a framework that can be used to understand, compare, and relate current paths of recent HCI research as well as to analyze specific interaction designs. We believe that viewing interaction through the lens of RBI provides insights for design and uncovers gaps or opportunities for future research.

[1]  Robert J. K. Jacob,et al.  A virtual reality interface design (vrid) model and methodology , 2001 .

[2]  Kenneth P. Fishkin,et al.  A taxonomy for and analysis of tangible interfaces , 2004, Personal and Ubiquitous Computing.

[3]  Austin Henderson,et al.  Making sense of sensing systems: five questions for designers and researchers , 2002, CHI.

[4]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[5]  Sharon Poggenpohl,et al.  The Laws of Simplicity: Design, Technology, Business, Life , 2007 .

[6]  Ashweeni Kumar Beeharee,et al.  Exploiting real world knowledge in ubiquitous applications , 2007, Personal and Ubiquitous Computing.

[7]  Robert J. K. Jacob,et al.  What is the next generation of human-computer interaction? , 2006, CHI Extended Abstracts.

[8]  Ian Oakley,et al.  Portable device interaction design concept , 2003 .

[9]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[10]  V. Michael Bove,et al.  Connectibles: tangible social networks , 2008, Tangible and Embedded Interaction.

[11]  Robert J. K. Jacob,et al.  Interacting with eye movements in virtual environments , 2000, CHI.

[12]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[13]  Emmanuel Dubois,et al.  A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model , 2007, EHCI/DS-VIS.

[14]  Jörn Hurtienne,et al.  Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction , 2007, TEI.

[15]  Orit Shaer,et al.  CHI2006: what is the next generation of human-computer interaction? , 2006, INTR.

[16]  Thomas P. Moran,et al.  Embodied User Interfaces: Towards Invisible User Interfaces , 1998, EHCI.

[17]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[18]  Orit Shaer,et al.  Reality-based interaction: unifying the new generation of interaction styles , 2007, CHI Extended Abstracts.

[19]  Gregory D. Abowd,et al.  Integrating status and event phenomena in formal specifications of interactive systems , 1994, SIGSOFT '94.

[20]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[21]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[22]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[23]  Mark Lentczner,et al.  Second Life , 2007, USENIX Annual Technical Conference.

[24]  Steve Benford,et al.  Collaborative virtual environments , 2001, CACM.

[25]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[26]  Trent Apted,et al.  Tabletop sharing of digital photographs for the elderly , 2006, CHI.

[27]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[28]  Jakob Nielsen,et al.  Noncommand user interfaces , 1993, CACM.

[29]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[30]  Ben Shneiderman,et al.  Why Not Make Interfaces Better than 3D Reality? , 2003, IEEE Computer Graphics and Applications.

[31]  Roel Vertegaal,et al.  eyeLook: using attention to facilitate mobile media consumption , 2005, UIST '05.

[32]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[33]  Clifton Forlines,et al.  DTLens: multi-user tabletop spatial data exploration , 2005, UIST.

[34]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[35]  Betty J. Mohler,et al.  Calibration of locomotion resulting from visual motion in a treadmill-based virtual environment , 2007, TAP.

[36]  John Maeda,et al.  The laws of simplicity , 2006, Design, technology, business, life.

[37]  Jacob Buur,et al.  Hands-only scenarios and video action walls: novel methods for tangible user interaction design , 2004, DIS '04.

[38]  Georgios Christou.  Towards a new method for the evaluation of reality based interaction , 2007, CHI Extended Abstracts.

[39]  Randolph L. Jackson,et al.  Collaboration and learning within immersive virtual reality , 2000, CVE '00.

[40]  Richard M. Young,et al.  Options and Criteria: Elements of design space analysis , 1991 .

[41]  Paul Dourish,et al.  Where the action is , 2001 .

[42]  Desney S. Tan,et al.  Using a low-cost electroencephalograph for task classification in HCI research , 2006, UIST.

[43]  Ryugo Kijima,et al.  Tangible NURBS-curve manipulation techniques using graspable handles on a large display , 2004, UIST '04.

[44]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[45]  Patrick J. Hayes,et al.  The second naive physics manifesto , 1995 .

[46]  Ben Shneiderman,et al.  Leonardo's laptop: human needs and the new computing technologies , 2005, CIKM '05.

[47]  Pattie Maes,et al.  Augmenting Looking, Pointing and Reaching Gestures to Enhance the Searching and Browsing of Physical Objects , 2007, Pervasive.

[48]  Céline Coutrix,et al.  Mixed reality: a model of mixed interaction , 2006, AVI '06.

[49]  Roel Vertegaal,et al.  ViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis , 2005, UIST.

[50]  Norbert A. Streitz,et al.  Roomware: Toward the Next Generation of Human- Computer Interaction Based on an Integrated Design of Real and Virtual Worlds , 2001 .

[51]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[52]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[53]  Orit Shaer,et al.  The tangible video editor: collaborative video editing with active tokens , 2007, Tangible and Embedded Interaction.

[54]  Norman G. Vinson,et al.  Design guidelines for landmarks to support navigation in virtual environments , 1999, CHI '99.

[55]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[56]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[57]  Georgios Christou,et al.  Identifiability : A Predictive Quantitative Measure for the Comparison of a Task Designed in Different Interaction Styles , 2005 .

[58]  Olivier Bau,et al.  D20: interaction with multifaceted display devices , 2006, CHI Extended Abstracts.