Affordances for manipulation of physical versus digital media on interactive surfaces

This work presents the results of a comparative study in which we investigate the ways manipulation of physical versus digital media are fundamentally different from one another. Participants carried out both a puzzle task and a photo sorting task in two different modes: in a physical 3-dimensional space and on a multi-touch, interactive tabletop in which the digital items resembled their physical counterparts in terms of appearance and behavior. By observing the interaction behaviors of 12 participants, we explore the main differences and discuss what this means for designing interactive surfaces which use aspects of the physical world as a design resource.

[1]  Andreas Paepcke,et al.  Cooperative gestures: multi-user gestural interactions for co-located groupware , 2006, CHI.

[2]  John C. Tang.  Findings from Observational Studies of Collaborative Work , 1991, Int. J. Man Mach. Stud..

[3]  Eric Harslem,et al.  Designing the STAR User Interface , 1987, ECICS.

[4]  Shumin Zhai,et al.  Manual and cognitive benefits of two-handed input: an experimental study , 1998, TCHI.

[5]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[6]  Kenneth P. Fishkin,et al.  A taxonomy for and analysis of tangible interfaces , 2004, Personal and Ubiquitous Computing.

[7]  Richard Mander,et al.  A “pile” metaphor for supporting casual organization of information , 1992, CHI.

[8]  Brenda K. Laurel,et al.  Interface as Mimesis , 1986 .

[9]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[10]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[11]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[12]  Meredith Ringel Morris,et al.  Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables , 2004, CHI EA '04.

[13]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[14]  Trent Apted,et al.  Tabletop sharing of digital photographs for the elderly , 2006, CHI.

[15]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[16]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[17]  M. Sheelagh T. Carpendale,et al.  Rotation and translation mechanisms for tabletop interaction , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[18]  Mary Czerwinski,et al.  Large display research overview , 2006, Color Imaging Conference.

[19]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[20]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[21]  Pierre Dragicevic,et al.  Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows , 2004, UIST '04.

[22]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[23]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[24]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[25]  Abigail Sellen,et al.  The myth of the paperless office , 2001 .

[26]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[27]  Meredith Ringel Morris,et al.  Barehands: implement-free interaction with a wall-mounted display , 2001, CHI Extended Abstracts.

[28]  Shumin Zhai,et al.  Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical User Interface , 1998, BCS HCI.

[29]  M. Sheelagh T. Carpendale,et al.  Interface currents: supporting fluent face-to-face collaboration , 2005, SIGGRAPH '05.

[30]  Andreas Butz,et al.  The EnLighTable: Design of Affordances to Support Collaborative Creativity , 2006, Smart Graphics.

[31]  Thomas Erickson,et al.  Working with interface metaphors , 1995 .

[32]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[33]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[34]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, International Conference on Human Factors in Computing Systems.

[35]  M. Sheelagh T. Carpendale,et al.  Interface Currents: Supporting Fluent Collaboration on Tabletop Displays , 2005, Smart Graphics.

[36]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[37]  Lucia Terrenghi,et al.  Design of Affordances for Direct Manipulation of Digital Information in Ubiquitous Computing Scenarios , 2005, Smart Graphics.

[38]  M. Sheelagh T. Carpendale,et al.  Roles of Orientation in Tabletop Collaboration: Comprehension, Coordination and Communication , 2004, Computer Supported Cooperative Work (CSCW).

[39]  Xinlei Chen,et al.  Two-handed drawing on augmented desk , 2002, CHI Extended Abstracts.

[40]  Pierre Wellner,et al.  The DigitalDesk Calculator: Tangible Manipulation on , 1991 .

[41]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[42]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[43]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[44]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.