A comparison of spatial organization strategies in graphical and tangible user interfaces

We present a study comparing how people use space in a Tangible User Interface (TUI) and in a Graphical User Interface (GUI). We asked subjects to read ten summaries of recent news articles and to think about the relationships between them. In our TUI condition, we bound each of the summaries to one of ten visually identical wooden blocks. In our GUI condition, each summary was represented by an icon on the screen. We asked subjects to indicate the location of each summary by pointing to the corresponding icon or wooden block. Afterward, we interviewed them about the strategies they used to position the blocks or icons during the task. We observed that TUI subjects performed better at the location recall task than GUI subjects. In addition, some TUI subjects used the spatial relationship between specific blocks and parts of the environment to help them remember the content of those blocks, while GUI subjects did not do this. Those TUI subjects who reported encoding information using this strategy tended to perform better at the recall task than those who did not.

[1]  J. Mandler,et al.  On the coding of spatial information , 1977, Memory & cognition.

[2]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[3]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[4]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[5]  Hiroshi Ishii,et al.  Water lamp and pinwheels: ambient projection of digital information into architectural space , 1998, CHI Conference Summary.

[6]  William Buxton,et al.  An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input , 1997, CHI.

[7]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[8]  Scott Brenner Brave.  Tangible interfaces for remote communication and collaboration , 1998 .

[9]  Hiroshi Ishii.  "The Last Farewell" Traces of Physical Presence , 1998 .

[10]  William Buxton,et al.  Graspable user interfaces , 1996 .

[11]  M Naveh-Benjamin,et al.  Coding of spatial location information: an automatic process? , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Bill Brewer.  The integration of spatial vision and action , 1999 .

[13]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[14]  Hiroshi Ishii.  Reflections: “The last farewell”: traces of physical presence , 1998, INTR.

[15]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[16]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[17]  M W Lansdale,et al.  Remembering about documents: memory for appearance, format, and location. , 1991, Ergonomics.

[18]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[19]  Thomas W. Malone,et al.  How do people organize their desks?: Implications for the design of office information systems , 1983, TOIS.

[20]  David Kirsh,et al.  Complementary Strategies: Why we use our hands when we think , 1995 .

[21]  Mary Czerwinski,et al.  Data mountain: using spatial memory for document management , 1998, UIST '98.

[22]  Donald A. Norman,et al.  Things that make us smart , 1979 .

[23]  Susan T. Dumais,et al.  A comparison of symbolic and spatial filing , 1985, CHI '85.

[24]  Roger Whittaker,et al.  The Last Farewell , 1971 .

[25]  Vic Barnett,et al.  Outliers in Statistical Data , 1980 .

[26]  Jiajie Zhang,et al.  The Nature of External Representations in Problem Solving , 1997, Cogn. Sci..

[27]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..