Towards new interaction : a content centric data surface approach

Point-and-click, multiple views in windows stacked over each other, and menu selection were breakthroughs in the 70s and what was achievable with the computational power then available. The desktop metaphor explains to users the structure of file, directories, and programs. The computer industry has developed enormously since then. Computational power, the flow and deposits of information have now increased to a point where new approaches to interaction have to be considered. This thesis presents a content-centric interface paradigm, which I call the data surface paradigm. The data surface paradigm contrasts with the desktop metaphor and elements of the desktop metaphor: windows, icons, menus, document files and application programs. The data surface paradigm is based on a reassessment of the fundamental design values of the desktop metaphor interface. It takes into account information navigation and retrieval, collaboration, and ongoing creative open-ended tasks and processes. As a design case I have studied computer music creativity throughout the thesis. Interviews and observations of novices and expert users of music creativity tools identified their needs and inspired prototype designs. I have used an iterative user-centred design process to build and evaluate a series of three prototypes. Content is visualised on a flat infinitely large twodimensional surface. Users navigate their content by zoom and pan, and incremental search. There are no windows. The unlimited area avoids the need to stack multiple views on top of each other. There are no icons. Content becomes its own icon when users zoom out, miniaturised in size but with preserved structure and metric relationships. There are no menus. Content affords typed commands and context help makes it easier for users to learn. Visual feedback and text completion of command substrings create a uniform model for command invocation and shortcuts. Users do not experience document files. The information content is visualised directly on the surface. Users have no need to deal with explicit file manipulation. The system manages the persistency of

[1]  Bonnie A. Nardi,et al.  Finding and reminding: file organization from the desktop , 1995, SGCH.

[2]  E. Pampalk.  Islands of Music Analysis, Organization, and Visualization of Music Archives , 2002 .

[3]  Ken Perlin,et al.  Pad: an alternative approach to the computer interface , 1993, SIGGRAPH.

[4]  Terry Winograd,et al.  A Language/Action Perspective on the Design of Cooperative Work , 1987, SGCH.

[5]  Peter Gärdenfors,et al.  Conceptual spaces - the geometry of thought , 2000 .

[6]  Shin Murakoshi.  Cognitive Map and Spatial Behavior , 1987 .

[7]  Nick Bryan-Kinns,et al.  Graphical Representations for Group Music Improvisation , 2003 .

[8]  Elizabeth D. Mynatt,et al.  Recognizing creative needs in user interface design , 2002, Creativity & Cognition.

[9]  Alan Kay,et al.  User Interface: A Personal View , 2005 .

[10]  Takeo Igarashi,et al.  Flatland: new dimensions in office whiteboards , 1999, CHI '99.

[11]  David A. Smith,et al.  Croquet: a menagerie of new user interfaces , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing, 2004..

[12]  Walter R. Smith.  The Newton application architecture , 1994, Proceedings of COMPCON '94.

[13]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[14]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[15]  Helmut Krueger,et al.  In pursuit of desktop evolution: User problems and practices with modern desktop systems , 2004, TCHI.

[16]  Jun Rekimoto,et al.  Time-machine computing: a time-centric approach for the information environment , 1999, UIST '99.

[17]  Jakob Nielsen,et al.  The Anti-Mac interface , 1996, CACM.

[18]  Kevin Lynch,et al.  The Image of the City , 1960 .

[19]  Yasuhiro Yamamoto,et al.  A framework that supports collective creativity in design using visual images , 1999, Creativity & Cognition.

[20]  R. Philip,et al.  An Open Agent Architecture , 1994 .

[21]  David A. Smith,et al.  Croquet - a collaboration system architecture , 2003, First Conference on Creating, Connecting and Collaborating Through Computing, 2003. C5 2003. Proceedings..

[22]  K. Höök,et al.  Spatial cognition in the mind and in the world - the case of hypermedia navigation , 1996 .

[23]  Phil Burk.  Jammin' on the Web - a new Client/Server Architecture for Multi-User Musical Performance , 2000, ICMC.

[24]  Lars Erik Holmquist,et al.  Focus+context visualization with flip zooming and the zoom browser , 1997, CHI Extended Abstracts.

[25]  Douglas C. Engelbart.  Special considerations of the individual as a user, generator, and retriever of information , 1992, LINK.

[26]  Andreas Dieberger,et al.  A City Metaphor to Support Navigation in Complex Information Spaces , 1997, J. Vis. Lang. Comput..

[27]  Philip R. Cohen.  The Pragmatics of Referring and the Modality of Communication , 1984, Comput. Linguistics.

[28]  James D. Hollan,et al.  Advances in the Pad++ Zoomable Graphics Widget , 1995 .

[29]  Lars Erik Holmquist,et al.  WEST: a Web browser for small terminals , 1999, UIST '99.

[30]  B. Tversky.  Distortions in memory for visual displays , 1991 .

[31]  J. L. Alty,et al.  Metaphor and human-computer interaction: a model based approach , 1999 .

[32]  Paul Dourish,et al.  Using properties for uniform interaction in the Presto document system , 1999, UIST '99.

[33]  Donald A. Schön,et al.  The Reflective Practitioner: How Professionals Think in Action. , 1987 .

[34]  Larry Wachowski,et al.  マトリックス = The matrix , 1999 .

[35]  John Perry,et al.  Disability, Inability and Cyberspace , 1997 .

[36]  John Maloney,et al.  The Self-4.0 user interface: manifesting a system-wide vision of concreteness, uniformity, and flexibility , 1995, OOPSLA 1995.

[37]  Björn Granström,et al.  Multimodality in Language and Speech Systems , 2002 .

[38]  Emmanuel Barillot,et al.  Context and interaction in zoomable user interfaces , 2000, AVI '00.