Going Beyond the Desktop Computer with an Attitude

This dissertation is based upon the work within a number of research projects, five of which are presented in detail. The work follows the direction of research laid out by the Ubiquitous Computing and Augmented Reality research programs and concerns the broad question of where to go as we seek to take digital technology, and human interactions with this technology, beyond the traditional desktop computer. The work presented takes a design-oriented approach to Human Computer Interaction research. Five prototype systems are presented: Ambient displays for remote awareness, a navigation device providing guidance through tactile cues, a personal device for wastewater plant operators, paper cards enabling control of video playback, and a cell phone that enables you to ‘talk silent’. It is discussed how these prototypes, despite obvious differences, all reflect the same overall attitude towards the role of digital technology. It is an attitude emphasizing that integration of digital technology with everyday human activities means making computational power manifest as part of a larger patchwork of resources. Furthermore, it is an attitude promoting the design of digital technology that leaves the control and initiative with people and their earned ability to take appropriate action when faced with the particularities of the social and physical settings encountered in everyday life beyond the computer screen. In other words, this dissertation brings forward, by using five prototypes as examples, an attitude that encourages us to recognize, embrace, and take advantage of, the fact that human interaction with digital technology takes place, not in a vacuum, but in a rich and diverse world full of many resources for human action other than the digital technology we bring about.

[1]  Kristinn R. Thórisson Gandalf: an embodied humanoid capable of real-time multimodal dialogue with people , 1997, AGENTS '97.

[2]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[3]  Bill N. Schilit,et al.  The PARCTAB mobile computing system , 1993, Proceedings of IEEE 4th Workshop on Workstation Operating Systems. WWOS-III.

[4]  Elwyn Edwards,et al.  The Human Operator in Process Control , 1974 .

[5]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[6]  Brygg Ullmer,et al.  Tangible interfaces for manipulating aggregates of digital information , 2002 .

[7]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[8]  D. Schoen Educating the reflective practitioner , 1987 .

[9]  Carl Gutwin,et al.  SUPPORT FOR GROUP AWARENESS IN REAL-TIME DESKTOP CONFERENCES , 1995 .

[10]  Alex Pentland,et al.  Tactual displays for wearable computing , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[11]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[12]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[13]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[14]  E. Schegloff,et al.  Opening up Closings , 1973 .

[15]  Paul Dourish,et al.  Where the action is , 2001 .

[16]  Steven Orla Kimbrough,et al.  On automated message processing in electronic commerce and work support systems: speech act theory and expressive felicity , 1997, TOIS.

[17]  Paul Dourish,et al.  Portholes: supporting awareness in a distributed work group , 1992, CHI.

[18]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[19]  Lars Erik Holmquist,et al.  WebStickers: using physical objects as WWW bookmarks , 1999, CHI EA '99.

[20]  William W. Gaver,et al.  Feather, Scent, and Shaker: Supporting Simple Intimacy , 1996 .

[21]  Jun Rekimoto,et al.  DataTiles: a modular platform for mixed physical and graphical interactions , 2001, CHI.

[22]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[23]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[24]  Shoshana Zuboff,et al.  In the Age of the Smart Machine: The Future of Work and Power , 1989 .

[25]  Hiroshi Ishii,et al.  Illuminating light: an optical design tool with a luminous-tangible interface , 1998, CHI.

[26]  Hubert L. Dreyfus,et al.  Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer , 1987, IEEE Expert.

[27]  Thomas Binder Setting the stage for improvised video scenarios , 1999, CHI EA '99.

[28]  Jonathan Grudin,et al.  Integration of Inter-Personal Space and Shared Workspace: ClearBoard Design and Experiments , 1992, CSCW.

[29]  Jacob Buur,et al.  Taking Video beyond 'Hard Data' in User Centred Design , 2000 .

[30]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[31]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[32]  Maribeth Back,et al.  Page detection using embedded tags , 2000, UIST '00.

[33]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[34]  Mark A. Jones,et al.  Insight lab: an immersive team environment linking paper, displays, and data , 1998, CHI.

[35]  Wendy E. Mackay,et al.  Augmenting reality: adding computational dimensions to paper , 1993, CACM.

[36]  Hiroshi Ishii,et al.  Transparent layered user interfaces: an evaluation of a display design to enhance focused and divided attention , 1995, CHI '95.

[37]  Andy Hopper,et al.  Active badges and personal interactive computing objects , 1992 .

[38]  Wendy E. Mackay,et al.  Computer-Augmented Environments: Back to the Real World - Introduction to the Special Issue. , 1993 .

[39]  Lisanne Bainbridge,et al.  The Process Controller , 1978 .

[40]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[41]  Sara A. Bly,et al.  Media spaces: bringing people together in a video, audio, and computing environment , 1993, CACM.

[42]  Gaetano Borriello,et al.  Survey on information appliances , 2000 .

[43]  Owen Daly-Jones,et al.  Informal workplace communication: what is it like and how might we support it? , 1994, CHI '94.

[44]  Paul Nemirovsky,et al.  GuideShoes: navigation based on musical patterns , 1999, CHI EA '99.

[45]  Peter Gullers Automation and skill , 1990 .

[46]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[47]  Brad Hartfield,et al.  Computer systems and the design of organizational interaction , 1988, TOIS.

[48]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[49]  Donald A. Norman,et al.  The invisible computer , 1998 .

[50]  Andrew E. Johnson,et al.  Supporting transcontinental collaborative work in persistent virtual environments , 1996, IEEE Computer Graphics and Applications.

[51]  Ronald E. Rice,et al.  Evaluating video as a technology for informal communication , 1992, CHI.

[52]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[53]  Elin Rønby Pedersen Calls.calm: enabling caller and callee to collaborate , 2001, CHI Extended Abstracts.

[54]  Paul P. Maglio,et al.  Informative things: how to attach information to the real world , 1998, UIST '98.

[55]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[56]  Terry Winograd,et al.  Visual instruments for an interactive mural , 1999, CHI Extended Abstracts.

[57]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[58]  Wendy E. Mackay,et al.  Video mosaic: laying out time in a physical space , 1994, MULTIMEDIA '94.

[59]  Hubert L. Dreyfus,et al.  What computers still can't do - a critique of artificial reason , 1992 .

[60]  C. Goodwin Conversational Organization: Interaction Between Speakers and Hearers , 1981 .

[61]  Carl Gutwin,et al.  Using Disortion-Oriented Displays to Support Workspace Awareness , 1996, BCS HCI.

[62]  Lia Adams,et al.  Palette: a paper interface for giving presentations , 1999, CHI '99.

[63]  William W. Gaver The affordances of media spaces for collaboration , 1992, CSCW '92.

[64]  Marilyn Tremaine,et al.  Experiences in the use of a media space , 1991, CHI.

[65]  John C. Tang,et al.  Videodraw: a video interface for collaborative drawing , 1991, TOIS.

[66]  Tomas Sokoler,et al.  VideoTable: a tangible interface for collaborative exploration of video material during design sessions , 2002, CHI Extended Abstracts.