The world through the computer: computer augmented interaction with real world environments

Current user interface techniques such as WIMP or the desktop metaphor do not support real world tasks, because the focus of these user interfaces is only on human–computer interactions, not on human–real world interactions. In this paper, we propose a method of building computer augmented environments using a situation-aware portable device. This device, calledNaviCam, has the ability to recognize the user’s situation by detecting color-code IDs in real world environments. It displays situation sensitive information by superimposing messages on its video see-through screen. Combination of ID-awareness and portable video-see-through display solves several problems with current ubiquitous computers systems and augmented reality systems.

[1]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[2]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[3]  Ulrich Neumann,et al.  Dynamic registration correction in augmented-reality systems , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[4]  Wendy E. Mackay,et al.  Back to the real world , 1993, CACM.

[5]  Steven K. Feiner,et al.  Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers , 1991, UIST '91.

[6]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[7]  Blair MacIntyre,et al.  Annotating the real world with knowledge-based graphics on a see-through head-mounted display , 1992 .

[8]  Katashi Nagao,et al.  Ubiquitous Talker: Spoken Language Interaction with Real World Objects , 1995, IJCAI.

[9]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[10]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[11]  Hiroshi Ishii,et al.  TeamWorkStation: towards a seamless shared workspace , 1990, CSCW '90.

[12]  Ken Sakamura.  The Objectives of the TRON Project , 1987 .

[13]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[14]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[15]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[16]  Wendy E. Mackay,et al.  Computer-Augmented Environments: Back to the Real World - Introduction to the Special Issue. , 1993 .

[17]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[18]  Wayne D. Gray.  Proceedings of the 1993 International Workshop on Intelligent User Interfaces, January 4-7, 1993, Orlando, Florida , 1993 .