Using Mobile Code to Create Ubiquitous Augmented Reality

Augmented reality systems supplement reality by adding virtual objects into a real-world view. In this article, we describe a flexible mobile code approach for implementing ubiquitous, active, and mobile augmented reality systems. We will concentrate primarily on solving the problem of how to acquire the data for the virtual objects in a way that will be flexible and expandable enough to be used in ubiquitous computing. To clarify the concepts and to illustrate our current research status, we will present an example system that provides virtual user interfaces for various real-world objects. We also hope that these interfaces provide useful insights to the possibilities that our approach can provide. This article suggests that the mobile code approach offers a relatively simple solution that is flexible, scales well, and does not require the computing equipment attached to the real-world objects to be excessively complicated. We can use the same approach in applications that provide only simple descriptions of the real-world objects and in complex applications that allow the user to manipulate real-world objects via virtual user interfaces that exist only in augmented reality. Our approach also supports active augmented reality, in which the virtual objects can react to the real-world events.

[1]  Martin Rutishauser,et al.  GLASS: Remote Monitoring of Embedded Systems in Power Engineering , 1998, IEEE Internet Comput..

[2]  Mostafa Ammar,et al.  Implementing communication protocols in Java , 1998 .

[3]  Juha Röning,et al.  Using Mobile Code Interfaces to Control Ubiquitous Embedded Systems , 1999, USENIX Workshop on Embedded Systems.

[4]  Mark Weiser The computer for the 21st century , 1991 .

[5]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[6]  Marvin Theimer,et al.  Providing location information in a ubiquitous computing environment (panel session) , 1994, SOSP '93.

[7]  Steve Mann,et al.  Wearable Computing: A First Step Toward Personal Imaging , 1997, Computer.

[8]  David M. Chess,et al.  Security Issues in Mobile Code Systems , 1998, Mobile Agents and Security.

[9]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[10]  Gerd Kortuem,et al.  Context-aware, adaptive wearable computers as remote interfaces to 'intelligent' environments , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[11]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[12]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[13]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[14]  Randy H. Katz,et al.  Composable ad-hoc mobile services for universal interaction , 1997, MobiCom '97.

[15]  Mike Spreitzer,et al.  Providing Location Information in a Ubiquitous Computing Environment , 1994, Mobidata.

[16]  Giovanni Vigna,et al.  Understanding Code Mobility , 1998, IEEE Trans. Software Eng..

[17]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[18]  Jouni Similä,et al.  CyPhone - Mobile Multimodal Personal Augmented Reality , 1998, WWCA.

[19]  Mark Billinghurst,et al.  Wearable computers for three dimensional CSCW , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[20]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[21]  Ian Douglas Agranat Engineering Web Technologies for Embedded Applications , 1998, IEEE Internet Comput..

[22]  Asim Smailagic,et al.  Metronaut: a wearable computer with sensing and global communication capabilities , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[23]  Mark Billinghurst,et al.  A wearable spatial conferencing space , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[24]  Mary C. Whitton,et al.  Technologies for augmented reality systems: realizing ultrasound-guided needle biopsies , 1996, SIGGRAPH.

[25]  Mahmoud Naghshineh,et al.  Bluetooth: vision, goals, and architecture , 1998, MOCO.

[26]  Jun Rekimoto,et al.  NaviCam:A Magnifying Glass Approach to Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[28]  Hideyuki Tamura,et al.  AR/sup 2/Hockey: a case study of collaborative augmented reality , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[29]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[30]  Gerd Kortuem,et al.  Software organization for dynamic and adaptable wearable systems , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[31]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[32]  Kishor S. Trivedi,et al.  Increasing Application Accessibility through Java , 1998, IEEE Internet Comput..

[33]  Noa M. Rensing,et al.  Eyeglass-based systems for wearable computing , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[34]  Hideyuki Tamura,et al.  AR2 Hockey , 1998, SIGGRAPH '98.