AR Guide System Using Mobile Projector in Indoor Environment

Many wearable augmented reality (AR) systems which overlay location-based information in the real world have been proposed in recent years. As one of the wearable AR applications, AR tour guide systems have been developed. In such systems, A Head-Mounted Display (HMD), a handheld display such as a PDA, or a projector has been used. The HMD and handheld display can provide each user with individual guide information. On the other hand, the projector can make it possible to share the guide information among multiple users. During visual tour guide, it is desirable for all the tourists in a group to share the guide information. This thesis proposes a projection-based AR guide system which guides users using a handheld projector in indoor environments. The projectionbased AR guide system projects guidance of exhibits onto walls or floors in the real world. In order to realize this system, it is necessary to measure a position and an orientation of the projector precisely in a wide area. In the proposed guide system, the projector’s position is estimated from images capturing invisible markers which are set up on ceilings with an infrared camera attached to the projector. In addition, to indicate the guide information intuitively for users, the proposed system displays information at three dimensional position using two projectors and polarized glasses. ∗ Master’s Thesis, Department of Information Systems, Graduate School of Information Science, Nara Institute of Science and Technology, NAIST-IS-MT0651076, February 5, 2009.

[1]  Naokazu Yokoya,et al.  Annotating user-viewed objects for wearable AR systems , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[2]  Katsuhiko Sakaue,et al.  A panorama-based method of personal positioning and orientation and its real-time applications for wearable computers , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[3]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[4]  R. Malaka,et al.  DEEP MAP: Challenging IT Research In The Framework Of A Tourist Information System , 2000 .

[5]  Henry Fuchs,et al.  Augmented Reality Guidance for Needle Biopsies: A Randomized, Controlled Trial in Phantoms , 2001, MICCAI.

[6]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[7]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[8]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[9]  Naokazu Yokoya,et al.  Localization system for large indoor environments using invisible markers , 2008, VRST '08.

[10]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[11]  Dieter Schmalstieg,et al.  Structured visual markers for indoor pathfinding , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[12]  Masayuki Takemura,et al.  Diminishing head-mounted display for shared mixed reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[13]  Naokazu Yokoya,et al.  Nara Palace Site Navigator: Device-Independent Human Navigation Using a Networked Shared Database , 2004 .

[14]  Keith Cheverst,et al.  Developing a context-aware electronic tourist guide: some issues and experiences , 2000, CHI.

[15]  Marcus Specht,et al.  Adaptive mobile museum guide for information and learning on demand , 1999, HCI.

[16]  Tomokazu Nakayama,et al.  The illusionhole with polarization filters , 2006, VRST '06.

[17]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[18]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[19]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[20]  Mark Billinghurst,et al.  Face to face collaborative AR on mobile phones , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[21]  Hideyuki Tamura,et al.  MR Platform: a basic body on which mixed reality applications are built , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[22]  Steve Mann,et al.  Wearable Computing: A First Step Toward Personal Imaging , 1997, Computer.

[23]  Gregory D. Abowd,et al.  Rapid prototyping of mobile context-aware applications: the Cyberguide case study , 1996, MobiCom '96.

[24]  Makoto Sato,et al.  Immersive multi-projector display on hybrid screens with human-scale haptic and locomotion interfaces , 2004, 2004 International Conference on Cyberworlds.