Handheld augmented reality indoor navigation with activity-based instructions

We present a novel design of an augmented reality interface to support indoor navigation. We combine activity-based instructions with sparse 3D localisation at selected info points in the building. Based on localisation accuracy and the users' activities, such as walking or standing still, the interface adapts the visualisation by changing the density and quality of information shown. We refine and validate our design through user involvement in pilot studies. We finally present the results of a comparative study conducted to validate the effectiveness of our design and to explore how the presence of info points affects users' performance on indoor navigation tasks. The results of this study validate our design and show an improvement in task performance when info points are present, which act as confirmation points and provide an overview of the task.

[1]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[2]  Johannes Schöning,et al.  PINwI: pedestrian indoor navigation without infrastructure , 2010, NordiCHI.

[3]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Andrew J. May,et al.  Pedestrian navigation aids: information requirements and design implications , 2003, Personal and Ubiquitous Computing.

[5]  Galen C. Hunt,et al.  User experiences with activity-based navigation on mobile devices , 2010, Mobile HCI.

[6]  Neal Lesh,et al.  Indoor navigation using a diverse set of cheap, wearable sensors , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[7]  Christian Kray,et al.  Presenting route instructions on mobile devices , 2003, IUI '03.

[8]  Dieter Schmalstieg,et al.  Location based Applications for Mobile Augmented Reality , 2003, AUIC.

[9]  F. Seco,et al.  A comparison of Pedestrian Dead-Reckoning algorithms using a low-cost MEMS IMU , 2009, 2009 IEEE International Symposium on Intelligent Signal Processing.

[10]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[11]  Steven K. Feiner,et al.  Steps Toward Accommodating Variable Position Tracking Accuracy in a Mobile Augmented Reality System , 2001 .

[12]  Dieter Schmalstieg,et al.  Indoor Positioning and Navigation with Camera Phones , 2009, IEEE Pervasive Computing.

[13]  Luca Chittaro,et al.  Presenting evacuation instructions on mobile devices by means of location-aware 3D virtual environments , 2008, Mobile HCI.

[14]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Andy Hopper,et al.  Implementing a Sentient Computing System , 2001, Computer.

[16]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[17]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[18]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[19]  Antonio Krüger,et al.  The Effects of Mobile Pedestrian Navigation Systems on the Concurrent Acquisition of Route and Survey Knowledge , 2004, Mobile HCI.

[20]  Roberto Bisiani,et al.  Indoor Navigation with Minimal Infrastructure , 2007, 2007 4th Workshop on Positioning, Navigation and Communication.

[21]  Takeshi Kurata,et al.  Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[22]  Andreas Butz,et al.  A hybrid indoor navigation system , 2001, IUI '01.

[23]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[24]  Bill N. Schilit,et al.  Place Lab: Device Positioning Using Radio Beacons in the Wild , 2005, Pervasive.

[25]  Johannes Schöning,et al.  Mobile Map Interaction - Evaluation in an indoor scenario , 2006, GI Jahrestagung.