Experimental evaluation of user interfaces for visual indoor navigation

Mobile location recognition by capturing images of the environment (visual localization) is a promising technique for indoor navigation in arbitrary surroundings. However, it has barely been investigated so far how the user interface (UI) can cope with the challenges of the vision-based localization technique, such as varying quality of the query images. We implemented a novel UI for visual localization, consisting of Virtual Reality (VR) and Augmented Reality (AR) views that actively communicate and ensure localization accuracy. If necessary, the system encourages the user to point the smartphone at distinctive regions to improve localization quality. We evaluated the UI in a experimental navigation task with a prototype, informed by initial evaluation results using design mockups. We found that VR can contribute to efficient and effective indoor navigation even at unreliable location and orientation accuracy. We discuss identified challenges and share lessons learned as recommendations for future work.

[1]  Dieter Schmalstieg,et al.  360° panoramic overviews for location-based services , 2012, CHI.

[2]  Toshiyuki Kamiya,et al.  Pedestrian navigation system for mobile phones using panoramic landscape images , 2006, International Symposium on Applications and the Internet (SAINT'06).

[3]  Dieter Schmalstieg,et al.  Indoor Positioning and Navigation with Camera Phones , 2009, IEEE Pervasive Computing.

[4]  Andrew G. Dempster,et al.  Indoor Positioning Techniques Based on Wireless LAN , 2007 .

[5]  Andreas Möller,et al.  Tool Support for Prototyping Interfaces for Vision-Based Indoor Navigation , 2012 .

[6]  Henry A. Kautz,et al.  Indoor wayfinding:: developing a functional interface for individuals with cognitive impairments , 2006, Assets '06.

[7]  Ashweeni Kumar Beeharee,et al.  A natural wayfinding exploiting photos in pedestrian navigation systems , 2006, Mobile HCI.

[8]  Rainer Malaka,et al.  Evaluation of an Augmented Photograph-Based Pedestrian Navigation System , 2008, Smart Graphics.

[9]  Gaetano Borriello,et al.  Positioning and Orientation in Indoor Environments Using Camera Phones , 2008, IEEE Computer Graphics and Applications.

[10]  Anas Al-Nuaimi,et al.  Mobile Visual Location Recognition , 2013 .

[11]  Andreas Möller,et al.  A mobile indoor navigation system interface adapted to vision-based localization , 2012, MUM.

[12]  Gerd Kortuem,et al.  Interactive Positioning Based on Object Visibility , 2004, Mobile HCI.

[13]  Christian Kray,et al.  Presenting route instructions on mobile devices , 2003, IUI '03.

[14]  Andreas Butz,et al.  A hybrid indoor navigation system , 2001, IUI '01.

[15]  Gaetano Borriello,et al.  Landmark-based pedestrian navigation from collections of geotagged photos , 2008, MUM '08.

[16]  Haiyun Luo,et al.  Zero-Configuration, Robust Indoor Localization: Theory and Experimentation , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[17]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[18]  Alois Ferscha,et al.  Augmented reality navigation systems , 2006, Universal Access in the Information Society.

[19]  J. F. Kelley,et al.  An empirical methodology for writing user-friendly natural language computer applications , 1983, CHI '83.

[20]  Volker Scholz,et al.  An Augmented Reality museum guide , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.