SeeNav: Seamless and Energy-Efficient Indoor Navigation using Augmented Reality

Augmented Reality (AR) based navigation has emerged as an impressive, yet seamless way of guiding users in unknown environments. Its quality of experience depends on many factors, including the accuracy of camera pose estimation, response delay, and energy consumption. In this paper, we present SeeNav - a seamless and energy-efficient AR navigation system for indoor environments. SeeNav combines image-based localization and inertial tracking to provide an accurate and robust camera pose estimation. As vision processing is much more compute intensive than the processing of inertial sensor data, SeeNav offloads the former one from resource-constrained mobile devices to a cloud to improve tracking performance and reduce power consumption. More than that, SeeNav implements a context-aware task scheduling algorithm that further minimizes energy consumption while maintaining the accuracy of camera pose estimation. Our experimental results, including a user study, show that SeeNav provides seamless navigation experience and reduces the overall energy consumption by 21.56% with context-aware task scheduling.

[1]  Dieter Schmalstieg,et al.  Global Localization from Monocular SLAM on a Mobile Phone , 2014, IEEE Transactions on Visualization and Computer Graphics.

[2]  Y. Oshman,et al.  Averaging Quaternions , 2007 .

[3]  Jan-Michael Frahm,et al.  Reconstructing the world* in six days , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Xuewen Liao,et al.  A segment-based fusion algorithm of WiFi fingerprinting and pedestrian dead reckoning , 2016, 2016 IEEE/CIC International Conference on Communications in China (ICCC).

[5]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[6]  Dieter Schmalstieg,et al.  Handheld augmented reality indoor navigation with activity-based instructions , 2011, Mobile HCI.

[7]  Jeremy R. Cooperstock,et al.  Smartphone Sensor Reliability for Augmented Reality Applications , 2012, MobiQuitous.

[8]  Luming Zhang,et al.  Fusion of Magnetic and Visual Sensors for Indoor Localization: Infrastructure-Free and More Effective , 2017, IEEE Transactions on Multimedia.

[9]  John L. Crassidis,et al.  Survey of nonlinear attitude estimation methods , 2007 .

[10]  Jari Syrjärinne,et al.  Mass-market requirements for indoor positioning and indoor navigation , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[11]  Markus König,et al.  Natural markers for augmented reality-based indoor navigation and facility maintenance , 2014 .

[12]  Jan-Michael Frahm,et al.  Reconstructing the World* in Six Days *(As Captured by the Yahoo 100 Million Image Dataset) , 2015, CVPR 2015.

[13]  C. Martin 2015 , 2015, Les 25 ans de l’OMC: Une rétrospective en photos.

[14]  Guowei Shi,et al.  Survey of Indoor Positioning Systems Based on Ultra-wideband (UWB) Technology , 2016 .

[15]  Han Zou,et al.  Exploiting cyclic features of walking for pedestrian dead reckoning with unconstrained smartphones , 2016, UbiComp.

[16]  Hannes Kaufmann,et al.  HyMoTrack: A Mobile AR Navigation System for Complex Indoor Environments , 2015, Sensors.

[17]  Xiaolin Li,et al.  Enabling Context-Aware Indoor Augmented Reality via Smartphone Sensing and Vision Tracking , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[18]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.

[19]  Jiung-yao Huang,et al.  A fast image matching technique for the panoramic-based localization , 2016, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS).

[20]  Dieter Schmalstieg,et al.  Challenges of Large-Scale Augmented Reality on Smartphones , 2011 .

[21]  Mahbub Hassan,et al.  A collaborative approach to heading estimation for smartphone-based PDR indoor localisation , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[22]  Frederik Petré,et al.  Sensor fusion for indoor navigation and tracking of automated guided vehicles , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[23]  Eduardo Ros,et al.  Real-Time Pose Detection and Tracking of Hundreds of Objects , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  A. Olteanu,et al.  A marker-based augmented reality system for mobile devices , 2013, 2013 11th RoEduNet International Conference.